Jul 09 03:54:14.084586 ip-10-0-134-121 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 09 03:54:14.084595 ip-10-0-134-121 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 09 03:54:14.084601 ip-10-0-134-121 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 09 03:54:14.084823 ip-10-0-134-121 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 09 03:54:24.178724 ip-10-0-134-121 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 09 03:54:24.178739 ip-10-0-134-121 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot b621e170455e45efb942dff6674d553f --
Jul 09 03:56:13.428140 ip-10-0-134-121 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 03:56:13.896333 ip-10-0-134-121 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 03:56:13.896333 ip-10-0-134-121 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 03:56:13.896333 ip-10-0-134-121 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 03:56:13.896333 ip-10-0-134-121 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 03:56:13.896333 ip-10-0-134-121 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 03:56:13.896333 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.894174    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 03:56:13.899784 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899389    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 03:56:13.899784 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899404    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 03:56:13.899784 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899409    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 03:56:13.899784 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899414    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 03:56:13.899784 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899419    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 03:56:13.899784 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899424    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 03:56:13.899784 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899428    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 03:56:13.899784 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899432    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 03:56:13.899784 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899436    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 03:56:13.899784 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899440    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 03:56:13.899784 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899444    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 03:56:13.899784 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899448    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 03:56:13.899784 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899452    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 03:56:13.899784 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899458    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 03:56:13.899784 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899472    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 03:56:13.899784 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899477    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 03:56:13.899784 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899480    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 03:56:13.899784 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899484    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 03:56:13.899784 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899488    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 03:56:13.899784 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899492    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 03:56:13.900435 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899496    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 03:56:13.900435 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899500    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 03:56:13.900435 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899503    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 03:56:13.900435 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899507    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 03:56:13.900435 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899511    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 03:56:13.900435 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899515    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 03:56:13.900435 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899519    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 03:56:13.900435 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899523    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 03:56:13.900435 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899526    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 03:56:13.900435 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899531    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 03:56:13.900435 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899534    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 03:56:13.900435 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899539    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 03:56:13.900435 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899542    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 03:56:13.900435 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899547    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 03:56:13.900435 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899550    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 03:56:13.900435 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899554    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 03:56:13.900435 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899558    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 03:56:13.900435 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899561    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 03:56:13.900435 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899565    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 03:56:13.900435 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899569    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 03:56:13.901092 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899573    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 03:56:13.901092 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899577    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 03:56:13.901092 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899580    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 03:56:13.901092 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899584    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 03:56:13.901092 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899588    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 03:56:13.901092 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899591    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 03:56:13.901092 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899596    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 03:56:13.901092 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899600    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 03:56:13.901092 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899604    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 03:56:13.901092 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899609    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 03:56:13.901092 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899613    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 03:56:13.901092 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899616    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 03:56:13.901092 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899620    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 03:56:13.901092 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899624    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 03:56:13.901092 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899628    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 03:56:13.901092 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899632    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 03:56:13.901092 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899636    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 03:56:13.901092 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899640    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 03:56:13.901092 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899643    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 03:56:13.987817 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899647    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 03:56:13.987817 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899651    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 03:56:13.987817 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899655    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 03:56:13.987817 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899658    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 03:56:13.987817 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899662    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 03:56:13.987817 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899666    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 03:56:13.987817 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899669    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 03:56:13.987817 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899673    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 03:56:13.987817 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899676    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 03:56:13.987817 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899680    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 03:56:13.987817 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899684    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 03:56:13.987817 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899688    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 03:56:13.987817 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899691    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 03:56:13.987817 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899696    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 03:56:13.987817 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899701    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 03:56:13.987817 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899705    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 03:56:13.987817 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899709    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 03:56:13.987817 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899713    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 03:56:13.987817 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899716    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 03:56:13.987817 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899720    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 03:56:13.976651 ip-10-0-134-121 systemd[1]: Started Kubernetes Kubelet.
Jul 09 03:56:13.991616 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899724    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 03:56:13.991616 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899728    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 03:56:13.991616 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899732    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 03:56:13.991616 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899736    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 03:56:13.991616 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899740    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 03:56:13.991616 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899744    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 03:56:13.991616 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899750    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 03:56:13.991616 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899754    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 03:56:13.991616 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899760    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 03:56:13.991616 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899764    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 03:56:13.991616 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899768    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 03:56:13.991616 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899774    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 03:56:13.991616 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899779    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 03:56:13.991616 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899783    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 03:56:13.991616 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899788    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 03:56:13.991616 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899793    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 03:56:13.991616 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899797    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 03:56:13.991616 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899801    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 03:56:13.991616 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899805    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 03:56:13.992705 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.899810    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 03:56:13.992705 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900769    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 03:56:13.992705 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900777    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 03:56:13.992705 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900782    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 03:56:13.992705 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900787    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 03:56:13.992705 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900791    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 03:56:13.992705 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900796    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 03:56:13.992705 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900801    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 03:56:13.992705 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900805    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 03:56:13.992705 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900810    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 03:56:13.992705 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900814    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 03:56:13.992705 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900818    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 03:56:13.992705 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900822    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 03:56:13.992705 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900826    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 03:56:13.992705 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900831    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 03:56:13.992705 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900836    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 03:56:13.992705 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900840    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 03:56:13.992705 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900844    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 03:56:13.992705 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900848    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 03:56:14.000420 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900851    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 03:56:14.000420 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900856    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 03:56:14.000420 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900859    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 03:56:14.000420 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900864    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 03:56:14.000420 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900868    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 03:56:14.000420 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900872    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 03:56:14.000420 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900876    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 03:56:14.000420 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900880    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 03:56:14.000420 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900898    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 03:56:14.000420 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900902    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 03:56:14.000420 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900906    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 03:56:14.000420 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900910    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 03:56:14.000420 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900914    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 03:56:14.000420 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900917    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 03:56:14.000420 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900921    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 03:56:14.000420 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900926    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 03:56:14.000420 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900930    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 03:56:14.000420 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900934    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 03:56:14.000420 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900939    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 03:56:14.000420 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900942    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 03:56:14.001447 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900946    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 03:56:14.001447 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900951    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 03:56:14.001447 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900955    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 03:56:14.001447 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900959    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 03:56:14.001447 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900963    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 03:56:14.001447 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900967    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 03:56:14.001447 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900971    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 03:56:14.001447 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900974    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 03:56:14.001447 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900978    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 03:56:14.001447 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900982    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 03:56:14.001447 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900986    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 03:56:14.001447 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900989    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 03:56:14.001447 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900993    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 03:56:14.001447 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.900997    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 03:56:14.001447 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901000    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 03:56:14.001447 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901004    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 03:56:14.001447 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901008    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 03:56:14.001447 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901013    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 03:56:14.001447 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901016    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 03:56:14.001447 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901022    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 03:56:14.002276 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901027    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 03:56:14.002276 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901033    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 03:56:14.002276 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901037    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 03:56:14.002276 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901041    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 03:56:14.002276 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901045    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 03:56:14.002276 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901048    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 03:56:14.002276 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901052    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 03:56:14.002276 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901059    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 03:56:14.002276 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901064    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 03:56:14.002276 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901068    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 03:56:14.002276 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901079    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 03:56:14.002276 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901083    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 03:56:14.002276 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901087    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 03:56:14.002276 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901091    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 03:56:14.002276 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901095    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 03:56:14.002276 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901100    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 03:56:14.002276 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901104    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 03:56:14.002276 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901108    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 03:56:14.002276 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901112    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 03:56:14.002276 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901116    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 03:56:14.002911 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901119    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 03:56:14.002911 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901123    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 03:56:14.002911 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901127    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 03:56:14.002911 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901130    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 03:56:14.002911 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901134    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 03:56:14.002911 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901138    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 03:56:14.002911 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901142    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 03:56:14.002911 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901146    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 03:56:14.002911 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901150    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 03:56:14.002911 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901153    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 03:56:14.002911 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901158    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 03:56:14.002911 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901162    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 03:56:14.002911 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901165    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 03:56:14.002911 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901169    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 03:56:14.002911 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901172    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 03:56:14.002911 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901176    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 03:56:14.002911 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901179    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 03:56:14.002911 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901183    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 03:56:14.002911 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901187    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 03:56:14.002911 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901190    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 03:56:14.003438 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901194    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 03:56:14.003438 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901697    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 03:56:14.003438 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901702    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 03:56:14.003438 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901707    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 03:56:14.003438 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901711    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 03:56:14.003438 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901715    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 03:56:14.003438 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901719    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 03:56:14.003438 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901723    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 03:56:14.003438 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901727    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 03:56:14.003438 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901731    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 03:56:14.003438 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901735    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 03:56:14.003438 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901739    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 03:56:14.003438 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901743    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 03:56:14.003438 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901746    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 03:56:14.003438 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901750    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 03:56:14.003438 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901753    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 03:56:14.003438 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901757    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 03:56:14.003438 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901760    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 03:56:14.003438 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901764    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 03:56:14.003438 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901767    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 03:56:14.004020 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901771    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 03:56:14.004020 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901774    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 03:56:14.004020 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901778    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 03:56:14.004020 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901782    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 03:56:14.004020 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901785    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 03:56:14.004020 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901789    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 03:56:14.004020 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901792    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 03:56:14.004020 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901796    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 03:56:14.004020 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901800    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 03:56:14.004020 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901803    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 03:56:14.004020 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901806    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 03:56:14.004020 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901810    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 03:56:14.004020 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901814    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 03:56:14.004020 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901817    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 03:56:14.004020 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901821    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 03:56:14.004020 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901824    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 03:56:14.004020 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901832    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 03:56:14.004020 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901835    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 03:56:14.004020 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901839    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 03:56:14.004020 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901843    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 03:56:14.004547 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901847    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 03:56:14.004547 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901851    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 03:56:14.004547 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901855    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 03:56:14.004547 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901859    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 03:56:14.004547 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901863    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 03:56:14.004547 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901867    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 03:56:14.004547 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901870    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 03:56:14.004547 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901874    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 03:56:14.004547 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901877    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 03:56:14.004547 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901881    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 03:56:14.004547 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901900    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 03:56:14.004547 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901905    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 03:56:14.004547 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901912    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 03:56:14.004547 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901917    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 03:56:14.004547 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901922    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 03:56:14.004547 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901928    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 03:56:14.004547 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901933    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 03:56:14.004547 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901937    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 03:56:14.005095 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901941    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 03:56:14.005095 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901946    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 03:56:14.005095 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901950    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 03:56:14.005095 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901954    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 03:56:14.005095 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901958    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 03:56:14.005095 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901963    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 03:56:14.005095 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901967    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 03:56:14.005095 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901971    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 03:56:14.005095 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901974    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 03:56:14.005095 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901978    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 03:56:14.005095 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901984    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 03:56:14.005095 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901987    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 03:56:14.005095 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901991    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 03:56:14.005095 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901995    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 03:56:14.005095 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.901998    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 03:56:14.005095 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.902003    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 03:56:14.005095 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.902007    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 03:56:14.005095 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.902011    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 03:56:14.005095 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.902015    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 03:56:14.005596 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.902019    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 03:56:14.005596 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.902022    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 03:56:14.005596 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.902026    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 03:56:14.005596 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.902029    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 03:56:14.005596 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.902032    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 03:56:14.005596 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.902036    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 03:56:14.005596 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.902039    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 03:56:14.005596 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.902043    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 03:56:14.005596 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.902046    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 03:56:14.005596 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.902050    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 03:56:14.005596 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.902053    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 03:56:14.005596 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.902057    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 03:56:14.005596 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.902061    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 03:56:14.005596 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.902065    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 03:56:14.005596 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.902068    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 03:56:14.005596 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.902072    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 03:56:14.005596 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.902075    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 03:56:14.005596 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.902079    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 03:56:14.005596 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.902082    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 03:56:14.005596 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.902086    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 03:56:14.006195 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.902089    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 03:56:14.006195 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.902093    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 03:56:14.006195 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.902097    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 03:56:14.006195 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902186    2582 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 03:56:14.006195 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902206    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 03:56:14.006195 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902214    2582 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 03:56:14.006195 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902221    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 03:56:14.006195 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902226    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 03:56:14.006195 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902231    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 03:56:14.006195 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902240    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 03:56:14.006195 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902247    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 03:56:14.006195 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902252    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 03:56:14.006195 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902256    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 03:56:14.006195 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902261    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 03:56:14.006195 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902266    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 03:56:14.006195 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902270    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 03:56:14.006195 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902275    2582 flags.go:64] FLAG: --cgroup-root=""
Jul 09 03:56:14.006195 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902279    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 03:56:14.006195 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902283    2582 flags.go:64] FLAG: --client-ca-file=""
Jul 09 03:56:14.006195 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902287    2582 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 03:56:14.006195 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902291    2582 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 03:56:14.006195 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902296    2582 flags.go:64] FLAG: --cluster-domain=""
Jul 09 03:56:14.006195 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902300    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 03:56:14.006195 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902305    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 03:56:14.006785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902309    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 03:56:14.006785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902314    2582 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 03:56:14.006785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902319    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 03:56:14.006785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902324    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 03:56:14.006785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902328    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 03:56:14.006785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902333    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 03:56:14.006785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902337    2582 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 03:56:14.006785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902342    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 03:56:14.006785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902346    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 03:56:14.006785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902350    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 03:56:14.006785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902354    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 03:56:14.006785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902362    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 03:56:14.006785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902366    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 03:56:14.006785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902370    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 03:56:14.006785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902374    2582 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 03:56:14.006785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902378    2582 flags.go:64] FLAG: --enable-server="true"
Jul 09 03:56:14.006785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902382    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 03:56:14.006785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902388    2582 flags.go:64] FLAG: --event-burst="100"
Jul 09 03:56:14.006785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902398    2582 flags.go:64] FLAG: --event-qps="50"
Jul 09 03:56:14.006785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902402    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 03:56:14.006785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902407    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 03:56:14.006785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902411    2582 flags.go:64] FLAG: --eviction-hard=""
Jul 09 03:56:14.006785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902416    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 03:56:14.006785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902420    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 03:56:14.095869 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902424    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 03:56:14.095869 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902429    2582 flags.go:64] FLAG: --eviction-soft=""
Jul 09 03:56:14.095869 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902433    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 03:56:14.095869 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902437    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 03:56:14.095869 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902441    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 03:56:14.095869 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902445    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 03:56:14.095869 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902450    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 03:56:14.095869 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902454    2582 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 03:56:14.095869 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902458    2582 flags.go:64] FLAG: --feature-gates=""
Jul 09 03:56:14.095869 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902463    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 03:56:14.095869 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902467    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 03:56:14.095869 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902471    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 03:56:14.095869 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902476    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 03:56:14.095869 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902480    2582 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 03:56:14.095869 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902484    2582 flags.go:64] FLAG: --help="false"
Jul 09 03:56:14.095869 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902488    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-134-121.ec2.internal"
Jul 09 03:56:14.095869 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902492    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 03:56:14.095869 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902496    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 03:56:14.095869 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902500    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 03:56:14.095869 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902507    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 03:56:14.095869 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902512    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 03:56:14.095869 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902517    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 03:56:14.095869 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902521    2582 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 03:56:14.118570 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902525    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 03:56:14.118570 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902529    2582 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 03:56:14.118570 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902533    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 03:56:14.118570 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902539    2582 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 03:56:14.118570 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902543    2582 flags.go:64] FLAG: --kube-reserved=""
Jul 09 03:56:14.118570 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902548    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 03:56:14.118570 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902552    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 03:56:14.118570 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902556    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 03:56:14.118570 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902560    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 03:56:14.118570 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902565    2582 flags.go:64] FLAG: --lock-file=""
Jul 09 03:56:14.118570 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902569    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 03:56:14.118570 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902573    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 03:56:14.118570 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902577    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 03:56:14.118570 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902585    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 03:56:14.118570 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902589    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 03:56:14.118570 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902593    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 03:56:14.118570 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902597    2582 flags.go:64] FLAG: --logging-format="text"
Jul 09 03:56:14.118570 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902601    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 03:56:14.118570 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902606    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 03:56:14.118570 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902610    2582 flags.go:64] FLAG: --manifest-url=""
Jul 09 03:56:14.118570 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902614    2582 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 03:56:14.118570 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902620    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 03:56:14.118570 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902624    2582 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 03:56:14.118570 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902630    2582 flags.go:64] FLAG: --max-pods="110"
Jul 09 03:56:14.118570 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902635    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 03:56:14.119542 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902639    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 03:56:14.119542 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902644    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 03:56:14.119542 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902648    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 03:56:14.119542 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902655    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 03:56:14.119542 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902659    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 03:56:14.119542 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902663    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 03:56:14.119542 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902672    2582 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 03:56:14.119542 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902677    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 03:56:14.119542 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902681    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 03:56:14.119542 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902686    2582 flags.go:64] FLAG: --pod-cidr=""
Jul 09 03:56:14.119542 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902692    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 09 03:56:14.119542 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902699    2582 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 03:56:14.119542 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902703    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 03:56:14.119542 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902708    2582 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 03:56:14.119542 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902712    2582 flags.go:64] FLAG: --port="10250"
Jul 09 03:56:14.119542 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902717    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 03:56:14.119542 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902721    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-083b9bd02d5bd1433"
Jul 09 03:56:14.119542 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902726    2582 flags.go:64] FLAG: --qos-reserved=""
Jul 09 03:56:14.119542 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902731    2582 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 03:56:14.119542 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902735    2582 flags.go:64] FLAG: --register-node="true"
Jul 09 03:56:14.119542 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902739    2582 flags.go:64] FLAG: --register-with-taints=""
Jul 09 03:56:14.119542 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902744    2582 flags.go:64] FLAG: --registry-burst="10"
Jul 09 03:56:14.119542 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902749    2582 flags.go:64] FLAG: --registry-qps="5"
Jul 09 03:56:14.119542 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902753    2582 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 03:56:14.120916 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902756    2582 flags.go:64] FLAG: --reserved-memory=""
Jul 09 03:56:14.120916 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902762    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 03:56:14.120916 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902766    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 03:56:14.120916 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902770    2582 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 03:56:14.120916 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902774    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 03:56:14.120916 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902779    2582 flags.go:64] FLAG: --runonce="false"
Jul 09 03:56:14.120916 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902783    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 03:56:14.120916 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902787    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 03:56:14.120916 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902792    2582 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 03:56:14.120916 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902795    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 03:56:14.120916 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902800    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 03:56:14.120916 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902804    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 03:56:14.120916 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902810    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 03:56:14.120916 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902815    2582 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 03:56:14.120916 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902819    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 03:56:14.120916 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902823    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 03:56:14.120916 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902827    2582 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 03:56:14.120916 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902831    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 03:56:14.120916 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902838    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 03:56:14.120916 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902842    2582 flags.go:64] FLAG: --system-cgroups=""
Jul 09 03:56:14.120916 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902846    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 03:56:14.120916 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902854    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 03:56:14.120916 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902858    2582 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 03:56:14.120916 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902862    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 03:56:14.120916 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902867    2582 flags.go:64] FLAG: --tls-min-version=""
Jul 09 03:56:14.121832 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902871    2582 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 03:56:14.121832 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902875    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 03:56:14.121832 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902899    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 03:56:14.121832 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902905    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 03:56:14.121832 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902909    2582 flags.go:64] FLAG: --v="2"
Jul 09 03:56:14.121832 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902914    2582 flags.go:64] FLAG: --version="false"
Jul 09 03:56:14.121832 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902920    2582 flags.go:64] FLAG: --vmodule=""
Jul 09 03:56:14.121832 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902925    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 03:56:14.121832 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.902929    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 03:56:14.121832 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903540    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 03:56:14.121832 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903564    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 03:56:14.121832 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903568    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 03:56:14.121832 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903571    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 03:56:14.121832 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903574    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 03:56:14.121832 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903578    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 03:56:14.121832 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903580    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 03:56:14.121832 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903583    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 03:56:14.121832 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903586    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 03:56:14.121832 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903589    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 03:56:14.121832 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903592    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 03:56:14.121832 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903595    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 03:56:14.121832 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903603    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 03:56:14.122668 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903616    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 03:56:14.122668 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903619    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 03:56:14.122668 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903623    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 03:56:14.122668 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903626    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 03:56:14.122668 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903629    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 03:56:14.122668 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903632    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 03:56:14.122668 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903635    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 03:56:14.122668 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903638    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 03:56:14.122668 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903643    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 03:56:14.122668 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903646    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 03:56:14.122668 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903649    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 03:56:14.122668 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903655    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 03:56:14.122668 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903658    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 03:56:14.122668 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903660    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 03:56:14.122668 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903663    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 03:56:14.122668 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903666    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 03:56:14.122668 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903669    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 03:56:14.122668 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903671    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 03:56:14.122668 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903674    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 03:56:14.122668 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903677    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 03:56:14.123508 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903701    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 03:56:14.123508 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903704    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 03:56:14.123508 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903707    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 03:56:14.123508 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903714    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 03:56:14.123508 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903717    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 03:56:14.123508 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903721    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 03:56:14.123508 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903723    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 03:56:14.123508 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903726    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 03:56:14.123508 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903729    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 03:56:14.123508 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903732    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 03:56:14.123508 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903735    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 03:56:14.123508 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903738    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 03:56:14.123508 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903740    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 03:56:14.123508 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903743    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 03:56:14.123508 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903746    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 03:56:14.123508 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903749    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 03:56:14.123508 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903754    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 03:56:14.123508 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903757    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 03:56:14.123508 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903760    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 03:56:14.123508 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903763    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 03:56:14.124129 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903767    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 03:56:14.124129 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903770    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 03:56:14.124129 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903773    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 03:56:14.124129 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903775    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 03:56:14.124129 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903778    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 03:56:14.124129 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903781    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 03:56:14.124129 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903784    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 03:56:14.124129 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903786    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 03:56:14.124129 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903792    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 03:56:14.124129 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903797    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 03:56:14.124129 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903800    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 03:56:14.124129 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903805    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 03:56:14.124129 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903807    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 03:56:14.124129 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903850    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 03:56:14.124129 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903853    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 03:56:14.124129 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903858    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 03:56:14.124129 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903861    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 03:56:14.124129 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903866    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 03:56:14.124129 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903870    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 03:56:14.124748 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903875    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 03:56:14.124748 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903878    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 03:56:14.124748 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903899    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 03:56:14.124748 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903904    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 03:56:14.124748 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903907    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 03:56:14.124748 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903910    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 03:56:14.124748 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903915    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 03:56:14.124748 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903918    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 03:56:14.124748 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903922    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 03:56:14.124748 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903925    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 03:56:14.124748 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903928    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 03:56:14.124748 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903934    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 03:56:14.124748 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903938    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 03:56:14.124748 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903943    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 03:56:14.124748 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903949    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 03:56:14.124748 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903953    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 03:56:14.124748 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903956    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 03:56:14.124748 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903961    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 03:56:14.124748 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903964    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 03:56:14.126346 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903966    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 03:56:14.126346 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903969    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 03:56:14.126346 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903972    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 03:56:14.126346 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903975    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 03:56:14.126346 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903977    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 03:56:14.126346 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903980    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 03:56:14.126346 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903983    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 03:56:14.126346 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.903986    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 03:56:14.126346 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.905180    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 03:56:14.126346 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.912849    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 09 03:56:14.126346 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.912865    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 03:56:14.126346 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.913552    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 03:56:14.126346 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.913563    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 03:56:14.126346 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913625    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 03:56:14.126779 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913630    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 03:56:14.126779 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913633    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 03:56:14.126779 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913636    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 03:56:14.126779 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913640    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 03:56:14.126779 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913642    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 03:56:14.126779 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913645    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 03:56:14.126779 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913647    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 03:56:14.126779 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913650    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 03:56:14.126779 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913652    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 03:56:14.126779 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913655    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 03:56:14.126779 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913658    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 03:56:14.126779 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913661    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 03:56:14.126779 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913663    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 03:56:14.126779 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913666    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 03:56:14.126779 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913668    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 03:56:14.126779 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913671    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 03:56:14.126779 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913673    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 03:56:14.126779 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913676    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 03:56:14.126779 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913679    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 03:56:14.246060 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913681    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 03:56:14.246060 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913684    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 03:56:14.246060 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913687    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 03:56:14.246060 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913689    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 03:56:14.246060 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913692    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 03:56:14.246060 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913696    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 03:56:14.246060 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913700    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 03:56:14.246060 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913703    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 03:56:14.246060 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913706    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 03:56:14.246060 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913709    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 03:56:14.246060 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913712    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 03:56:14.246060 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913715    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 03:56:14.246060 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913719    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 03:56:14.246060 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913722    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 03:56:14.246060 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913725    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 03:56:14.246060 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913728    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 03:56:14.246060 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913731    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 03:56:14.246060 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913734    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 03:56:14.246060 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913737    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 03:56:14.246060 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913740    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 03:56:14.246816 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913742    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 03:56:14.246816 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913745    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 03:56:14.246816 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913747    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 03:56:14.246816 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913750    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 03:56:14.246816 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913753    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 03:56:14.246816 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913755    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 03:56:14.246816 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913757    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 03:56:14.246816 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913760    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 03:56:14.246816 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913762    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 03:56:14.246816 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913765    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 03:56:14.246816 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913768    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 03:56:14.246816 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913770    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 03:56:14.246816 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913773    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 03:56:14.246816 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913776    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 03:56:14.246816 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913778    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 03:56:14.246816 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913781    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 03:56:14.246816 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913783    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 03:56:14.246816 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913786    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 03:56:14.246816 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913788    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 03:56:14.246816 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913791    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 03:56:14.247436 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913794    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 03:56:14.247436 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913796    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 03:56:14.247436 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913799    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 03:56:14.247436 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913802    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 03:56:14.247436 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913804    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 03:56:14.247436 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913807    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 03:56:14.247436 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913809    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 03:56:14.247436 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913813    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 03:56:14.247436 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913816    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 03:56:14.247436 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913820    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 03:56:14.247436 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913822    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 03:56:14.247436 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913825    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 03:56:14.247436 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913828    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 03:56:14.247436 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913830    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 03:56:14.247436 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913833    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 03:56:14.247436 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913835    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 03:56:14.247436 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913838    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 03:56:14.247436 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913840    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 03:56:14.247436 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913843    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 03:56:14.247436 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913845    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 03:56:14.248050 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913848    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 03:56:14.248050 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913850    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 03:56:14.248050 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913853    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 03:56:14.248050 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913856    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 03:56:14.248050 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913859    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 03:56:14.248050 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913861    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 03:56:14.248050 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913864    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 03:56:14.248050 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913866    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 03:56:14.248050 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913869    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 03:56:14.248050 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913871    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 03:56:14.248050 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913874    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 03:56:14.248050 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913876    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 03:56:14.248050 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913894    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 03:56:14.248050 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913897    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 03:56:14.248050 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913899    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 03:56:14.248050 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913902    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 03:56:14.248050 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913905    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 03:56:14.248050 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913908    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 03:56:14.248050 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.913910    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 03:56:14.248666 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.913915    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 03:56:14.248666 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914031    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 03:56:14.248666 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914035    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 03:56:14.248666 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914039    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 03:56:14.248666 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914041    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 03:56:14.248666 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914044    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 03:56:14.248666 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914046    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 03:56:14.248666 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914050    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 03:56:14.248666 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914055    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 03:56:14.248666 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914057    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 03:56:14.248666 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914060    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 03:56:14.248666 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914063    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 03:56:14.248666 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914066    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 03:56:14.248666 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914069    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 03:56:14.248666 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914071    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 03:56:14.249288 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914074    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 03:56:14.249288 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914077    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 03:56:14.249288 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914080    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 03:56:14.249288 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914082    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 03:56:14.249288 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914085    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 03:56:14.249288 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914088    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 03:56:14.249288 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914090    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 03:56:14.249288 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914093    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 03:56:14.249288 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914095    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 03:56:14.249288 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914098    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 03:56:14.249288 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914100    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 03:56:14.249288 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914104    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 03:56:14.249288 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914107    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 03:56:14.249288 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914109    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 03:56:14.249288 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914112    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 03:56:14.249288 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914115    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 03:56:14.249288 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914117    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 03:56:14.249288 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914120    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 03:56:14.249288 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914123    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 03:56:14.249288 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914125    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 03:56:14.250138 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914128    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 03:56:14.250138 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914130    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 03:56:14.250138 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914132    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 03:56:14.250138 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914135    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 03:56:14.250138 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914138    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 03:56:14.250138 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914140    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 03:56:14.250138 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914143    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 03:56:14.250138 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914145    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 03:56:14.250138 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914148    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 03:56:14.250138 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914151    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 03:56:14.250138 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914154    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 03:56:14.250138 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914156    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 03:56:14.250138 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914164    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 03:56:14.250138 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914167    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 03:56:14.250138 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914169    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 03:56:14.250138 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914172    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 03:56:14.250138 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914175    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 03:56:14.250138 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914177    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 03:56:14.250138 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914180    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 03:56:14.250138 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914182    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 03:56:14.250951 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914185    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 03:56:14.250951 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914187    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 03:56:14.250951 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914190    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 03:56:14.250951 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914193    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 03:56:14.250951 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914196    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 03:56:14.250951 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914199    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 03:56:14.250951 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914201    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 03:56:14.250951 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914204    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 03:56:14.250951 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914206    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 03:56:14.250951 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914209    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 03:56:14.250951 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914211    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 03:56:14.250951 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914214    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 03:56:14.250951 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914216    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 03:56:14.250951 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914219    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 03:56:14.250951 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914221    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 03:56:14.250951 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914224    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 03:56:14.250951 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914226    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 03:56:14.250951 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914229    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 03:56:14.250951 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914231    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 03:56:14.251469 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914235    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 03:56:14.251469 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914239    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 03:56:14.251469 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914242    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 03:56:14.251469 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914246    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 03:56:14.251469 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914250    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 03:56:14.251469 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914254    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 03:56:14.251469 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914257    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 03:56:14.251469 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914260    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 03:56:14.251469 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914263    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 03:56:14.251469 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914265    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 03:56:14.251469 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914268    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 03:56:14.251469 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914270    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 03:56:14.251469 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914273    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 03:56:14.251469 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914275    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 03:56:14.251469 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914278    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 03:56:14.251469 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914281    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 03:56:14.251469 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914284    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 03:56:14.251469 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914287    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 03:56:14.251469 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914290    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 03:56:14.252031 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914292    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 03:56:14.252031 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914295    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 03:56:14.252031 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914297    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 03:56:14.252031 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914300    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 03:56:14.252031 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914302    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 03:56:14.252031 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914305    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 03:56:14.252031 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:13.914307    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 03:56:14.252031 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.914312    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 03:56:14.252031 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.914443    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 03:56:14.252031 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.916451    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 03:56:14.252031 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.918061    2582 server.go:1019] "Starting client certificate rotation"
Jul 09 03:56:14.252031 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.920816    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 03:56:14.252031 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.920931    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 03:56:14.252426 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.920967    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 03:56:14.252426 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.924745    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 03:56:14.252426 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.935455    2582 log.go:25] "Validated CRI v1 runtime API"
Jul 09 03:56:14.252426 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.937720    2582 log.go:25] "Validated CRI v1 image API"
Jul 09 03:56:14.252426 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.939960    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 03:56:14.252426 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.948458    2582 fs.go:135] Filesystem UUIDs: map[2a625409-8182-4b58-932d-d420b94b4ce8:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 89521bd0-7a18-4b02-a079-f9d93ebf8a70:/dev/nvme0n1p4]
Jul 09 03:56:14.252426 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.948471    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 03:56:14.252426 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.949334    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 03:56:14.252863 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.954090    2582 manager.go:216] Machine: {Timestamp:2026-07-09 03:56:13.953591398 +0000 UTC m=+0.397721464 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102893 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2819386d2902721c9f63eef3f91580 SystemUUID:ec281938-6d29-0272-1c9f-63eef3f91580 BootID:b621e170-455e-45ef-b942-dff6674d553f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:01:76:01:d7:a7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:01:76:01:d7:a7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:98:b8:e7:28:ee Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 03:56:14.252863 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.954184    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 03:56:14.252863 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.954275    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 03:56:14.252863 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.957108    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 03:56:14.252863 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.957350    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-121.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 03:56:14.252863 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.959708    2582 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 03:56:14.252863 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.959717    2582 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 03:56:14.252863 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.959725    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 03:56:14.252863 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.959738    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 03:56:14.252863 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.960877    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 03:56:14.252863 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.964663    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 03:56:14.252863 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.964760    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 03:56:14.252863 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.964787    2582 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 03:56:14.252863 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.964797    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 03:56:14.252863 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.964810    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 03:56:14.252863 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.964819    2582 kubelet.go:398] "Adding apiserver pod source"
Jul 09 03:56:14.252863 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.964827    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 03:56:14.252863 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.965192    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.965216    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.967198    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.969430    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.969457    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.970564    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.970582    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.970593    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.970611    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.970624    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.970632    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.970644    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.970651    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.970660    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.970681    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.970694    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.970701    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.971400    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tffc9"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.972400    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.972411    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.975727    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-121.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.975837    2582 server.go:1268] "Started kubelet"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.975952    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.975991    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.976067    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:13.976370    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-121.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.977115    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.978589    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tffc9"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.978949    2582 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:13.981692    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:13.983379    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.984040    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.984060    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:13.984105    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:13.983398    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-121.ec2.internal.18c082e558180bc1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-121.ec2.internal,UID:ip-10-0-134-121.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-121.ec2.internal,},FirstTimestamp:2026-07-09 03:56:13.975808961 +0000 UTC m=+0.419939025,LastTimestamp:2026-07-09 03:56:13.975808961 +0000 UTC m=+0.419939025,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-121.ec2.internal,}"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.984803    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.984905    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.984785    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.985061    2582 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.985080    2582 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 03:56:14.253749 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.985915    2582 factory.go:153] Registering CRI-O factory
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.985937    2582 factory.go:223] Registration of the crio container factory successfully
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.985987    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.985997    2582 factory.go:55] Registering systemd factory
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.986006    2582 factory.go:223] Registration of the systemd container factory successfully
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.986026    2582 factory.go:103] Registering Raw factory
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.986040    2582 manager.go:1196] Started watching for new ooms in manager
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.986416    2582 manager.go:349] Starting recovery of all containers
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.993924    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:13.996131    2582 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-121.ec2.internal\" not found" node="ip-10-0-134-121.ec2.internal"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:13.997442    2582 manager.go:354] Recovery completed
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.002031    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.007147    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.007180    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.007195    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientPID"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.007641    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.007650    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.007664    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.007705    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.008412    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.008433    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.008443    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientPID"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.009778    2582 policy_none.go:49] "None policy: Start"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.009789    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.009799    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.011784    2582 policy_none.go:47] "Start"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.059448    2582 manager.go:337] "Starting Device Plugin manager"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:14.059474    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.059488    2582 server.go:87] "Starting device plugin registration server"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.059713    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.059724    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.059835    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.059944    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.059953    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:14.060343    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:14.060384    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.147236    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.148391    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.148420    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.148436    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:14.148473    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.150265    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.159962    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.160673    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.160697    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.160708    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientPID"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.160728    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-121.ec2.internal"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.168204    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-121.ec2.internal"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:14.168220    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-121.ec2.internal\": node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 09 03:56:14.254900 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:14.190182    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 09 03:56:14.256269 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.249542    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal"]
Jul 09 03:56:14.256269 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.249606    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 03:56:14.256269 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.250351    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 03:56:14.256269 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.250373    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 03:56:14.256269 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.250384    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientPID"
Jul 09 03:56:14.256269 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.252613    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 03:56:14.256269 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.252808    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 09 03:56:14.256269 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.252842    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 03:56:14.256269 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.253238    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 03:56:14.256269 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.253261    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 03:56:14.256269 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.253274    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientPID"
Jul 09 03:56:14.256269 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.253311    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 03:56:14.256269 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.253331    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 03:56:14.256269 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.253340    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientPID"
Jul 09 03:56:14.256269 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.255471    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal"
Jul 09 03:56:14.256269 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.255498    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 03:56:14.256269 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.256134    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 03:56:14.256269 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.256159    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 03:56:14.256269 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.256173    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeHasSufficientPID"
Jul 09 03:56:14.370863 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.286700    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b2391f67a4d0a7377532ffd51db564eb-config\") pod \"kube-apiserver-proxy-ip-10-0-134-121.ec2.internal\" (UID: \"b2391f67a4d0a7377532ffd51db564eb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal"
Jul 09 03:56:14.370863 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.286873    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9ffe1746002404069169959a6c9f1c5c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal\" (UID: \"9ffe1746002404069169959a6c9f1c5c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 09 03:56:14.370863 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.286891    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ffe1746002404069169959a6c9f1c5c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal\" (UID: \"9ffe1746002404069169959a6c9f1c5c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 09 03:56:14.370863 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:14.291007    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 09 03:56:14.370863 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:14.295587    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-121.ec2.internal\" not found" node="ip-10-0-134-121.ec2.internal"
Jul 09 03:56:14.370863 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:14.301045    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-121.ec2.internal\" not found" node="ip-10-0-134-121.ec2.internal"
Jul 09 03:56:14.505670 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.387885    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b2391f67a4d0a7377532ffd51db564eb-config\") pod \"kube-apiserver-proxy-ip-10-0-134-121.ec2.internal\" (UID: \"b2391f67a4d0a7377532ffd51db564eb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal"
Jul 09 03:56:14.505670 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.387923    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9ffe1746002404069169959a6c9f1c5c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal\" (UID: \"9ffe1746002404069169959a6c9f1c5c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 09 03:56:14.505670 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.387944    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ffe1746002404069169959a6c9f1c5c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal\" (UID: \"9ffe1746002404069169959a6c9f1c5c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 09 03:56:14.505670 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.387994    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ffe1746002404069169959a6c9f1c5c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal\" (UID: \"9ffe1746002404069169959a6c9f1c5c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 09 03:56:14.505670 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.388062    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b2391f67a4d0a7377532ffd51db564eb-config\") pod \"kube-apiserver-proxy-ip-10-0-134-121.ec2.internal\" (UID: \"b2391f67a4d0a7377532ffd51db564eb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal"
Jul 09 03:56:14.505670 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.388091    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9ffe1746002404069169959a6c9f1c5c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal\" (UID: \"9ffe1746002404069169959a6c9f1c5c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 09 03:56:14.505670 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:14.392142    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 09 03:56:14.505670 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:14.493284    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 09 03:56:14.626509 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:14.594347    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 09 03:56:14.626509 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.598814    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 09 03:56:14.626509 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.603808    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal"
Jul 09 03:56:14.782578 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:14.695234    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 09 03:56:14.917322 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:14.796292    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-121.ec2.internal\" not found"
Jul 09 03:56:14.917322 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.833320    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 03:56:14.917322 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.884266    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal"
Jul 09 03:56:14.917322 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.897512    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 03:56:14.917322 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.899830    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal"
Jul 09 03:56:14.917322 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.906852    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 03:56:14.917322 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.914418    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 03:56:14.918352 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.918216    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 03:56:14.918352 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.918325    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 03:56:14.918352 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.918325    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 03:56:14.918557 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.918351    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 03:56:14.918557 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.918376    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.967332    2582 apiserver.go:52] "Watching apiserver"
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.983262    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 03:51:14 +0000 UTC" deadline="2028-04-01 04:52:44.15853225 +0000 UTC"
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.983301    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15168h56m29.175233643s"
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.984908    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.985071    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.985402    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-pckd6","openshift-cluster-node-tuning-operator/tuned-rpfcz","openshift-dns/node-resolver-xh8sc","openshift-image-registry/node-ca-7m8zc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal","openshift-multus/multus-additional-cni-plugins-2dg7h","openshift-multus/network-metrics-daemon-7tm6g","openshift-ovn-kubernetes/ovnkube-node-c9jc2","kube-system/konnectivity-agent-x2dmv","kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k","openshift-multus/multus-gtc4l","openshift-network-diagnostics/network-check-target-x4hpr","openshift-network-operator/iptables-alerter-jr47s"]
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.988418    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:14.988483    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pckd6" podUID="babf27a7-be72-48d0-b348-d2697acd6584"
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.990421    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.992523    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xh8sc"
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.993652    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.993695    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dhw4m\""
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.993810    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.994778    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7m8zc"
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.994841    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.995500    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ch7vv\""
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.995715    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.997687    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.997695    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.997784    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.997928    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gpfrx\""
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:14.998741    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2dg7h"
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.000765    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.001012    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:15.001075    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tm6g" podUID="bf8932b3-3cac-4cb8-a827-361f7df4639d"
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.001175    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.001353    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.001387    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-l9k5g\""
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.001580    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.001580    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 03:56:15.030725 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.001584    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 03:56:15.039870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.003396    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.039870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.005812    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x2dmv"
Jul 09 03:56:15.039870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.008921    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k"
Jul 09 03:56:15.039870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.011377    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.039870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.013738    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:56:15.039870 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:15.013823    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4hpr" podUID="846ebd25-184d-41b4-a8cc-4e7775766ec5"
Jul 09 03:56:15.039870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.016437    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cszfc\""
Jul 09 03:56:15.039870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.016605    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 03:56:15.039870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.016675    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 03:56:15.039870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.016793    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jr47s"
Jul 09 03:56:15.039870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.016879    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 03:56:15.039870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.016956    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 03:56:15.039870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.016965    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 03:56:15.039870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.016980    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lqrf9\""
Jul 09 03:56:15.039870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.016879    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 03:56:15.039870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.017370    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 03:56:15.039870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.017760    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 03:56:15.039870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.017790    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 03:56:15.039870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.018332    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 03:56:15.039870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.019639    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 03:56:15.039870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.019816    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 03:56:15.039870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.019841    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 03:56:15.039870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.019998    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cljjc\""
Jul 09 03:56:15.039870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.020163    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hkj5r\""
Jul 09 03:56:15.039870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.020282    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-76lgp\""
Jul 09 03:56:15.039870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.020624    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 03:56:15.039870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.020791    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 03:56:15.172899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.054220    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-k8vdq"
Jul 09 03:56:15.172899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.062329    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-k8vdq"
Jul 09 03:56:15.172899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.085754    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 03:56:15.172899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098221    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-run-systemd\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.172899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098245    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-node-log\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.172899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098262    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-host-var-lib-cni-multus\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.172899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098280    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-etc-systemd\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.172899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098298    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5c0183f4-6c4a-4d0f-9455-79191c11022e-serviceca\") pod \"node-ca-7m8zc\" (UID: \"5c0183f4-6c4a-4d0f-9455-79191c11022e\") " pod="openshift-image-registry/node-ca-7m8zc"
Jul 09 03:56:15.172899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098337    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4b516d27-7195-483b-af5d-d68ba511a331-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2dg7h\" (UID: \"4b516d27-7195-483b-af5d-d68ba511a331\") " pod="openshift-multus/multus-additional-cni-plugins-2dg7h"
Jul 09 03:56:15.172899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098377    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-run-openvswitch\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.172899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098403    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-host-run-ovn-kubernetes\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.172899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098419    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5fb5b3e9-2be3-4e82-9b7a-bdd9d2f8f8d9-host-slash\") pod \"iptables-alerter-jr47s\" (UID: \"5fb5b3e9-2be3-4e82-9b7a-bdd9d2f8f8d9\") " pod="openshift-network-operator/iptables-alerter-jr47s"
Jul 09 03:56:15.172899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098435    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m24z\" (UniqueName: \"kubernetes.io/projected/846ebd25-184d-41b4-a8cc-4e7775766ec5-kube-api-access-2m24z\") pod \"network-check-target-x4hpr\" (UID: \"846ebd25-184d-41b4-a8cc-4e7775766ec5\") " pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:56:15.172899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098454    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fda0b7cf-903a-43d4-b8d9-769a9f62a7ff-konnectivity-ca\") pod \"konnectivity-agent-x2dmv\" (UID: \"fda0b7cf-903a-43d4-b8d9-769a9f62a7ff\") " pod="kube-system/konnectivity-agent-x2dmv"
Jul 09 03:56:15.172899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098480    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.172899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098520    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-cnibin\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.172899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098553    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-os-release\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.172899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098581    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-cni-binary-copy\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.175995 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098599    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-host-run-multus-certs\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.175995 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098615    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b516d27-7195-483b-af5d-d68ba511a331-system-cni-dir\") pod \"multus-additional-cni-plugins-2dg7h\" (UID: \"4b516d27-7195-483b-af5d-d68ba511a331\") " pod="openshift-multus/multus-additional-cni-plugins-2dg7h"
Jul 09 03:56:15.175995 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098637    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/00b3d9c6-ac5a-4649-b028-433713d020bf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zcz8k\" (UID: \"00b3d9c6-ac5a-4649-b028-433713d020bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k"
Jul 09 03:56:15.175995 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098661    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-multus-cni-dir\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.175995 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098686    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/babf27a7-be72-48d0-b348-d2697acd6584-kubelet-config\") pod \"global-pull-secret-syncer-pckd6\" (UID: \"babf27a7-be72-48d0-b348-d2697acd6584\") " pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:15.175995 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098703    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-etc-sysctl-d\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.175995 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098718    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-var-lib-kubelet\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.175995 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098738    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/00b3d9c6-ac5a-4649-b028-433713d020bf-registration-dir\") pod \"aws-ebs-csi-driver-node-zcz8k\" (UID: \"00b3d9c6-ac5a-4649-b028-433713d020bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k"
Jul 09 03:56:15.175995 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098762    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-host-run-netns\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.175995 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098783    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-multus-conf-dir\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.175995 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098796    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-sys\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.175995 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098811    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b516d27-7195-483b-af5d-d68ba511a331-cnibin\") pod \"multus-additional-cni-plugins-2dg7h\" (UID: \"4b516d27-7195-483b-af5d-d68ba511a331\") " pod="openshift-multus/multus-additional-cni-plugins-2dg7h"
Jul 09 03:56:15.175995 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098841    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/33172081-e578-41b0-ae82-d9d52c06df2b-env-overrides\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.175995 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098871    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-multus-socket-dir-parent\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.175995 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098887    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-host-var-lib-cni-bin\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.175995 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098930    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6ee14835-1a14-4e38-aee4-078038e51d39-hosts-file\") pod \"node-resolver-xh8sc\" (UID: \"6ee14835-1a14-4e38-aee4-078038e51d39\") " pod="openshift-dns/node-resolver-xh8sc"
Jul 09 03:56:15.176629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098956    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5dg2\" (UniqueName: \"kubernetes.io/projected/5fb5b3e9-2be3-4e82-9b7a-bdd9d2f8f8d9-kube-api-access-b5dg2\") pod \"iptables-alerter-jr47s\" (UID: \"5fb5b3e9-2be3-4e82-9b7a-bdd9d2f8f8d9\") " pod="openshift-network-operator/iptables-alerter-jr47s"
Jul 09 03:56:15.176629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.098979    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-host-kubelet\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.176629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099002    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-systemd-units\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.176629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099026    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/33172081-e578-41b0-ae82-d9d52c06df2b-ovn-node-metrics-cert\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.176629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099050    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtz4x\" (UniqueName: \"kubernetes.io/projected/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-kube-api-access-mtz4x\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.176629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099072    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/babf27a7-be72-48d0-b348-d2697acd6584-dbus\") pod \"global-pull-secret-syncer-pckd6\" (UID: \"babf27a7-be72-48d0-b348-d2697acd6584\") " pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:15.176629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099096    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf8932b3-3cac-4cb8-a827-361f7df4639d-metrics-certs\") pod \"network-metrics-daemon-7tm6g\" (UID: \"bf8932b3-3cac-4cb8-a827-361f7df4639d\") " pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:15.176629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099112    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-log-socket\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.176629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099127    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-etc-kubernetes\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.176629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099163    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7kp8\" (UniqueName: \"kubernetes.io/projected/5c0183f4-6c4a-4d0f-9455-79191c11022e-kube-api-access-v7kp8\") pod \"node-ca-7m8zc\" (UID: \"5c0183f4-6c4a-4d0f-9455-79191c11022e\") " pod="openshift-image-registry/node-ca-7m8zc"
Jul 09 03:56:15.176629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099191    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4b516d27-7195-483b-af5d-d68ba511a331-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2dg7h\" (UID: \"4b516d27-7195-483b-af5d-d68ba511a331\") " pod="openshift-multus/multus-additional-cni-plugins-2dg7h"
Jul 09 03:56:15.176629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099214    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fda0b7cf-903a-43d4-b8d9-769a9f62a7ff-agent-certs\") pod \"konnectivity-agent-x2dmv\" (UID: \"fda0b7cf-903a-43d4-b8d9-769a9f62a7ff\") " pod="kube-system/konnectivity-agent-x2dmv"
Jul 09 03:56:15.176629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099231    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-host-cni-bin\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.176629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099247    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxw25\" (UniqueName: \"kubernetes.io/projected/00b3d9c6-ac5a-4649-b028-433713d020bf-kube-api-access-mxw25\") pod \"aws-ebs-csi-driver-node-zcz8k\" (UID: \"00b3d9c6-ac5a-4649-b028-433713d020bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k"
Jul 09 03:56:15.176629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099264    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-etc-modprobe-d\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.176629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099287    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b516d27-7195-483b-af5d-d68ba511a331-os-release\") pod \"multus-additional-cni-plugins-2dg7h\" (UID: \"4b516d27-7195-483b-af5d-d68ba511a331\") " pod="openshift-multus/multus-additional-cni-plugins-2dg7h"
Jul 09 03:56:15.177516 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099310    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b516d27-7195-483b-af5d-d68ba511a331-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2dg7h\" (UID: \"4b516d27-7195-483b-af5d-d68ba511a331\") " pod="openshift-multus/multus-additional-cni-plugins-2dg7h"
Jul 09 03:56:15.177516 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099327    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-host-cni-netd\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.177516 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099341    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-system-cni-dir\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.177516 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099357    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-multus-daemon-config\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.177516 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099395    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-etc-kubernetes\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.177516 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099419    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-run\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.177516 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099435    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxw72\" (UniqueName: \"kubernetes.io/projected/4b516d27-7195-483b-af5d-d68ba511a331-kube-api-access-hxw72\") pod \"multus-additional-cni-plugins-2dg7h\" (UID: \"4b516d27-7195-483b-af5d-d68ba511a331\") " pod="openshift-multus/multus-additional-cni-plugins-2dg7h"
Jul 09 03:56:15.177516 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099458    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-etc-sysctl-conf\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.177516 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099473    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/98c7f805-7c08-4452-8ff9-c0504e52d3bf-etc-tuned\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.177516 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099489    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-etc-openvswitch\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.177516 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099504    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/33172081-e578-41b0-ae82-d9d52c06df2b-ovnkube-script-lib\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.177516 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099526    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/00b3d9c6-ac5a-4649-b028-433713d020bf-socket-dir\") pod \"aws-ebs-csi-driver-node-zcz8k\" (UID: \"00b3d9c6-ac5a-4649-b028-433713d020bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k"
Jul 09 03:56:15.177516 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099549    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-etc-sysconfig\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.177516 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099579    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv5b4\" (UniqueName: \"kubernetes.io/projected/6ee14835-1a14-4e38-aee4-078038e51d39-kube-api-access-jv5b4\") pod \"node-resolver-xh8sc\" (UID: \"6ee14835-1a14-4e38-aee4-078038e51d39\") " pod="openshift-dns/node-resolver-xh8sc"
Jul 09 03:56:15.177516 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099609    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz82z\" (UniqueName: \"kubernetes.io/projected/bf8932b3-3cac-4cb8-a827-361f7df4639d-kube-api-access-fz82z\") pod \"network-metrics-daemon-7tm6g\" (UID: \"bf8932b3-3cac-4cb8-a827-361f7df4639d\") " pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:15.177516 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099635    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-host-slash\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.178157 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099665    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-host-run-netns\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.178157 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099685    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-run-ovn\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.178157 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099708    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcwf6\" (UniqueName: \"kubernetes.io/projected/33172081-e578-41b0-ae82-d9d52c06df2b-kube-api-access-pcwf6\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.178157 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099737    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-host-run-k8s-cni-cncf-io\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.178157 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099764    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-host\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.178157 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099781    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b516d27-7195-483b-af5d-d68ba511a331-cni-binary-copy\") pod \"multus-additional-cni-plugins-2dg7h\" (UID: \"4b516d27-7195-483b-af5d-d68ba511a331\") " pod="openshift-multus/multus-additional-cni-plugins-2dg7h"
Jul 09 03:56:15.178157 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099804    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/33172081-e578-41b0-ae82-d9d52c06df2b-ovnkube-config\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.178157 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099829    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/00b3d9c6-ac5a-4649-b028-433713d020bf-etc-selinux\") pod \"aws-ebs-csi-driver-node-zcz8k\" (UID: \"00b3d9c6-ac5a-4649-b028-433713d020bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k"
Jul 09 03:56:15.178157 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099849    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/00b3d9c6-ac5a-4649-b028-433713d020bf-sys-fs\") pod \"aws-ebs-csi-driver-node-zcz8k\" (UID: \"00b3d9c6-ac5a-4649-b028-433713d020bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k"
Jul 09 03:56:15.178157 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099864    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-host-var-lib-kubelet\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.178157 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099879    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-lib-modules\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.178157 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099916    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfbxc\" (UniqueName: \"kubernetes.io/projected/98c7f805-7c08-4452-8ff9-c0504e52d3bf-kube-api-access-pfbxc\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.178157 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099941    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-var-lib-openvswitch\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.178157 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.099975    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/00b3d9c6-ac5a-4649-b028-433713d020bf-device-dir\") pod \"aws-ebs-csi-driver-node-zcz8k\" (UID: \"00b3d9c6-ac5a-4649-b028-433713d020bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k"
Jul 09 03:56:15.178157 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.100001    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/babf27a7-be72-48d0-b348-d2697acd6584-original-pull-secret\") pod \"global-pull-secret-syncer-pckd6\" (UID: \"babf27a7-be72-48d0-b348-d2697acd6584\") " pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:15.178157 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.100022    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-hostroot\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.179065 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.100042    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98c7f805-7c08-4452-8ff9-c0504e52d3bf-tmp\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.179065 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.100062    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c0183f4-6c4a-4d0f-9455-79191c11022e-host\") pod \"node-ca-7m8zc\" (UID: \"5c0183f4-6c4a-4d0f-9455-79191c11022e\") " pod="openshift-image-registry/node-ca-7m8zc"
Jul 09 03:56:15.179065 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.100089    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5fb5b3e9-2be3-4e82-9b7a-bdd9d2f8f8d9-iptables-alerter-script\") pod \"iptables-alerter-jr47s\" (UID: \"5fb5b3e9-2be3-4e82-9b7a-bdd9d2f8f8d9\") " pod="openshift-network-operator/iptables-alerter-jr47s"
Jul 09 03:56:15.179065 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.100115    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ee14835-1a14-4e38-aee4-078038e51d39-tmp-dir\") pod \"node-resolver-xh8sc\" (UID: \"6ee14835-1a14-4e38-aee4-078038e51d39\") " pod="openshift-dns/node-resolver-xh8sc"
Jul 09 03:56:15.278997 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.200303    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-host-var-lib-cni-multus\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.278997 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.200332    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-etc-systemd\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.278997 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.200350    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5c0183f4-6c4a-4d0f-9455-79191c11022e-serviceca\") pod \"node-ca-7m8zc\" (UID: \"5c0183f4-6c4a-4d0f-9455-79191c11022e\") " pod="openshift-image-registry/node-ca-7m8zc"
Jul 09 03:56:15.278997 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.200375    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4b516d27-7195-483b-af5d-d68ba511a331-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2dg7h\" (UID: \"4b516d27-7195-483b-af5d-d68ba511a331\") " pod="openshift-multus/multus-additional-cni-plugins-2dg7h"
Jul 09 03:56:15.278997 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.200401    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-run-openvswitch\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.278997 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.200412    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-host-var-lib-cni-multus\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.278997 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.200425    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-host-run-ovn-kubernetes\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.278997 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.200458    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-etc-systemd\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.278997 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.200450    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5fb5b3e9-2be3-4e82-9b7a-bdd9d2f8f8d9-host-slash\") pod \"iptables-alerter-jr47s\" (UID: \"5fb5b3e9-2be3-4e82-9b7a-bdd9d2f8f8d9\") " pod="openshift-network-operator/iptables-alerter-jr47s"
Jul 09 03:56:15.278997 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.200498    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5fb5b3e9-2be3-4e82-9b7a-bdd9d2f8f8d9-host-slash\") pod \"iptables-alerter-jr47s\" (UID: \"5fb5b3e9-2be3-4e82-9b7a-bdd9d2f8f8d9\") " pod="openshift-network-operator/iptables-alerter-jr47s"
Jul 09 03:56:15.278997 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.200496    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-run-openvswitch\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.278997 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.200517    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-host-run-ovn-kubernetes\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.278997 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.200507    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m24z\" (UniqueName: \"kubernetes.io/projected/846ebd25-184d-41b4-a8cc-4e7775766ec5-kube-api-access-2m24z\") pod \"network-check-target-x4hpr\" (UID: \"846ebd25-184d-41b4-a8cc-4e7775766ec5\") " pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:56:15.278997 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.200580    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fda0b7cf-903a-43d4-b8d9-769a9f62a7ff-konnectivity-ca\") pod \"konnectivity-agent-x2dmv\" (UID: \"fda0b7cf-903a-43d4-b8d9-769a9f62a7ff\") " pod="kube-system/konnectivity-agent-x2dmv"
Jul 09 03:56:15.278997 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.200622    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.278997 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.200654    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-cnibin\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.278997 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.200679    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-os-release\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.279899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.200729    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.279899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.200734    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-cni-binary-copy\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.279899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.200775    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-host-run-multus-certs\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.279899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.200806    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b516d27-7195-483b-af5d-d68ba511a331-system-cni-dir\") pod \"multus-additional-cni-plugins-2dg7h\" (UID: \"4b516d27-7195-483b-af5d-d68ba511a331\") " pod="openshift-multus/multus-additional-cni-plugins-2dg7h"
Jul 09 03:56:15.279899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.200827    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-cnibin\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.279899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.200833    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/00b3d9c6-ac5a-4649-b028-433713d020bf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zcz8k\" (UID: \"00b3d9c6-ac5a-4649-b028-433713d020bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k"
Jul 09 03:56:15.279899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.200865    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-multus-cni-dir\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.279899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.200879    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/00b3d9c6-ac5a-4649-b028-433713d020bf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zcz8k\" (UID: \"00b3d9c6-ac5a-4649-b028-433713d020bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k"
Jul 09 03:56:15.279899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.200948    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/babf27a7-be72-48d0-b348-d2697acd6584-kubelet-config\") pod \"global-pull-secret-syncer-pckd6\" (UID: \"babf27a7-be72-48d0-b348-d2697acd6584\") " pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:15.279899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.200997    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-host-run-multus-certs\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.279899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201026    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5c0183f4-6c4a-4d0f-9455-79191c11022e-serviceca\") pod \"node-ca-7m8zc\" (UID: \"5c0183f4-6c4a-4d0f-9455-79191c11022e\") " pod="openshift-image-registry/node-ca-7m8zc"
Jul 09 03:56:15.279899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201040    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4b516d27-7195-483b-af5d-d68ba511a331-system-cni-dir\") pod \"multus-additional-cni-plugins-2dg7h\" (UID: \"4b516d27-7195-483b-af5d-d68ba511a331\") " pod="openshift-multus/multus-additional-cni-plugins-2dg7h"
Jul 09 03:56:15.279899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201049    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-multus-cni-dir\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.279899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.200884    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/babf27a7-be72-48d0-b348-d2697acd6584-kubelet-config\") pod \"global-pull-secret-syncer-pckd6\" (UID: \"babf27a7-be72-48d0-b348-d2697acd6584\") " pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:15.279899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201079    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-etc-sysctl-d\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.279899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201096    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-var-lib-kubelet\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.279899 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201135    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/00b3d9c6-ac5a-4649-b028-433713d020bf-registration-dir\") pod \"aws-ebs-csi-driver-node-zcz8k\" (UID: \"00b3d9c6-ac5a-4649-b028-433713d020bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k"
Jul 09 03:56:15.280629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201154    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fda0b7cf-903a-43d4-b8d9-769a9f62a7ff-konnectivity-ca\") pod \"konnectivity-agent-x2dmv\" (UID: \"fda0b7cf-903a-43d4-b8d9-769a9f62a7ff\") " pod="kube-system/konnectivity-agent-x2dmv"
Jul 09 03:56:15.280629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201157    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4b516d27-7195-483b-af5d-d68ba511a331-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2dg7h\" (UID: \"4b516d27-7195-483b-af5d-d68ba511a331\") " pod="openshift-multus/multus-additional-cni-plugins-2dg7h"
Jul 09 03:56:15.280629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201152    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-host-run-netns\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.280629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201185    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-host-run-netns\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.280629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201206    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-etc-sysctl-d\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.280629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201219    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/00b3d9c6-ac5a-4649-b028-433713d020bf-registration-dir\") pod \"aws-ebs-csi-driver-node-zcz8k\" (UID: \"00b3d9c6-ac5a-4649-b028-433713d020bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k"
Jul 09 03:56:15.280629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201226    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-var-lib-kubelet\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.280629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201250    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-os-release\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.280629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201257    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-multus-conf-dir\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.280629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201277    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-multus-conf-dir\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.280629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201296    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-sys\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.280629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201321    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b516d27-7195-483b-af5d-d68ba511a331-cnibin\") pod \"multus-additional-cni-plugins-2dg7h\" (UID: \"4b516d27-7195-483b-af5d-d68ba511a331\") " pod="openshift-multus/multus-additional-cni-plugins-2dg7h"
Jul 09 03:56:15.280629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201337    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/33172081-e578-41b0-ae82-d9d52c06df2b-env-overrides\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.280629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201354    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-multus-socket-dir-parent\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.280629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201357    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-sys\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.280629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201380    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4b516d27-7195-483b-af5d-d68ba511a331-cnibin\") pod \"multus-additional-cni-plugins-2dg7h\" (UID: \"4b516d27-7195-483b-af5d-d68ba511a331\") " pod="openshift-multus/multus-additional-cni-plugins-2dg7h"
Jul 09 03:56:15.280629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201395    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-host-var-lib-cni-bin\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.280629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201412    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-cni-binary-copy\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.281559 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201426    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6ee14835-1a14-4e38-aee4-078038e51d39-hosts-file\") pod \"node-resolver-xh8sc\" (UID: \"6ee14835-1a14-4e38-aee4-078038e51d39\") " pod="openshift-dns/node-resolver-xh8sc"
Jul 09 03:56:15.281559 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201432    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-host-var-lib-cni-bin\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.281559 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201401    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-multus-socket-dir-parent\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.281559 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201445    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5dg2\" (UniqueName: \"kubernetes.io/projected/5fb5b3e9-2be3-4e82-9b7a-bdd9d2f8f8d9-kube-api-access-b5dg2\") pod \"iptables-alerter-jr47s\" (UID: \"5fb5b3e9-2be3-4e82-9b7a-bdd9d2f8f8d9\") " pod="openshift-network-operator/iptables-alerter-jr47s"
Jul 09 03:56:15.281559 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201474    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6ee14835-1a14-4e38-aee4-078038e51d39-hosts-file\") pod \"node-resolver-xh8sc\" (UID: \"6ee14835-1a14-4e38-aee4-078038e51d39\") " pod="openshift-dns/node-resolver-xh8sc"
Jul 09 03:56:15.281559 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201474    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-host-kubelet\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.281559 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201500    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-systemd-units\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.281559 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201508    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-host-kubelet\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.281559 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201520    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/33172081-e578-41b0-ae82-d9d52c06df2b-ovn-node-metrics-cert\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.281559 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201550    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtz4x\" (UniqueName: \"kubernetes.io/projected/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-kube-api-access-mtz4x\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.281559 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201578    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/babf27a7-be72-48d0-b348-d2697acd6584-dbus\") pod \"global-pull-secret-syncer-pckd6\" (UID: \"babf27a7-be72-48d0-b348-d2697acd6584\") " pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:15.281559 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201584    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-systemd-units\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.281559 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201603    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf8932b3-3cac-4cb8-a827-361f7df4639d-metrics-certs\") pod \"network-metrics-daemon-7tm6g\" (UID: \"bf8932b3-3cac-4cb8-a827-361f7df4639d\") " pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:15.281559 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201643    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-log-socket\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.281559 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:15.201679    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 03:56:15.281559 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201724    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-etc-kubernetes\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.281559 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201729    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/babf27a7-be72-48d0-b348-d2697acd6584-dbus\") pod \"global-pull-secret-syncer-pckd6\" (UID: \"babf27a7-be72-48d0-b348-d2697acd6584\") " pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:15.281559 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201680    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-etc-kubernetes\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.282284 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201768    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-log-socket\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.282284 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:15.201776    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf8932b3-3cac-4cb8-a827-361f7df4639d-metrics-certs podName:bf8932b3-3cac-4cb8-a827-361f7df4639d nodeName:}" failed. No retries permitted until 2026-07-09 03:56:15.701733018 +0000 UTC m=+2.145863110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf8932b3-3cac-4cb8-a827-361f7df4639d-metrics-certs") pod "network-metrics-daemon-7tm6g" (UID: "bf8932b3-3cac-4cb8-a827-361f7df4639d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 03:56:15.282284 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201794    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/33172081-e578-41b0-ae82-d9d52c06df2b-env-overrides\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.282284 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201838    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 03:56:15.282284 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201876    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7kp8\" (UniqueName: \"kubernetes.io/projected/5c0183f4-6c4a-4d0f-9455-79191c11022e-kube-api-access-v7kp8\") pod \"node-ca-7m8zc\" (UID: \"5c0183f4-6c4a-4d0f-9455-79191c11022e\") " pod="openshift-image-registry/node-ca-7m8zc"
Jul 09 03:56:15.282284 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201947    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4b516d27-7195-483b-af5d-d68ba511a331-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2dg7h\" (UID: \"4b516d27-7195-483b-af5d-d68ba511a331\") " pod="openshift-multus/multus-additional-cni-plugins-2dg7h"
Jul 09 03:56:15.282284 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201975    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fda0b7cf-903a-43d4-b8d9-769a9f62a7ff-agent-certs\") pod \"konnectivity-agent-x2dmv\" (UID: \"fda0b7cf-903a-43d4-b8d9-769a9f62a7ff\") " pod="kube-system/konnectivity-agent-x2dmv"
Jul 09 03:56:15.282284 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.201991    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-host-cni-bin\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.282284 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202013    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxw25\" (UniqueName: \"kubernetes.io/projected/00b3d9c6-ac5a-4649-b028-433713d020bf-kube-api-access-mxw25\") pod \"aws-ebs-csi-driver-node-zcz8k\" (UID: \"00b3d9c6-ac5a-4649-b028-433713d020bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k"
Jul 09 03:56:15.282284 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202040    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-etc-modprobe-d\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.282284 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202047    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-host-cni-bin\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.282284 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202064    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b516d27-7195-483b-af5d-d68ba511a331-os-release\") pod \"multus-additional-cni-plugins-2dg7h\" (UID: \"4b516d27-7195-483b-af5d-d68ba511a331\") " pod="openshift-multus/multus-additional-cni-plugins-2dg7h"
Jul 09 03:56:15.282284 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202091    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b516d27-7195-483b-af5d-d68ba511a331-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2dg7h\" (UID: \"4b516d27-7195-483b-af5d-d68ba511a331\") " pod="openshift-multus/multus-additional-cni-plugins-2dg7h"
Jul 09 03:56:15.282284 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202123    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-host-cni-netd\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.282284 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202146    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-system-cni-dir\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.282284 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202167    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4b516d27-7195-483b-af5d-d68ba511a331-os-release\") pod \"multus-additional-cni-plugins-2dg7h\" (UID: \"4b516d27-7195-483b-af5d-d68ba511a331\") " pod="openshift-multus/multus-additional-cni-plugins-2dg7h"
Jul 09 03:56:15.282284 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202177    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-multus-daemon-config\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.283506 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202183    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-etc-modprobe-d\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.283506 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202203    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-etc-kubernetes\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.283506 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202218    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-host-cni-netd\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.283506 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202236    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-run\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.283506 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202270    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxw72\" (UniqueName: \"kubernetes.io/projected/4b516d27-7195-483b-af5d-d68ba511a331-kube-api-access-hxw72\") pod \"multus-additional-cni-plugins-2dg7h\" (UID: \"4b516d27-7195-483b-af5d-d68ba511a331\") " pod="openshift-multus/multus-additional-cni-plugins-2dg7h"
Jul 09 03:56:15.283506 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202291    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-etc-kubernetes\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.283506 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202297    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-etc-sysctl-conf\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.283506 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202327    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/98c7f805-7c08-4452-8ff9-c0504e52d3bf-etc-tuned\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.283506 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202351    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-etc-openvswitch\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.283506 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202376    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/33172081-e578-41b0-ae82-d9d52c06df2b-ovnkube-script-lib\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.283506 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202403    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/00b3d9c6-ac5a-4649-b028-433713d020bf-socket-dir\") pod \"aws-ebs-csi-driver-node-zcz8k\" (UID: \"00b3d9c6-ac5a-4649-b028-433713d020bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k"
Jul 09 03:56:15.283506 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202420    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-etc-sysctl-conf\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.283506 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202429    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-etc-sysconfig\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.283506 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202459    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv5b4\" (UniqueName: \"kubernetes.io/projected/6ee14835-1a14-4e38-aee4-078038e51d39-kube-api-access-jv5b4\") pod \"node-resolver-xh8sc\" (UID: \"6ee14835-1a14-4e38-aee4-078038e51d39\") " pod="openshift-dns/node-resolver-xh8sc"
Jul 09 03:56:15.283506 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202473    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-run\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.283506 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202491    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz82z\" (UniqueName: \"kubernetes.io/projected/bf8932b3-3cac-4cb8-a827-361f7df4639d-kube-api-access-fz82z\") pod \"network-metrics-daemon-7tm6g\" (UID: \"bf8932b3-3cac-4cb8-a827-361f7df4639d\") " pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:15.283506 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202509    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4b516d27-7195-483b-af5d-d68ba511a331-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2dg7h\" (UID: \"4b516d27-7195-483b-af5d-d68ba511a331\") " pod="openshift-multus/multus-additional-cni-plugins-2dg7h"
Jul 09 03:56:15.284486 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202518    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-host-slash\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.284486 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202543    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-host-run-netns\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.284486 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202567    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-run-ovn\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.284486 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202596    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcwf6\" (UniqueName: \"kubernetes.io/projected/33172081-e578-41b0-ae82-d9d52c06df2b-kube-api-access-pcwf6\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.284486 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202622    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-host-run-k8s-cni-cncf-io\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.284486 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202623    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-system-cni-dir\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.284486 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202626    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/00b3d9c6-ac5a-4649-b028-433713d020bf-socket-dir\") pod \"aws-ebs-csi-driver-node-zcz8k\" (UID: \"00b3d9c6-ac5a-4649-b028-433713d020bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k"
Jul 09 03:56:15.284486 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202666    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-etc-openvswitch\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.284486 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202702    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-multus-daemon-config\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.284486 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202721    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-etc-sysconfig\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.284486 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202755    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-host-run-netns\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.284486 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202374    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4b516d27-7195-483b-af5d-d68ba511a331-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2dg7h\" (UID: \"4b516d27-7195-483b-af5d-d68ba511a331\") " pod="openshift-multus/multus-additional-cni-plugins-2dg7h"
Jul 09 03:56:15.284486 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202760    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-host-slash\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.284486 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202669    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-host-run-k8s-cni-cncf-io\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.284486 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202842    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-host\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.284486 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.202868    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-run-ovn\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.284486 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.203024    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b516d27-7195-483b-af5d-d68ba511a331-cni-binary-copy\") pod \"multus-additional-cni-plugins-2dg7h\" (UID: \"4b516d27-7195-483b-af5d-d68ba511a331\") " pod="openshift-multus/multus-additional-cni-plugins-2dg7h"
Jul 09 03:56:15.284486 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.203037    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-host\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.285391 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.203056    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/33172081-e578-41b0-ae82-d9d52c06df2b-ovnkube-config\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.285391 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.203084    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/00b3d9c6-ac5a-4649-b028-433713d020bf-etc-selinux\") pod \"aws-ebs-csi-driver-node-zcz8k\" (UID: \"00b3d9c6-ac5a-4649-b028-433713d020bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k"
Jul 09 03:56:15.285391 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.203117    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/00b3d9c6-ac5a-4649-b028-433713d020bf-sys-fs\") pod \"aws-ebs-csi-driver-node-zcz8k\" (UID: \"00b3d9c6-ac5a-4649-b028-433713d020bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k"
Jul 09 03:56:15.285391 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.203141    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-host-var-lib-kubelet\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.285391 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.203167    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-lib-modules\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.285391 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.203196    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfbxc\" (UniqueName: \"kubernetes.io/projected/98c7f805-7c08-4452-8ff9-c0504e52d3bf-kube-api-access-pfbxc\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.285391 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.203223    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-var-lib-openvswitch\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.285391 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.203248    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/00b3d9c6-ac5a-4649-b028-433713d020bf-device-dir\") pod \"aws-ebs-csi-driver-node-zcz8k\" (UID: \"00b3d9c6-ac5a-4649-b028-433713d020bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k"
Jul 09 03:56:15.285391 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.203276    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/babf27a7-be72-48d0-b348-d2697acd6584-original-pull-secret\") pod \"global-pull-secret-syncer-pckd6\" (UID: \"babf27a7-be72-48d0-b348-d2697acd6584\") " pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:15.285391 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.203302    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-hostroot\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.285391 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.203326    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98c7f805-7c08-4452-8ff9-c0504e52d3bf-tmp\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.285391 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.203372    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c0183f4-6c4a-4d0f-9455-79191c11022e-host\") pod \"node-ca-7m8zc\" (UID: \"5c0183f4-6c4a-4d0f-9455-79191c11022e\") " pod="openshift-image-registry/node-ca-7m8zc"
Jul 09 03:56:15.285391 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.203404    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5fb5b3e9-2be3-4e82-9b7a-bdd9d2f8f8d9-iptables-alerter-script\") pod \"iptables-alerter-jr47s\" (UID: \"5fb5b3e9-2be3-4e82-9b7a-bdd9d2f8f8d9\") " pod="openshift-network-operator/iptables-alerter-jr47s"
Jul 09 03:56:15.285391 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.203432    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ee14835-1a14-4e38-aee4-078038e51d39-tmp-dir\") pod \"node-resolver-xh8sc\" (UID: \"6ee14835-1a14-4e38-aee4-078038e51d39\") " pod="openshift-dns/node-resolver-xh8sc"
Jul 09 03:56:15.285391 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.203453    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-run-systemd\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.285391 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.203475    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-node-log\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.285391 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.203543    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/00b3d9c6-ac5a-4649-b028-433713d020bf-device-dir\") pod \"aws-ebs-csi-driver-node-zcz8k\" (UID: \"00b3d9c6-ac5a-4649-b028-433713d020bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k"
Jul 09 03:56:15.286395 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.203542    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-host-var-lib-kubelet\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.286395 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.203575    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-node-log\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.286395 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:15.203596    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 03:56:15.286395 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.203670    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/00b3d9c6-ac5a-4649-b028-433713d020bf-etc-selinux\") pod \"aws-ebs-csi-driver-node-zcz8k\" (UID: \"00b3d9c6-ac5a-4649-b028-433713d020bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k"
Jul 09 03:56:15.286395 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:15.203680    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/babf27a7-be72-48d0-b348-d2697acd6584-original-pull-secret podName:babf27a7-be72-48d0-b348-d2697acd6584 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:15.70365925 +0000 UTC m=+2.147789306 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/babf27a7-be72-48d0-b348-d2697acd6584-original-pull-secret") pod "global-pull-secret-syncer-pckd6" (UID: "babf27a7-be72-48d0-b348-d2697acd6584") : object "kube-system"/"original-pull-secret" not registered
Jul 09 03:56:15.286395 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.203716    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-hostroot\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.286395 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.203733    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/00b3d9c6-ac5a-4649-b028-433713d020bf-sys-fs\") pod \"aws-ebs-csi-driver-node-zcz8k\" (UID: \"00b3d9c6-ac5a-4649-b028-433713d020bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k"
Jul 09 03:56:15.286395 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.204012    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-var-lib-openvswitch\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.286395 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.204103    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/98c7f805-7c08-4452-8ff9-c0504e52d3bf-lib-modules\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.286395 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.204346    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c0183f4-6c4a-4d0f-9455-79191c11022e-host\") pod \"node-ca-7m8zc\" (UID: \"5c0183f4-6c4a-4d0f-9455-79191c11022e\") " pod="openshift-image-registry/node-ca-7m8zc"
Jul 09 03:56:15.286395 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.204400    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/33172081-e578-41b0-ae82-d9d52c06df2b-ovnkube-config\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.286395 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.204443    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/33172081-e578-41b0-ae82-d9d52c06df2b-run-systemd\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.286395 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.204597    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ee14835-1a14-4e38-aee4-078038e51d39-tmp-dir\") pod \"node-resolver-xh8sc\" (UID: \"6ee14835-1a14-4e38-aee4-078038e51d39\") " pod="openshift-dns/node-resolver-xh8sc"
Jul 09 03:56:15.286395 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.204756    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4b516d27-7195-483b-af5d-d68ba511a331-cni-binary-copy\") pod \"multus-additional-cni-plugins-2dg7h\" (UID: \"4b516d27-7195-483b-af5d-d68ba511a331\") " pod="openshift-multus/multus-additional-cni-plugins-2dg7h"
Jul 09 03:56:15.286395 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.204852    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/33172081-e578-41b0-ae82-d9d52c06df2b-ovnkube-script-lib\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.286395 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.205224    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5fb5b3e9-2be3-4e82-9b7a-bdd9d2f8f8d9-iptables-alerter-script\") pod \"iptables-alerter-jr47s\" (UID: \"5fb5b3e9-2be3-4e82-9b7a-bdd9d2f8f8d9\") " pod="openshift-network-operator/iptables-alerter-jr47s"
Jul 09 03:56:15.286395 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.205952    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/98c7f805-7c08-4452-8ff9-c0504e52d3bf-etc-tuned\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.287146 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.206227    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fda0b7cf-903a-43d4-b8d9-769a9f62a7ff-agent-certs\") pod \"konnectivity-agent-x2dmv\" (UID: \"fda0b7cf-903a-43d4-b8d9-769a9f62a7ff\") " pod="kube-system/konnectivity-agent-x2dmv"
Jul 09 03:56:15.287146 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.206283    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/33172081-e578-41b0-ae82-d9d52c06df2b-ovn-node-metrics-cert\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.287146 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:15.207649    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 03:56:15.287146 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:15.207679    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 03:56:15.287146 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:15.207695    2582 projected.go:196] Error preparing data for projected volume kube-api-access-2m24z for pod openshift-network-diagnostics/network-check-target-x4hpr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 03:56:15.287146 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:15.207757    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/846ebd25-184d-41b4-a8cc-4e7775766ec5-kube-api-access-2m24z podName:846ebd25-184d-41b4-a8cc-4e7775766ec5 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:15.707739581 +0000 UTC m=+2.151869636 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2m24z" (UniqueName: "kubernetes.io/projected/846ebd25-184d-41b4-a8cc-4e7775766ec5-kube-api-access-2m24z") pod "network-check-target-x4hpr" (UID: "846ebd25-184d-41b4-a8cc-4e7775766ec5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 03:56:15.287146 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.208773    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98c7f805-7c08-4452-8ff9-c0504e52d3bf-tmp\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.287146 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.209741    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5dg2\" (UniqueName: \"kubernetes.io/projected/5fb5b3e9-2be3-4e82-9b7a-bdd9d2f8f8d9-kube-api-access-b5dg2\") pod \"iptables-alerter-jr47s\" (UID: \"5fb5b3e9-2be3-4e82-9b7a-bdd9d2f8f8d9\") " pod="openshift-network-operator/iptables-alerter-jr47s"
Jul 09 03:56:15.287146 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.211353    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxw72\" (UniqueName: \"kubernetes.io/projected/4b516d27-7195-483b-af5d-d68ba511a331-kube-api-access-hxw72\") pod \"multus-additional-cni-plugins-2dg7h\" (UID: \"4b516d27-7195-483b-af5d-d68ba511a331\") " pod="openshift-multus/multus-additional-cni-plugins-2dg7h"
Jul 09 03:56:15.287146 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.211863    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7kp8\" (UniqueName: \"kubernetes.io/projected/5c0183f4-6c4a-4d0f-9455-79191c11022e-kube-api-access-v7kp8\") pod \"node-ca-7m8zc\" (UID: \"5c0183f4-6c4a-4d0f-9455-79191c11022e\") " pod="openshift-image-registry/node-ca-7m8zc"
Jul 09 03:56:15.287146 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.211917    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtz4x\" (UniqueName: \"kubernetes.io/projected/d6e75e5d-b20e-4dc5-9531-940a7b7f13f4-kube-api-access-mtz4x\") pod \"multus-gtc4l\" (UID: \"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4\") " pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.287146 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.215935    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfbxc\" (UniqueName: \"kubernetes.io/projected/98c7f805-7c08-4452-8ff9-c0504e52d3bf-kube-api-access-pfbxc\") pod \"tuned-rpfcz\" (UID: \"98c7f805-7c08-4452-8ff9-c0504e52d3bf\") " pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.287146 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.216590    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv5b4\" (UniqueName: \"kubernetes.io/projected/6ee14835-1a14-4e38-aee4-078038e51d39-kube-api-access-jv5b4\") pod \"node-resolver-xh8sc\" (UID: \"6ee14835-1a14-4e38-aee4-078038e51d39\") " pod="openshift-dns/node-resolver-xh8sc"
Jul 09 03:56:15.287146 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.216781    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxw25\" (UniqueName: \"kubernetes.io/projected/00b3d9c6-ac5a-4649-b028-433713d020bf-kube-api-access-mxw25\") pod \"aws-ebs-csi-driver-node-zcz8k\" (UID: \"00b3d9c6-ac5a-4649-b028-433713d020bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k"
Jul 09 03:56:15.287146 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.217345    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz82z\" (UniqueName: \"kubernetes.io/projected/bf8932b3-3cac-4cb8-a827-361f7df4639d-kube-api-access-fz82z\") pod \"network-metrics-daemon-7tm6g\" (UID: \"bf8932b3-3cac-4cb8-a827-361f7df4639d\") " pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:15.287146 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.218547    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcwf6\" (UniqueName: \"kubernetes.io/projected/33172081-e578-41b0-ae82-d9d52c06df2b-kube-api-access-pcwf6\") pod \"ovnkube-node-c9jc2\" (UID: \"33172081-e578-41b0-ae82-d9d52c06df2b\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.287146 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.224066    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jr47s"
Jul 09 03:56:15.287987 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:15.281740    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ffe1746002404069169959a6c9f1c5c.slice/crio-6fd6f9f61e6ca3043621e5987cd444d1f25ea6f26ec83d4c2e0100e7ae075ff0 WatchSource:0}: Error finding container 6fd6f9f61e6ca3043621e5987cd444d1f25ea6f26ec83d4c2e0100e7ae075ff0: Status 404 returned error can't find the container with id 6fd6f9f61e6ca3043621e5987cd444d1f25ea6f26ec83d4c2e0100e7ae075ff0
Jul 09 03:56:15.409593 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.291392    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 03:56:15.409593 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.373232    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rpfcz"
Jul 09 03:56:15.409593 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.374380    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xh8sc"
Jul 09 03:56:15.409593 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:15.383202    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98c7f805_7c08_4452_8ff9_c0504e52d3bf.slice/crio-58e826ed68b90d1bed3fb38246cecc8b2b889e78c8d519660977a4cf60bbaa7d WatchSource:0}: Error finding container 58e826ed68b90d1bed3fb38246cecc8b2b889e78c8d519660977a4cf60bbaa7d: Status 404 returned error can't find the container with id 58e826ed68b90d1bed3fb38246cecc8b2b889e78c8d519660977a4cf60bbaa7d
Jul 09 03:56:15.409593 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.386836    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7m8zc"
Jul 09 03:56:15.409593 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:15.387456    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ee14835_1a14_4e38_aee4_078038e51d39.slice/crio-a0aed47c47a559459575b456f01e5317ee992c6c9bf71939bfdbe0813d657a74 WatchSource:0}: Error finding container a0aed47c47a559459575b456f01e5317ee992c6c9bf71939bfdbe0813d657a74: Status 404 returned error can't find the container with id a0aed47c47a559459575b456f01e5317ee992c6c9bf71939bfdbe0813d657a74
Jul 09 03:56:15.409593 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.393654    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2dg7h"
Jul 09 03:56:15.409593 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:15.396717    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c0183f4_6c4a_4d0f_9455_79191c11022e.slice/crio-01bbf9b90b0423b3a6f53624f1dc008bc18254b2f219bc4b2ccdd122c57e6270 WatchSource:0}: Error finding container 01bbf9b90b0423b3a6f53624f1dc008bc18254b2f219bc4b2ccdd122c57e6270: Status 404 returned error can't find the container with id 01bbf9b90b0423b3a6f53624f1dc008bc18254b2f219bc4b2ccdd122c57e6270
Jul 09 03:56:15.409593 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:15.403033    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b516d27_7195_483b_af5d_d68ba511a331.slice/crio-a100bd0652be78d678c8e6b32119094071f9109717bb8542207ab5cc500bf022 WatchSource:0}: Error finding container a100bd0652be78d678c8e6b32119094071f9109717bb8542207ab5cc500bf022: Status 404 returned error can't find the container with id a100bd0652be78d678c8e6b32119094071f9109717bb8542207ab5cc500bf022
Jul 09 03:56:15.512185 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.440264    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:15.512185 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:15.448795    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33172081_e578_41b0_ae82_d9d52c06df2b.slice/crio-b85d63a25518a72088569e27f066dab4cb350f9770b945639d911f24b381cdf8 WatchSource:0}: Error finding container b85d63a25518a72088569e27f066dab4cb350f9770b945639d911f24b381cdf8: Status 404 returned error can't find the container with id b85d63a25518a72088569e27f066dab4cb350f9770b945639d911f24b381cdf8
Jul 09 03:56:15.512185 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.457521    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x2dmv"
Jul 09 03:56:15.512185 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:15.468426    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfda0b7cf_903a_43d4_b8d9_769a9f62a7ff.slice/crio-0e0c711224ada84ab00a7aefc02d39fa69256c8d469f6bdf5dc3aeb1d8c98f39 WatchSource:0}: Error finding container 0e0c711224ada84ab00a7aefc02d39fa69256c8d469f6bdf5dc3aeb1d8c98f39: Status 404 returned error can't find the container with id 0e0c711224ada84ab00a7aefc02d39fa69256c8d469f6bdf5dc3aeb1d8c98f39
Jul 09 03:56:15.512185 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.480830    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k"
Jul 09 03:56:15.512185 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.504480    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gtc4l"
Jul 09 03:56:15.514308 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:15.514286    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00b3d9c6_ac5a_4649_b028_433713d020bf.slice/crio-46f51699af88d86f52e17265ea7d0cd81efd5a74a9c30e61582ad85ad365d228 WatchSource:0}: Error finding container 46f51699af88d86f52e17265ea7d0cd81efd5a74a9c30e61582ad85ad365d228: Status 404 returned error can't find the container with id 46f51699af88d86f52e17265ea7d0cd81efd5a74a9c30e61582ad85ad365d228
Jul 09 03:56:15.517326 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:15.517288    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6e75e5d_b20e_4dc5_9531_940a7b7f13f4.slice/crio-889eaec3dc8afa23f9de6ac36a0b9246a585350639bb08a3bc17a9ef460a216e WatchSource:0}: Error finding container 889eaec3dc8afa23f9de6ac36a0b9246a585350639bb08a3bc17a9ef460a216e: Status 404 returned error can't find the container with id 889eaec3dc8afa23f9de6ac36a0b9246a585350639bb08a3bc17a9ef460a216e
Jul 09 03:56:15.636614 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:15.636591    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb5b3e9_2be3_4e82_9b7a_bdd9d2f8f8d9.slice/crio-cea85bd5128f42c6ce75b8cb8e7a152b3322354c71665c8e24380f57ad60bc72 WatchSource:0}: Error finding container cea85bd5128f42c6ce75b8cb8e7a152b3322354c71665c8e24380f57ad60bc72: Status 404 returned error can't find the container with id cea85bd5128f42c6ce75b8cb8e7a152b3322354c71665c8e24380f57ad60bc72
Jul 09 03:56:15.706044 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.705971    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf8932b3-3cac-4cb8-a827-361f7df4639d-metrics-certs\") pod \"network-metrics-daemon-7tm6g\" (UID: \"bf8932b3-3cac-4cb8-a827-361f7df4639d\") " pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:15.706150 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.706043    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/babf27a7-be72-48d0-b348-d2697acd6584-original-pull-secret\") pod \"global-pull-secret-syncer-pckd6\" (UID: \"babf27a7-be72-48d0-b348-d2697acd6584\") " pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:15.706150 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:15.706087    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 03:56:15.706150 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:15.706135    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 03:56:15.706309 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:15.706183    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/babf27a7-be72-48d0-b348-d2697acd6584-original-pull-secret podName:babf27a7-be72-48d0-b348-d2697acd6584 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:16.706164336 +0000 UTC m=+3.150294408 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/babf27a7-be72-48d0-b348-d2697acd6584-original-pull-secret") pod "global-pull-secret-syncer-pckd6" (UID: "babf27a7-be72-48d0-b348-d2697acd6584") : object "kube-system"/"original-pull-secret" not registered
Jul 09 03:56:15.706309 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:15.706202    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf8932b3-3cac-4cb8-a827-361f7df4639d-metrics-certs podName:bf8932b3-3cac-4cb8-a827-361f7df4639d nodeName:}" failed. No retries permitted until 2026-07-09 03:56:16.706192403 +0000 UTC m=+3.150322457 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf8932b3-3cac-4cb8-a827-361f7df4639d-metrics-certs") pod "network-metrics-daemon-7tm6g" (UID: "bf8932b3-3cac-4cb8-a827-361f7df4639d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 03:56:15.807374 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:15.807336    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m24z\" (UniqueName: \"kubernetes.io/projected/846ebd25-184d-41b4-a8cc-4e7775766ec5-kube-api-access-2m24z\") pod \"network-check-target-x4hpr\" (UID: \"846ebd25-184d-41b4-a8cc-4e7775766ec5\") " pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:56:15.807540 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:15.807519    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 03:56:15.807622 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:15.807542    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 03:56:15.807622 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:15.807555    2582 projected.go:196] Error preparing data for projected volume kube-api-access-2m24z for pod openshift-network-diagnostics/network-check-target-x4hpr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 03:56:15.807622 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:15.807612    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/846ebd25-184d-41b4-a8cc-4e7775766ec5-kube-api-access-2m24z podName:846ebd25-184d-41b4-a8cc-4e7775766ec5 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:16.807594055 +0000 UTC m=+3.251724123 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2m24z" (UniqueName: "kubernetes.io/projected/846ebd25-184d-41b4-a8cc-4e7775766ec5-kube-api-access-2m24z") pod "network-check-target-x4hpr" (UID: "846ebd25-184d-41b4-a8cc-4e7775766ec5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 03:56:16.019631 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:16.019556    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 03:56:16.065761 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:16.065700    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 03:51:15 +0000 UTC" deadline="2028-03-24 20:43:31.905388454 +0000 UTC"
Jul 09 03:56:16.065919 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:16.065769    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14992h47m15.839631378s"
Jul 09 03:56:16.172453 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:16.172394    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gtc4l" event={"ID":"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4","Type":"ContainerStarted","Data":"889eaec3dc8afa23f9de6ac36a0b9246a585350639bb08a3bc17a9ef460a216e"}
Jul 09 03:56:16.213903 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:16.210949    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2" event={"ID":"33172081-e578-41b0-ae82-d9d52c06df2b","Type":"ContainerStarted","Data":"b85d63a25518a72088569e27f066dab4cb350f9770b945639d911f24b381cdf8"}
Jul 09 03:56:16.219331 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:16.219298    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2dg7h" event={"ID":"4b516d27-7195-483b-af5d-d68ba511a331","Type":"ContainerStarted","Data":"a100bd0652be78d678c8e6b32119094071f9109717bb8542207ab5cc500bf022"}
Jul 09 03:56:16.229361 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:16.229292    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7m8zc" event={"ID":"5c0183f4-6c4a-4d0f-9455-79191c11022e","Type":"ContainerStarted","Data":"01bbf9b90b0423b3a6f53624f1dc008bc18254b2f219bc4b2ccdd122c57e6270"}
Jul 09 03:56:16.255145 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:16.255080    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xh8sc" event={"ID":"6ee14835-1a14-4e38-aee4-078038e51d39","Type":"ContainerStarted","Data":"a0aed47c47a559459575b456f01e5317ee992c6c9bf71939bfdbe0813d657a74"}
Jul 09 03:56:16.266980 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:16.266942    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rpfcz" event={"ID":"98c7f805-7c08-4452-8ff9-c0504e52d3bf","Type":"ContainerStarted","Data":"58e826ed68b90d1bed3fb38246cecc8b2b889e78c8d519660977a4cf60bbaa7d"}
Jul 09 03:56:16.280348 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:16.280257    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal" event={"ID":"b2391f67a4d0a7377532ffd51db564eb","Type":"ContainerStarted","Data":"046e12450c12525771fc94e531e29ab8501b2ea02b6d8e5658d07889ca401ecb"}
Jul 09 03:56:16.293194 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:16.293074    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal" event={"ID":"9ffe1746002404069169959a6c9f1c5c","Type":"ContainerStarted","Data":"6fd6f9f61e6ca3043621e5987cd444d1f25ea6f26ec83d4c2e0100e7ae075ff0"}
Jul 09 03:56:16.315731 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:16.315692    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jr47s" event={"ID":"5fb5b3e9-2be3-4e82-9b7a-bdd9d2f8f8d9","Type":"ContainerStarted","Data":"cea85bd5128f42c6ce75b8cb8e7a152b3322354c71665c8e24380f57ad60bc72"}
Jul 09 03:56:16.324272 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:16.324232    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k" event={"ID":"00b3d9c6-ac5a-4649-b028-433713d020bf","Type":"ContainerStarted","Data":"46f51699af88d86f52e17265ea7d0cd81efd5a74a9c30e61582ad85ad365d228"}
Jul 09 03:56:16.333785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:16.333746    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x2dmv" event={"ID":"fda0b7cf-903a-43d4-b8d9-769a9f62a7ff","Type":"ContainerStarted","Data":"0e0c711224ada84ab00a7aefc02d39fa69256c8d469f6bdf5dc3aeb1d8c98f39"}
Jul 09 03:56:16.389404 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:16.389370    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 03:56:16.714640 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:16.714559    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/babf27a7-be72-48d0-b348-d2697acd6584-original-pull-secret\") pod \"global-pull-secret-syncer-pckd6\" (UID: \"babf27a7-be72-48d0-b348-d2697acd6584\") " pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:16.714640 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:16.714634    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf8932b3-3cac-4cb8-a827-361f7df4639d-metrics-certs\") pod \"network-metrics-daemon-7tm6g\" (UID: \"bf8932b3-3cac-4cb8-a827-361f7df4639d\") " pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:16.714856 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:16.714758    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 03:56:16.714856 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:16.714818    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf8932b3-3cac-4cb8-a827-361f7df4639d-metrics-certs podName:bf8932b3-3cac-4cb8-a827-361f7df4639d nodeName:}" failed. No retries permitted until 2026-07-09 03:56:18.714800009 +0000 UTC m=+5.158930074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf8932b3-3cac-4cb8-a827-361f7df4639d-metrics-certs") pod "network-metrics-daemon-7tm6g" (UID: "bf8932b3-3cac-4cb8-a827-361f7df4639d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 03:56:16.715247 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:16.715209    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 03:56:16.715320 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:16.715262    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/babf27a7-be72-48d0-b348-d2697acd6584-original-pull-secret podName:babf27a7-be72-48d0-b348-d2697acd6584 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:18.715247838 +0000 UTC m=+5.159377900 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/babf27a7-be72-48d0-b348-d2697acd6584-original-pull-secret") pod "global-pull-secret-syncer-pckd6" (UID: "babf27a7-be72-48d0-b348-d2697acd6584") : object "kube-system"/"original-pull-secret" not registered
Jul 09 03:56:16.817115 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:16.815229    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m24z\" (UniqueName: \"kubernetes.io/projected/846ebd25-184d-41b4-a8cc-4e7775766ec5-kube-api-access-2m24z\") pod \"network-check-target-x4hpr\" (UID: \"846ebd25-184d-41b4-a8cc-4e7775766ec5\") " pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:56:16.817115 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:16.815419    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 03:56:16.817115 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:16.815440    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 03:56:16.817115 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:16.815454    2582 projected.go:196] Error preparing data for projected volume kube-api-access-2m24z for pod openshift-network-diagnostics/network-check-target-x4hpr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 03:56:16.817115 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:16.815509    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/846ebd25-184d-41b4-a8cc-4e7775766ec5-kube-api-access-2m24z podName:846ebd25-184d-41b4-a8cc-4e7775766ec5 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:18.815492809 +0000 UTC m=+5.259622863 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2m24z" (UniqueName: "kubernetes.io/projected/846ebd25-184d-41b4-a8cc-4e7775766ec5-kube-api-access-2m24z") pod "network-check-target-x4hpr" (UID: "846ebd25-184d-41b4-a8cc-4e7775766ec5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 03:56:17.066581 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:17.066502    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 03:51:15 +0000 UTC" deadline="2028-03-27 19:55:22.093445252 +0000 UTC"
Jul 09 03:56:17.066581 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:17.066538    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15063h59m5.026911143s"
Jul 09 03:56:17.148842 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:17.148648    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:17.148842 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:17.148785    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tm6g" podUID="bf8932b3-3cac-4cb8-a827-361f7df4639d"
Jul 09 03:56:17.149468 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:17.149185    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:56:17.149468 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:17.149269    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4hpr" podUID="846ebd25-184d-41b4-a8cc-4e7775766ec5"
Jul 09 03:56:17.149468 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:17.149337    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:17.149468 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:17.149403    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pckd6" podUID="babf27a7-be72-48d0-b348-d2697acd6584"
Jul 09 03:56:17.150021 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:17.150002    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 03:56:17.455562 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:17.455299    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 03:56:18.732737 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:18.732694    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/babf27a7-be72-48d0-b348-d2697acd6584-original-pull-secret\") pod \"global-pull-secret-syncer-pckd6\" (UID: \"babf27a7-be72-48d0-b348-d2697acd6584\") " pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:18.733371 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:18.732785    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf8932b3-3cac-4cb8-a827-361f7df4639d-metrics-certs\") pod \"network-metrics-daemon-7tm6g\" (UID: \"bf8932b3-3cac-4cb8-a827-361f7df4639d\") " pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:18.733371 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:18.732965    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 03:56:18.733371 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:18.733026    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf8932b3-3cac-4cb8-a827-361f7df4639d-metrics-certs podName:bf8932b3-3cac-4cb8-a827-361f7df4639d nodeName:}" failed. No retries permitted until 2026-07-09 03:56:22.73300777 +0000 UTC m=+9.177137830 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf8932b3-3cac-4cb8-a827-361f7df4639d-metrics-certs") pod "network-metrics-daemon-7tm6g" (UID: "bf8932b3-3cac-4cb8-a827-361f7df4639d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 03:56:18.733549 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:18.733401    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 03:56:18.733549 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:18.733447    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/babf27a7-be72-48d0-b348-d2697acd6584-original-pull-secret podName:babf27a7-be72-48d0-b348-d2697acd6584 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:22.733434559 +0000 UTC m=+9.177564613 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/babf27a7-be72-48d0-b348-d2697acd6584-original-pull-secret") pod "global-pull-secret-syncer-pckd6" (UID: "babf27a7-be72-48d0-b348-d2697acd6584") : object "kube-system"/"original-pull-secret" not registered
Jul 09 03:56:18.833437 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:18.833403    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m24z\" (UniqueName: \"kubernetes.io/projected/846ebd25-184d-41b4-a8cc-4e7775766ec5-kube-api-access-2m24z\") pod \"network-check-target-x4hpr\" (UID: \"846ebd25-184d-41b4-a8cc-4e7775766ec5\") " pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:56:18.833614 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:18.833561    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 03:56:18.833614 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:18.833578    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 03:56:18.833614 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:18.833591    2582 projected.go:196] Error preparing data for projected volume kube-api-access-2m24z for pod openshift-network-diagnostics/network-check-target-x4hpr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 03:56:18.833781 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:18.833651    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/846ebd25-184d-41b4-a8cc-4e7775766ec5-kube-api-access-2m24z podName:846ebd25-184d-41b4-a8cc-4e7775766ec5 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:22.833633424 +0000 UTC m=+9.277763479 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2m24z" (UniqueName: "kubernetes.io/projected/846ebd25-184d-41b4-a8cc-4e7775766ec5-kube-api-access-2m24z") pod "network-check-target-x4hpr" (UID: "846ebd25-184d-41b4-a8cc-4e7775766ec5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 03:56:19.149711 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:19.149663    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:19.149917 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:19.149823    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tm6g" podUID="bf8932b3-3cac-4cb8-a827-361f7df4639d"
Jul 09 03:56:19.150001 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:19.149932    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:56:19.150052 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:19.150019    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4hpr" podUID="846ebd25-184d-41b4-a8cc-4e7775766ec5"
Jul 09 03:56:19.150100 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:19.150085    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:19.150259 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:19.150153    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pckd6" podUID="babf27a7-be72-48d0-b348-d2697acd6584"
Jul 09 03:56:21.149937 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:21.149445    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:21.149937 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:21.149571    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:21.149937 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:21.149579    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pckd6" podUID="babf27a7-be72-48d0-b348-d2697acd6584"
Jul 09 03:56:21.149937 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:21.149616    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:56:21.149937 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:21.149731    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tm6g" podUID="bf8932b3-3cac-4cb8-a827-361f7df4639d"
Jul 09 03:56:21.149937 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:21.149810    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4hpr" podUID="846ebd25-184d-41b4-a8cc-4e7775766ec5"
Jul 09 03:56:22.763121 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:22.763074    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf8932b3-3cac-4cb8-a827-361f7df4639d-metrics-certs\") pod \"network-metrics-daemon-7tm6g\" (UID: \"bf8932b3-3cac-4cb8-a827-361f7df4639d\") " pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:22.763576 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:22.763146    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/babf27a7-be72-48d0-b348-d2697acd6584-original-pull-secret\") pod \"global-pull-secret-syncer-pckd6\" (UID: \"babf27a7-be72-48d0-b348-d2697acd6584\") " pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:22.763576 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:22.763250    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 03:56:22.763576 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:22.763300    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 03:56:22.763576 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:22.763351    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf8932b3-3cac-4cb8-a827-361f7df4639d-metrics-certs podName:bf8932b3-3cac-4cb8-a827-361f7df4639d nodeName:}" failed. No retries permitted until 2026-07-09 03:56:30.76332711 +0000 UTC m=+17.207457184 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf8932b3-3cac-4cb8-a827-361f7df4639d-metrics-certs") pod "network-metrics-daemon-7tm6g" (UID: "bf8932b3-3cac-4cb8-a827-361f7df4639d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 03:56:22.763576 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:22.763371    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/babf27a7-be72-48d0-b348-d2697acd6584-original-pull-secret podName:babf27a7-be72-48d0-b348-d2697acd6584 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:30.763361471 +0000 UTC m=+17.207491528 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/babf27a7-be72-48d0-b348-d2697acd6584-original-pull-secret") pod "global-pull-secret-syncer-pckd6" (UID: "babf27a7-be72-48d0-b348-d2697acd6584") : object "kube-system"/"original-pull-secret" not registered
Jul 09 03:56:22.864429 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:22.863764    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m24z\" (UniqueName: \"kubernetes.io/projected/846ebd25-184d-41b4-a8cc-4e7775766ec5-kube-api-access-2m24z\") pod \"network-check-target-x4hpr\" (UID: \"846ebd25-184d-41b4-a8cc-4e7775766ec5\") " pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:56:22.864429 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:22.863980    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 03:56:22.864429 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:22.864003    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 03:56:22.864429 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:22.864017    2582 projected.go:196] Error preparing data for projected volume kube-api-access-2m24z for pod openshift-network-diagnostics/network-check-target-x4hpr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 03:56:22.864429 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:22.864077    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/846ebd25-184d-41b4-a8cc-4e7775766ec5-kube-api-access-2m24z podName:846ebd25-184d-41b4-a8cc-4e7775766ec5 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:30.864059158 +0000 UTC m=+17.308189212 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2m24z" (UniqueName: "kubernetes.io/projected/846ebd25-184d-41b4-a8cc-4e7775766ec5-kube-api-access-2m24z") pod "network-check-target-x4hpr" (UID: "846ebd25-184d-41b4-a8cc-4e7775766ec5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 03:56:23.148957 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:23.148926    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:56:23.149124 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:23.148966    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:23.149124 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:23.149060    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4hpr" podUID="846ebd25-184d-41b4-a8cc-4e7775766ec5"
Jul 09 03:56:23.149256 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:23.149122    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pckd6" podUID="babf27a7-be72-48d0-b348-d2697acd6584"
Jul 09 03:56:23.149256 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:23.149175    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:23.149354 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:23.149266    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tm6g" podUID="bf8932b3-3cac-4cb8-a827-361f7df4639d"
Jul 09 03:56:25.148997 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:25.148909    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:25.148997 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:25.148940    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:56:25.148997 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:25.148958    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:25.149548 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:25.149052    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pckd6" podUID="babf27a7-be72-48d0-b348-d2697acd6584"
Jul 09 03:56:25.149548 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:25.149147    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4hpr" podUID="846ebd25-184d-41b4-a8cc-4e7775766ec5"
Jul 09 03:56:25.149548 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:25.149259    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tm6g" podUID="bf8932b3-3cac-4cb8-a827-361f7df4639d"
Jul 09 03:56:27.149620 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:27.149597    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:56:27.150008 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:27.149597    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:27.150008 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:27.149722    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4hpr" podUID="846ebd25-184d-41b4-a8cc-4e7775766ec5"
Jul 09 03:56:27.150008 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:27.149805    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tm6g" podUID="bf8932b3-3cac-4cb8-a827-361f7df4639d"
Jul 09 03:56:27.150008 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:27.149597    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:27.150008 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:27.149912    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pckd6" podUID="babf27a7-be72-48d0-b348-d2697acd6584"
Jul 09 03:56:29.149568 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:29.149529    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:29.150006 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:29.149530    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:29.150006 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:29.149648    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pckd6" podUID="babf27a7-be72-48d0-b348-d2697acd6584"
Jul 09 03:56:29.150006 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:29.149531    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:56:29.150006 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:29.149721    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tm6g" podUID="bf8932b3-3cac-4cb8-a827-361f7df4639d"
Jul 09 03:56:29.150006 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:29.149811    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4hpr" podUID="846ebd25-184d-41b4-a8cc-4e7775766ec5"
Jul 09 03:56:30.824228 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:30.824202    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/babf27a7-be72-48d0-b348-d2697acd6584-original-pull-secret\") pod \"global-pull-secret-syncer-pckd6\" (UID: \"babf27a7-be72-48d0-b348-d2697acd6584\") " pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:30.824547 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:30.824254    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf8932b3-3cac-4cb8-a827-361f7df4639d-metrics-certs\") pod \"network-metrics-daemon-7tm6g\" (UID: \"bf8932b3-3cac-4cb8-a827-361f7df4639d\") " pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:30.824547 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:30.824341    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 03:56:30.824547 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:30.824343    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 03:56:30.824547 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:30.824393    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf8932b3-3cac-4cb8-a827-361f7df4639d-metrics-certs podName:bf8932b3-3cac-4cb8-a827-361f7df4639d nodeName:}" failed. No retries permitted until 2026-07-09 03:56:46.824375586 +0000 UTC m=+33.268505640 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf8932b3-3cac-4cb8-a827-361f7df4639d-metrics-certs") pod "network-metrics-daemon-7tm6g" (UID: "bf8932b3-3cac-4cb8-a827-361f7df4639d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 03:56:30.824547 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:30.824406    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/babf27a7-be72-48d0-b348-d2697acd6584-original-pull-secret podName:babf27a7-be72-48d0-b348-d2697acd6584 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:46.82440063 +0000 UTC m=+33.268530681 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/babf27a7-be72-48d0-b348-d2697acd6584-original-pull-secret") pod "global-pull-secret-syncer-pckd6" (UID: "babf27a7-be72-48d0-b348-d2697acd6584") : object "kube-system"/"original-pull-secret" not registered
Jul 09 03:56:30.924599 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:30.924577    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m24z\" (UniqueName: \"kubernetes.io/projected/846ebd25-184d-41b4-a8cc-4e7775766ec5-kube-api-access-2m24z\") pod \"network-check-target-x4hpr\" (UID: \"846ebd25-184d-41b4-a8cc-4e7775766ec5\") " pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:56:30.924696 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:30.924674    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 03:56:30.924696 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:30.924686    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 03:56:30.924696 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:30.924695    2582 projected.go:196] Error preparing data for projected volume kube-api-access-2m24z for pod openshift-network-diagnostics/network-check-target-x4hpr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 03:56:30.924807 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:30.924734    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/846ebd25-184d-41b4-a8cc-4e7775766ec5-kube-api-access-2m24z podName:846ebd25-184d-41b4-a8cc-4e7775766ec5 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:46.924722885 +0000 UTC m=+33.368852935 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2m24z" (UniqueName: "kubernetes.io/projected/846ebd25-184d-41b4-a8cc-4e7775766ec5-kube-api-access-2m24z") pod "network-check-target-x4hpr" (UID: "846ebd25-184d-41b4-a8cc-4e7775766ec5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 03:56:31.149672 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:31.149642    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:31.149847 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:31.149642    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:31.149847 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:31.149760    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pckd6" podUID="babf27a7-be72-48d0-b348-d2697acd6584"
Jul 09 03:56:31.149847 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:31.149642    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:56:31.150031 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:31.149843    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tm6g" podUID="bf8932b3-3cac-4cb8-a827-361f7df4639d"
Jul 09 03:56:31.150031 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:31.149935    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4hpr" podUID="846ebd25-184d-41b4-a8cc-4e7775766ec5"
Jul 09 03:56:33.149157 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:33.149124    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:33.149717 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:33.149124    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:33.149717 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:33.149126    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:56:33.149717 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:33.149342    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tm6g" podUID="bf8932b3-3cac-4cb8-a827-361f7df4639d"
Jul 09 03:56:33.149717 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:33.149225    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pckd6" podUID="babf27a7-be72-48d0-b348-d2697acd6584"
Jul 09 03:56:33.149717 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:33.149395    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4hpr" podUID="846ebd25-184d-41b4-a8cc-4e7775766ec5"
Jul 09 03:56:35.149276 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:35.149234    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:35.149276 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:35.149282    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:56:35.149663 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:35.149291    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:35.149663 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:35.149366    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pckd6" podUID="babf27a7-be72-48d0-b348-d2697acd6584"
Jul 09 03:56:35.149663 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:35.149476    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4hpr" podUID="846ebd25-184d-41b4-a8cc-4e7775766ec5"
Jul 09 03:56:35.149663 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:35.149551    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tm6g" podUID="bf8932b3-3cac-4cb8-a827-361f7df4639d"
Jul 09 03:56:36.378141 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:36.377544    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gtc4l" event={"ID":"d6e75e5d-b20e-4dc5-9531-940a7b7f13f4","Type":"ContainerStarted","Data":"a38fb18da4d67c5e238fc1715a594a0406b012a75a15dd794b6077cf978e227e"}
Jul 09 03:56:36.380807 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:36.380790    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9jc2_33172081-e578-41b0-ae82-d9d52c06df2b/ovn-acl-logging/0.log"
Jul 09 03:56:36.381214 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:36.381190    2582 generic.go:356] "Generic (PLEG): container finished" podID="33172081-e578-41b0-ae82-d9d52c06df2b" containerID="5655603e4659442e705eaa9e2f3d9a2c412ebff0f43067910322f37add364473" exitCode=1
Jul 09 03:56:36.381287 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:36.381261    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2" event={"ID":"33172081-e578-41b0-ae82-d9d52c06df2b","Type":"ContainerStarted","Data":"8493d56ef110f54bcd36a27510a9cf8e74320ea6c31004f4a7637f56623c05db"}
Jul 09 03:56:36.381345 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:36.381321    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2" event={"ID":"33172081-e578-41b0-ae82-d9d52c06df2b","Type":"ContainerStarted","Data":"e9b48158d59aac29510e2255f46e95113f5854b0761a2f63190b8399cc976a8c"}
Jul 09 03:56:36.381386 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:36.381359    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2" event={"ID":"33172081-e578-41b0-ae82-d9d52c06df2b","Type":"ContainerDied","Data":"5655603e4659442e705eaa9e2f3d9a2c412ebff0f43067910322f37add364473"}
Jul 09 03:56:36.381416 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:36.381390    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2" event={"ID":"33172081-e578-41b0-ae82-d9d52c06df2b","Type":"ContainerStarted","Data":"aee28fec7a1c68d60d0d1dbfeb0f702702f96f36a5722b7f4411acd5a3091c76"}
Jul 09 03:56:36.383747 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:36.383726    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rpfcz" event={"ID":"98c7f805-7c08-4452-8ff9-c0504e52d3bf","Type":"ContainerStarted","Data":"5b1d3ac5eb246a196d98111a4f5a0c3a4ee263014552909b06202ccf32211eb2"}
Jul 09 03:56:36.385108 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:36.385088    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal" event={"ID":"b2391f67a4d0a7377532ffd51db564eb","Type":"ContainerStarted","Data":"095c94450c021997fcc963ec11d6604c133615bd7cd48391cea5bee3ec43feac"}
Jul 09 03:56:36.407956 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:36.407917    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-121.ec2.internal" podStartSLOduration=22.407905778 podStartE2EDuration="22.407905778s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:56:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:56:36.407665558 +0000 UTC m=+22.851795631" watchObservedRunningTime="2026-07-09 03:56:36.407905778 +0000 UTC m=+22.852035844"
Jul 09 03:56:36.408037 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:36.408025    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gtc4l" podStartSLOduration=2.666448842 podStartE2EDuration="22.408019689s" totalImagesPullingTime="19.741570847s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:56:36.394946948 +0000 UTC m=+22.839077021" watchObservedRunningTime="2026-07-09 03:56:36.408019689 +0000 UTC m=+22.852149767"
Jul 09 03:56:36.424856 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:36.424816    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rpfcz" podStartSLOduration=2.581440148 podStartE2EDuration="22.424804761s" totalImagesPullingTime="19.843364613s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:56:36.424770887 +0000 UTC m=+22.868900960" watchObservedRunningTime="2026-07-09 03:56:36.424804761 +0000 UTC m=+22.868934833"
Jul 09 03:56:37.149238 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:37.149052    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:56:37.149447 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:37.149098    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:37.149447 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:37.149309    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4hpr" podUID="846ebd25-184d-41b4-a8cc-4e7775766ec5"
Jul 09 03:56:37.149447 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:37.149382    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tm6g" podUID="bf8932b3-3cac-4cb8-a827-361f7df4639d"
Jul 09 03:56:37.149447 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:37.149097    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:37.149605 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:37.149449    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pckd6" podUID="babf27a7-be72-48d0-b348-d2697acd6584"
Jul 09 03:56:37.389943 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:37.389902    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7m8zc" event={"ID":"5c0183f4-6c4a-4d0f-9455-79191c11022e","Type":"ContainerStarted","Data":"e584d7210627891adbec71e8333aaaf762d8ece27fd16d2b40382956590c67ba"}
Jul 09 03:56:37.391769 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:37.391739    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xh8sc" event={"ID":"6ee14835-1a14-4e38-aee4-078038e51d39","Type":"ContainerStarted","Data":"b1a868f96cad57fe7a7894a340eb017a3aa562834a7a31a6cda9725b361e0fb5"}
Jul 09 03:56:37.393319 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:37.393294    2582 generic.go:356] "Generic (PLEG): container finished" podID="9ffe1746002404069169959a6c9f1c5c" containerID="72ae2a30ee9a3230ad4e7549499a5fe8b217832c23e9934dda923514662c8452" exitCode=0
Jul 09 03:56:37.393459 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:37.393361    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal" event={"ID":"9ffe1746002404069169959a6c9f1c5c","Type":"ContainerDied","Data":"72ae2a30ee9a3230ad4e7549499a5fe8b217832c23e9934dda923514662c8452"}
Jul 09 03:56:37.394920 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:37.394878    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jr47s" event={"ID":"5fb5b3e9-2be3-4e82-9b7a-bdd9d2f8f8d9","Type":"ContainerStarted","Data":"408a6593d60d251009fe8fc9ddf38962c9dca4fbb38178eae8b40ac272b47141"}
Jul 09 03:56:37.396561 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:37.396532    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k" event={"ID":"00b3d9c6-ac5a-4649-b028-433713d020bf","Type":"ContainerStarted","Data":"038621695bd18d3a8aec86c60a1b446fbc3c2995a0f63af4180c8af114b5d4bc"}
Jul 09 03:56:37.398068 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:37.398043    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x2dmv" event={"ID":"fda0b7cf-903a-43d4-b8d9-769a9f62a7ff","Type":"ContainerStarted","Data":"84e64844f7a3883136afc41c1602d156a4c2838eddc0ed80397690fe7616591e"}
Jul 09 03:56:37.401020 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:37.400973    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9jc2_33172081-e578-41b0-ae82-d9d52c06df2b/ovn-acl-logging/0.log"
Jul 09 03:56:37.401433 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:37.401412    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2" event={"ID":"33172081-e578-41b0-ae82-d9d52c06df2b","Type":"ContainerStarted","Data":"f224205184e97089923cd35975b5967580a49bd2eabe00e9d000511394c65a1c"}
Jul 09 03:56:37.401500 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:37.401474    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2" event={"ID":"33172081-e578-41b0-ae82-d9d52c06df2b","Type":"ContainerStarted","Data":"2831e34bf8fa85b919ee641970775f6e5eb4687f051857eb2bce7526bf727ee0"}
Jul 09 03:56:37.402918 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:37.402900    2582 generic.go:356] "Generic (PLEG): container finished" podID="4b516d27-7195-483b-af5d-d68ba511a331" containerID="09a8108bc559979ae087d65a539e84bb1b8b941c92699992b8597d2e9de5729c" exitCode=0
Jul 09 03:56:37.403018 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:37.402966    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2dg7h" event={"ID":"4b516d27-7195-483b-af5d-d68ba511a331","Type":"ContainerDied","Data":"09a8108bc559979ae087d65a539e84bb1b8b941c92699992b8597d2e9de5729c"}
Jul 09 03:56:37.405407 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:37.405366    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7m8zc" podStartSLOduration=3.6272324510000002 podStartE2EDuration="23.405351737s" totalImagesPullingTime="19.778119286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:56:37.404876762 +0000 UTC m=+23.849006821" watchObservedRunningTime="2026-07-09 03:56:37.405351737 +0000 UTC m=+23.849481837"
Jul 09 03:56:37.450646 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:37.450608    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xh8sc" podStartSLOduration=3.614812289 podStartE2EDuration="23.450595347s" totalImagesPullingTime="19.835783058s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:56:37.420120676 +0000 UTC m=+23.864250748" watchObservedRunningTime="2026-07-09 03:56:37.450595347 +0000 UTC m=+23.894725431"
Jul 09 03:56:37.479435 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:37.479400    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jr47s" podStartSLOduration=3.890550767 podStartE2EDuration="23.479389159s" totalImagesPullingTime="19.588838392s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:56:37.479295984 +0000 UTC m=+23.923426057" watchObservedRunningTime="2026-07-09 03:56:37.479389159 +0000 UTC m=+23.923519242"
Jul 09 03:56:37.479852 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:37.479829    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-x2dmv" podStartSLOduration=3.772325048 podStartE2EDuration="23.479824861s" totalImagesPullingTime="19.707499813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:56:37.464233058 +0000 UTC m=+23.908363130" watchObservedRunningTime="2026-07-09 03:56:37.479824861 +0000 UTC m=+23.923954934"
Jul 09 03:56:37.832120 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:37.832098    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 03:56:38.074941 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:38.074777    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T03:56:37.832115048Z","UUID":"cf682445-5213-43cb-92c0-0ec98bec3878","Handler":null,"Name":"","Endpoint":""}
Jul 09 03:56:38.076419 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:38.076399    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 03:56:38.076560 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:38.076433    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 03:56:38.408806 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:38.408764    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal" event={"ID":"9ffe1746002404069169959a6c9f1c5c","Type":"ContainerStarted","Data":"4ef7a1f0d8f3fd8c47746e15033da2c165c0101ec502b64bef87c94287239e11"}
Jul 09 03:56:38.412431 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:38.412086    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k" event={"ID":"00b3d9c6-ac5a-4649-b028-433713d020bf","Type":"ContainerStarted","Data":"fc032dd42f5724da8393eb65df7de987ed53a7e47a4f1b097cf110e302e71a21"}
Jul 09 03:56:38.424479 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:38.424430    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-121.ec2.internal" podStartSLOduration=24.424415268 podStartE2EDuration="24.424415268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:56:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:56:38.424081857 +0000 UTC m=+24.868211929" watchObservedRunningTime="2026-07-09 03:56:38.424415268 +0000 UTC m=+24.868545356"
Jul 09 03:56:39.148941 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:39.148915    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:56:39.148941 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:39.148947    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:39.149188 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:39.148916    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:39.149188 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:39.149033    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4hpr" podUID="846ebd25-184d-41b4-a8cc-4e7775766ec5"
Jul 09 03:56:39.149188 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:39.149132    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tm6g" podUID="bf8932b3-3cac-4cb8-a827-361f7df4639d"
Jul 09 03:56:39.149335 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:39.149220    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pckd6" podUID="babf27a7-be72-48d0-b348-d2697acd6584"
Jul 09 03:56:39.416473 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:39.416390    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k" event={"ID":"00b3d9c6-ac5a-4649-b028-433713d020bf","Type":"ContainerStarted","Data":"d00f9369892df829ff3ec90c9a10d99195f93ab09992edf61b70223a23975d09"}
Jul 09 03:56:39.420283 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:39.420250    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9jc2_33172081-e578-41b0-ae82-d9d52c06df2b/ovn-acl-logging/0.log"
Jul 09 03:56:39.420679 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:39.420656    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2" event={"ID":"33172081-e578-41b0-ae82-d9d52c06df2b","Type":"ContainerStarted","Data":"6cc7f61767d4db52d4e7cff37f147fb013016681460459298938cb18ce37dfbb"}
Jul 09 03:56:39.432158 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:39.432113    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zcz8k" podStartSLOduration=3.789520329 podStartE2EDuration="25.432097013s" totalImagesPullingTime="21.642576684s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:56:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:56:39.432071297 +0000 UTC m=+25.876201372" watchObservedRunningTime="2026-07-09 03:56:39.432097013 +0000 UTC m=+25.876227079"
Jul 09 03:56:41.149081 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:41.149046    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:41.149081 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:41.149074    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:56:41.149598 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:41.149051    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:41.149598 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:41.149153    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pckd6" podUID="babf27a7-be72-48d0-b348-d2697acd6584"
Jul 09 03:56:41.149598 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:41.149208    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tm6g" podUID="bf8932b3-3cac-4cb8-a827-361f7df4639d"
Jul 09 03:56:41.149598 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:41.149278    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4hpr" podUID="846ebd25-184d-41b4-a8cc-4e7775766ec5"
Jul 09 03:56:41.736640 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:41.736615    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-x2dmv"
Jul 09 03:56:41.737787 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:41.737771    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-x2dmv"
Jul 09 03:56:42.429075 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:42.428875    2582 generic.go:356] "Generic (PLEG): container finished" podID="4b516d27-7195-483b-af5d-d68ba511a331" containerID="b0a52af5105513242c39825b9bf30dc249a743bf9b4208504df3cb1653bfd50f" exitCode=0
Jul 09 03:56:42.429738 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:42.428918    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2dg7h" event={"ID":"4b516d27-7195-483b-af5d-d68ba511a331","Type":"ContainerDied","Data":"b0a52af5105513242c39825b9bf30dc249a743bf9b4208504df3cb1653bfd50f"}
Jul 09 03:56:42.432382 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:42.432368    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9jc2_33172081-e578-41b0-ae82-d9d52c06df2b/ovn-acl-logging/0.log"
Jul 09 03:56:42.432768 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:42.432744    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2" event={"ID":"33172081-e578-41b0-ae82-d9d52c06df2b","Type":"ContainerStarted","Data":"c1525cc3c08aacd0a1afdc79d39b707c089b4c444972b5564d99ad92a561912b"}
Jul 09 03:56:42.432880 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:42.432824    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-x2dmv"
Jul 09 03:56:42.433122 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:42.433100    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:42.433297 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:42.433222    2582 scope.go:117] "RemoveContainer" containerID="5655603e4659442e705eaa9e2f3d9a2c412ebff0f43067910322f37add364473"
Jul 09 03:56:42.433556 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:42.433541    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-x2dmv"
Jul 09 03:56:42.448066 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:42.448051    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:43.148759 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:43.148674    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:43.149048 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:43.148806    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pckd6" podUID="babf27a7-be72-48d0-b348-d2697acd6584"
Jul 09 03:56:43.149170 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:43.149146    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:56:43.149339 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:43.149186    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:43.149339 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:43.149268    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4hpr" podUID="846ebd25-184d-41b4-a8cc-4e7775766ec5"
Jul 09 03:56:43.149459 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:43.149349    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tm6g" podUID="bf8932b3-3cac-4cb8-a827-361f7df4639d"
Jul 09 03:56:43.438118 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:43.438066    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9jc2_33172081-e578-41b0-ae82-d9d52c06df2b/ovn-acl-logging/0.log"
Jul 09 03:56:43.438515 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:43.438410    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2" event={"ID":"33172081-e578-41b0-ae82-d9d52c06df2b","Type":"ContainerStarted","Data":"b4e2f062289b43a0e47ba91219830d1cfe9c4254ca1b21f82d8a2429a62552d5"}
Jul 09 03:56:43.438825 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:43.438801    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:43.438953 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:43.438874    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:43.452454 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:43.452426    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:56:43.500510 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:43.500469    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2" podStartSLOduration=9.077991811 podStartE2EDuration="29.500457315s" totalImagesPullingTime="20.422465504s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:56:43.498424331 +0000 UTC m=+29.942554404" watchObservedRunningTime="2026-07-09 03:56:43.500457315 +0000 UTC m=+29.944587387"
Jul 09 03:56:43.817988 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:43.817956    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7tm6g"]
Jul 09 03:56:43.818114 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:43.818075    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:43.818221 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:43.818196    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tm6g" podUID="bf8932b3-3cac-4cb8-a827-361f7df4639d"
Jul 09 03:56:43.818748 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:43.818722    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x4hpr"]
Jul 09 03:56:43.818861 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:43.818812    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:56:43.818927 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:43.818880    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4hpr" podUID="846ebd25-184d-41b4-a8cc-4e7775766ec5"
Jul 09 03:56:43.819437 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:43.819417    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pckd6"]
Jul 09 03:56:43.819488 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:43.819479    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:43.819556 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:43.819542    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pckd6" podUID="babf27a7-be72-48d0-b348-d2697acd6584"
Jul 09 03:56:44.442483 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:44.442450    2582 generic.go:356] "Generic (PLEG): container finished" podID="4b516d27-7195-483b-af5d-d68ba511a331" containerID="fc5130f515fe61896c1acf8140208ff45c3887cfaa79e2566f3d41c07cac8481" exitCode=0
Jul 09 03:56:44.442863 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:44.442538    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2dg7h" event={"ID":"4b516d27-7195-483b-af5d-d68ba511a331","Type":"ContainerDied","Data":"fc5130f515fe61896c1acf8140208ff45c3887cfaa79e2566f3d41c07cac8481"}
Jul 09 03:56:45.149676 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:45.149611    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:45.149827 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:45.149611    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:56:45.149827 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:45.149717    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pckd6" podUID="babf27a7-be72-48d0-b348-d2697acd6584"
Jul 09 03:56:45.149827 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:45.149800    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4hpr" podUID="846ebd25-184d-41b4-a8cc-4e7775766ec5"
Jul 09 03:56:46.149736 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:46.149565    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:46.150216 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:46.149807    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tm6g" podUID="bf8932b3-3cac-4cb8-a827-361f7df4639d"
Jul 09 03:56:46.448592 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:46.448565    2582 generic.go:356] "Generic (PLEG): container finished" podID="4b516d27-7195-483b-af5d-d68ba511a331" containerID="32b26ed3cd4bedf83296d755b20b1c8c913c6d8ab8cec1f66a157ea71429f27f" exitCode=0
Jul 09 03:56:46.448711 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:46.448616    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2dg7h" event={"ID":"4b516d27-7195-483b-af5d-d68ba511a331","Type":"ContainerDied","Data":"32b26ed3cd4bedf83296d755b20b1c8c913c6d8ab8cec1f66a157ea71429f27f"}
Jul 09 03:56:46.843055 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:46.842975    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf8932b3-3cac-4cb8-a827-361f7df4639d-metrics-certs\") pod \"network-metrics-daemon-7tm6g\" (UID: \"bf8932b3-3cac-4cb8-a827-361f7df4639d\") " pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:46.843055 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:46.843030    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/babf27a7-be72-48d0-b348-d2697acd6584-original-pull-secret\") pod \"global-pull-secret-syncer-pckd6\" (UID: \"babf27a7-be72-48d0-b348-d2697acd6584\") " pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:46.843225 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:46.843112    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 03:56:46.843225 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:46.843117    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 03:56:46.843317 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:46.843227    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf8932b3-3cac-4cb8-a827-361f7df4639d-metrics-certs podName:bf8932b3-3cac-4cb8-a827-361f7df4639d nodeName:}" failed. No retries permitted until 2026-07-09 03:57:18.843200307 +0000 UTC m=+65.287330360 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf8932b3-3cac-4cb8-a827-361f7df4639d-metrics-certs") pod "network-metrics-daemon-7tm6g" (UID: "bf8932b3-3cac-4cb8-a827-361f7df4639d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 03:56:46.843317 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:46.843273    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/babf27a7-be72-48d0-b348-d2697acd6584-original-pull-secret podName:babf27a7-be72-48d0-b348-d2697acd6584 nodeName:}" failed. No retries permitted until 2026-07-09 03:57:18.843254987 +0000 UTC m=+65.287385051 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/babf27a7-be72-48d0-b348-d2697acd6584-original-pull-secret") pod "global-pull-secret-syncer-pckd6" (UID: "babf27a7-be72-48d0-b348-d2697acd6584") : object "kube-system"/"original-pull-secret" not registered
Jul 09 03:56:46.943691 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:46.943663    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m24z\" (UniqueName: \"kubernetes.io/projected/846ebd25-184d-41b4-a8cc-4e7775766ec5-kube-api-access-2m24z\") pod \"network-check-target-x4hpr\" (UID: \"846ebd25-184d-41b4-a8cc-4e7775766ec5\") " pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:56:46.943841 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:46.943792    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 03:56:46.943841 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:46.943806    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 03:56:46.943841 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:46.943815    2582 projected.go:196] Error preparing data for projected volume kube-api-access-2m24z for pod openshift-network-diagnostics/network-check-target-x4hpr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 03:56:46.944001 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:46.943860    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/846ebd25-184d-41b4-a8cc-4e7775766ec5-kube-api-access-2m24z podName:846ebd25-184d-41b4-a8cc-4e7775766ec5 nodeName:}" failed. No retries permitted until 2026-07-09 03:57:18.943846546 +0000 UTC m=+65.387976601 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2m24z" (UniqueName: "kubernetes.io/projected/846ebd25-184d-41b4-a8cc-4e7775766ec5-kube-api-access-2m24z") pod "network-check-target-x4hpr" (UID: "846ebd25-184d-41b4-a8cc-4e7775766ec5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 03:56:47.149389 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:47.149360    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:47.149558 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:47.149469    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pckd6" podUID="babf27a7-be72-48d0-b348-d2697acd6584"
Jul 09 03:56:47.149558 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:47.149534    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:56:47.149676 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:47.149641    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-x4hpr" podUID="846ebd25-184d-41b4-a8cc-4e7775766ec5"
Jul 09 03:56:48.148965 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.148930    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:48.149412 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:48.149077    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7tm6g" podUID="bf8932b3-3cac-4cb8-a827-361f7df4639d"
Jul 09 03:56:48.363502 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.363476    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-121.ec2.internal" event="NodeReady"
Jul 09 03:56:48.363664 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.363627    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 03:56:48.404091 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.404015    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9klq9"]
Jul 09 03:56:48.407766 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.407743    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-89ht9"]
Jul 09 03:56:48.407909 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.407878    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9klq9"
Jul 09 03:56:48.411599 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.411578    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 03:56:48.411719 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.411624    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 03:56:48.411719 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.411640    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-89ht9"
Jul 09 03:56:48.411865 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.411847    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-q7njr\""
Jul 09 03:56:48.419833 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.419814    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 03:56:48.419948 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.419844    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 03:56:48.420104 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.420087    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 03:56:48.420169 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.420116    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pxg4s\""
Jul 09 03:56:48.423393 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.423325    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9klq9"]
Jul 09 03:56:48.424343 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.424294    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-89ht9"]
Jul 09 03:56:48.555461 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.555434    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fglgj\" (UniqueName: \"kubernetes.io/projected/6e5de089-67a0-409d-b5dc-4ac5c979b266-kube-api-access-fglgj\") pod \"dns-default-9klq9\" (UID: \"6e5de089-67a0-409d-b5dc-4ac5c979b266\") " pod="openshift-dns/dns-default-9klq9"
Jul 09 03:56:48.555620 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.555466    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clk5k\" (UniqueName: \"kubernetes.io/projected/6b55c1aa-edd7-4de7-8379-ec449c32ed67-kube-api-access-clk5k\") pod \"ingress-canary-89ht9\" (UID: \"6b55c1aa-edd7-4de7-8379-ec449c32ed67\") " pod="openshift-ingress-canary/ingress-canary-89ht9"
Jul 09 03:56:48.555620 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.555504    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6e5de089-67a0-409d-b5dc-4ac5c979b266-config-volume\") pod \"dns-default-9klq9\" (UID: \"6e5de089-67a0-409d-b5dc-4ac5c979b266\") " pod="openshift-dns/dns-default-9klq9"
Jul 09 03:56:48.555620 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.555597    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e5de089-67a0-409d-b5dc-4ac5c979b266-tmp-dir\") pod \"dns-default-9klq9\" (UID: \"6e5de089-67a0-409d-b5dc-4ac5c979b266\") " pod="openshift-dns/dns-default-9klq9"
Jul 09 03:56:48.555770 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.555634    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b55c1aa-edd7-4de7-8379-ec449c32ed67-cert\") pod \"ingress-canary-89ht9\" (UID: \"6b55c1aa-edd7-4de7-8379-ec449c32ed67\") " pod="openshift-ingress-canary/ingress-canary-89ht9"
Jul 09 03:56:48.555770 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.555666    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e5de089-67a0-409d-b5dc-4ac5c979b266-metrics-tls\") pod \"dns-default-9klq9\" (UID: \"6e5de089-67a0-409d-b5dc-4ac5c979b266\") " pod="openshift-dns/dns-default-9klq9"
Jul 09 03:56:48.656854 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.656788    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fglgj\" (UniqueName: \"kubernetes.io/projected/6e5de089-67a0-409d-b5dc-4ac5c979b266-kube-api-access-fglgj\") pod \"dns-default-9klq9\" (UID: \"6e5de089-67a0-409d-b5dc-4ac5c979b266\") " pod="openshift-dns/dns-default-9klq9"
Jul 09 03:56:48.656854 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.656819    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clk5k\" (UniqueName: \"kubernetes.io/projected/6b55c1aa-edd7-4de7-8379-ec449c32ed67-kube-api-access-clk5k\") pod \"ingress-canary-89ht9\" (UID: \"6b55c1aa-edd7-4de7-8379-ec449c32ed67\") " pod="openshift-ingress-canary/ingress-canary-89ht9"
Jul 09 03:56:48.656854 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.656841    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6e5de089-67a0-409d-b5dc-4ac5c979b266-config-volume\") pod \"dns-default-9klq9\" (UID: \"6e5de089-67a0-409d-b5dc-4ac5c979b266\") " pod="openshift-dns/dns-default-9klq9"
Jul 09 03:56:48.657070 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.656980    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e5de089-67a0-409d-b5dc-4ac5c979b266-tmp-dir\") pod \"dns-default-9klq9\" (UID: \"6e5de089-67a0-409d-b5dc-4ac5c979b266\") " pod="openshift-dns/dns-default-9klq9"
Jul 09 03:56:48.657070 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.657013    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b55c1aa-edd7-4de7-8379-ec449c32ed67-cert\") pod \"ingress-canary-89ht9\" (UID: \"6b55c1aa-edd7-4de7-8379-ec449c32ed67\") " pod="openshift-ingress-canary/ingress-canary-89ht9"
Jul 09 03:56:48.657070 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.657045    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e5de089-67a0-409d-b5dc-4ac5c979b266-metrics-tls\") pod \"dns-default-9klq9\" (UID: \"6e5de089-67a0-409d-b5dc-4ac5c979b266\") " pod="openshift-dns/dns-default-9klq9"
Jul 09 03:56:48.657165 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:48.657154    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 03:56:48.657227 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:48.657216    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e5de089-67a0-409d-b5dc-4ac5c979b266-metrics-tls podName:6e5de089-67a0-409d-b5dc-4ac5c979b266 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:49.157198537 +0000 UTC m=+35.601328601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6e5de089-67a0-409d-b5dc-4ac5c979b266-metrics-tls") pod "dns-default-9klq9" (UID: "6e5de089-67a0-409d-b5dc-4ac5c979b266") : secret "dns-default-metrics-tls" not found
Jul 09 03:56:48.657278 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.657248    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e5de089-67a0-409d-b5dc-4ac5c979b266-tmp-dir\") pod \"dns-default-9klq9\" (UID: \"6e5de089-67a0-409d-b5dc-4ac5c979b266\") " pod="openshift-dns/dns-default-9klq9"
Jul 09 03:56:48.657449 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.657431    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6e5de089-67a0-409d-b5dc-4ac5c979b266-config-volume\") pod \"dns-default-9klq9\" (UID: \"6e5de089-67a0-409d-b5dc-4ac5c979b266\") " pod="openshift-dns/dns-default-9klq9"
Jul 09 03:56:48.661040 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.661015    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b55c1aa-edd7-4de7-8379-ec449c32ed67-cert\") pod \"ingress-canary-89ht9\" (UID: \"6b55c1aa-edd7-4de7-8379-ec449c32ed67\") " pod="openshift-ingress-canary/ingress-canary-89ht9"
Jul 09 03:56:48.665550 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.665525    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fglgj\" (UniqueName: \"kubernetes.io/projected/6e5de089-67a0-409d-b5dc-4ac5c979b266-kube-api-access-fglgj\") pod \"dns-default-9klq9\" (UID: \"6e5de089-67a0-409d-b5dc-4ac5c979b266\") " pod="openshift-dns/dns-default-9klq9"
Jul 09 03:56:48.665652 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.665558    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clk5k\" (UniqueName: \"kubernetes.io/projected/6b55c1aa-edd7-4de7-8379-ec449c32ed67-kube-api-access-clk5k\") pod \"ingress-canary-89ht9\" (UID: \"6b55c1aa-edd7-4de7-8379-ec449c32ed67\") " pod="openshift-ingress-canary/ingress-canary-89ht9"
Jul 09 03:56:48.727625 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.727597    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-89ht9"
Jul 09 03:56:48.882157 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:48.882123    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-89ht9"]
Jul 09 03:56:48.886196 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:48.886046    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b55c1aa_edd7_4de7_8379_ec449c32ed67.slice/crio-5f36f53b1413d625cac649d69f1e48700d83c6361b03d9a3d7e69bd768d6d8f9 WatchSource:0}: Error finding container 5f36f53b1413d625cac649d69f1e48700d83c6361b03d9a3d7e69bd768d6d8f9: Status 404 returned error can't find the container with id 5f36f53b1413d625cac649d69f1e48700d83c6361b03d9a3d7e69bd768d6d8f9
Jul 09 03:56:49.148816 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:49.148790    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:56:49.148816 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:49.148822    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:56:49.151988 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:49.151967    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 03:56:49.153128 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:49.153102    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 03:56:49.156136 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:49.153376    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 03:56:49.156136 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:49.153617    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vmr74\""
Jul 09 03:56:49.160226 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:49.160204    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e5de089-67a0-409d-b5dc-4ac5c979b266-metrics-tls\") pod \"dns-default-9klq9\" (UID: \"6e5de089-67a0-409d-b5dc-4ac5c979b266\") " pod="openshift-dns/dns-default-9klq9"
Jul 09 03:56:49.160349 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:49.160311    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 03:56:49.160410 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:49.160363    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e5de089-67a0-409d-b5dc-4ac5c979b266-metrics-tls podName:6e5de089-67a0-409d-b5dc-4ac5c979b266 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:50.160347544 +0000 UTC m=+36.604477596 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6e5de089-67a0-409d-b5dc-4ac5c979b266-metrics-tls") pod "dns-default-9klq9" (UID: "6e5de089-67a0-409d-b5dc-4ac5c979b266") : secret "dns-default-metrics-tls" not found
Jul 09 03:56:49.457516 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:49.457403    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-89ht9" event={"ID":"6b55c1aa-edd7-4de7-8379-ec449c32ed67","Type":"ContainerStarted","Data":"5f36f53b1413d625cac649d69f1e48700d83c6361b03d9a3d7e69bd768d6d8f9"}
Jul 09 03:56:50.149050 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:50.149011    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:56:50.152261 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:50.152236    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s6dbl\""
Jul 09 03:56:50.152500 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:50.152478    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 03:56:50.169163 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:50.169140    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e5de089-67a0-409d-b5dc-4ac5c979b266-metrics-tls\") pod \"dns-default-9klq9\" (UID: \"6e5de089-67a0-409d-b5dc-4ac5c979b266\") " pod="openshift-dns/dns-default-9klq9"
Jul 09 03:56:50.169300 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:50.169281    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 03:56:50.169388 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:50.169361    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e5de089-67a0-409d-b5dc-4ac5c979b266-metrics-tls podName:6e5de089-67a0-409d-b5dc-4ac5c979b266 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:52.169337684 +0000 UTC m=+38.613467740 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6e5de089-67a0-409d-b5dc-4ac5c979b266-metrics-tls") pod "dns-default-9klq9" (UID: "6e5de089-67a0-409d-b5dc-4ac5c979b266") : secret "dns-default-metrics-tls" not found
Jul 09 03:56:52.181208 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:52.181180    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e5de089-67a0-409d-b5dc-4ac5c979b266-metrics-tls\") pod \"dns-default-9klq9\" (UID: \"6e5de089-67a0-409d-b5dc-4ac5c979b266\") " pod="openshift-dns/dns-default-9klq9"
Jul 09 03:56:52.181560 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:52.181349    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 03:56:52.181560 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:52.181419    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e5de089-67a0-409d-b5dc-4ac5c979b266-metrics-tls podName:6e5de089-67a0-409d-b5dc-4ac5c979b266 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:56.181401412 +0000 UTC m=+42.625531476 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6e5de089-67a0-409d-b5dc-4ac5c979b266-metrics-tls") pod "dns-default-9klq9" (UID: "6e5de089-67a0-409d-b5dc-4ac5c979b266") : secret "dns-default-metrics-tls" not found
Jul 09 03:56:52.465817 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:52.465730    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-89ht9" event={"ID":"6b55c1aa-edd7-4de7-8379-ec449c32ed67","Type":"ContainerStarted","Data":"a2962ba14487347602e08bf9f34a586e9bb3a51d66216ca35c94070b70ff3bd2"}
Jul 09 03:56:52.468583 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:52.468558    2582 generic.go:356] "Generic (PLEG): container finished" podID="4b516d27-7195-483b-af5d-d68ba511a331" containerID="9872d236561d47aaef66e5ecd1828407ff9fda1c6a7c15cfdce7ef1274648c61" exitCode=0
Jul 09 03:56:52.468714 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:52.468591    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2dg7h" event={"ID":"4b516d27-7195-483b-af5d-d68ba511a331","Type":"ContainerDied","Data":"9872d236561d47aaef66e5ecd1828407ff9fda1c6a7c15cfdce7ef1274648c61"}
Jul 09 03:56:52.482142 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:52.482103    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-89ht9" podStartSLOduration=1.185973104 podStartE2EDuration="4.482087452s" totalImagesPullingTime="3.296114348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:56:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:56:52.481811763 +0000 UTC m=+38.925941836" watchObservedRunningTime="2026-07-09 03:56:52.482087452 +0000 UTC m=+38.926217526"
Jul 09 03:56:53.194740 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.193124    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-m78bd"]
Jul 09 03:56:53.213055 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.213033    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m78bd"]
Jul 09 03:56:53.213163 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.213126    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m78bd"
Jul 09 03:56:53.215604 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.215580    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 03:56:53.215719 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.215685    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kwlqq\""
Jul 09 03:56:53.215719 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.215685    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 03:56:53.217072 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.217055    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 03:56:53.217072 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.217071    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 03:56:53.290787 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.290762    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ddbc84e-053b-4692-8d2a-7312ffde9752-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m78bd\" (UID: \"3ddbc84e-053b-4692-8d2a-7312ffde9752\") " pod="openshift-insights/insights-runtime-extractor-m78bd"
Jul 09 03:56:53.290904 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.290789    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ddbc84e-053b-4692-8d2a-7312ffde9752-data-volume\") pod \"insights-runtime-extractor-m78bd\" (UID: \"3ddbc84e-053b-4692-8d2a-7312ffde9752\") " pod="openshift-insights/insights-runtime-extractor-m78bd"
Jul 09 03:56:53.290904 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.290807    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9rnz\" (UniqueName: \"kubernetes.io/projected/3ddbc84e-053b-4692-8d2a-7312ffde9752-kube-api-access-x9rnz\") pod \"insights-runtime-extractor-m78bd\" (UID: \"3ddbc84e-053b-4692-8d2a-7312ffde9752\") " pod="openshift-insights/insights-runtime-extractor-m78bd"
Jul 09 03:56:53.290904 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.290841    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3ddbc84e-053b-4692-8d2a-7312ffde9752-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m78bd\" (UID: \"3ddbc84e-053b-4692-8d2a-7312ffde9752\") " pod="openshift-insights/insights-runtime-extractor-m78bd"
Jul 09 03:56:53.291026 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.290935    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3ddbc84e-053b-4692-8d2a-7312ffde9752-crio-socket\") pod \"insights-runtime-extractor-m78bd\" (UID: \"3ddbc84e-053b-4692-8d2a-7312ffde9752\") " pod="openshift-insights/insights-runtime-extractor-m78bd"
Jul 09 03:56:53.344557 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.344535    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-tf5wr"]
Jul 09 03:56:53.366913 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.366878    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-tf5wr"
Jul 09 03:56:53.366913 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.366908    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-tf5wr"]
Jul 09 03:56:53.369567 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.369549    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-2mz4k\""
Jul 09 03:56:53.369660 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.369564    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 09 03:56:53.369660 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.369558    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 09 03:56:53.391541 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.391516    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ddbc84e-053b-4692-8d2a-7312ffde9752-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m78bd\" (UID: \"3ddbc84e-053b-4692-8d2a-7312ffde9752\") " pod="openshift-insights/insights-runtime-extractor-m78bd"
Jul 09 03:56:53.391541 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.391542    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ddbc84e-053b-4692-8d2a-7312ffde9752-data-volume\") pod \"insights-runtime-extractor-m78bd\" (UID: \"3ddbc84e-053b-4692-8d2a-7312ffde9752\") " pod="openshift-insights/insights-runtime-extractor-m78bd"
Jul 09 03:56:53.391656 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.391559    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9rnz\" (UniqueName: \"kubernetes.io/projected/3ddbc84e-053b-4692-8d2a-7312ffde9752-kube-api-access-x9rnz\") pod \"insights-runtime-extractor-m78bd\" (UID: \"3ddbc84e-053b-4692-8d2a-7312ffde9752\") " pod="openshift-insights/insights-runtime-extractor-m78bd"
Jul 09 03:56:53.391656 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.391622    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3ddbc84e-053b-4692-8d2a-7312ffde9752-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m78bd\" (UID: \"3ddbc84e-053b-4692-8d2a-7312ffde9752\") " pod="openshift-insights/insights-runtime-extractor-m78bd"
Jul 09 03:56:53.391716 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.391668    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3ddbc84e-053b-4692-8d2a-7312ffde9752-crio-socket\") pod \"insights-runtime-extractor-m78bd\" (UID: \"3ddbc84e-053b-4692-8d2a-7312ffde9752\") " pod="openshift-insights/insights-runtime-extractor-m78bd"
Jul 09 03:56:53.391778 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:53.391764    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 03:56:53.391820 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:53.391792    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 03:56:53.391820 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:53.391818    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3ddbc84e-053b-4692-8d2a-7312ffde9752-kube-rbac-proxy-cm podName:3ddbc84e-053b-4692-8d2a-7312ffde9752 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:53.891803024 +0000 UTC m=+40.335933075 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3ddbc84e-053b-4692-8d2a-7312ffde9752-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m78bd" (UID: "3ddbc84e-053b-4692-8d2a-7312ffde9752") : configmap "kube-rbac-proxy" not found
Jul 09 03:56:53.391916 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:53.391831    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ddbc84e-053b-4692-8d2a-7312ffde9752-insights-runtime-extractor-tls podName:3ddbc84e-053b-4692-8d2a-7312ffde9752 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:53.891825827 +0000 UTC m=+40.335955878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3ddbc84e-053b-4692-8d2a-7312ffde9752-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m78bd" (UID: "3ddbc84e-053b-4692-8d2a-7312ffde9752") : secret "insights-runtime-extractor-tls" not found
Jul 09 03:56:53.391960 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.391926    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3ddbc84e-053b-4692-8d2a-7312ffde9752-crio-socket\") pod \"insights-runtime-extractor-m78bd\" (UID: \"3ddbc84e-053b-4692-8d2a-7312ffde9752\") " pod="openshift-insights/insights-runtime-extractor-m78bd"
Jul 09 03:56:53.392075 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.392061    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ddbc84e-053b-4692-8d2a-7312ffde9752-data-volume\") pod \"insights-runtime-extractor-m78bd\" (UID: \"3ddbc84e-053b-4692-8d2a-7312ffde9752\") " pod="openshift-insights/insights-runtime-extractor-m78bd"
Jul 09 03:56:53.406645 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.406625    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9rnz\" (UniqueName: \"kubernetes.io/projected/3ddbc84e-053b-4692-8d2a-7312ffde9752-kube-api-access-x9rnz\") pod \"insights-runtime-extractor-m78bd\" (UID: \"3ddbc84e-053b-4692-8d2a-7312ffde9752\") " pod="openshift-insights/insights-runtime-extractor-m78bd"
Jul 09 03:56:53.474074 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.474011    2582 generic.go:356] "Generic (PLEG): container finished" podID="4b516d27-7195-483b-af5d-d68ba511a331" containerID="e92e81da897456d34c5d8ce04eecd9eb3cbc126c648e4924e7d953b42d1abf1c" exitCode=0
Jul 09 03:56:53.474168 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.474062    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2dg7h" event={"ID":"4b516d27-7195-483b-af5d-d68ba511a331","Type":"ContainerDied","Data":"e92e81da897456d34c5d8ce04eecd9eb3cbc126c648e4924e7d953b42d1abf1c"}
Jul 09 03:56:53.492756 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.492729    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rhb8\" (UniqueName: \"kubernetes.io/projected/1a6cb4fd-e8a1-4d8f-92d1-04b37ab2fc0e-kube-api-access-5rhb8\") pod \"migrator-d57d58cc9-tf5wr\" (UID: \"1a6cb4fd-e8a1-4d8f-92d1-04b37ab2fc0e\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-tf5wr"
Jul 09 03:56:53.593570 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.593545    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rhb8\" (UniqueName: \"kubernetes.io/projected/1a6cb4fd-e8a1-4d8f-92d1-04b37ab2fc0e-kube-api-access-5rhb8\") pod \"migrator-d57d58cc9-tf5wr\" (UID: \"1a6cb4fd-e8a1-4d8f-92d1-04b37ab2fc0e\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-tf5wr"
Jul 09 03:56:53.601175 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.601150    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rhb8\" (UniqueName: \"kubernetes.io/projected/1a6cb4fd-e8a1-4d8f-92d1-04b37ab2fc0e-kube-api-access-5rhb8\") pod \"migrator-d57d58cc9-tf5wr\" (UID: \"1a6cb4fd-e8a1-4d8f-92d1-04b37ab2fc0e\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-tf5wr"
Jul 09 03:56:53.674848 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.674825    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-tf5wr"
Jul 09 03:56:53.807421 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.807394    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-tf5wr"]
Jul 09 03:56:53.810008 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:53.809983    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a6cb4fd_e8a1_4d8f_92d1_04b37ab2fc0e.slice/crio-2dbecbd367a9ae7ce581390415ead7e59961e62535fa05e22a405958af5ba1e2 WatchSource:0}: Error finding container 2dbecbd367a9ae7ce581390415ead7e59961e62535fa05e22a405958af5ba1e2: Status 404 returned error can't find the container with id 2dbecbd367a9ae7ce581390415ead7e59961e62535fa05e22a405958af5ba1e2
Jul 09 03:56:53.895676 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.895649    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ddbc84e-053b-4692-8d2a-7312ffde9752-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m78bd\" (UID: \"3ddbc84e-053b-4692-8d2a-7312ffde9752\") " pod="openshift-insights/insights-runtime-extractor-m78bd"
Jul 09 03:56:53.895767 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:53.895702    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3ddbc84e-053b-4692-8d2a-7312ffde9752-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m78bd\" (UID: \"3ddbc84e-053b-4692-8d2a-7312ffde9752\") " pod="openshift-insights/insights-runtime-extractor-m78bd"
Jul 09 03:56:53.895803 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:53.895772    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 03:56:53.895803 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:53.895782    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 03:56:53.895865 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:53.895819    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3ddbc84e-053b-4692-8d2a-7312ffde9752-kube-rbac-proxy-cm podName:3ddbc84e-053b-4692-8d2a-7312ffde9752 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:54.895805379 +0000 UTC m=+41.339935429 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3ddbc84e-053b-4692-8d2a-7312ffde9752-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m78bd" (UID: "3ddbc84e-053b-4692-8d2a-7312ffde9752") : configmap "kube-rbac-proxy" not found
Jul 09 03:56:53.895865 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:53.895842    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ddbc84e-053b-4692-8d2a-7312ffde9752-insights-runtime-extractor-tls podName:3ddbc84e-053b-4692-8d2a-7312ffde9752 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:54.895828675 +0000 UTC m=+41.339958729 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3ddbc84e-053b-4692-8d2a-7312ffde9752-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m78bd" (UID: "3ddbc84e-053b-4692-8d2a-7312ffde9752") : secret "insights-runtime-extractor-tls" not found
Jul 09 03:56:54.477646 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:54.477609    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-tf5wr" event={"ID":"1a6cb4fd-e8a1-4d8f-92d1-04b37ab2fc0e","Type":"ContainerStarted","Data":"2dbecbd367a9ae7ce581390415ead7e59961e62535fa05e22a405958af5ba1e2"}
Jul 09 03:56:54.480523 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:54.480500    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2dg7h" event={"ID":"4b516d27-7195-483b-af5d-d68ba511a331","Type":"ContainerStarted","Data":"ce77831261fa9deff4527950244b1596ea905f58dc6812d351de047df5dc3e8f"}
Jul 09 03:56:54.502599 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:54.502563    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2dg7h" podStartSLOduration=8.413912261 podStartE2EDuration="40.502551994s" totalImagesPullingTime="32.088639733s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:56:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:56:54.500932667 +0000 UTC m=+40.945062740" watchObservedRunningTime="2026-07-09 03:56:54.502551994 +0000 UTC m=+40.946682079"
Jul 09 03:56:54.900505 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:54.900471    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ddbc84e-053b-4692-8d2a-7312ffde9752-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m78bd\" (UID: \"3ddbc84e-053b-4692-8d2a-7312ffde9752\") " pod="openshift-insights/insights-runtime-extractor-m78bd"
Jul 09 03:56:54.900640 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:54.900539    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3ddbc84e-053b-4692-8d2a-7312ffde9752-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m78bd\" (UID: \"3ddbc84e-053b-4692-8d2a-7312ffde9752\") " pod="openshift-insights/insights-runtime-extractor-m78bd"
Jul 09 03:56:54.900640 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:54.900625    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 03:56:54.900723 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:54.900682    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ddbc84e-053b-4692-8d2a-7312ffde9752-insights-runtime-extractor-tls podName:3ddbc84e-053b-4692-8d2a-7312ffde9752 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:56.900667948 +0000 UTC m=+43.344798002 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3ddbc84e-053b-4692-8d2a-7312ffde9752-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m78bd" (UID: "3ddbc84e-053b-4692-8d2a-7312ffde9752") : secret "insights-runtime-extractor-tls" not found
Jul 09 03:56:54.900723 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:54.900630    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 03:56:54.900723 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:54.900722    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3ddbc84e-053b-4692-8d2a-7312ffde9752-kube-rbac-proxy-cm podName:3ddbc84e-053b-4692-8d2a-7312ffde9752 nodeName:}" failed. No retries permitted until 2026-07-09 03:56:56.900714057 +0000 UTC m=+43.344844122 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3ddbc84e-053b-4692-8d2a-7312ffde9752-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m78bd" (UID: "3ddbc84e-053b-4692-8d2a-7312ffde9752") : configmap "kube-rbac-proxy" not found
Jul 09 03:56:54.935087 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:54.935061    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-ggwsg"]
Jul 09 03:56:54.954912 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:54.954872    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-ggwsg"]
Jul 09 03:56:54.955002 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:54.954966    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-ggwsg"
Jul 09 03:56:54.957715 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:54.957693    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 09 03:56:54.957715 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:54.957701    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 09 03:56:54.957873 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:54.957783    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 09 03:56:54.957873 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:54.957857    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 09 03:56:54.958008 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:54.957897    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-clmlq\""
Jul 09 03:56:55.101732 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:55.101687    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k5lb\" (UniqueName: \"kubernetes.io/projected/2c4edf70-d8a4-4dde-b7be-13781e81ac35-kube-api-access-4k5lb\") pod \"service-ca-758f599c5-ggwsg\" (UID: \"2c4edf70-d8a4-4dde-b7be-13781e81ac35\") " pod="openshift-service-ca/service-ca-758f599c5-ggwsg"
Jul 09 03:56:55.101732 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:55.101730    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2c4edf70-d8a4-4dde-b7be-13781e81ac35-signing-cabundle\") pod \"service-ca-758f599c5-ggwsg\" (UID: \"2c4edf70-d8a4-4dde-b7be-13781e81ac35\") " pod="openshift-service-ca/service-ca-758f599c5-ggwsg"
Jul 09 03:56:55.101993 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:55.101784    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2c4edf70-d8a4-4dde-b7be-13781e81ac35-signing-key\") pod \"service-ca-758f599c5-ggwsg\" (UID: \"2c4edf70-d8a4-4dde-b7be-13781e81ac35\") " pod="openshift-service-ca/service-ca-758f599c5-ggwsg"
Jul 09 03:56:55.202656 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:55.202561    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2c4edf70-d8a4-4dde-b7be-13781e81ac35-signing-key\") pod \"service-ca-758f599c5-ggwsg\" (UID: \"2c4edf70-d8a4-4dde-b7be-13781e81ac35\") " pod="openshift-service-ca/service-ca-758f599c5-ggwsg"
Jul 09 03:56:55.202829 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:55.202716    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k5lb\" (UniqueName: \"kubernetes.io/projected/2c4edf70-d8a4-4dde-b7be-13781e81ac35-kube-api-access-4k5lb\") pod \"service-ca-758f599c5-ggwsg\" (UID: \"2c4edf70-d8a4-4dde-b7be-13781e81ac35\") " pod="openshift-service-ca/service-ca-758f599c5-ggwsg"
Jul 09 03:56:55.202829 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:55.202750    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2c4edf70-d8a4-4dde-b7be-13781e81ac35-signing-cabundle\") pod \"service-ca-758f599c5-ggwsg\" (UID: \"2c4edf70-d8a4-4dde-b7be-13781e81ac35\") " pod="openshift-service-ca/service-ca-758f599c5-ggwsg"
Jul 09 03:56:55.203509 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:55.203483    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2c4edf70-d8a4-4dde-b7be-13781e81ac35-signing-cabundle\") pod \"service-ca-758f599c5-ggwsg\" (UID: \"2c4edf70-d8a4-4dde-b7be-13781e81ac35\") " pod="openshift-service-ca/service-ca-758f599c5-ggwsg"
Jul 09 03:56:55.205268 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:55.205245    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2c4edf70-d8a4-4dde-b7be-13781e81ac35-signing-key\") pod \"service-ca-758f599c5-ggwsg\" (UID: \"2c4edf70-d8a4-4dde-b7be-13781e81ac35\") " pod="openshift-service-ca/service-ca-758f599c5-ggwsg"
Jul 09 03:56:55.211431 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:55.211405    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k5lb\" (UniqueName: \"kubernetes.io/projected/2c4edf70-d8a4-4dde-b7be-13781e81ac35-kube-api-access-4k5lb\") pod \"service-ca-758f599c5-ggwsg\" (UID: \"2c4edf70-d8a4-4dde-b7be-13781e81ac35\") " pod="openshift-service-ca/service-ca-758f599c5-ggwsg"
Jul 09 03:56:55.265370 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:55.265338    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-ggwsg"
Jul 09 03:56:55.369286 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:55.369256    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xh8sc_6ee14835-1a14-4e38-aee4-078038e51d39/dns-node-resolver/0.log"
Jul 09 03:56:55.487180 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:55.487111    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-ggwsg"]
Jul 09 03:56:55.490289 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:56:55.490264    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c4edf70_d8a4_4dde_b7be_13781e81ac35.slice/crio-246c933a93b5873cb68f8eb9bb48ce06cd91f117dd149bd257c9d2e266ffceea WatchSource:0}: Error finding container 246c933a93b5873cb68f8eb9bb48ce06cd91f117dd149bd257c9d2e266ffceea: Status 404 returned error can't find the container with id 246c933a93b5873cb68f8eb9bb48ce06cd91f117dd149bd257c9d2e266ffceea
Jul 09 03:56:55.969500 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:55.969477    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7m8zc_5c0183f4-6c4a-4d0f-9455-79191c11022e/node-ca/0.log"
Jul 09 03:56:56.209992 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:56.209967    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e5de089-67a0-409d-b5dc-4ac5c979b266-metrics-tls\") pod \"dns-default-9klq9\" (UID: \"6e5de089-67a0-409d-b5dc-4ac5c979b266\") " pod="openshift-dns/dns-default-9klq9"
Jul 09 03:56:56.210146 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:56.210116    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 03:56:56.210200 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:56.210176    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e5de089-67a0-409d-b5dc-4ac5c979b266-metrics-tls podName:6e5de089-67a0-409d-b5dc-4ac5c979b266 nodeName:}" failed. No retries permitted until 2026-07-09 03:57:04.210158621 +0000 UTC m=+50.654288672 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6e5de089-67a0-409d-b5dc-4ac5c979b266-metrics-tls") pod "dns-default-9klq9" (UID: "6e5de089-67a0-409d-b5dc-4ac5c979b266") : secret "dns-default-metrics-tls" not found
Jul 09 03:56:56.487390 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:56.487306    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-tf5wr" event={"ID":"1a6cb4fd-e8a1-4d8f-92d1-04b37ab2fc0e","Type":"ContainerStarted","Data":"f8da6d59df73b5cb0d4e7bf5576aa8a9a963eb44f671703bcc44c09dee49570e"}
Jul 09 03:56:56.487390 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:56.487373    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-tf5wr" event={"ID":"1a6cb4fd-e8a1-4d8f-92d1-04b37ab2fc0e","Type":"ContainerStarted","Data":"d52aabcf9b53ca8a691b5025e136be13cf57063bedc07ea22f8eae6b37402bbf"}
Jul 09 03:56:56.488607 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:56.488580    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-ggwsg" event={"ID":"2c4edf70-d8a4-4dde-b7be-13781e81ac35","Type":"ContainerStarted","Data":"246c933a93b5873cb68f8eb9bb48ce06cd91f117dd149bd257c9d2e266ffceea"}
Jul 09 03:56:56.504605 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:56.504562    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-tf5wr" podStartSLOduration=1.574347827 podStartE2EDuration="3.504546691s" totalImagesPullingTime="1.930198864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:56:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:56:56.504000751 +0000 UTC m=+42.948130823" watchObservedRunningTime="2026-07-09 03:56:56.504546691 +0000 UTC m=+42.948676765"
Jul 09 03:56:56.770020 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:56.769950    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-89ht9_6b55c1aa-edd7-4de7-8379-ec449c32ed67/serve-healthcheck-canary/0.log"
Jul 09 03:56:56.915003 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:56.914970    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ddbc84e-053b-4692-8d2a-7312ffde9752-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m78bd\" (UID: \"3ddbc84e-053b-4692-8d2a-7312ffde9752\") " pod="openshift-insights/insights-runtime-extractor-m78bd"
Jul 09 03:56:56.915157 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:56.915044    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3ddbc84e-053b-4692-8d2a-7312ffde9752-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m78bd\" (UID: \"3ddbc84e-053b-4692-8d2a-7312ffde9752\") " pod="openshift-insights/insights-runtime-extractor-m78bd"
Jul 09 03:56:56.915157 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:56.915131    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 03:56:56.915333 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:56.915197    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3ddbc84e-053b-4692-8d2a-7312ffde9752-kube-rbac-proxy-cm podName:3ddbc84e-053b-4692-8d2a-7312ffde9752 nodeName:}" failed. No retries permitted until 2026-07-09 03:57:00.915175393 +0000 UTC m=+47.359305446 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3ddbc84e-053b-4692-8d2a-7312ffde9752-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m78bd" (UID: "3ddbc84e-053b-4692-8d2a-7312ffde9752") : configmap "kube-rbac-proxy" not found
Jul 09 03:56:56.915333 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:56.915150    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 03:56:56.915333 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:56:56.915260    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ddbc84e-053b-4692-8d2a-7312ffde9752-insights-runtime-extractor-tls podName:3ddbc84e-053b-4692-8d2a-7312ffde9752 nodeName:}" failed. No retries permitted until 2026-07-09 03:57:00.91524706 +0000 UTC m=+47.359377121 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3ddbc84e-053b-4692-8d2a-7312ffde9752-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m78bd" (UID: "3ddbc84e-053b-4692-8d2a-7312ffde9752") : secret "insights-runtime-extractor-tls" not found
Jul 09 03:56:58.495140 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:58.495038    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-ggwsg" event={"ID":"2c4edf70-d8a4-4dde-b7be-13781e81ac35","Type":"ContainerStarted","Data":"4cb6b4ee2d5312ac8950c2eec9c6eb6a129af51b98316f96ad50f2494808f608"}
Jul 09 03:56:58.512176 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:56:58.512128    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-ggwsg" podStartSLOduration=1.9013437149999999 podStartE2EDuration="4.512113189s" totalImagesPullingTime="2.610769474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:56:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:56:58.511720402 +0000 UTC m=+44.955850477" watchObservedRunningTime="2026-07-09 03:56:58.512113189 +0000 UTC m=+44.956243241"
Jul 09 03:57:00.950095 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:00.950058    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ddbc84e-053b-4692-8d2a-7312ffde9752-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m78bd\" (UID: \"3ddbc84e-053b-4692-8d2a-7312ffde9752\") " pod="openshift-insights/insights-runtime-extractor-m78bd"
Jul 09 03:57:00.950561 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:00.950125    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3ddbc84e-053b-4692-8d2a-7312ffde9752-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m78bd\" (UID: \"3ddbc84e-053b-4692-8d2a-7312ffde9752\") " pod="openshift-insights/insights-runtime-extractor-m78bd"
Jul 09 03:57:00.950561 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:57:00.950197    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 03:57:00.950561 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:57:00.950238    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 03:57:00.950561 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:57:00.950263    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ddbc84e-053b-4692-8d2a-7312ffde9752-insights-runtime-extractor-tls podName:3ddbc84e-053b-4692-8d2a-7312ffde9752 nodeName:}" failed. No retries permitted until 2026-07-09 03:57:08.950248003 +0000 UTC m=+55.394378054 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3ddbc84e-053b-4692-8d2a-7312ffde9752-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m78bd" (UID: "3ddbc84e-053b-4692-8d2a-7312ffde9752") : secret "insights-runtime-extractor-tls" not found
Jul 09 03:57:00.950561 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:57:00.950281    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3ddbc84e-053b-4692-8d2a-7312ffde9752-kube-rbac-proxy-cm podName:3ddbc84e-053b-4692-8d2a-7312ffde9752 nodeName:}" failed. No retries permitted until 2026-07-09 03:57:08.950269616 +0000 UTC m=+55.394399675 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3ddbc84e-053b-4692-8d2a-7312ffde9752-kube-rbac-proxy-cm") pod "insights-runtime-extractor-m78bd" (UID: "3ddbc84e-053b-4692-8d2a-7312ffde9752") : configmap "kube-rbac-proxy" not found
Jul 09 03:57:04.276484 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:04.276452    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e5de089-67a0-409d-b5dc-4ac5c979b266-metrics-tls\") pod \"dns-default-9klq9\" (UID: \"6e5de089-67a0-409d-b5dc-4ac5c979b266\") " pod="openshift-dns/dns-default-9klq9"
Jul 09 03:57:04.278701 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:04.278683    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6e5de089-67a0-409d-b5dc-4ac5c979b266-metrics-tls\") pod \"dns-default-9klq9\" (UID: \"6e5de089-67a0-409d-b5dc-4ac5c979b266\") " pod="openshift-dns/dns-default-9klq9"
Jul 09 03:57:04.319807 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:04.319779    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9klq9"
Jul 09 03:57:04.459986 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:04.459954    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9klq9"]
Jul 09 03:57:04.462803 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:57:04.462780    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e5de089_67a0_409d_b5dc_4ac5c979b266.slice/crio-bd843f9cd9170ac1b021d3419e23f213f355231d3b4c7280849acb5bab860f62 WatchSource:0}: Error finding container bd843f9cd9170ac1b021d3419e23f213f355231d3b4c7280849acb5bab860f62: Status 404 returned error can't find the container with id bd843f9cd9170ac1b021d3419e23f213f355231d3b4c7280849acb5bab860f62
Jul 09 03:57:04.511111 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:04.511084    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9klq9" event={"ID":"6e5de089-67a0-409d-b5dc-4ac5c979b266","Type":"ContainerStarted","Data":"bd843f9cd9170ac1b021d3419e23f213f355231d3b4c7280849acb5bab860f62"}
Jul 09 03:57:07.521455 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:07.521417    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9klq9" event={"ID":"6e5de089-67a0-409d-b5dc-4ac5c979b266","Type":"ContainerStarted","Data":"32c43f6b18d06162f5ae9643e200553a9a344eeb4ddbf1c76fbd1b4ccf7df1e8"}
Jul 09 03:57:07.521812 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:07.521520    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9klq9" event={"ID":"6e5de089-67a0-409d-b5dc-4ac5c979b266","Type":"ContainerStarted","Data":"11c8121c7954fa93b611db6cb56c69d98f30c0bc2746664b5cda829840844c1f"}
Jul 09 03:57:07.521812 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:07.521550    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9klq9"
Jul 09 03:57:07.539818 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:07.539776    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9klq9" podStartSLOduration=16.951725574 podStartE2EDuration="19.539762908s" totalImagesPullingTime="2.588037334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:56:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:57:07.538149432 +0000 UTC m=+53.982279508" watchObservedRunningTime="2026-07-09 03:57:07.539762908 +0000 UTC m=+53.983892959"
Jul 09 03:57:09.014038 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:09.014006    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ddbc84e-053b-4692-8d2a-7312ffde9752-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m78bd\" (UID: \"3ddbc84e-053b-4692-8d2a-7312ffde9752\") " pod="openshift-insights/insights-runtime-extractor-m78bd"
Jul 09 03:57:09.014399 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:09.014052    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3ddbc84e-053b-4692-8d2a-7312ffde9752-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m78bd\" (UID: \"3ddbc84e-053b-4692-8d2a-7312ffde9752\") " pod="openshift-insights/insights-runtime-extractor-m78bd"
Jul 09 03:57:09.014399 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:57:09.014152    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 03:57:09.014399 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:57:09.014223    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ddbc84e-053b-4692-8d2a-7312ffde9752-insights-runtime-extractor-tls podName:3ddbc84e-053b-4692-8d2a-7312ffde9752 nodeName:}" failed. No retries permitted until 2026-07-09 03:57:25.014204333 +0000 UTC m=+71.458334399 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3ddbc84e-053b-4692-8d2a-7312ffde9752-insights-runtime-extractor-tls") pod "insights-runtime-extractor-m78bd" (UID: "3ddbc84e-053b-4692-8d2a-7312ffde9752") : secret "insights-runtime-extractor-tls" not found
Jul 09 03:57:09.014610 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:09.014592    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3ddbc84e-053b-4692-8d2a-7312ffde9752-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-m78bd\" (UID: \"3ddbc84e-053b-4692-8d2a-7312ffde9752\") " pod="openshift-insights/insights-runtime-extractor-m78bd"
Jul 09 03:57:15.453971 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.453940    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9jc2"
Jul 09 03:57:15.611648 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.611619    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849958c59c-jb22m"]
Jul 09 03:57:15.614240 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.614224    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849958c59c-jb22m"
Jul 09 03:57:15.616974 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.616953    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 09 03:57:15.617105 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.617090    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 09 03:57:15.617147 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.617088    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 09 03:57:15.617363 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.617348    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 09 03:57:15.617435 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.617404    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 09 03:57:15.617479 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.617463    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 09 03:57:15.617524 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.617475    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 09 03:57:15.626118 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.626097    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849958c59c-jb22m"]
Jul 09 03:57:15.658041 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.658020    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/bbfd0eff-1a9b-48c1-91b5-8850f0de8168-ca\") pod \"cluster-proxy-proxy-agent-849958c59c-jb22m\" (UID: \"bbfd0eff-1a9b-48c1-91b5-8850f0de8168\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849958c59c-jb22m"
Jul 09 03:57:15.658154 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.658057    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/bbfd0eff-1a9b-48c1-91b5-8850f0de8168-hub\") pod \"cluster-proxy-proxy-agent-849958c59c-jb22m\" (UID: \"bbfd0eff-1a9b-48c1-91b5-8850f0de8168\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849958c59c-jb22m"
Jul 09 03:57:15.658154 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.658081    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/bbfd0eff-1a9b-48c1-91b5-8850f0de8168-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-849958c59c-jb22m\" (UID: \"bbfd0eff-1a9b-48c1-91b5-8850f0de8168\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849958c59c-jb22m"
Jul 09 03:57:15.658154 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.658105    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mbqd\" (UniqueName: \"kubernetes.io/projected/bbfd0eff-1a9b-48c1-91b5-8850f0de8168-kube-api-access-7mbqd\") pod \"cluster-proxy-proxy-agent-849958c59c-jb22m\" (UID: \"bbfd0eff-1a9b-48c1-91b5-8850f0de8168\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849958c59c-jb22m"
Jul 09 03:57:15.658306 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.658154    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bbfd0eff-1a9b-48c1-91b5-8850f0de8168-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-849958c59c-jb22m\" (UID: \"bbfd0eff-1a9b-48c1-91b5-8850f0de8168\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849958c59c-jb22m"
Jul 09 03:57:15.658306 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.658233    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbfd0eff-1a9b-48c1-91b5-8850f0de8168-additional-service-ca\") pod \"cluster-proxy-proxy-agent-849958c59c-jb22m\" (UID: \"bbfd0eff-1a9b-48c1-91b5-8850f0de8168\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849958c59c-jb22m"
Jul 09 03:57:15.758644 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.758592    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/bbfd0eff-1a9b-48c1-91b5-8850f0de8168-ca\") pod \"cluster-proxy-proxy-agent-849958c59c-jb22m\" (UID: \"bbfd0eff-1a9b-48c1-91b5-8850f0de8168\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849958c59c-jb22m"
Jul 09 03:57:15.758644 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.758627    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/bbfd0eff-1a9b-48c1-91b5-8850f0de8168-hub\") pod \"cluster-proxy-proxy-agent-849958c59c-jb22m\" (UID: \"bbfd0eff-1a9b-48c1-91b5-8850f0de8168\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849958c59c-jb22m"
Jul 09 03:57:15.758770 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.758648    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/bbfd0eff-1a9b-48c1-91b5-8850f0de8168-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-849958c59c-jb22m\" (UID: \"bbfd0eff-1a9b-48c1-91b5-8850f0de8168\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849958c59c-jb22m"
Jul 09 03:57:15.758770 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.758673    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mbqd\" (UniqueName: \"kubernetes.io/projected/bbfd0eff-1a9b-48c1-91b5-8850f0de8168-kube-api-access-7mbqd\") pod \"cluster-proxy-proxy-agent-849958c59c-jb22m\" (UID: \"bbfd0eff-1a9b-48c1-91b5-8850f0de8168\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849958c59c-jb22m"
Jul 09 03:57:15.758770 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.758700    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bbfd0eff-1a9b-48c1-91b5-8850f0de8168-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-849958c59c-jb22m\" (UID: \"bbfd0eff-1a9b-48c1-91b5-8850f0de8168\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849958c59c-jb22m"
Jul 09 03:57:15.758770 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.758740    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbfd0eff-1a9b-48c1-91b5-8850f0de8168-additional-service-ca\") pod \"cluster-proxy-proxy-agent-849958c59c-jb22m\" (UID: \"bbfd0eff-1a9b-48c1-91b5-8850f0de8168\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849958c59c-jb22m"
Jul 09 03:57:15.759385 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.759365    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbfd0eff-1a9b-48c1-91b5-8850f0de8168-additional-service-ca\") pod \"cluster-proxy-proxy-agent-849958c59c-jb22m\" (UID: \"bbfd0eff-1a9b-48c1-91b5-8850f0de8168\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849958c59c-jb22m"
Jul 09 03:57:15.761290 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.761267    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/bbfd0eff-1a9b-48c1-91b5-8850f0de8168-hub\") pod \"cluster-proxy-proxy-agent-849958c59c-jb22m\" (UID: \"bbfd0eff-1a9b-48c1-91b5-8850f0de8168\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849958c59c-jb22m"
Jul 09 03:57:15.761368 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.761324    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bbfd0eff-1a9b-48c1-91b5-8850f0de8168-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-849958c59c-jb22m\" (UID: \"bbfd0eff-1a9b-48c1-91b5-8850f0de8168\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849958c59c-jb22m"
Jul 09 03:57:15.761368 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.761339    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/bbfd0eff-1a9b-48c1-91b5-8850f0de8168-ca\") pod \"cluster-proxy-proxy-agent-849958c59c-jb22m\" (UID: \"bbfd0eff-1a9b-48c1-91b5-8850f0de8168\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849958c59c-jb22m"
Jul 09 03:57:15.761727 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.761708    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/bbfd0eff-1a9b-48c1-91b5-8850f0de8168-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-849958c59c-jb22m\" (UID: \"bbfd0eff-1a9b-48c1-91b5-8850f0de8168\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849958c59c-jb22m"
Jul 09 03:57:15.766337 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.766316    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mbqd\" (UniqueName: \"kubernetes.io/projected/bbfd0eff-1a9b-48c1-91b5-8850f0de8168-kube-api-access-7mbqd\") pod \"cluster-proxy-proxy-agent-849958c59c-jb22m\" (UID: \"bbfd0eff-1a9b-48c1-91b5-8850f0de8168\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849958c59c-jb22m"
Jul 09 03:57:15.934005 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:15.933981    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849958c59c-jb22m"
Jul 09 03:57:16.058239 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:16.058207    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849958c59c-jb22m"]
Jul 09 03:57:16.061312 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:57:16.061285    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbfd0eff_1a9b_48c1_91b5_8850f0de8168.slice/crio-921b2e997265bdde2e9ea073415b673b3d53693b64a62f902c219fdef16d69ff WatchSource:0}: Error finding container 921b2e997265bdde2e9ea073415b673b3d53693b64a62f902c219fdef16d69ff: Status 404 returned error can't find the container with id 921b2e997265bdde2e9ea073415b673b3d53693b64a62f902c219fdef16d69ff
Jul 09 03:57:16.549537 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:16.549500    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849958c59c-jb22m" event={"ID":"bbfd0eff-1a9b-48c1-91b5-8850f0de8168","Type":"ContainerStarted","Data":"921b2e997265bdde2e9ea073415b673b3d53693b64a62f902c219fdef16d69ff"}
Jul 09 03:57:17.526824 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:17.526797    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9klq9"
Jul 09 03:57:18.881842 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:18.881808    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/babf27a7-be72-48d0-b348-d2697acd6584-original-pull-secret\") pod \"global-pull-secret-syncer-pckd6\" (UID: \"babf27a7-be72-48d0-b348-d2697acd6584\") " pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:57:18.882256 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:18.881929    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf8932b3-3cac-4cb8-a827-361f7df4639d-metrics-certs\") pod \"network-metrics-daemon-7tm6g\" (UID: \"bf8932b3-3cac-4cb8-a827-361f7df4639d\") " pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:57:18.885063 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:18.885041    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 03:57:18.886134 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:18.886115    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 03:57:18.894661 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:18.894637    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/babf27a7-be72-48d0-b348-d2697acd6584-original-pull-secret\") pod \"global-pull-secret-syncer-pckd6\" (UID: \"babf27a7-be72-48d0-b348-d2697acd6584\") " pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:57:18.894753 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:18.894665    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf8932b3-3cac-4cb8-a827-361f7df4639d-metrics-certs\") pod \"network-metrics-daemon-7tm6g\" (UID: \"bf8932b3-3cac-4cb8-a827-361f7df4639d\") " pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:57:18.963440 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:18.963412    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s6dbl\""
Jul 09 03:57:18.971592 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:18.971571    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7tm6g"
Jul 09 03:57:18.982840 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:18.982809    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m24z\" (UniqueName: \"kubernetes.io/projected/846ebd25-184d-41b4-a8cc-4e7775766ec5-kube-api-access-2m24z\") pod \"network-check-target-x4hpr\" (UID: \"846ebd25-184d-41b4-a8cc-4e7775766ec5\") " pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:57:18.985623 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:18.985603    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 03:57:18.996111 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:18.996088    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 03:57:19.006995 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:19.006973    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m24z\" (UniqueName: \"kubernetes.io/projected/846ebd25-184d-41b4-a8cc-4e7775766ec5-kube-api-access-2m24z\") pod \"network-check-target-x4hpr\" (UID: \"846ebd25-184d-41b4-a8cc-4e7775766ec5\") " pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:57:19.167945 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:19.167849    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vmr74\""
Jul 09 03:57:19.169995 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:19.169965    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pckd6"
Jul 09 03:57:19.176107 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:19.176086    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:57:20.042927 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:20.042839    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-x4hpr"]
Jul 09 03:57:20.047746 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:57:20.047720    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod846ebd25_184d_41b4_a8cc_4e7775766ec5.slice/crio-f1fd9fd79e926e6cbae6c3308c35a475d74f6908cd24f38c827cd0924f3b4024 WatchSource:0}: Error finding container f1fd9fd79e926e6cbae6c3308c35a475d74f6908cd24f38c827cd0924f3b4024: Status 404 returned error can't find the container with id f1fd9fd79e926e6cbae6c3308c35a475d74f6908cd24f38c827cd0924f3b4024
Jul 09 03:57:20.265422 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:20.265339    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pckd6"]
Jul 09 03:57:20.268265 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:57:20.268235    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbabf27a7_be72_48d0_b348_d2697acd6584.slice/crio-a15f15d44714410003d4edbe1074f16f7608e0ee082f9611e6cb5626df6cbb1b WatchSource:0}: Error finding container a15f15d44714410003d4edbe1074f16f7608e0ee082f9611e6cb5626df6cbb1b: Status 404 returned error can't find the container with id a15f15d44714410003d4edbe1074f16f7608e0ee082f9611e6cb5626df6cbb1b
Jul 09 03:57:20.268410 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:20.268381    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7tm6g"]
Jul 09 03:57:20.271016 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:57:20.270995    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf8932b3_3cac_4cb8_a827_361f7df4639d.slice/crio-6ced4135d3ad761e042c348880c1914ce0f16227d8ca918c2c04198926b65a86 WatchSource:0}: Error finding container 6ced4135d3ad761e042c348880c1914ce0f16227d8ca918c2c04198926b65a86: Status 404 returned error can't find the container with id 6ced4135d3ad761e042c348880c1914ce0f16227d8ca918c2c04198926b65a86
Jul 09 03:57:20.564277 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:20.564195    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x4hpr" event={"ID":"846ebd25-184d-41b4-a8cc-4e7775766ec5","Type":"ContainerStarted","Data":"f1fd9fd79e926e6cbae6c3308c35a475d74f6908cd24f38c827cd0924f3b4024"}
Jul 09 03:57:20.566597 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:20.566568    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849958c59c-jb22m" event={"ID":"bbfd0eff-1a9b-48c1-91b5-8850f0de8168","Type":"ContainerStarted","Data":"4ac734cfc489a8695b640f019e5183019951a299162e223764b64e1f11936074"}
Jul 09 03:57:20.566722 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:20.566607    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849958c59c-jb22m" event={"ID":"bbfd0eff-1a9b-48c1-91b5-8850f0de8168","Type":"ContainerStarted","Data":"aa2be67d1c2a3fa092b842f628102adf21cb972ece5cac89a3211d12b9d5f80e"}
Jul 09 03:57:20.566722 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:20.566621    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849958c59c-jb22m" event={"ID":"bbfd0eff-1a9b-48c1-91b5-8850f0de8168","Type":"ContainerStarted","Data":"4b6b3b15cb2f91fe4cfba374681a82ebfb1481b9c5b6264ad585399bc86bf7e7"}
Jul 09 03:57:20.567931 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:20.567904    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7tm6g" event={"ID":"bf8932b3-3cac-4cb8-a827-361f7df4639d","Type":"ContainerStarted","Data":"6ced4135d3ad761e042c348880c1914ce0f16227d8ca918c2c04198926b65a86"}
Jul 09 03:57:20.569015 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:20.568989    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pckd6" event={"ID":"babf27a7-be72-48d0-b348-d2697acd6584","Type":"ContainerStarted","Data":"a15f15d44714410003d4edbe1074f16f7608e0ee082f9611e6cb5626df6cbb1b"}
Jul 09 03:57:20.585087 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:20.585047    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-849958c59c-jb22m" podStartSLOduration=1.700700369 podStartE2EDuration="5.585032995s" totalImagesPullingTime="3.884332626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:57:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:57:20.584096611 +0000 UTC m=+67.028226684" watchObservedRunningTime="2026-07-09 03:57:20.585032995 +0000 UTC m=+67.029163117"
Jul 09 03:57:22.579442 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:22.579402    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7tm6g" event={"ID":"bf8932b3-3cac-4cb8-a827-361f7df4639d","Type":"ContainerStarted","Data":"9fa905db4145374698a1884e241c72355cddaa2157541836923ee2d9913bad28"}
Jul 09 03:57:22.580003 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:22.579468    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7tm6g" event={"ID":"bf8932b3-3cac-4cb8-a827-361f7df4639d","Type":"ContainerStarted","Data":"b9cdef75c6a468cee65ccc17d7b8546bf2d8ac6f585c8f39ed826273338a16db"}
Jul 09 03:57:22.594599 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:22.594547    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7tm6g" podStartSLOduration=67.033767254 podStartE2EDuration="1m8.594528303s" totalImagesPullingTime="1.560761049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:57:22.593943869 +0000 UTC m=+69.038073943" watchObservedRunningTime="2026-07-09 03:57:22.594528303 +0000 UTC m=+69.038658377"
Jul 09 03:57:25.026712 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:25.026630    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ddbc84e-053b-4692-8d2a-7312ffde9752-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m78bd\" (UID: \"3ddbc84e-053b-4692-8d2a-7312ffde9752\") " pod="openshift-insights/insights-runtime-extractor-m78bd"
Jul 09 03:57:25.028926 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:25.028903    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3ddbc84e-053b-4692-8d2a-7312ffde9752-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-m78bd\" (UID: \"3ddbc84e-053b-4692-8d2a-7312ffde9752\") " pod="openshift-insights/insights-runtime-extractor-m78bd"
Jul 09 03:57:25.324160 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:25.324077    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kwlqq\""
Jul 09 03:57:25.332435 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:25.332414    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-m78bd"
Jul 09 03:57:25.452045 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:25.452016    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-m78bd"]
Jul 09 03:57:25.454689 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:57:25.454670    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ddbc84e_053b_4692_8d2a_7312ffde9752.slice/crio-8726769446d4ea691e7580fbbb3a71bffd13be1c0ae8e05dc440affda4d98dce WatchSource:0}: Error finding container 8726769446d4ea691e7580fbbb3a71bffd13be1c0ae8e05dc440affda4d98dce: Status 404 returned error can't find the container with id 8726769446d4ea691e7580fbbb3a71bffd13be1c0ae8e05dc440affda4d98dce
Jul 09 03:57:25.593412 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:25.593341    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pckd6" event={"ID":"babf27a7-be72-48d0-b348-d2697acd6584","Type":"ContainerStarted","Data":"786fb21c406f78632db683555c6e497f8d27ca0bae50baf887dba6385fefbfbf"}
Jul 09 03:57:25.594848 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:25.594824    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-x4hpr" event={"ID":"846ebd25-184d-41b4-a8cc-4e7775766ec5","Type":"ContainerStarted","Data":"3356b43f8c034e2af00189ff9389359cc7719e98e1bb065b7233e7ad4463e211"}
Jul 09 03:57:25.594972 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:25.594874    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:57:25.595921 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:25.595902    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m78bd" event={"ID":"3ddbc84e-053b-4692-8d2a-7312ffde9752","Type":"ContainerStarted","Data":"8726769446d4ea691e7580fbbb3a71bffd13be1c0ae8e05dc440affda4d98dce"}
Jul 09 03:57:25.608042 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:25.608006    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pckd6" podStartSLOduration=67.206983028 podStartE2EDuration="1m11.607995573s" totalImagesPullingTime="4.401012545s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:57:25.607421198 +0000 UTC m=+72.051551271" watchObservedRunningTime="2026-07-09 03:57:25.607995573 +0000 UTC m=+72.052125656"
Jul 09 03:57:25.622083 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:25.622045    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-x4hpr" podStartSLOduration=67.004427108 podStartE2EDuration="1m11.622033487s" totalImagesPullingTime="4.617606379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 03:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:57:25.621395034 +0000 UTC m=+72.065525106" watchObservedRunningTime="2026-07-09 03:57:25.622033487 +0000 UTC m=+72.066163570"
Jul 09 03:57:29.612145 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:29.612109    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m78bd" event={"ID":"3ddbc84e-053b-4692-8d2a-7312ffde9752","Type":"ContainerStarted","Data":"a0fa7d862dccbea4d010bac92f221295d9c3ab7dc2f82dd1a28c48a2186b0068"}
Jul 09 03:57:30.617908 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:30.617848    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m78bd" event={"ID":"3ddbc84e-053b-4692-8d2a-7312ffde9752","Type":"ContainerStarted","Data":"c0e8d295be03a33f5b3ce63fa3ea3b8bc0637b287d868effabab0dff1acddebc"}
Jul 09 03:57:32.626981 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:32.626946    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-m78bd" event={"ID":"3ddbc84e-053b-4692-8d2a-7312ffde9752","Type":"ContainerStarted","Data":"bf5fd1f2b64204c2697364ff92a4a80d448af2d40a587735b3dfee1d3b3e2a98"}
Jul 09 03:57:32.648142 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:32.648098    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-m78bd" podStartSLOduration=32.929987509 podStartE2EDuration="39.648085757s" totalImagesPullingTime="6.718098248s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 03:56:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:57:32.647297118 +0000 UTC m=+79.091427192" watchObservedRunningTime="2026-07-09 03:57:32.648085757 +0000 UTC m=+79.092215841"
Jul 09 03:57:34.610499 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.610465    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hcs2f"]
Jul 09 03:57:34.613980 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.613959    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.616970 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.616937    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 03:57:34.618207 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.618176    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 03:57:34.618207 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.618200    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 03:57:34.618378 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.618217    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 03:57:34.618378 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.618244    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6gkkq\""
Jul 09 03:57:34.618378 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.618340    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 03:57:34.618553 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.618378    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 03:57:34.692461 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.692436    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e7fce95-2eaa-4b3b-a7bb-86db7a41b637-node-exporter-textfile\") pod \"node-exporter-hcs2f\" (UID: \"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637\") " pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.692599 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.692474    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s28xq\" (UniqueName: \"kubernetes.io/projected/6e7fce95-2eaa-4b3b-a7bb-86db7a41b637-kube-api-access-s28xq\") pod \"node-exporter-hcs2f\" (UID: \"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637\") " pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.692599 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.692505    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e7fce95-2eaa-4b3b-a7bb-86db7a41b637-root\") pod \"node-exporter-hcs2f\" (UID: \"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637\") " pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.692599 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.692555    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e7fce95-2eaa-4b3b-a7bb-86db7a41b637-node-exporter-wtmp\") pod \"node-exporter-hcs2f\" (UID: \"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637\") " pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.692599 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.692593    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e7fce95-2eaa-4b3b-a7bb-86db7a41b637-metrics-client-ca\") pod \"node-exporter-hcs2f\" (UID: \"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637\") " pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.692750 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.692627    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e7fce95-2eaa-4b3b-a7bb-86db7a41b637-sys\") pod \"node-exporter-hcs2f\" (UID: \"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637\") " pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.692750 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.692655    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e7fce95-2eaa-4b3b-a7bb-86db7a41b637-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hcs2f\" (UID: \"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637\") " pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.692750 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.692712    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e7fce95-2eaa-4b3b-a7bb-86db7a41b637-node-exporter-accelerators-collector-config\") pod \"node-exporter-hcs2f\" (UID: \"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637\") " pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.692750 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.692739    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e7fce95-2eaa-4b3b-a7bb-86db7a41b637-node-exporter-tls\") pod \"node-exporter-hcs2f\" (UID: \"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637\") " pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.793710 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.793682    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e7fce95-2eaa-4b3b-a7bb-86db7a41b637-node-exporter-accelerators-collector-config\") pod \"node-exporter-hcs2f\" (UID: \"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637\") " pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.793853 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.793718    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e7fce95-2eaa-4b3b-a7bb-86db7a41b637-node-exporter-tls\") pod \"node-exporter-hcs2f\" (UID: \"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637\") " pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.793853 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.793735    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e7fce95-2eaa-4b3b-a7bb-86db7a41b637-node-exporter-textfile\") pod \"node-exporter-hcs2f\" (UID: \"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637\") " pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.793853 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.793751    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s28xq\" (UniqueName: \"kubernetes.io/projected/6e7fce95-2eaa-4b3b-a7bb-86db7a41b637-kube-api-access-s28xq\") pod \"node-exporter-hcs2f\" (UID: \"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637\") " pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.793853 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.793778    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e7fce95-2eaa-4b3b-a7bb-86db7a41b637-root\") pod \"node-exporter-hcs2f\" (UID: \"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637\") " pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.793853 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.793799    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e7fce95-2eaa-4b3b-a7bb-86db7a41b637-node-exporter-wtmp\") pod \"node-exporter-hcs2f\" (UID: \"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637\") " pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.793853 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.793825    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e7fce95-2eaa-4b3b-a7bb-86db7a41b637-metrics-client-ca\") pod \"node-exporter-hcs2f\" (UID: \"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637\") " pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.794180 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.793865    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e7fce95-2eaa-4b3b-a7bb-86db7a41b637-sys\") pod \"node-exporter-hcs2f\" (UID: \"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637\") " pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.794180 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.793919    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e7fce95-2eaa-4b3b-a7bb-86db7a41b637-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hcs2f\" (UID: \"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637\") " pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.794180 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.794035    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6e7fce95-2eaa-4b3b-a7bb-86db7a41b637-node-exporter-wtmp\") pod \"node-exporter-hcs2f\" (UID: \"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637\") " pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.794331 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.794222    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e7fce95-2eaa-4b3b-a7bb-86db7a41b637-sys\") pod \"node-exporter-hcs2f\" (UID: \"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637\") " pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.794331 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.794273    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6e7fce95-2eaa-4b3b-a7bb-86db7a41b637-root\") pod \"node-exporter-hcs2f\" (UID: \"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637\") " pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.794433 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.794337    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6e7fce95-2eaa-4b3b-a7bb-86db7a41b637-node-exporter-textfile\") pod \"node-exporter-hcs2f\" (UID: \"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637\") " pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.794433 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.794405    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6e7fce95-2eaa-4b3b-a7bb-86db7a41b637-node-exporter-accelerators-collector-config\") pod \"node-exporter-hcs2f\" (UID: \"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637\") " pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.794629 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.794606    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e7fce95-2eaa-4b3b-a7bb-86db7a41b637-metrics-client-ca\") pod \"node-exporter-hcs2f\" (UID: \"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637\") " pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.796769 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.796747    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6e7fce95-2eaa-4b3b-a7bb-86db7a41b637-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hcs2f\" (UID: \"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637\") " pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.796907 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.796765    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6e7fce95-2eaa-4b3b-a7bb-86db7a41b637-node-exporter-tls\") pod \"node-exporter-hcs2f\" (UID: \"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637\") " pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.805121 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.805095    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s28xq\" (UniqueName: \"kubernetes.io/projected/6e7fce95-2eaa-4b3b-a7bb-86db7a41b637-kube-api-access-s28xq\") pod \"node-exporter-hcs2f\" (UID: \"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637\") " pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.925210 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:34.925147    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hcs2f"
Jul 09 03:57:34.937408 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:57:34.937372    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e7fce95_2eaa_4b3b_a7bb_86db7a41b637.slice/crio-bca006508f21b34e1cd80c4e5fd812dce792a5a79f3f9249824af85f3006b49e WatchSource:0}: Error finding container bca006508f21b34e1cd80c4e5fd812dce792a5a79f3f9249824af85f3006b49e: Status 404 returned error can't find the container with id bca006508f21b34e1cd80c4e5fd812dce792a5a79f3f9249824af85f3006b49e
Jul 09 03:57:35.638336 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:35.638299    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hcs2f" event={"ID":"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637","Type":"ContainerStarted","Data":"bca006508f21b34e1cd80c4e5fd812dce792a5a79f3f9249824af85f3006b49e"}
Jul 09 03:57:36.642844 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:36.642807    2582 generic.go:356] "Generic (PLEG): container finished" podID="6e7fce95-2eaa-4b3b-a7bb-86db7a41b637" containerID="35d2d4fe26dc2c8b5eb82fdae8e18c2f1ecd48540dbf519d3d00de705ffd2683" exitCode=0
Jul 09 03:57:36.642844 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:36.642845    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hcs2f" event={"ID":"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637","Type":"ContainerDied","Data":"35d2d4fe26dc2c8b5eb82fdae8e18c2f1ecd48540dbf519d3d00de705ffd2683"}
Jul 09 03:57:37.648096 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:37.648058    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hcs2f" event={"ID":"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637","Type":"ContainerStarted","Data":"bd413b21967bb442e5a91b7a8a11bcb71b7feff0814565fd30487b7c121ca0f7"}
Jul 09 03:57:37.648476 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:37.648113    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hcs2f" event={"ID":"6e7fce95-2eaa-4b3b-a7bb-86db7a41b637","Type":"ContainerStarted","Data":"f1604023e1b46c451799694ae768a05df01b1ad110a2d844315e977153b6b110"}
Jul 09 03:57:37.669853 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:37.669807    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hcs2f" podStartSLOduration=2.492545295 podStartE2EDuration="3.669790934s" totalImagesPullingTime="1.113353831s" totalInitContainerRuntime="63.891808ms" isStatefulPod=true podCreationTimestamp="2026-07-09 03:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:57:37.66750244 +0000 UTC m=+84.111632513" watchObservedRunningTime="2026-07-09 03:57:37.669790934 +0000 UTC m=+84.113921067"
Jul 09 03:57:40.844352 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.844321    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 03:57:40.850547 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.850527    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:40.855021 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.855003    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 09 03:57:40.855130 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.855066    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 09 03:57:40.855329 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.855314    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 09 03:57:40.855402 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.855325    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 09 03:57:40.855402 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.855315    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 09 03:57:40.855564 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.855547    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dsp5pqrtjeu6c\""
Jul 09 03:57:40.855654 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.855569    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 09 03:57:40.855654 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.855575    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 09 03:57:40.856003 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.855984    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 09 03:57:40.856102 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.856007    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 09 03:57:40.856102 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.855989    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 09 03:57:40.856102 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.856028    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 09 03:57:40.856752 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.856705    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 09 03:57:40.856752 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.856708    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 09 03:57:40.856913 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.856877    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 09 03:57:40.856991 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.856966    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-pdm2f\""
Jul 09 03:57:40.860365 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.860338    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 09 03:57:40.875539 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.875518    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 03:57:40.936785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.936760    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:40.936902 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.936788    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/331784c5-c654-41d9-9ea3-8fc55d974b03-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:40.936902 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.936808    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:40.936902 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.936826    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:40.936902 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.936852    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:40.937040 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.936926    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:40.937040 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.936949    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:40.937040 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.936980    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:40.937040 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.936996    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:40.937040 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.937019    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:40.937040 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.937038    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:40.937216 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.937061    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:40.937216 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.937080    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-web-config\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:40.937216 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.937111    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:40.937216 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.937137    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-config\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:40.937216 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.937152    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzrkx\" (UniqueName: \"kubernetes.io/projected/331784c5-c654-41d9-9ea3-8fc55d974b03-kube-api-access-rzrkx\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:40.937216 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.937188    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:40.937216 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.937208    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:40.937425 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.937224    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:40.937425 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:40.937255    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/331784c5-c654-41d9-9ea3-8fc55d974b03-config-out\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.037792 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.037769    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/331784c5-c654-41d9-9ea3-8fc55d974b03-config-out\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.037929 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.037799    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.037929 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.037816    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/331784c5-c654-41d9-9ea3-8fc55d974b03-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.037929 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.037834    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.037929 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.037851    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.037929 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.037872    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.037929 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.037915    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.038225 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.037946    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.038225 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.037966    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.038225 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.037989    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.038225 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.038013    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.038225 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.038039    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.038225 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.038072    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.038225 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.038098    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-web-config\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.038225 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.038119    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.038225 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.038148    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-config\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.038225 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.038171    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzrkx\" (UniqueName: \"kubernetes.io/projected/331784c5-c654-41d9-9ea3-8fc55d974b03-kube-api-access-rzrkx\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.038225 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.038196    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.038225 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.038227    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.038831 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.038254    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.038831 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.038596    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.039295 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.039272    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.040927 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.040874    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/331784c5-c654-41d9-9ea3-8fc55d974b03-config-out\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.041630 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.041052    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.041630 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.041174    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/331784c5-c654-41d9-9ea3-8fc55d974b03-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.041630 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.041237    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.041630 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.041398    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.041630 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.041575    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.041956 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.041879    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.041956 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.041402    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.042070 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.042019    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.042180 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.042149    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.043016 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.042600    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.043016 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.042630    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.043016 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.042976    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.043506 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.043492    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.043833 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.043812    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-config\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.044595 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.044577    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-web-config\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.044735 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.044719    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.048802 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.048782    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzrkx\" (UniqueName: \"kubernetes.io/projected/331784c5-c654-41d9-9ea3-8fc55d974b03-kube-api-access-rzrkx\") pod \"prometheus-k8s-0\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.160125 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.160099    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:41.296910 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.295323    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 03:57:41.320863 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:57:41.320837    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod331784c5_c654_41d9_9ea3_8fc55d974b03.slice/crio-cc15032acfbf5a0c5b07d04a26598e329a2d3876af10fbeadd830e83b0f28917 WatchSource:0}: Error finding container cc15032acfbf5a0c5b07d04a26598e329a2d3876af10fbeadd830e83b0f28917: Status 404 returned error can't find the container with id cc15032acfbf5a0c5b07d04a26598e329a2d3876af10fbeadd830e83b0f28917
Jul 09 03:57:41.661922 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:41.661880    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"331784c5-c654-41d9-9ea3-8fc55d974b03","Type":"ContainerStarted","Data":"cc15032acfbf5a0c5b07d04a26598e329a2d3876af10fbeadd830e83b0f28917"}
Jul 09 03:57:42.666987 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:42.666954    2582 generic.go:356] "Generic (PLEG): container finished" podID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerID="f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808" exitCode=0
Jul 09 03:57:42.667331 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:42.667044    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"331784c5-c654-41d9-9ea3-8fc55d974b03","Type":"ContainerDied","Data":"f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808"}
Jul 09 03:57:46.686307 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:46.686268    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"331784c5-c654-41d9-9ea3-8fc55d974b03","Type":"ContainerStarted","Data":"6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b"}
Jul 09 03:57:46.686752 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:46.686347    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"331784c5-c654-41d9-9ea3-8fc55d974b03","Type":"ContainerStarted","Data":"bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943"}
Jul 09 03:57:48.700662 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:48.700627    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"331784c5-c654-41d9-9ea3-8fc55d974b03","Type":"ContainerStarted","Data":"9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304"}
Jul 09 03:57:48.701059 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:48.700711    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"331784c5-c654-41d9-9ea3-8fc55d974b03","Type":"ContainerStarted","Data":"2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7"}
Jul 09 03:57:48.701059 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:48.700737    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"331784c5-c654-41d9-9ea3-8fc55d974b03","Type":"ContainerStarted","Data":"838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91"}
Jul 09 03:57:48.701059 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:48.700761    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"331784c5-c654-41d9-9ea3-8fc55d974b03","Type":"ContainerStarted","Data":"a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7"}
Jul 09 03:57:48.729255 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:48.729197    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.444400214 podStartE2EDuration="8.729182688s" totalImagesPullingTime="6.266537219s" totalInitContainerRuntime="18.245255ms" isStatefulPod=false podCreationTimestamp="2026-07-09 03:57:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:57:48.726635993 +0000 UTC m=+95.170766068" watchObservedRunningTime="2026-07-09 03:57:48.729182688 +0000 UTC m=+95.173312770"
Jul 09 03:57:51.162527 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:51.162488    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:57:56.602782 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:57:56.602750    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-x4hpr"
Jul 09 03:58:41.160211 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:41.160176    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:58:41.179400 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:41.179373    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:58:41.897208 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:41.897185    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:58:59.176553 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.176521    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 03:58:59.177103 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.176815    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerName="prometheus" containerID="cri-o://bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943" gracePeriod=600
Jul 09 03:58:59.177103 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.176826    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerName="kube-rbac-proxy" containerID="cri-o://2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7" gracePeriod=600
Jul 09 03:58:59.177103 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.176871    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerName="kube-rbac-proxy-web" containerID="cri-o://838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91" gracePeriod=600
Jul 09 03:58:59.177103 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.176960    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerName="config-reloader" containerID="cri-o://6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b" gracePeriod=600
Jul 09 03:58:59.177103 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.176977    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304" gracePeriod=600
Jul 09 03:58:59.177103 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.176895    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerName="thanos-sidecar" containerID="cri-o://a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7" gracePeriod=600
Jul 09 03:58:59.408839 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.408814    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:58:59.482572 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.482504    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-kube-rbac-proxy\") pod \"331784c5-c654-41d9-9ea3-8fc55d974b03\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") "
Jul 09 03:58:59.482572 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.482540    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-prometheus-k8s-tls\") pod \"331784c5-c654-41d9-9ea3-8fc55d974b03\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") "
Jul 09 03:58:59.482572 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.482559    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-web-config\") pod \"331784c5-c654-41d9-9ea3-8fc55d974b03\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") "
Jul 09 03:58:59.482812 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.482579    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"331784c5-c654-41d9-9ea3-8fc55d974b03\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") "
Jul 09 03:58:59.482812 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.482606    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/331784c5-c654-41d9-9ea3-8fc55d974b03-tls-assets\") pod \"331784c5-c654-41d9-9ea3-8fc55d974b03\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") "
Jul 09 03:58:59.482812 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.482632    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-configmap-kubelet-serving-ca-bundle\") pod \"331784c5-c654-41d9-9ea3-8fc55d974b03\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") "
Jul 09 03:58:59.482812 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.482661    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-k8s-rulefiles-0\") pod \"331784c5-c654-41d9-9ea3-8fc55d974b03\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") "
Jul 09 03:58:59.482812 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.482688    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzrkx\" (UniqueName: \"kubernetes.io/projected/331784c5-c654-41d9-9ea3-8fc55d974b03-kube-api-access-rzrkx\") pod \"331784c5-c654-41d9-9ea3-8fc55d974b03\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") "
Jul 09 03:58:59.482812 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.482717    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-grpc-tls\") pod \"331784c5-c654-41d9-9ea3-8fc55d974b03\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") "
Jul 09 03:58:59.484132 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.483201    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "331784c5-c654-41d9-9ea3-8fc55d974b03" (UID: "331784c5-c654-41d9-9ea3-8fc55d974b03"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 03:58:59.484132 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.483354    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-configmap-metrics-client-ca\") pod \"331784c5-c654-41d9-9ea3-8fc55d974b03\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") "
Jul 09 03:58:59.484132 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.483398    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"331784c5-c654-41d9-9ea3-8fc55d974b03\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") "
Jul 09 03:58:59.484132 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.483432    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-trusted-ca-bundle\") pod \"331784c5-c654-41d9-9ea3-8fc55d974b03\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") "
Jul 09 03:58:59.484132 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.483475    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-config\") pod \"331784c5-c654-41d9-9ea3-8fc55d974b03\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") "
Jul 09 03:58:59.484132 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.483505    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-metrics-client-certs\") pod \"331784c5-c654-41d9-9ea3-8fc55d974b03\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") "
Jul 09 03:58:59.484132 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.483541    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-k8s-rulefiles-2\") pod \"331784c5-c654-41d9-9ea3-8fc55d974b03\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") "
Jul 09 03:58:59.484132 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.483569    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-configmap-serving-certs-ca-bundle\") pod \"331784c5-c654-41d9-9ea3-8fc55d974b03\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") "
Jul 09 03:58:59.484132 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.483614    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-k8s-rulefiles-1\") pod \"331784c5-c654-41d9-9ea3-8fc55d974b03\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") "
Jul 09 03:58:59.484132 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.483640    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/331784c5-c654-41d9-9ea3-8fc55d974b03-config-out\") pod \"331784c5-c654-41d9-9ea3-8fc55d974b03\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") "
Jul 09 03:58:59.484132 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.483678    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-thanos-prometheus-http-client-file\") pod \"331784c5-c654-41d9-9ea3-8fc55d974b03\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") "
Jul 09 03:58:59.484132 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.483704    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-k8s-db\") pod \"331784c5-c654-41d9-9ea3-8fc55d974b03\" (UID: \"331784c5-c654-41d9-9ea3-8fc55d974b03\") "
Jul 09 03:58:59.484132 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.483948    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 03:58:59.484852 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.484483    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "331784c5-c654-41d9-9ea3-8fc55d974b03" (UID: "331784c5-c654-41d9-9ea3-8fc55d974b03"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 03:58:59.486182 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.485415    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "331784c5-c654-41d9-9ea3-8fc55d974b03" (UID: "331784c5-c654-41d9-9ea3-8fc55d974b03"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 03:58:59.486182 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.485616    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "331784c5-c654-41d9-9ea3-8fc55d974b03" (UID: "331784c5-c654-41d9-9ea3-8fc55d974b03"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 03:58:59.486182 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.485812    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "331784c5-c654-41d9-9ea3-8fc55d974b03" (UID: "331784c5-c654-41d9-9ea3-8fc55d974b03"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 03:58:59.486182 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.486129    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "331784c5-c654-41d9-9ea3-8fc55d974b03" (UID: "331784c5-c654-41d9-9ea3-8fc55d974b03"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 03:58:59.486456 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.486369    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "331784c5-c654-41d9-9ea3-8fc55d974b03" (UID: "331784c5-c654-41d9-9ea3-8fc55d974b03"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 03:58:59.486694 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.486669    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "331784c5-c654-41d9-9ea3-8fc55d974b03" (UID: "331784c5-c654-41d9-9ea3-8fc55d974b03"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 03:58:59.486838 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.486812    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "331784c5-c654-41d9-9ea3-8fc55d974b03" (UID: "331784c5-c654-41d9-9ea3-8fc55d974b03"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 03:58:59.487204 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.487037    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/331784c5-c654-41d9-9ea3-8fc55d974b03-kube-api-access-rzrkx" (OuterVolumeSpecName: "kube-api-access-rzrkx") pod "331784c5-c654-41d9-9ea3-8fc55d974b03" (UID: "331784c5-c654-41d9-9ea3-8fc55d974b03"). InnerVolumeSpecName "kube-api-access-rzrkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 03:58:59.487204 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.487110    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/331784c5-c654-41d9-9ea3-8fc55d974b03-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "331784c5-c654-41d9-9ea3-8fc55d974b03" (UID: "331784c5-c654-41d9-9ea3-8fc55d974b03"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 03:58:59.487204 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.487176    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "331784c5-c654-41d9-9ea3-8fc55d974b03" (UID: "331784c5-c654-41d9-9ea3-8fc55d974b03"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 03:58:59.487537 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.487316    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "331784c5-c654-41d9-9ea3-8fc55d974b03" (UID: "331784c5-c654-41d9-9ea3-8fc55d974b03"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 03:58:59.487928 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.487862    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "331784c5-c654-41d9-9ea3-8fc55d974b03" (UID: "331784c5-c654-41d9-9ea3-8fc55d974b03"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 03:58:59.488490 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.488463    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-config" (OuterVolumeSpecName: "config") pod "331784c5-c654-41d9-9ea3-8fc55d974b03" (UID: "331784c5-c654-41d9-9ea3-8fc55d974b03"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 03:58:59.488577 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.488527    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "331784c5-c654-41d9-9ea3-8fc55d974b03" (UID: "331784c5-c654-41d9-9ea3-8fc55d974b03"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 03:58:59.488795 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.488774    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/331784c5-c654-41d9-9ea3-8fc55d974b03-config-out" (OuterVolumeSpecName: "config-out") pod "331784c5-c654-41d9-9ea3-8fc55d974b03" (UID: "331784c5-c654-41d9-9ea3-8fc55d974b03"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 03:58:59.489036 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.489011    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "331784c5-c654-41d9-9ea3-8fc55d974b03" (UID: "331784c5-c654-41d9-9ea3-8fc55d974b03"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 03:58:59.489089 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.489057    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "331784c5-c654-41d9-9ea3-8fc55d974b03" (UID: "331784c5-c654-41d9-9ea3-8fc55d974b03"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 03:58:59.495278 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.495260    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-web-config" (OuterVolumeSpecName: "web-config") pod "331784c5-c654-41d9-9ea3-8fc55d974b03" (UID: "331784c5-c654-41d9-9ea3-8fc55d974b03"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 03:58:59.584334 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.584311    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 03:58:59.584334 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.584331    2582 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-config\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 03:58:59.584452 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.584340    2582 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-metrics-client-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 03:58:59.584452 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.584349    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 03:58:59.584452 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.584358    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 03:58:59.584452 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.584366    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 03:58:59.584452 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.584374    2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/331784c5-c654-41d9-9ea3-8fc55d974b03-config-out\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 03:58:59.584452 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.584381    2582 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 03:58:59.584452 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.584390    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-k8s-db\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 03:58:59.584452 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.584398    2582 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-kube-rbac-proxy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 03:58:59.584452 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.584405    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 03:58:59.584452 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.584413    2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-web-config\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 03:58:59.584452 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.584421    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 03:58:59.584452 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.584429    2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/331784c5-c654-41d9-9ea3-8fc55d974b03-tls-assets\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 03:58:59.584452 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.584438    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 03:58:59.584452 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.584446    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzrkx\" (UniqueName: \"kubernetes.io/projected/331784c5-c654-41d9-9ea3-8fc55d974b03-kube-api-access-rzrkx\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 03:58:59.584452 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.584454    2582 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-grpc-tls\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 03:58:59.584924 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.584462    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/331784c5-c654-41d9-9ea3-8fc55d974b03-configmap-metrics-client-ca\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 03:58:59.584924 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.584470    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/331784c5-c654-41d9-9ea3-8fc55d974b03-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 03:58:59.945561 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.945533    2582 generic.go:356] "Generic (PLEG): container finished" podID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerID="9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304" exitCode=0
Jul 09 03:58:59.945561 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.945557    2582 generic.go:356] "Generic (PLEG): container finished" podID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerID="2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7" exitCode=0
Jul 09 03:58:59.945716 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.945568    2582 generic.go:356] "Generic (PLEG): container finished" podID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerID="838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91" exitCode=0
Jul 09 03:58:59.945716 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.945578    2582 generic.go:356] "Generic (PLEG): container finished" podID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerID="a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7" exitCode=0
Jul 09 03:58:59.945716 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.945588    2582 generic.go:356] "Generic (PLEG): container finished" podID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerID="6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b" exitCode=0
Jul 09 03:58:59.945716 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.945596    2582 generic.go:356] "Generic (PLEG): container finished" podID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerID="bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943" exitCode=0
Jul 09 03:58:59.945716 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.945602    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:58:59.945716 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.945594    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"331784c5-c654-41d9-9ea3-8fc55d974b03","Type":"ContainerDied","Data":"9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304"}
Jul 09 03:58:59.945914 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.945739    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"331784c5-c654-41d9-9ea3-8fc55d974b03","Type":"ContainerDied","Data":"2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7"}
Jul 09 03:58:59.945914 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.945770    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"331784c5-c654-41d9-9ea3-8fc55d974b03","Type":"ContainerDied","Data":"838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91"}
Jul 09 03:58:59.945914 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.945795    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"331784c5-c654-41d9-9ea3-8fc55d974b03","Type":"ContainerDied","Data":"a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7"}
Jul 09 03:58:59.945914 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.945805    2582 scope.go:117] "RemoveContainer" containerID="9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304"
Jul 09 03:58:59.945914 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.945829    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"331784c5-c654-41d9-9ea3-8fc55d974b03","Type":"ContainerDied","Data":"6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b"}
Jul 09 03:58:59.945914 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.945854    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"331784c5-c654-41d9-9ea3-8fc55d974b03","Type":"ContainerDied","Data":"bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943"}
Jul 09 03:58:59.945914 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.945879    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"331784c5-c654-41d9-9ea3-8fc55d974b03","Type":"ContainerDied","Data":"cc15032acfbf5a0c5b07d04a26598e329a2d3876af10fbeadd830e83b0f28917"}
Jul 09 03:58:59.953732 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.953699    2582 scope.go:117] "RemoveContainer" containerID="2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7"
Jul 09 03:58:59.960040 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.960019    2582 scope.go:117] "RemoveContainer" containerID="838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91"
Jul 09 03:58:59.966354 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.966337    2582 scope.go:117] "RemoveContainer" containerID="a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7"
Jul 09 03:58:59.969516 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.969168    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 03:58:59.973129 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.973111    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 03:58:59.973415 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.973402    2582 scope.go:117] "RemoveContainer" containerID="6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b"
Jul 09 03:58:59.979675 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.979660    2582 scope.go:117] "RemoveContainer" containerID="bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943"
Jul 09 03:58:59.986281 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.986264    2582 scope.go:117] "RemoveContainer" containerID="f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808"
Jul 09 03:58:59.992428 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.992410    2582 scope.go:117] "RemoveContainer" containerID="9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304"
Jul 09 03:58:59.992674 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:58:59.992657    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304\": container with ID starting with 9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304 not found: ID does not exist" containerID="9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304"
Jul 09 03:58:59.992719 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.992681    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304"} err="failed to get container status \"9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304\": rpc error: code = NotFound desc = could not find container \"9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304\": container with ID starting with 9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304 not found: ID does not exist"
Jul 09 03:58:59.992719 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.992708    2582 scope.go:117] "RemoveContainer" containerID="2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7"
Jul 09 03:58:59.992971 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:58:59.992951    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7\": container with ID starting with 2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7 not found: ID does not exist" containerID="2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7"
Jul 09 03:58:59.993018 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.992978    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7"} err="failed to get container status \"2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7\": rpc error: code = NotFound desc = could not find container \"2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7\": container with ID starting with 2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7 not found: ID does not exist"
Jul 09 03:58:59.993018 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.992999    2582 scope.go:117] "RemoveContainer" containerID="838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91"
Jul 09 03:58:59.993181 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:58:59.993167    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91\": container with ID starting with 838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91 not found: ID does not exist" containerID="838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91"
Jul 09 03:58:59.993224 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.993184    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91"} err="failed to get container status \"838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91\": rpc error: code = NotFound desc = could not find container \"838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91\": container with ID starting with 838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91 not found: ID does not exist"
Jul 09 03:58:59.993224 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.993196    2582 scope.go:117] "RemoveContainer" containerID="a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7"
Jul 09 03:58:59.993376 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:58:59.993362    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7\": container with ID starting with a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7 not found: ID does not exist" containerID="a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7"
Jul 09 03:58:59.993409 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.993377    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7"} err="failed to get container status \"a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7\": rpc error: code = NotFound desc = could not find container \"a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7\": container with ID starting with a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7 not found: ID does not exist"
Jul 09 03:58:59.993409 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.993389    2582 scope.go:117] "RemoveContainer" containerID="6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b"
Jul 09 03:58:59.993592 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:58:59.993576    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b\": container with ID starting with 6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b not found: ID does not exist" containerID="6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b"
Jul 09 03:58:59.993632 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.993595    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b"} err="failed to get container status \"6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b\": rpc error: code = NotFound desc = could not find container \"6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b\": container with ID starting with 6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b not found: ID does not exist"
Jul 09 03:58:59.993632 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.993606    2582 scope.go:117] "RemoveContainer" containerID="bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943"
Jul 09 03:58:59.993808 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:58:59.993793    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943\": container with ID starting with bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943 not found: ID does not exist" containerID="bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943"
Jul 09 03:58:59.993845 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.993811    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943"} err="failed to get container status \"bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943\": rpc error: code = NotFound desc = could not find container \"bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943\": container with ID starting with bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943 not found: ID does not exist"
Jul 09 03:58:59.993845 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.993822    2582 scope.go:117] "RemoveContainer" containerID="f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808"
Jul 09 03:58:59.994011 ip-10-0-134-121 kubenswrapper[2582]: E0709 03:58:59.993996    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808\": container with ID starting with f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808 not found: ID does not exist" containerID="f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808"
Jul 09 03:58:59.994057 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.994014    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808"} err="failed to get container status \"f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808\": rpc error: code = NotFound desc = could not find container \"f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808\": container with ID starting with f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808 not found: ID does not exist"
Jul 09 03:58:59.994057 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.994025    2582 scope.go:117] "RemoveContainer" containerID="9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304"
Jul 09 03:58:59.994193 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.994178    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304"} err="failed to get container status \"9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304\": rpc error: code = NotFound desc = could not find container \"9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304\": container with ID starting with 9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304 not found: ID does not exist"
Jul 09 03:58:59.994236 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.994193    2582 scope.go:117] "RemoveContainer" containerID="2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7"
Jul 09 03:58:59.994402 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.994385    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7"} err="failed to get container status \"2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7\": rpc error: code = NotFound desc = could not find container \"2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7\": container with ID starting with 2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7 not found: ID does not exist"
Jul 09 03:58:59.994402 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.994401    2582 scope.go:117] "RemoveContainer" containerID="838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91"
Jul 09 03:58:59.994572 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.994557    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91"} err="failed to get container status \"838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91\": rpc error: code = NotFound desc = could not find container \"838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91\": container with ID starting with 838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91 not found: ID does not exist"
Jul 09 03:58:59.994608 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.994572    2582 scope.go:117] "RemoveContainer" containerID="a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7"
Jul 09 03:58:59.994759 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.994744    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7"} err="failed to get container status \"a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7\": rpc error: code = NotFound desc = could not find container \"a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7\": container with ID starting with a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7 not found: ID does not exist"
Jul 09 03:58:59.994811 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.994759    2582 scope.go:117] "RemoveContainer" containerID="6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b"
Jul 09 03:58:59.995003 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.994987    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b"} err="failed to get container status \"6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b\": rpc error: code = NotFound desc = could not find container \"6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b\": container with ID starting with 6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b not found: ID does not exist"
Jul 09 03:58:59.995003 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.995001    2582 scope.go:117] "RemoveContainer" containerID="bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943"
Jul 09 03:58:59.995223 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.995203    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943"} err="failed to get container status \"bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943\": rpc error: code = NotFound desc = could not find container \"bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943\": container with ID starting with bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943 not found: ID does not exist"
Jul 09 03:58:59.995265 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.995225    2582 scope.go:117] "RemoveContainer" containerID="f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808"
Jul 09 03:58:59.995470 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.995445    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808"} err="failed to get container status \"f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808\": rpc error: code = NotFound desc = could not find container \"f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808\": container with ID starting with f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808 not found: ID does not exist"
Jul 09 03:58:59.995563 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.995472    2582 scope.go:117] "RemoveContainer" containerID="9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304"
Jul 09 03:58:59.995921 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.995815    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304"} err="failed to get container status \"9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304\": rpc error: code = NotFound desc = could not find container \"9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304\": container with ID starting with 9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304 not found: ID does not exist"
Jul 09 03:58:59.996006 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.995878    2582 scope.go:117] "RemoveContainer" containerID="2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7"
Jul 09 03:58:59.996312 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.996287    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7"} err="failed to get container status \"2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7\": rpc error: code = NotFound desc = could not find container \"2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7\": container with ID starting with 2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7 not found: ID does not exist"
Jul 09 03:58:59.996312 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.996312    2582 scope.go:117] "RemoveContainer" containerID="838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91"
Jul 09 03:58:59.996566 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.996550    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91"} err="failed to get container status \"838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91\": rpc error: code = NotFound desc = could not find container \"838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91\": container with ID starting with 838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91 not found: ID does not exist"
Jul 09 03:58:59.996566 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.996566    2582 scope.go:117] "RemoveContainer" containerID="a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7"
Jul 09 03:58:59.996804 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.996790    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7"} err="failed to get container status \"a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7\": rpc error: code = NotFound desc = could not find container \"a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7\": container with ID starting with a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7 not found: ID does not exist"
Jul 09 03:58:59.996847 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.996805    2582 scope.go:117] "RemoveContainer" containerID="6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b"
Jul 09 03:58:59.997060 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997035    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b"} err="failed to get container status \"6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b\": rpc error: code = NotFound desc = could not find container \"6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b\": container with ID starting with 6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b not found: ID does not exist"
Jul 09 03:58:59.997060 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997058    2582 scope.go:117] "RemoveContainer" containerID="bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943"
Jul 09 03:58:59.997288 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997274    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943"} err="failed to get container status \"bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943\": rpc error: code = NotFound desc = could not find container \"bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943\": container with ID starting with bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943 not found: ID does not exist"
Jul 09 03:58:59.997288 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997288    2582 scope.go:117] "RemoveContainer" containerID="f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808"
Jul 09 03:58:59.997378 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997362    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 03:58:59.997504 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997488    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808"} err="failed to get container status \"f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808\": rpc error: code = NotFound desc = could not find container \"f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808\": container with ID starting with f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808 not found: ID does not exist"
Jul 09 03:58:59.997544 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997504    2582 scope.go:117] "RemoveContainer" containerID="9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304"
Jul 09 03:58:59.997588 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997580    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerName="kube-rbac-proxy-thanos"
Jul 09 03:58:59.997644 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997592    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerName="kube-rbac-proxy-thanos"
Jul 09 03:58:59.997644 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997603    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerName="kube-rbac-proxy-web"
Jul 09 03:58:59.997644 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997614    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerName="kube-rbac-proxy-web"
Jul 09 03:58:59.997644 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997628    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerName="init-config-reloader"
Jul 09 03:58:59.997644 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997636    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerName="init-config-reloader"
Jul 09 03:58:59.997798 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997648    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerName="thanos-sidecar"
Jul 09 03:58:59.997798 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997657    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerName="thanos-sidecar"
Jul 09 03:58:59.997798 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997664    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerName="prometheus"
Jul 09 03:58:59.997798 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997669    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerName="prometheus"
Jul 09 03:58:59.997798 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997675    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerName="config-reloader"
Jul 09 03:58:59.997798 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997682    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerName="config-reloader"
Jul 09 03:58:59.997798 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997690    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerName="kube-rbac-proxy"
Jul 09 03:58:59.997798 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997695    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerName="kube-rbac-proxy"
Jul 09 03:58:59.997798 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997714    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304"} err="failed to get container status \"9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304\": rpc error: code = NotFound desc = could not find container \"9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304\": container with ID starting with 9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304 not found: ID does not exist"
Jul 09 03:58:59.997798 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997727    2582 scope.go:117] "RemoveContainer" containerID="2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7"
Jul 09 03:58:59.997798 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997738    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerName="kube-rbac-proxy-web"
Jul 09 03:58:59.997798 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997747    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerName="thanos-sidecar"
Jul 09 03:58:59.997798 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997752    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerName="kube-rbac-proxy"
Jul 09 03:58:59.997798 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997759    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerName="kube-rbac-proxy-thanos"
Jul 09 03:58:59.997798 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997767    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerName="prometheus"
Jul 09 03:58:59.997798 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997776    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="331784c5-c654-41d9-9ea3-8fc55d974b03" containerName="config-reloader"
Jul 09 03:58:59.998331 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997931    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7"} err="failed to get container status \"2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7\": rpc error: code = NotFound desc = could not find container \"2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7\": container with ID starting with 2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7 not found: ID does not exist"
Jul 09 03:58:59.998331 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.997944    2582 scope.go:117] "RemoveContainer" containerID="838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91"
Jul 09 03:58:59.998331 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.998151    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91"} err="failed to get container status \"838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91\": rpc error: code = NotFound desc = could not find container \"838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91\": container with ID starting with 838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91 not found: ID does not exist"
Jul 09 03:58:59.998331 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.998164    2582 scope.go:117] "RemoveContainer" containerID="a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7"
Jul 09 03:58:59.998458 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.998360    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7"} err="failed to get container status \"a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7\": rpc error: code = NotFound desc = could not find container \"a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7\": container with ID starting with a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7 not found: ID does not exist"
Jul 09 03:58:59.998458 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.998374    2582 scope.go:117] "RemoveContainer" containerID="6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b"
Jul 09 03:58:59.999169 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.999043    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b"} err="failed to get container status \"6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b\": rpc error: code = NotFound desc = could not find container \"6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b\": container with ID starting with 6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b not found: ID does not exist"
Jul 09 03:58:59.999169 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:58:59.999074    2582 scope.go:117] "RemoveContainer" containerID="bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943"
Jul 09 03:59:00.003100 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.003074    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943"} err="failed to get container status \"bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943\": rpc error: code = NotFound desc = could not find container \"bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943\": container with ID starting with bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943 not found: ID does not exist"
Jul 09 03:59:00.003100 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.003098    2582 scope.go:117] "RemoveContainer" containerID="f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808"
Jul 09 03:59:00.003333 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.003312    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808"} err="failed to get container status \"f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808\": rpc error: code = NotFound desc = could not find container \"f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808\": container with ID starting with f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808 not found: ID does not exist"
Jul 09 03:59:00.003388 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.003334    2582 scope.go:117] "RemoveContainer" containerID="9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304"
Jul 09 03:59:00.003554 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.003539    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304"} err="failed to get container status \"9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304\": rpc error: code = NotFound desc = could not find container \"9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304\": container with ID starting with 9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304 not found: ID does not exist"
Jul 09 03:59:00.003608 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.003555    2582 scope.go:117] "RemoveContainer" containerID="2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7"
Jul 09 03:59:00.003759 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.003740    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7"} err="failed to get container status \"2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7\": rpc error: code = NotFound desc = could not find container \"2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7\": container with ID starting with 2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7 not found: ID does not exist"
Jul 09 03:59:00.003813 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.003760    2582 scope.go:117] "RemoveContainer" containerID="838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91"
Jul 09 03:59:00.003992 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.003965    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91"} err="failed to get container status \"838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91\": rpc error: code = NotFound desc = could not find container \"838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91\": container with ID starting with 838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91 not found: ID does not exist"
Jul 09 03:59:00.003992 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.003984    2582 scope.go:117] "RemoveContainer" containerID="a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7"
Jul 09 03:59:00.004221 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.004203    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7"} err="failed to get container status \"a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7\": rpc error: code = NotFound desc = could not find container \"a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7\": container with ID starting with a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7 not found: ID does not exist"
Jul 09 03:59:00.004277 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.004222    2582 scope.go:117] "RemoveContainer" containerID="6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b"
Jul 09 03:59:00.004429 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.004413    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b"} err="failed to get container status \"6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b\": rpc error: code = NotFound desc = could not find container \"6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b\": container with ID starting with 6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b not found: ID does not exist"
Jul 09 03:59:00.004484 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.004431    2582 scope.go:117] "RemoveContainer" containerID="bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943"
Jul 09 03:59:00.004694 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.004670    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943"} err="failed to get container status \"bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943\": rpc error: code = NotFound desc = could not find container \"bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943\": container with ID starting with bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943 not found: ID does not exist"
Jul 09 03:59:00.004771 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.004697    2582 scope.go:117] "RemoveContainer" containerID="f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808"
Jul 09 03:59:00.004981 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.004954    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808"} err="failed to get container status \"f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808\": rpc error: code = NotFound desc = could not find container \"f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808\": container with ID starting with f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808 not found: ID does not exist"
Jul 09 03:59:00.005090 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.004984    2582 scope.go:117] "RemoveContainer" containerID="9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304"
Jul 09 03:59:00.005250 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.005228    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304"} err="failed to get container status \"9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304\": rpc error: code = NotFound desc = could not find container \"9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304\": container with ID starting with 9d4008088a843467cf6ec6e72bcd737666abd89feb6f484eb0f584b09f9e8304 not found: ID does not exist"
Jul 09 03:59:00.005298 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.005250    2582 scope.go:117] "RemoveContainer" containerID="2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7"
Jul 09 03:59:00.005511 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.005492    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7"} err="failed to get container status \"2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7\": rpc error: code = NotFound desc = could not find container \"2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7\": container with ID starting with 2355f68f553639179b9cd43aeffd6804ed33d2b050604646fb833aef51a12da7 not found: ID does not exist"
Jul 09 03:59:00.005565 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.005512    2582 scope.go:117] "RemoveContainer" containerID="838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91"
Jul 09 03:59:00.005719 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.005700    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91"} err="failed to get container status \"838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91\": rpc error: code = NotFound desc = could not find container \"838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91\": container with ID starting with 838c94c3e40f244dd526b043596681293084a201172432e6ab1f979e27c25e91 not found: ID does not exist"
Jul 09 03:59:00.005797 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.005721    2582 scope.go:117] "RemoveContainer" containerID="a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7"
Jul 09 03:59:00.006009 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.005992    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.006360 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.005997    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7"} err="failed to get container status \"a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7\": rpc error: code = NotFound desc = could not find container \"a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7\": container with ID starting with a5a11ba7df9478dc22d2ae2698f9d1be0cd529de9721509b8a9f02f7264ffbb7 not found: ID does not exist"
Jul 09 03:59:00.006360 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.006211    2582 scope.go:117] "RemoveContainer" containerID="6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b"
Jul 09 03:59:00.006597 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.006579    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b"} err="failed to get container status \"6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b\": rpc error: code = NotFound desc = could not find container \"6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b\": container with ID starting with 6445404433b6960dc598db3080f1ee32ae5c53c35e0d0928e887a9ca1145799b not found: ID does not exist"
Jul 09 03:59:00.006643 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.006598    2582 scope.go:117] "RemoveContainer" containerID="bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943"
Jul 09 03:59:00.006850 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.006831    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943"} err="failed to get container status \"bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943\": rpc error: code = NotFound desc = could not find container \"bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943\": container with ID starting with bf2f90c868f6a33e84ee33b09dca72d880e642baac653e51794a81a2ea225943 not found: ID does not exist"
Jul 09 03:59:00.006922 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.006850    2582 scope.go:117] "RemoveContainer" containerID="f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808"
Jul 09 03:59:00.007072 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.007056    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808"} err="failed to get container status \"f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808\": rpc error: code = NotFound desc = could not find container \"f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808\": container with ID starting with f4ffdd172f906166baf6a94679fb4a2eafef50c1fd7ff055f6fc0ad8be2f4808 not found: ID does not exist"
Jul 09 03:59:00.009017 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.008998    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 09 03:59:00.009130 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.009000    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 09 03:59:00.009380 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.009346    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 09 03:59:00.009380 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.009368    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-pdm2f\""
Jul 09 03:59:00.009531 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.009440    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 09 03:59:00.009531 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.009500    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 09 03:59:00.009683 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.009594    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 09 03:59:00.009683 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.009594    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 09 03:59:00.009683 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.009598    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 09 03:59:00.009875 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.009860    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dsp5pqrtjeu6c\""
Jul 09 03:59:00.009875 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.009867    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 09 03:59:00.010045 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.009934    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 09 03:59:00.010264 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.010248    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 09 03:59:00.010349 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.010320    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 09 03:59:00.010512 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.010496    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 09 03:59:00.013091 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.013012    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 09 03:59:00.015243 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.015225    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 09 03:59:00.017087 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.017066    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 03:59:00.087429 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.087394    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2de2d64c-3c67-4013-85ee-381cac7650c8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.087585 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.087435    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2de2d64c-3c67-4013-85ee-381cac7650c8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.087585 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.087462    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2de2d64c-3c67-4013-85ee-381cac7650c8-config-out\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.087585 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.087497    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2de2d64c-3c67-4013-85ee-381cac7650c8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.087585 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.087538    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2de2d64c-3c67-4013-85ee-381cac7650c8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.087585 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.087562    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2de2d64c-3c67-4013-85ee-381cac7650c8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.087585 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.087580    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2de2d64c-3c67-4013-85ee-381cac7650c8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.087785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.087599    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2de2d64c-3c67-4013-85ee-381cac7650c8-web-config\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.087785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.087625    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2de2d64c-3c67-4013-85ee-381cac7650c8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.087785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.087656    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2de2d64c-3c67-4013-85ee-381cac7650c8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.087785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.087695    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2de2d64c-3c67-4013-85ee-381cac7650c8-config\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.087785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.087710    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2de2d64c-3c67-4013-85ee-381cac7650c8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.087785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.087728    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2de2d64c-3c67-4013-85ee-381cac7650c8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.087785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.087743    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2de2d64c-3c67-4013-85ee-381cac7650c8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.087785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.087762    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2de2d64c-3c67-4013-85ee-381cac7650c8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.087785 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.087786    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfj6w\" (UniqueName: \"kubernetes.io/projected/2de2d64c-3c67-4013-85ee-381cac7650c8-kube-api-access-wfj6w\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.088099 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.087818    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2de2d64c-3c67-4013-85ee-381cac7650c8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.088099 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.087846    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2de2d64c-3c67-4013-85ee-381cac7650c8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.088099 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.087867    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2de2d64c-3c67-4013-85ee-381cac7650c8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.088099 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.087938    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2de2d64c-3c67-4013-85ee-381cac7650c8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.153645 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.153605    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="331784c5-c654-41d9-9ea3-8fc55d974b03" path="/var/lib/kubelet/pods/331784c5-c654-41d9-9ea3-8fc55d974b03/volumes"
Jul 09 03:59:00.188391 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.188360    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2de2d64c-3c67-4013-85ee-381cac7650c8-web-config\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.188391 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.188391    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2de2d64c-3c67-4013-85ee-381cac7650c8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.188870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.188410    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2de2d64c-3c67-4013-85ee-381cac7650c8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.188870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.188430    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2de2d64c-3c67-4013-85ee-381cac7650c8-config\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.188870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.188444    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2de2d64c-3c67-4013-85ee-381cac7650c8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.188870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.188463    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2de2d64c-3c67-4013-85ee-381cac7650c8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.188870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.188504    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2de2d64c-3c67-4013-85ee-381cac7650c8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.188870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.188547    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2de2d64c-3c67-4013-85ee-381cac7650c8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.188870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.188585    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfj6w\" (UniqueName: \"kubernetes.io/projected/2de2d64c-3c67-4013-85ee-381cac7650c8-kube-api-access-wfj6w\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.188870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.188633    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2de2d64c-3c67-4013-85ee-381cac7650c8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.188870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.188658    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2de2d64c-3c67-4013-85ee-381cac7650c8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.188870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.188683    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2de2d64c-3c67-4013-85ee-381cac7650c8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.188870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.188710    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2de2d64c-3c67-4013-85ee-381cac7650c8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.188870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.188756    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2de2d64c-3c67-4013-85ee-381cac7650c8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.188870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.188784    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2de2d64c-3c67-4013-85ee-381cac7650c8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.188870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.188809    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2de2d64c-3c67-4013-85ee-381cac7650c8-config-out\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.188870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.188834    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2de2d64c-3c67-4013-85ee-381cac7650c8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.188870 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.188864    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2de2d64c-3c67-4013-85ee-381cac7650c8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.189692 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.188921    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2de2d64c-3c67-4013-85ee-381cac7650c8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.189692 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.188952    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2de2d64c-3c67-4013-85ee-381cac7650c8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.189692 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.189086    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2de2d64c-3c67-4013-85ee-381cac7650c8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.189692 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.189414    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2de2d64c-3c67-4013-85ee-381cac7650c8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.189692 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.189511    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2de2d64c-3c67-4013-85ee-381cac7650c8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.190838 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.190522    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2de2d64c-3c67-4013-85ee-381cac7650c8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.190838 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.190586    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2de2d64c-3c67-4013-85ee-381cac7650c8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.190838 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.190791    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2de2d64c-3c67-4013-85ee-381cac7650c8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.191481 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.191300    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2de2d64c-3c67-4013-85ee-381cac7650c8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.191481 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.191431    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2de2d64c-3c67-4013-85ee-381cac7650c8-web-config\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.191481 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.191473    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2de2d64c-3c67-4013-85ee-381cac7650c8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.193737 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.192051    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2de2d64c-3c67-4013-85ee-381cac7650c8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.193737 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.192804    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2de2d64c-3c67-4013-85ee-381cac7650c8-config-out\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.193737 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.193255    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2de2d64c-3c67-4013-85ee-381cac7650c8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.193737 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.193391    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2de2d64c-3c67-4013-85ee-381cac7650c8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.193737 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.193543    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2de2d64c-3c67-4013-85ee-381cac7650c8-config\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.194956 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.194850    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2de2d64c-3c67-4013-85ee-381cac7650c8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.194956 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.194908    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2de2d64c-3c67-4013-85ee-381cac7650c8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.195121 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.194999    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2de2d64c-3c67-4013-85ee-381cac7650c8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.195415 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.195392    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2de2d64c-3c67-4013-85ee-381cac7650c8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.196345 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.196295    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2de2d64c-3c67-4013-85ee-381cac7650c8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.198041 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.198024    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfj6w\" (UniqueName: \"kubernetes.io/projected/2de2d64c-3c67-4013-85ee-381cac7650c8-kube-api-access-wfj6w\") pod \"prometheus-k8s-0\" (UID: \"2de2d64c-3c67-4013-85ee-381cac7650c8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.315942 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.315881    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 03:59:00.451161 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.451137    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 09 03:59:00.452973 ip-10-0-134-121 kubenswrapper[2582]: W0709 03:59:00.452946    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2de2d64c_3c67_4013_85ee_381cac7650c8.slice/crio-db673411d537847290bdf950816bae83f1a65a6d3f58bb502c983e6f2b54ab8c WatchSource:0}: Error finding container db673411d537847290bdf950816bae83f1a65a6d3f58bb502c983e6f2b54ab8c: Status 404 returned error can't find the container with id db673411d537847290bdf950816bae83f1a65a6d3f58bb502c983e6f2b54ab8c
Jul 09 03:59:00.950579 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.950540    2582 generic.go:356] "Generic (PLEG): container finished" podID="2de2d64c-3c67-4013-85ee-381cac7650c8" containerID="5b5c2a282de6bb266f6278d8e2a3ba1da621426cc312f810f4f5ca7a394c8a71" exitCode=0
Jul 09 03:59:00.950801 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.950628    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2de2d64c-3c67-4013-85ee-381cac7650c8","Type":"ContainerDied","Data":"5b5c2a282de6bb266f6278d8e2a3ba1da621426cc312f810f4f5ca7a394c8a71"}
Jul 09 03:59:00.950801 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:00.950695    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2de2d64c-3c67-4013-85ee-381cac7650c8","Type":"ContainerStarted","Data":"db673411d537847290bdf950816bae83f1a65a6d3f58bb502c983e6f2b54ab8c"}
Jul 09 03:59:01.958905 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:01.958857    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2de2d64c-3c67-4013-85ee-381cac7650c8","Type":"ContainerStarted","Data":"679af30815fcb0ff40c39008f3eb111de4671f2493acd2f49a979f112c122bd3"}
Jul 09 03:59:01.959252 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:01.958961    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2de2d64c-3c67-4013-85ee-381cac7650c8","Type":"ContainerStarted","Data":"40118225a0ca7677e1a60427de7e4a497dfa569d46a0e5ece0b1b4b3aa607d9e"}
Jul 09 03:59:01.959252 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:01.958988    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2de2d64c-3c67-4013-85ee-381cac7650c8","Type":"ContainerStarted","Data":"b16c4c13ccbb03aebb368cc6b51811687c8a8f0a149306c9d707d069c7aed4bc"}
Jul 09 03:59:01.959252 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:01.959013    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2de2d64c-3c67-4013-85ee-381cac7650c8","Type":"ContainerStarted","Data":"c930dd97649550fa6dca2a85c8cd72e78d26c95d84c79e897e38e5e0666ed0f5"}
Jul 09 03:59:01.959252 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:01.959037    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2de2d64c-3c67-4013-85ee-381cac7650c8","Type":"ContainerStarted","Data":"dd353d924ca95a585eadc628092f954c1d431785c60b149204d447d16011bdd0"}
Jul 09 03:59:01.959252 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:01.959060    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2de2d64c-3c67-4013-85ee-381cac7650c8","Type":"ContainerStarted","Data":"98b1b0db79eb1d64ecaef2c7844117f8490bb20c135db0c6a1ba7235e852b593"}
Jul 09 03:59:01.988510 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:01.988460    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.969981906 podStartE2EDuration="2.988444474s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.462568ms" isStatefulPod=false podCreationTimestamp="2026-07-09 03:58:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 03:59:01.986507657 +0000 UTC m=+168.430637731" watchObservedRunningTime="2026-07-09 03:59:01.988444474 +0000 UTC m=+168.432574569"
Jul 09 03:59:05.316438 ip-10-0-134-121 kubenswrapper[2582]: I0709 03:59:05.316390    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 04:00:00.316441 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:00.316397    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 04:00:00.331265 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:00.331238    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 04:00:01.174462 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:01.174436    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 09 04:00:34.564592 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:34.564560    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-gwmvw"]
Jul 09 04:00:34.567937 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:34.567918    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-gwmvw"
Jul 09 04:00:34.570706 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:34.570683    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 04:00:34.570942 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:34.570746    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mnmqz\""
Jul 09 04:00:34.571508 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:34.571494    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 04:00:34.571675 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:34.571659    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 04:00:34.571870 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:34.571855    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 04:00:34.584377 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:34.584355    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-gwmvw"]
Jul 09 04:00:34.630745 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:34.630719    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1abb00fc-797d-498d-afc8-927022f790fb-manifests\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-gwmvw\" (UID: \"1abb00fc-797d-498d-afc8-927022f790fb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-gwmvw"
Jul 09 04:00:34.630872 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:34.630753    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1abb00fc-797d-498d-afc8-927022f790fb-tmp\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-gwmvw\" (UID: \"1abb00fc-797d-498d-afc8-927022f790fb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-gwmvw"
Jul 09 04:00:34.630872 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:34.630794    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1abb00fc-797d-498d-afc8-927022f790fb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-gwmvw\" (UID: \"1abb00fc-797d-498d-afc8-927022f790fb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-gwmvw"
Jul 09 04:00:34.630996 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:34.630863    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsqfs\" (UniqueName: \"kubernetes.io/projected/1abb00fc-797d-498d-afc8-927022f790fb-kube-api-access-fsqfs\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-gwmvw\" (UID: \"1abb00fc-797d-498d-afc8-927022f790fb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-gwmvw"
Jul 09 04:00:34.630996 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:34.630952    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1abb00fc-797d-498d-afc8-927022f790fb-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-gwmvw\" (UID: \"1abb00fc-797d-498d-afc8-927022f790fb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-gwmvw"
Jul 09 04:00:34.731583 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:34.731555    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1abb00fc-797d-498d-afc8-927022f790fb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-gwmvw\" (UID: \"1abb00fc-797d-498d-afc8-927022f790fb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-gwmvw"
Jul 09 04:00:34.731714 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:34.731596    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsqfs\" (UniqueName: \"kubernetes.io/projected/1abb00fc-797d-498d-afc8-927022f790fb-kube-api-access-fsqfs\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-gwmvw\" (UID: \"1abb00fc-797d-498d-afc8-927022f790fb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-gwmvw"
Jul 09 04:00:34.731714 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:34.731640    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1abb00fc-797d-498d-afc8-927022f790fb-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-gwmvw\" (UID: \"1abb00fc-797d-498d-afc8-927022f790fb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-gwmvw"
Jul 09 04:00:34.731714 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:34.731672    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1abb00fc-797d-498d-afc8-927022f790fb-manifests\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-gwmvw\" (UID: \"1abb00fc-797d-498d-afc8-927022f790fb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-gwmvw"
Jul 09 04:00:34.731714 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:34.731703    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1abb00fc-797d-498d-afc8-927022f790fb-tmp\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-gwmvw\" (UID: \"1abb00fc-797d-498d-afc8-927022f790fb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-gwmvw"
Jul 09 04:00:34.732122 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:34.732092    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1abb00fc-797d-498d-afc8-927022f790fb-manifests\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-gwmvw\" (UID: \"1abb00fc-797d-498d-afc8-927022f790fb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-gwmvw"
Jul 09 04:00:34.733960 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:34.733938    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1abb00fc-797d-498d-afc8-927022f790fb-tmp\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-gwmvw\" (UID: \"1abb00fc-797d-498d-afc8-927022f790fb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-gwmvw"
Jul 09 04:00:34.734173 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:34.734157    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1abb00fc-797d-498d-afc8-927022f790fb-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-gwmvw\" (UID: \"1abb00fc-797d-498d-afc8-927022f790fb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-gwmvw"
Jul 09 04:00:34.734216 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:34.734178    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1abb00fc-797d-498d-afc8-927022f790fb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-gwmvw\" (UID: \"1abb00fc-797d-498d-afc8-927022f790fb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-gwmvw"
Jul 09 04:00:34.741626 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:34.741604    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsqfs\" (UniqueName: \"kubernetes.io/projected/1abb00fc-797d-498d-afc8-927022f790fb-kube-api-access-fsqfs\") pod \"opendatahub-operator-controller-manager-7d756d6f6f-gwmvw\" (UID: \"1abb00fc-797d-498d-afc8-927022f790fb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-gwmvw"
Jul 09 04:00:34.878317 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:34.878294    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-gwmvw"
Jul 09 04:00:35.010725 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:35.010701    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-gwmvw"]
Jul 09 04:00:35.013561 ip-10-0-134-121 kubenswrapper[2582]: W0709 04:00:35.013534    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1abb00fc_797d_498d_afc8_927022f790fb.slice/crio-f2f0ac20432ecb858c5413da3458e61efdca617541f4c53dccbdcfecc4560ab3 WatchSource:0}: Error finding container f2f0ac20432ecb858c5413da3458e61efdca617541f4c53dccbdcfecc4560ab3: Status 404 returned error can't find the container with id f2f0ac20432ecb858c5413da3458e61efdca617541f4c53dccbdcfecc4560ab3
Jul 09 04:00:35.264645 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:35.264556    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-gwmvw" event={"ID":"1abb00fc-797d-498d-afc8-927022f790fb","Type":"ContainerStarted","Data":"f2f0ac20432ecb858c5413da3458e61efdca617541f4c53dccbdcfecc4560ab3"}
Jul 09 04:00:38.277388 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:38.277341    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-gwmvw" event={"ID":"1abb00fc-797d-498d-afc8-927022f790fb","Type":"ContainerStarted","Data":"124a951aaa10c27d16307d2c781cf06f87ec643ac7102ae2f14b970a2faa0213"}
Jul 09 04:00:39.282412 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:39.282380    2582 generic.go:356] "Generic (PLEG): container finished" podID="1abb00fc-797d-498d-afc8-927022f790fb" containerID="124a951aaa10c27d16307d2c781cf06f87ec643ac7102ae2f14b970a2faa0213" exitCode=0
Jul 09 04:00:39.282781 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:39.282443    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-gwmvw" event={"ID":"1abb00fc-797d-498d-afc8-927022f790fb","Type":"ContainerDied","Data":"124a951aaa10c27d16307d2c781cf06f87ec643ac7102ae2f14b970a2faa0213"}
Jul 09 04:00:40.287973 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:40.287935    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-gwmvw" event={"ID":"1abb00fc-797d-498d-afc8-927022f790fb","Type":"ContainerStarted","Data":"2b78e5caff8eae1e1d743c0c4c405448e1ae5e094c901bf051bf8c963e4c6909"}
Jul 09 04:00:40.288439 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:40.288042    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-gwmvw"
Jul 09 04:00:40.310645 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:40.310595    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-gwmvw" podStartSLOduration=1.7665219479999998 podStartE2EDuration="6.310578901s" totalImagesPullingTime="3.55399394s" totalInitContainerRuntime="990.063013ms" isStatefulPod=false podCreationTimestamp="2026-07-09 04:00:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:00:40.309559623 +0000 UTC m=+266.753689696" watchObservedRunningTime="2026-07-09 04:00:40.310578901 +0000 UTC m=+266.754708973"
Jul 09 04:00:51.294152 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:51.294124    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d756d6f6f-gwmvw"
Jul 09 04:00:55.349930 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:55.349872    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-789458d7cb-gc7dh"]
Jul 09 04:00:55.361284 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:55.361255    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-789458d7cb-gc7dh"
Jul 09 04:00:55.363060 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:55.363000    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-789458d7cb-gc7dh"]
Jul 09 04:00:55.365708 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:55.365679    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 09 04:00:55.365974 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:55.365956    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 09 04:00:55.366171 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:55.366154    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-csmxc\""
Jul 09 04:00:55.366253 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:55.366236    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 09 04:00:55.366853 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:55.366463    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 09 04:00:55.366853 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:55.366640    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 09 04:00:55.480391 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:55.480362    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/32e98a40-2535-4314-b00c-f13e5e1f5205-manager-config\") pod \"lws-controller-manager-789458d7cb-gc7dh\" (UID: \"32e98a40-2535-4314-b00c-f13e5e1f5205\") " pod="openshift-lws-operator/lws-controller-manager-789458d7cb-gc7dh"
Jul 09 04:00:55.480547 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:55.480416    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk26c\" (UniqueName: \"kubernetes.io/projected/32e98a40-2535-4314-b00c-f13e5e1f5205-kube-api-access-zk26c\") pod \"lws-controller-manager-789458d7cb-gc7dh\" (UID: \"32e98a40-2535-4314-b00c-f13e5e1f5205\") " pod="openshift-lws-operator/lws-controller-manager-789458d7cb-gc7dh"
Jul 09 04:00:55.480547 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:55.480495    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32e98a40-2535-4314-b00c-f13e5e1f5205-cert\") pod \"lws-controller-manager-789458d7cb-gc7dh\" (UID: \"32e98a40-2535-4314-b00c-f13e5e1f5205\") " pod="openshift-lws-operator/lws-controller-manager-789458d7cb-gc7dh"
Jul 09 04:00:55.480547 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:55.480521    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/32e98a40-2535-4314-b00c-f13e5e1f5205-metrics-cert\") pod \"lws-controller-manager-789458d7cb-gc7dh\" (UID: \"32e98a40-2535-4314-b00c-f13e5e1f5205\") " pod="openshift-lws-operator/lws-controller-manager-789458d7cb-gc7dh"
Jul 09 04:00:55.581395 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:55.581361    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/32e98a40-2535-4314-b00c-f13e5e1f5205-manager-config\") pod \"lws-controller-manager-789458d7cb-gc7dh\" (UID: \"32e98a40-2535-4314-b00c-f13e5e1f5205\") " pod="openshift-lws-operator/lws-controller-manager-789458d7cb-gc7dh"
Jul 09 04:00:55.581395 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:55.581399    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk26c\" (UniqueName: \"kubernetes.io/projected/32e98a40-2535-4314-b00c-f13e5e1f5205-kube-api-access-zk26c\") pod \"lws-controller-manager-789458d7cb-gc7dh\" (UID: \"32e98a40-2535-4314-b00c-f13e5e1f5205\") " pod="openshift-lws-operator/lws-controller-manager-789458d7cb-gc7dh"
Jul 09 04:00:55.581619 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:55.581427    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32e98a40-2535-4314-b00c-f13e5e1f5205-cert\") pod \"lws-controller-manager-789458d7cb-gc7dh\" (UID: \"32e98a40-2535-4314-b00c-f13e5e1f5205\") " pod="openshift-lws-operator/lws-controller-manager-789458d7cb-gc7dh"
Jul 09 04:00:55.581619 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:55.581442    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/32e98a40-2535-4314-b00c-f13e5e1f5205-metrics-cert\") pod \"lws-controller-manager-789458d7cb-gc7dh\" (UID: \"32e98a40-2535-4314-b00c-f13e5e1f5205\") " pod="openshift-lws-operator/lws-controller-manager-789458d7cb-gc7dh"
Jul 09 04:00:55.582038 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:55.582012    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/32e98a40-2535-4314-b00c-f13e5e1f5205-manager-config\") pod \"lws-controller-manager-789458d7cb-gc7dh\" (UID: \"32e98a40-2535-4314-b00c-f13e5e1f5205\") " pod="openshift-lws-operator/lws-controller-manager-789458d7cb-gc7dh"
Jul 09 04:00:55.583772 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:55.583747    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/32e98a40-2535-4314-b00c-f13e5e1f5205-cert\") pod \"lws-controller-manager-789458d7cb-gc7dh\" (UID: \"32e98a40-2535-4314-b00c-f13e5e1f5205\") " pod="openshift-lws-operator/lws-controller-manager-789458d7cb-gc7dh"
Jul 09 04:00:55.583862 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:55.583845    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/32e98a40-2535-4314-b00c-f13e5e1f5205-metrics-cert\") pod \"lws-controller-manager-789458d7cb-gc7dh\" (UID: \"32e98a40-2535-4314-b00c-f13e5e1f5205\") " pod="openshift-lws-operator/lws-controller-manager-789458d7cb-gc7dh"
Jul 09 04:00:55.610055 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:55.609996    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk26c\" (UniqueName: \"kubernetes.io/projected/32e98a40-2535-4314-b00c-f13e5e1f5205-kube-api-access-zk26c\") pod \"lws-controller-manager-789458d7cb-gc7dh\" (UID: \"32e98a40-2535-4314-b00c-f13e5e1f5205\") " pod="openshift-lws-operator/lws-controller-manager-789458d7cb-gc7dh"
Jul 09 04:00:55.674031 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:55.674002    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-789458d7cb-gc7dh"
Jul 09 04:00:55.805239 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:55.805210    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-789458d7cb-gc7dh"]
Jul 09 04:00:55.808500 ip-10-0-134-121 kubenswrapper[2582]: W0709 04:00:55.808475    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32e98a40_2535_4314_b00c_f13e5e1f5205.slice/crio-60b381d101d91b3955b149ddb9cf320f5e1279f8734f48b95f9e0c416ee8cd68 WatchSource:0}: Error finding container 60b381d101d91b3955b149ddb9cf320f5e1279f8734f48b95f9e0c416ee8cd68: Status 404 returned error can't find the container with id 60b381d101d91b3955b149ddb9cf320f5e1279f8734f48b95f9e0c416ee8cd68
Jul 09 04:00:56.342103 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:00:56.342067    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-789458d7cb-gc7dh" event={"ID":"32e98a40-2535-4314-b00c-f13e5e1f5205","Type":"ContainerStarted","Data":"60b381d101d91b3955b149ddb9cf320f5e1279f8734f48b95f9e0c416ee8cd68"}
Jul 09 04:01:00.362121 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:00.362074    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-789458d7cb-gc7dh" event={"ID":"32e98a40-2535-4314-b00c-f13e5e1f5205","Type":"ContainerStarted","Data":"3a6ffc125cee5522bba6d2cc86fc385c45411a17bcc57f78eeab0a5da3853f63"}
Jul 09 04:01:00.362571 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:00.362149    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-789458d7cb-gc7dh"
Jul 09 04:01:00.380460 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:00.380399    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-789458d7cb-gc7dh" podStartSLOduration=1.6953494930000002 podStartE2EDuration="5.380383262s" totalImagesPullingTime="3.685033769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:00:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:01:00.37819749 +0000 UTC m=+286.822327564" watchObservedRunningTime="2026-07-09 04:01:00.380383262 +0000 UTC m=+286.824513337"
Jul 09 04:01:01.919595 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:01.919555    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"]
Jul 09 04:01:01.922676 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:01.922654    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:01.925574 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:01.925532    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 04:01:01.925676 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:01.925624    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 04:01:01.925676 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:01.925638    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-thcjq\""
Jul 09 04:01:01.925833 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:01.925810    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 09 04:01:01.942437 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:01.942411    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"]
Jul 09 04:01:02.038067 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.038033    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e497ea1b-1298-413e-be8d-64f451c82d61-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:02.038067 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.038075    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:02.038267 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.038093    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e497ea1b-1298-413e-be8d-64f451c82d61-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:02.038267 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.038183    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8d27\" (UniqueName: \"kubernetes.io/projected/e497ea1b-1298-413e-be8d-64f451c82d61-kube-api-access-h8d27\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:02.038267 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.038253    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:02.038361 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.038285    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e497ea1b-1298-413e-be8d-64f451c82d61-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:02.038361 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.038303    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:02.038361 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.038318    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:02.038361 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.038342    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:02.111337 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.111298    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"]
Jul 09 04:01:02.114511 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.114481    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.115624 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.115602    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9"]
Jul 09 04:01:02.118545 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.118528    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9"
Jul 09 04:01:02.121355 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.121331    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-txtnc\""
Jul 09 04:01:02.121638 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.121618    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 09 04:01:02.121705 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.121621    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 09 04:01:02.121705 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.121667    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 09 04:01:02.128418 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.128392    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"]
Jul 09 04:01:02.131749 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.131726    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9"]
Jul 09 04:01:02.138789 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.138762    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:02.138946 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.138801    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e497ea1b-1298-413e-be8d-64f451c82d61-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:02.138946 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.138821    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:02.138946 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.138863    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:02.138946 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.138926    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:02.139172 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.138967    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e497ea1b-1298-413e-be8d-64f451c82d61-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:02.139172 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.138996    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:02.139172 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.139018    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e497ea1b-1298-413e-be8d-64f451c82d61-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:02.139172 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.139057    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8d27\" (UniqueName: \"kubernetes.io/projected/e497ea1b-1298-413e-be8d-64f451c82d61-kube-api-access-h8d27\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:02.139369 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.139190    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:02.139369 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.139212    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:02.139634 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.139611    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:02.139789 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.139727    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:02.140396 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.140371    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e497ea1b-1298-413e-be8d-64f451c82d61-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:02.141481 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.141451    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:02.141624 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.141608    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e497ea1b-1298-413e-be8d-64f451c82d61-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:02.147456 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.147352    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e497ea1b-1298-413e-be8d-64f451c82d61-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:02.151488 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.151441    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8d27\" (UniqueName: \"kubernetes.io/projected/e497ea1b-1298-413e-be8d-64f451c82d61-kube-api-access-h8d27\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:02.233147 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.233049    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:02.239450 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.239426    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/856dc76d-4779-4d58-95a0-c07a0196d498-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f99q5\" (UID: \"856dc76d-4779-4d58-95a0-c07a0196d498\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.239568 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.239458    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/856dc76d-4779-4d58-95a0-c07a0196d498-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f99q5\" (UID: \"856dc76d-4779-4d58-95a0-c07a0196d498\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.239568 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.239480    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/72461646-3392-44e7-a9ba-5085d22cbb88-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-lwtn9\" (UID: \"72461646-3392-44e7-a9ba-5085d22cbb88\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9"
Jul 09 04:01:02.239568 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.239496    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnwfb\" (UniqueName: \"kubernetes.io/projected/72461646-3392-44e7-a9ba-5085d22cbb88-kube-api-access-lnwfb\") pod \"istiod-openshift-gateway-94bb8fbfd-lwtn9\" (UID: \"72461646-3392-44e7-a9ba-5085d22cbb88\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9"
Jul 09 04:01:02.239568 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.239555    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfhl2\" (UniqueName: \"kubernetes.io/projected/856dc76d-4779-4d58-95a0-c07a0196d498-kube-api-access-wfhl2\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f99q5\" (UID: \"856dc76d-4779-4d58-95a0-c07a0196d498\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.239724 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.239590    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/856dc76d-4779-4d58-95a0-c07a0196d498-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f99q5\" (UID: \"856dc76d-4779-4d58-95a0-c07a0196d498\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.239724 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.239618    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/856dc76d-4779-4d58-95a0-c07a0196d498-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f99q5\" (UID: \"856dc76d-4779-4d58-95a0-c07a0196d498\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.239724 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.239636    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/856dc76d-4779-4d58-95a0-c07a0196d498-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f99q5\" (UID: \"856dc76d-4779-4d58-95a0-c07a0196d498\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.239724 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.239656    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/72461646-3392-44e7-a9ba-5085d22cbb88-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-lwtn9\" (UID: \"72461646-3392-44e7-a9ba-5085d22cbb88\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9"
Jul 09 04:01:02.239724 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.239706    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/856dc76d-4779-4d58-95a0-c07a0196d498-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f99q5\" (UID: \"856dc76d-4779-4d58-95a0-c07a0196d498\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.239944 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.239740    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/72461646-3392-44e7-a9ba-5085d22cbb88-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-lwtn9\" (UID: \"72461646-3392-44e7-a9ba-5085d22cbb88\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9"
Jul 09 04:01:02.239944 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.239758    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/72461646-3392-44e7-a9ba-5085d22cbb88-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-lwtn9\" (UID: \"72461646-3392-44e7-a9ba-5085d22cbb88\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9"
Jul 09 04:01:02.239944 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.239783    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/856dc76d-4779-4d58-95a0-c07a0196d498-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f99q5\" (UID: \"856dc76d-4779-4d58-95a0-c07a0196d498\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.239944 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.239801    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72461646-3392-44e7-a9ba-5085d22cbb88-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-lwtn9\" (UID: \"72461646-3392-44e7-a9ba-5085d22cbb88\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9"
Jul 09 04:01:02.239944 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.239816    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/72461646-3392-44e7-a9ba-5085d22cbb88-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-lwtn9\" (UID: \"72461646-3392-44e7-a9ba-5085d22cbb88\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9"
Jul 09 04:01:02.239944 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.239919    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/856dc76d-4779-4d58-95a0-c07a0196d498-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f99q5\" (UID: \"856dc76d-4779-4d58-95a0-c07a0196d498\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.340490 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.340450    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/856dc76d-4779-4d58-95a0-c07a0196d498-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f99q5\" (UID: \"856dc76d-4779-4d58-95a0-c07a0196d498\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.340657 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.340509    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/856dc76d-4779-4d58-95a0-c07a0196d498-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f99q5\" (UID: \"856dc76d-4779-4d58-95a0-c07a0196d498\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.340657 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.340544    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/72461646-3392-44e7-a9ba-5085d22cbb88-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-lwtn9\" (UID: \"72461646-3392-44e7-a9ba-5085d22cbb88\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9"
Jul 09 04:01:02.340657 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.340571    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnwfb\" (UniqueName: \"kubernetes.io/projected/72461646-3392-44e7-a9ba-5085d22cbb88-kube-api-access-lnwfb\") pod \"istiod-openshift-gateway-94bb8fbfd-lwtn9\" (UID: \"72461646-3392-44e7-a9ba-5085d22cbb88\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9"
Jul 09 04:01:02.340657 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.340601    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfhl2\" (UniqueName: \"kubernetes.io/projected/856dc76d-4779-4d58-95a0-c07a0196d498-kube-api-access-wfhl2\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f99q5\" (UID: \"856dc76d-4779-4d58-95a0-c07a0196d498\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.340657 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.340635    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/856dc76d-4779-4d58-95a0-c07a0196d498-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f99q5\" (UID: \"856dc76d-4779-4d58-95a0-c07a0196d498\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.340957 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.340684    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/856dc76d-4779-4d58-95a0-c07a0196d498-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f99q5\" (UID: \"856dc76d-4779-4d58-95a0-c07a0196d498\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.340957 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.340712    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/856dc76d-4779-4d58-95a0-c07a0196d498-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f99q5\" (UID: \"856dc76d-4779-4d58-95a0-c07a0196d498\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.340957 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.340743    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/72461646-3392-44e7-a9ba-5085d22cbb88-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-lwtn9\" (UID: \"72461646-3392-44e7-a9ba-5085d22cbb88\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9"
Jul 09 04:01:02.340957 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.340797    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/856dc76d-4779-4d58-95a0-c07a0196d498-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f99q5\" (UID: \"856dc76d-4779-4d58-95a0-c07a0196d498\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.340957 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.340850    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/72461646-3392-44e7-a9ba-5085d22cbb88-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-lwtn9\" (UID: \"72461646-3392-44e7-a9ba-5085d22cbb88\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9"
Jul 09 04:01:02.340957 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.340880    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/72461646-3392-44e7-a9ba-5085d22cbb88-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-lwtn9\" (UID: \"72461646-3392-44e7-a9ba-5085d22cbb88\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9"
Jul 09 04:01:02.340957 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.340935    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/856dc76d-4779-4d58-95a0-c07a0196d498-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f99q5\" (UID: \"856dc76d-4779-4d58-95a0-c07a0196d498\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.341301 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.340952    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/856dc76d-4779-4d58-95a0-c07a0196d498-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f99q5\" (UID: \"856dc76d-4779-4d58-95a0-c07a0196d498\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.341301 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.340965    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72461646-3392-44e7-a9ba-5085d22cbb88-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-lwtn9\" (UID: \"72461646-3392-44e7-a9ba-5085d22cbb88\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9"
Jul 09 04:01:02.341301 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.341036    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/72461646-3392-44e7-a9ba-5085d22cbb88-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-lwtn9\" (UID: \"72461646-3392-44e7-a9ba-5085d22cbb88\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9"
Jul 09 04:01:02.341301 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.341092    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/856dc76d-4779-4d58-95a0-c07a0196d498-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f99q5\" (UID: \"856dc76d-4779-4d58-95a0-c07a0196d498\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.341499 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.341411    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/856dc76d-4779-4d58-95a0-c07a0196d498-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f99q5\" (UID: \"856dc76d-4779-4d58-95a0-c07a0196d498\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.342154 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.341752    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/856dc76d-4779-4d58-95a0-c07a0196d498-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f99q5\" (UID: \"856dc76d-4779-4d58-95a0-c07a0196d498\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.342154 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.341852    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/856dc76d-4779-4d58-95a0-c07a0196d498-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f99q5\" (UID: \"856dc76d-4779-4d58-95a0-c07a0196d498\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.342154 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.341869    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/72461646-3392-44e7-a9ba-5085d22cbb88-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-lwtn9\" (UID: \"72461646-3392-44e7-a9ba-5085d22cbb88\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9"
Jul 09 04:01:02.342414 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.342390    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/856dc76d-4779-4d58-95a0-c07a0196d498-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f99q5\" (UID: \"856dc76d-4779-4d58-95a0-c07a0196d498\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.343569 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.343545    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/856dc76d-4779-4d58-95a0-c07a0196d498-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f99q5\" (UID: \"856dc76d-4779-4d58-95a0-c07a0196d498\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.343734 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.343671    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/72461646-3392-44e7-a9ba-5085d22cbb88-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-lwtn9\" (UID: \"72461646-3392-44e7-a9ba-5085d22cbb88\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9"
Jul 09 04:01:02.343967 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.343852    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/856dc76d-4779-4d58-95a0-c07a0196d498-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f99q5\" (UID: \"856dc76d-4779-4d58-95a0-c07a0196d498\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.343967 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.343926    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/72461646-3392-44e7-a9ba-5085d22cbb88-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-lwtn9\" (UID: \"72461646-3392-44e7-a9ba-5085d22cbb88\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9"
Jul 09 04:01:02.344319 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.344290    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/72461646-3392-44e7-a9ba-5085d22cbb88-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-lwtn9\" (UID: \"72461646-3392-44e7-a9ba-5085d22cbb88\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9"
Jul 09 04:01:02.344585 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.344569    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/72461646-3392-44e7-a9ba-5085d22cbb88-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-lwtn9\" (UID: \"72461646-3392-44e7-a9ba-5085d22cbb88\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9"
Jul 09 04:01:02.357806 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.357781    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/856dc76d-4779-4d58-95a0-c07a0196d498-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f99q5\" (UID: \"856dc76d-4779-4d58-95a0-c07a0196d498\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.358466 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.358444    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfhl2\" (UniqueName: \"kubernetes.io/projected/856dc76d-4779-4d58-95a0-c07a0196d498-kube-api-access-wfhl2\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f99q5\" (UID: \"856dc76d-4779-4d58-95a0-c07a0196d498\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.358665 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.358648    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72461646-3392-44e7-a9ba-5085d22cbb88-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-lwtn9\" (UID: \"72461646-3392-44e7-a9ba-5085d22cbb88\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9"
Jul 09 04:01:02.364813 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.364792    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnwfb\" (UniqueName: \"kubernetes.io/projected/72461646-3392-44e7-a9ba-5085d22cbb88-kube-api-access-lnwfb\") pod \"istiod-openshift-gateway-94bb8fbfd-lwtn9\" (UID: \"72461646-3392-44e7-a9ba-5085d22cbb88\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9"
Jul 09 04:01:02.390500 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.390424    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"]
Jul 09 04:01:02.392990 ip-10-0-134-121 kubenswrapper[2582]: W0709 04:01:02.392966    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode497ea1b_1298_413e_be8d_64f451c82d61.slice/crio-11f96dc0d12e90380b7b3d70754b8e09433319962a9539dcddc46d8e2d572212 WatchSource:0}: Error finding container 11f96dc0d12e90380b7b3d70754b8e09433319962a9539dcddc46d8e2d572212: Status 404 returned error can't find the container with id 11f96dc0d12e90380b7b3d70754b8e09433319962a9539dcddc46d8e2d572212
Jul 09 04:01:02.428526 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.428491    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:02.439066 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.439036    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9"
Jul 09 04:01:02.592523 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.592494    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"]
Jul 09 04:01:02.594862 ip-10-0-134-121 kubenswrapper[2582]: W0709 04:01:02.594833    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod856dc76d_4779_4d58_95a0_c07a0196d498.slice/crio-6838d32c162bc00f521934f4a0e8665a45615be3f89d778092ba122386cf1ffc WatchSource:0}: Error finding container 6838d32c162bc00f521934f4a0e8665a45615be3f89d778092ba122386cf1ffc: Status 404 returned error can't find the container with id 6838d32c162bc00f521934f4a0e8665a45615be3f89d778092ba122386cf1ffc
Jul 09 04:01:02.611547 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:02.611504    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9"]
Jul 09 04:01:02.614437 ip-10-0-134-121 kubenswrapper[2582]: W0709 04:01:02.614410    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72461646_3392_44e7_a9ba_5085d22cbb88.slice/crio-a2a2e7e6920a5bad5f51a3a54fa9a303a9633a4e56e06e1a10119a9e1a7feadc WatchSource:0}: Error finding container a2a2e7e6920a5bad5f51a3a54fa9a303a9633a4e56e06e1a10119a9e1a7feadc: Status 404 returned error can't find the container with id a2a2e7e6920a5bad5f51a3a54fa9a303a9633a4e56e06e1a10119a9e1a7feadc
Jul 09 04:01:03.377070 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:03.376578    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9" event={"ID":"72461646-3392-44e7-a9ba-5085d22cbb88","Type":"ContainerStarted","Data":"a2a2e7e6920a5bad5f51a3a54fa9a303a9633a4e56e06e1a10119a9e1a7feadc"}
Jul 09 04:01:03.388414 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:03.388248    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5" event={"ID":"856dc76d-4779-4d58-95a0-c07a0196d498","Type":"ContainerStarted","Data":"6838d32c162bc00f521934f4a0e8665a45615be3f89d778092ba122386cf1ffc"}
Jul 09 04:01:03.392804 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:03.392072    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj" event={"ID":"e497ea1b-1298-413e-be8d-64f451c82d61","Type":"ContainerStarted","Data":"11f96dc0d12e90380b7b3d70754b8e09433319962a9539dcddc46d8e2d572212"}
Jul 09 04:01:06.452270 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:06.452231    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:01:06.452612 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:06.452308    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:01:06.452612 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:06.452580    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:01:06.452714 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:06.452653    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:01:06.452714 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:06.452704    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:01:06.459411 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:06.459388    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:01:06.459487 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:06.459441    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:01:06.459487 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:06.459468    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:01:07.409469 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:07.409437    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9" event={"ID":"72461646-3392-44e7-a9ba-5085d22cbb88","Type":"ContainerStarted","Data":"9399b59c34e4a54cd20bcce08947562c6e6a5fd2a19fd5fb1e746ff8afc12230"}
Jul 09 04:01:07.409670 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:07.409631    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9"
Jul 09 04:01:07.411163 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:07.411130    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5" event={"ID":"856dc76d-4779-4d58-95a0-c07a0196d498","Type":"ContainerStarted","Data":"d20d8d568c5c428c7f293ed3d4c30dc6fe08e588d96b69e0adf484eb15a56bfe"}
Jul 09 04:01:07.411581 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:07.411553    2582 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-lwtn9 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 04:01:07.411685 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:07.411596    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9" podUID="72461646-3392-44e7-a9ba-5085d22cbb88" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 04:01:07.412622 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:07.412603    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj" event={"ID":"e497ea1b-1298-413e-be8d-64f451c82d61","Type":"ContainerStarted","Data":"ee4495b26e32fd09df4ecb11642f1ff3134cf0a713c5f1664fd2dfcb789aa444"}
Jul 09 04:01:07.428781 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:07.428757    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:07.432055 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:07.432007    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9" podStartSLOduration=1.596860902 podStartE2EDuration="5.431991307s" totalImagesPullingTime="3.835130405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:01:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:01:07.430735567 +0000 UTC m=+293.874865642" watchObservedRunningTime="2026-07-09 04:01:07.431991307 +0000 UTC m=+293.876121380"
Jul 09 04:01:07.433915 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:07.433877    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:07.450020 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:07.449974    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5" podStartSLOduration=1.5877240769999998 podStartE2EDuration="5.449962254s" totalImagesPullingTime="3.862238177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:01:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:01:07.449157619 +0000 UTC m=+293.893287693" watchObservedRunningTime="2026-07-09 04:01:07.449962254 +0000 UTC m=+293.894092327"
Jul 09 04:01:07.470167 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:07.470127    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj" podStartSLOduration=2.412800051 podStartE2EDuration="6.470113367s" totalImagesPullingTime="4.057313316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:01:07.469137464 +0000 UTC m=+293.913267568" watchObservedRunningTime="2026-07-09 04:01:07.470113367 +0000 UTC m=+293.914243530"
Jul 09 04:01:08.233501 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:08.233466    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:08.234723 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:08.234697    2582 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.16:15021/healthz/ready\": dial tcp 10.134.0.16:15021: connect: connection refused" start-of-body=
Jul 09 04:01:08.234859 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:08.234762    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj" podUID="e497ea1b-1298-413e-be8d-64f451c82d61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.16:15021/healthz/ready\": dial tcp 10.134.0.16:15021: connect: connection refused"
Jul 09 04:01:08.416583 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:08.416554    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:08.417073 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:08.417045    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-lwtn9"
Jul 09 04:01:08.417497 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:08.417480    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f99q5"
Jul 09 04:01:08.494241 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:08.494162    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"]
Jul 09 04:01:09.234119 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:09.234080    2582 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.16:15021/healthz/ready\": dial tcp 10.134.0.16:15021: connect: connection refused" start-of-body=
Jul 09 04:01:09.234286 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:09.234144    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj" podUID="e497ea1b-1298-413e-be8d-64f451c82d61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.16:15021/healthz/ready\": dial tcp 10.134.0.16:15021: connect: connection refused"
Jul 09 04:01:10.233759 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:10.233720    2582 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.16:15021/healthz/ready\": dial tcp 10.134.0.16:15021: connect: connection refused" start-of-body=
Jul 09 04:01:10.234200 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:10.233783    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj" podUID="e497ea1b-1298-413e-be8d-64f451c82d61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.16:15021/healthz/ready\": dial tcp 10.134.0.16:15021: connect: connection refused"
Jul 09 04:01:10.424199 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:10.424155    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj" podUID="e497ea1b-1298-413e-be8d-64f451c82d61" containerName="istio-proxy" containerID="cri-o://ee4495b26e32fd09df4ecb11642f1ff3134cf0a713c5f1664fd2dfcb789aa444" gracePeriod=30
Jul 09 04:01:11.368080 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:11.368054    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-789458d7cb-gc7dh"
Jul 09 04:01:14.004047 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:14.004016    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9jc2_33172081-e578-41b0-ae82-d9d52c06df2b/ovn-acl-logging/0.log"
Jul 09 04:01:14.004963 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:14.004930    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9jc2_33172081-e578-41b0-ae82-d9d52c06df2b/ovn-acl-logging/0.log"
Jul 09 04:01:14.010436 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:14.010418    2582 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 04:01:15.664391 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:15.664365    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:15.763681 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:15.763620    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8d27\" (UniqueName: \"kubernetes.io/projected/e497ea1b-1298-413e-be8d-64f451c82d61-kube-api-access-h8d27\") pod \"e497ea1b-1298-413e-be8d-64f451c82d61\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") "
Jul 09 04:01:15.763681 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:15.763659    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e497ea1b-1298-413e-be8d-64f451c82d61-istiod-ca-cert\") pod \"e497ea1b-1298-413e-be8d-64f451c82d61\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") "
Jul 09 04:01:15.763833 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:15.763694    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e497ea1b-1298-413e-be8d-64f451c82d61-istio-podinfo\") pod \"e497ea1b-1298-413e-be8d-64f451c82d61\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") "
Jul 09 04:01:15.763876 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:15.763845    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-istio-data\") pod \"e497ea1b-1298-413e-be8d-64f451c82d61\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") "
Jul 09 04:01:15.763962 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:15.763922    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-istio-envoy\") pod \"e497ea1b-1298-413e-be8d-64f451c82d61\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") "
Jul 09 04:01:15.764018 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:15.763960    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-workload-certs\") pod \"e497ea1b-1298-413e-be8d-64f451c82d61\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") "
Jul 09 04:01:15.764018 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:15.764003    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e497ea1b-1298-413e-be8d-64f451c82d61-istio-token\") pod \"e497ea1b-1298-413e-be8d-64f451c82d61\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") "
Jul 09 04:01:15.764117 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:15.764066    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-workload-socket\") pod \"e497ea1b-1298-413e-be8d-64f451c82d61\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") "
Jul 09 04:01:15.764117 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:15.764090    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-credential-socket\") pod \"e497ea1b-1298-413e-be8d-64f451c82d61\" (UID: \"e497ea1b-1298-413e-be8d-64f451c82d61\") "
Jul 09 04:01:15.764271 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:15.764114    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-istio-data" (OuterVolumeSpecName: "istio-data") pod "e497ea1b-1298-413e-be8d-64f451c82d61" (UID: "e497ea1b-1298-413e-be8d-64f451c82d61"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:01:15.764271 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:15.764160    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e497ea1b-1298-413e-be8d-64f451c82d61-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e497ea1b-1298-413e-be8d-64f451c82d61" (UID: "e497ea1b-1298-413e-be8d-64f451c82d61"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:01:15.764395 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:15.764373    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e497ea1b-1298-413e-be8d-64f451c82d61" (UID: "e497ea1b-1298-413e-be8d-64f451c82d61"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:01:15.764469 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:15.764389    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e497ea1b-1298-413e-be8d-64f451c82d61" (UID: "e497ea1b-1298-413e-be8d-64f451c82d61"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:01:15.764469 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:15.764399    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e497ea1b-1298-413e-be8d-64f451c82d61-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:01:15.764469 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:15.764437    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:01:15.764623 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:15.764495    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e497ea1b-1298-413e-be8d-64f451c82d61" (UID: "e497ea1b-1298-413e-be8d-64f451c82d61"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:01:15.766077 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:15.766045    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e497ea1b-1298-413e-be8d-64f451c82d61-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e497ea1b-1298-413e-be8d-64f451c82d61" (UID: "e497ea1b-1298-413e-be8d-64f451c82d61"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 04:01:15.766177 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:15.766078    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e497ea1b-1298-413e-be8d-64f451c82d61-kube-api-access-h8d27" (OuterVolumeSpecName: "kube-api-access-h8d27") pod "e497ea1b-1298-413e-be8d-64f451c82d61" (UID: "e497ea1b-1298-413e-be8d-64f451c82d61"). InnerVolumeSpecName "kube-api-access-h8d27". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:01:15.766177 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:15.766088    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e497ea1b-1298-413e-be8d-64f451c82d61-istio-token" (OuterVolumeSpecName: "istio-token") pod "e497ea1b-1298-413e-be8d-64f451c82d61" (UID: "e497ea1b-1298-413e-be8d-64f451c82d61"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:01:15.766177 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:15.766120    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e497ea1b-1298-413e-be8d-64f451c82d61" (UID: "e497ea1b-1298-413e-be8d-64f451c82d61"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:01:15.865297 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:15.865271    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:01:15.865297 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:15.865296    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:01:15.865452 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:15.865309    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8d27\" (UniqueName: \"kubernetes.io/projected/e497ea1b-1298-413e-be8d-64f451c82d61-kube-api-access-h8d27\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:01:15.865452 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:15.865318    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e497ea1b-1298-413e-be8d-64f451c82d61-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:01:15.865452 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:15.865328    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:01:15.865452 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:15.865336    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e497ea1b-1298-413e-be8d-64f451c82d61-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:01:15.865452 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:15.865344    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e497ea1b-1298-413e-be8d-64f451c82d61-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:01:16.449927 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:16.449809    2582 generic.go:356] "Generic (PLEG): container finished" podID="e497ea1b-1298-413e-be8d-64f451c82d61" containerID="ee4495b26e32fd09df4ecb11642f1ff3134cf0a713c5f1664fd2dfcb789aa444" exitCode=0
Jul 09 04:01:16.449927 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:16.449854    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"
Jul 09 04:01:16.449927 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:16.449865    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj" event={"ID":"e497ea1b-1298-413e-be8d-64f451c82d61","Type":"ContainerDied","Data":"ee4495b26e32fd09df4ecb11642f1ff3134cf0a713c5f1664fd2dfcb789aa444"}
Jul 09 04:01:16.450186 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:16.449947    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj" event={"ID":"e497ea1b-1298-413e-be8d-64f451c82d61","Type":"ContainerDied","Data":"11f96dc0d12e90380b7b3d70754b8e09433319962a9539dcddc46d8e2d572212"}
Jul 09 04:01:16.450186 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:16.449976    2582 scope.go:117] "RemoveContainer" containerID="ee4495b26e32fd09df4ecb11642f1ff3134cf0a713c5f1664fd2dfcb789aa444"
Jul 09 04:01:16.458098 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:16.458075    2582 scope.go:117] "RemoveContainer" containerID="ee4495b26e32fd09df4ecb11642f1ff3134cf0a713c5f1664fd2dfcb789aa444"
Jul 09 04:01:16.458344 ip-10-0-134-121 kubenswrapper[2582]: E0709 04:01:16.458323    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee4495b26e32fd09df4ecb11642f1ff3134cf0a713c5f1664fd2dfcb789aa444\": container with ID starting with ee4495b26e32fd09df4ecb11642f1ff3134cf0a713c5f1664fd2dfcb789aa444 not found: ID does not exist" containerID="ee4495b26e32fd09df4ecb11642f1ff3134cf0a713c5f1664fd2dfcb789aa444"
Jul 09 04:01:16.458390 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:16.458354    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee4495b26e32fd09df4ecb11642f1ff3134cf0a713c5f1664fd2dfcb789aa444"} err="failed to get container status \"ee4495b26e32fd09df4ecb11642f1ff3134cf0a713c5f1664fd2dfcb789aa444\": rpc error: code = NotFound desc = could not find container \"ee4495b26e32fd09df4ecb11642f1ff3134cf0a713c5f1664fd2dfcb789aa444\": container with ID starting with ee4495b26e32fd09df4ecb11642f1ff3134cf0a713c5f1664fd2dfcb789aa444 not found: ID does not exist"
Jul 09 04:01:16.468708 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:16.468687    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"]
Jul 09 04:01:16.472708 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:16.472685    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-tpsvj"]
Jul 09 04:01:18.154185 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:01:18.154154    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e497ea1b-1298-413e-be8d-64f451c82d61" path="/var/lib/kubelet/pods/e497ea1b-1298-413e-be8d-64f451c82d61/volumes"
Jul 09 04:03:40.511004 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.510926    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"]
Jul 09 04:03:40.511544 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.511307    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e497ea1b-1298-413e-be8d-64f451c82d61" containerName="istio-proxy"
Jul 09 04:03:40.511544 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.511325    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e497ea1b-1298-413e-be8d-64f451c82d61" containerName="istio-proxy"
Jul 09 04:03:40.511544 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.511462    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e497ea1b-1298-413e-be8d-64f451c82d61" containerName="istio-proxy"
Jul 09 04:03:40.514699 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.514666    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.517562 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.517533    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-76smz\""
Jul 09 04:03:40.527313 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.527289    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"]
Jul 09 04:03:40.640930 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.640895    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25e8cf62-ee7f-4101-968c-f30ac9967442-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks8fc\" (UID: \"25e8cf62-ee7f-4101-968c-f30ac9967442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.641081 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.640940    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25e8cf62-ee7f-4101-968c-f30ac9967442-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks8fc\" (UID: \"25e8cf62-ee7f-4101-968c-f30ac9967442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.641081 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.640964    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25e8cf62-ee7f-4101-968c-f30ac9967442-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks8fc\" (UID: \"25e8cf62-ee7f-4101-968c-f30ac9967442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.641081 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.640981    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25e8cf62-ee7f-4101-968c-f30ac9967442-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks8fc\" (UID: \"25e8cf62-ee7f-4101-968c-f30ac9967442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.641081 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.641029    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25e8cf62-ee7f-4101-968c-f30ac9967442-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks8fc\" (UID: \"25e8cf62-ee7f-4101-968c-f30ac9967442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.641081 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.641050    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-688fc\" (UniqueName: \"kubernetes.io/projected/25e8cf62-ee7f-4101-968c-f30ac9967442-kube-api-access-688fc\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks8fc\" (UID: \"25e8cf62-ee7f-4101-968c-f30ac9967442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.641255 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.641094    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25e8cf62-ee7f-4101-968c-f30ac9967442-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks8fc\" (UID: \"25e8cf62-ee7f-4101-968c-f30ac9967442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.641255 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.641119    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25e8cf62-ee7f-4101-968c-f30ac9967442-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks8fc\" (UID: \"25e8cf62-ee7f-4101-968c-f30ac9967442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.641255 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.641143    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25e8cf62-ee7f-4101-968c-f30ac9967442-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks8fc\" (UID: \"25e8cf62-ee7f-4101-968c-f30ac9967442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.742107 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.742080    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25e8cf62-ee7f-4101-968c-f30ac9967442-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks8fc\" (UID: \"25e8cf62-ee7f-4101-968c-f30ac9967442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.742107 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.742108    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25e8cf62-ee7f-4101-968c-f30ac9967442-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks8fc\" (UID: \"25e8cf62-ee7f-4101-968c-f30ac9967442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.742301 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.742127    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25e8cf62-ee7f-4101-968c-f30ac9967442-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks8fc\" (UID: \"25e8cf62-ee7f-4101-968c-f30ac9967442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.742301 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.742149    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25e8cf62-ee7f-4101-968c-f30ac9967442-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks8fc\" (UID: \"25e8cf62-ee7f-4101-968c-f30ac9967442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.742301 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.742166    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-688fc\" (UniqueName: \"kubernetes.io/projected/25e8cf62-ee7f-4101-968c-f30ac9967442-kube-api-access-688fc\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks8fc\" (UID: \"25e8cf62-ee7f-4101-968c-f30ac9967442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.742301 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.742214    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25e8cf62-ee7f-4101-968c-f30ac9967442-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks8fc\" (UID: \"25e8cf62-ee7f-4101-968c-f30ac9967442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.742301 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.742251    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25e8cf62-ee7f-4101-968c-f30ac9967442-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks8fc\" (UID: \"25e8cf62-ee7f-4101-968c-f30ac9967442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.742522 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.742458    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25e8cf62-ee7f-4101-968c-f30ac9967442-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks8fc\" (UID: \"25e8cf62-ee7f-4101-968c-f30ac9967442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.742522 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.742511    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25e8cf62-ee7f-4101-968c-f30ac9967442-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks8fc\" (UID: \"25e8cf62-ee7f-4101-968c-f30ac9967442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.742706 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.742687    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/25e8cf62-ee7f-4101-968c-f30ac9967442-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks8fc\" (UID: \"25e8cf62-ee7f-4101-968c-f30ac9967442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.742866 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.742840    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/25e8cf62-ee7f-4101-968c-f30ac9967442-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks8fc\" (UID: \"25e8cf62-ee7f-4101-968c-f30ac9967442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.742866 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.742861    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/25e8cf62-ee7f-4101-968c-f30ac9967442-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks8fc\" (UID: \"25e8cf62-ee7f-4101-968c-f30ac9967442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.743054 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.742984    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/25e8cf62-ee7f-4101-968c-f30ac9967442-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks8fc\" (UID: \"25e8cf62-ee7f-4101-968c-f30ac9967442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.743054 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.743042    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/25e8cf62-ee7f-4101-968c-f30ac9967442-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks8fc\" (UID: \"25e8cf62-ee7f-4101-968c-f30ac9967442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.744592 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.744572    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/25e8cf62-ee7f-4101-968c-f30ac9967442-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks8fc\" (UID: \"25e8cf62-ee7f-4101-968c-f30ac9967442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.744803 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.744783    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/25e8cf62-ee7f-4101-968c-f30ac9967442-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks8fc\" (UID: \"25e8cf62-ee7f-4101-968c-f30ac9967442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.751436 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.751410    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/25e8cf62-ee7f-4101-968c-f30ac9967442-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks8fc\" (UID: \"25e8cf62-ee7f-4101-968c-f30ac9967442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.752249 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.752225    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-688fc\" (UniqueName: \"kubernetes.io/projected/25e8cf62-ee7f-4101-968c-f30ac9967442-kube-api-access-688fc\") pod \"maas-default-gateway-openshift-default-56654dcf7-ks8fc\" (UID: \"25e8cf62-ee7f-4101-968c-f30ac9967442\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.825501 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.825449    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:40.954633 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.954543    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"]
Jul 09 04:03:40.957682 ip-10-0-134-121 kubenswrapper[2582]: W0709 04:03:40.957649    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25e8cf62_ee7f_4101_968c_f30ac9967442.slice/crio-18d47a5a43295a11db246c10601e3e5fd3c10ddbf052d187a9a14b08d5300290 WatchSource:0}: Error finding container 18d47a5a43295a11db246c10601e3e5fd3c10ddbf052d187a9a14b08d5300290: Status 404 returned error can't find the container with id 18d47a5a43295a11db246c10601e3e5fd3c10ddbf052d187a9a14b08d5300290
Jul 09 04:03:40.959721 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.959690    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:03:40.959833 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.959763    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:03:40.959833 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.959807    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:03:40.971822 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:40.971794    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc" event={"ID":"25e8cf62-ee7f-4101-968c-f30ac9967442","Type":"ContainerStarted","Data":"18d47a5a43295a11db246c10601e3e5fd3c10ddbf052d187a9a14b08d5300290"}
Jul 09 04:03:41.977375 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:41.977336    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc" event={"ID":"25e8cf62-ee7f-4101-968c-f30ac9967442","Type":"ContainerStarted","Data":"b8553ec5e2e1abdd6f8ffdfbe4ae0aa9dea9e5214953c859a74f35ff42d5a137"}
Jul 09 04:03:41.999329 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:41.999284    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc" podStartSLOduration=1.999269014 podStartE2EDuration="1.999269014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:03:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:03:41.997767196 +0000 UTC m=+448.441897271" watchObservedRunningTime="2026-07-09 04:03:41.999269014 +0000 UTC m=+448.443399091"
Jul 09 04:03:42.825924 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:42.825875    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:42.830398 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:42.830374    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:42.981010 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:42.980980    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:03:42.981856 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:03:42.981839    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:04:33.698430 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:33.698393    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75ff664d5d-5jt4k"]
Jul 09 04:04:33.701723 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:33.701706    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75ff664d5d-5jt4k"
Jul 09 04:04:33.704402 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:33.704357    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 09 04:04:33.704402 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:33.704361    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5rhkr\""
Jul 09 04:04:33.704704 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:33.704688    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 09 04:04:33.712038 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:33.712017    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75ff664d5d-5jt4k"]
Jul 09 04:04:33.737305 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:33.737280    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnlhc\" (UniqueName: \"kubernetes.io/projected/82e86ffc-1e81-453e-8440-ac9ab8a0d0a5-kube-api-access-tnlhc\") pod \"maas-controller-75ff664d5d-5jt4k\" (UID: \"82e86ffc-1e81-453e-8440-ac9ab8a0d0a5\") " pod="opendatahub/maas-controller-75ff664d5d-5jt4k"
Jul 09 04:04:33.737412 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:33.737323    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/82e86ffc-1e81-453e-8440-ac9ab8a0d0a5-webhook-cert\") pod \"maas-controller-75ff664d5d-5jt4k\" (UID: \"82e86ffc-1e81-453e-8440-ac9ab8a0d0a5\") " pod="opendatahub/maas-controller-75ff664d5d-5jt4k"
Jul 09 04:04:33.837836 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:33.837801    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/82e86ffc-1e81-453e-8440-ac9ab8a0d0a5-webhook-cert\") pod \"maas-controller-75ff664d5d-5jt4k\" (UID: \"82e86ffc-1e81-453e-8440-ac9ab8a0d0a5\") " pod="opendatahub/maas-controller-75ff664d5d-5jt4k"
Jul 09 04:04:33.838034 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:33.837965    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnlhc\" (UniqueName: \"kubernetes.io/projected/82e86ffc-1e81-453e-8440-ac9ab8a0d0a5-kube-api-access-tnlhc\") pod \"maas-controller-75ff664d5d-5jt4k\" (UID: \"82e86ffc-1e81-453e-8440-ac9ab8a0d0a5\") " pod="opendatahub/maas-controller-75ff664d5d-5jt4k"
Jul 09 04:04:33.840290 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:33.840271    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/82e86ffc-1e81-453e-8440-ac9ab8a0d0a5-webhook-cert\") pod \"maas-controller-75ff664d5d-5jt4k\" (UID: \"82e86ffc-1e81-453e-8440-ac9ab8a0d0a5\") " pod="opendatahub/maas-controller-75ff664d5d-5jt4k"
Jul 09 04:04:33.848324 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:33.848302    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnlhc\" (UniqueName: \"kubernetes.io/projected/82e86ffc-1e81-453e-8440-ac9ab8a0d0a5-kube-api-access-tnlhc\") pod \"maas-controller-75ff664d5d-5jt4k\" (UID: \"82e86ffc-1e81-453e-8440-ac9ab8a0d0a5\") " pod="opendatahub/maas-controller-75ff664d5d-5jt4k"
Jul 09 04:04:33.863644 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:33.863621    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-86498dd47f-xxzz4"]
Jul 09 04:04:33.866935 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:33.866916    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86498dd47f-xxzz4"
Jul 09 04:04:33.875200 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:33.875178    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86498dd47f-xxzz4"]
Jul 09 04:04:33.938616 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:33.938590    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b14ad16e-c3e9-401b-b4a9-60588d454db8-webhook-cert\") pod \"maas-controller-86498dd47f-xxzz4\" (UID: \"b14ad16e-c3e9-401b-b4a9-60588d454db8\") " pod="opendatahub/maas-controller-86498dd47f-xxzz4"
Jul 09 04:04:33.938724 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:33.938638    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8gpz\" (UniqueName: \"kubernetes.io/projected/b14ad16e-c3e9-401b-b4a9-60588d454db8-kube-api-access-d8gpz\") pod \"maas-controller-86498dd47f-xxzz4\" (UID: \"b14ad16e-c3e9-401b-b4a9-60588d454db8\") " pod="opendatahub/maas-controller-86498dd47f-xxzz4"
Jul 09 04:04:34.012042 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:34.011992    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75ff664d5d-5jt4k"
Jul 09 04:04:34.039440 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:34.039416    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b14ad16e-c3e9-401b-b4a9-60588d454db8-webhook-cert\") pod \"maas-controller-86498dd47f-xxzz4\" (UID: \"b14ad16e-c3e9-401b-b4a9-60588d454db8\") " pod="opendatahub/maas-controller-86498dd47f-xxzz4"
Jul 09 04:04:34.039546 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:34.039461    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8gpz\" (UniqueName: \"kubernetes.io/projected/b14ad16e-c3e9-401b-b4a9-60588d454db8-kube-api-access-d8gpz\") pod \"maas-controller-86498dd47f-xxzz4\" (UID: \"b14ad16e-c3e9-401b-b4a9-60588d454db8\") " pod="opendatahub/maas-controller-86498dd47f-xxzz4"
Jul 09 04:04:34.041766 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:34.041742    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b14ad16e-c3e9-401b-b4a9-60588d454db8-webhook-cert\") pod \"maas-controller-86498dd47f-xxzz4\" (UID: \"b14ad16e-c3e9-401b-b4a9-60588d454db8\") " pod="opendatahub/maas-controller-86498dd47f-xxzz4"
Jul 09 04:04:34.048010 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:34.047988    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8gpz\" (UniqueName: \"kubernetes.io/projected/b14ad16e-c3e9-401b-b4a9-60588d454db8-kube-api-access-d8gpz\") pod \"maas-controller-86498dd47f-xxzz4\" (UID: \"b14ad16e-c3e9-401b-b4a9-60588d454db8\") " pod="opendatahub/maas-controller-86498dd47f-xxzz4"
Jul 09 04:04:34.136673 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:34.136599    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75ff664d5d-5jt4k"]
Jul 09 04:04:34.138716 ip-10-0-134-121 kubenswrapper[2582]: W0709 04:04:34.138690    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82e86ffc_1e81_453e_8440_ac9ab8a0d0a5.slice/crio-274558c47f2f47a3a5cffae7ad3dbff3dc5af95faa53d372226ce68c9fcb9a27 WatchSource:0}: Error finding container 274558c47f2f47a3a5cffae7ad3dbff3dc5af95faa53d372226ce68c9fcb9a27: Status 404 returned error can't find the container with id 274558c47f2f47a3a5cffae7ad3dbff3dc5af95faa53d372226ce68c9fcb9a27
Jul 09 04:04:34.140026 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:34.140007    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 04:04:34.167864 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:34.167841    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75ff664d5d-5jt4k" event={"ID":"82e86ffc-1e81-453e-8440-ac9ab8a0d0a5","Type":"ContainerStarted","Data":"274558c47f2f47a3a5cffae7ad3dbff3dc5af95faa53d372226ce68c9fcb9a27"}
Jul 09 04:04:34.176412 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:34.176388    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86498dd47f-xxzz4"
Jul 09 04:04:34.302527 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:34.302497    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86498dd47f-xxzz4"]
Jul 09 04:04:34.304929 ip-10-0-134-121 kubenswrapper[2582]: W0709 04:04:34.304903    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb14ad16e_c3e9_401b_b4a9_60588d454db8.slice/crio-e2f63f7699caddc61ada9be1dcced4fa972b18f58b329fc7a97a9994f15e8f5e WatchSource:0}: Error finding container e2f63f7699caddc61ada9be1dcced4fa972b18f58b329fc7a97a9994f15e8f5e: Status 404 returned error can't find the container with id e2f63f7699caddc61ada9be1dcced4fa972b18f58b329fc7a97a9994f15e8f5e
Jul 09 04:04:35.176925 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:35.176767    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86498dd47f-xxzz4" event={"ID":"b14ad16e-c3e9-401b-b4a9-60588d454db8","Type":"ContainerStarted","Data":"e2f63f7699caddc61ada9be1dcced4fa972b18f58b329fc7a97a9994f15e8f5e"}
Jul 09 04:04:37.185974 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:37.185930    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75ff664d5d-5jt4k" event={"ID":"82e86ffc-1e81-453e-8440-ac9ab8a0d0a5","Type":"ContainerStarted","Data":"084fac6a6aa0f36b4c0cd6b07da62cd642737e5d5d34961af984f44086d5b39c"}
Jul 09 04:04:37.186441 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:37.186036    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75ff664d5d-5jt4k"
Jul 09 04:04:37.187336 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:37.187305    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86498dd47f-xxzz4" event={"ID":"b14ad16e-c3e9-401b-b4a9-60588d454db8","Type":"ContainerStarted","Data":"6a3c5ebba3adb8c8ee37ed778c358b9e923c10ef7ea86eaa5b225a246e3f3e27"}
Jul 09 04:04:37.187447 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:37.187430    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86498dd47f-xxzz4"
Jul 09 04:04:37.206596 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:37.206545    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75ff664d5d-5jt4k" podStartSLOduration=1.589278106 podStartE2EDuration="4.206523801s" totalImagesPullingTime="2.617245695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:04:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:04:37.205989298 +0000 UTC m=+503.650119379" watchObservedRunningTime="2026-07-09 04:04:37.206523801 +0000 UTC m=+503.650653874"
Jul 09 04:04:48.195528 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:48.195500    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-86498dd47f-xxzz4"
Jul 09 04:04:48.195994 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:48.195561    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75ff664d5d-5jt4k"
Jul 09 04:04:48.212357 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:48.212311    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-86498dd47f-xxzz4" podStartSLOduration=12.750612952 podStartE2EDuration="15.212298218s" totalImagesPullingTime="2.461685266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:04:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:04:37.221590816 +0000 UTC m=+503.665720904" watchObservedRunningTime="2026-07-09 04:04:48.212298218 +0000 UTC m=+514.656428290"
Jul 09 04:04:48.251709 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:48.251676    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75ff664d5d-5jt4k"]
Jul 09 04:04:48.251880 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:48.251860    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-75ff664d5d-5jt4k" podUID="82e86ffc-1e81-453e-8440-ac9ab8a0d0a5" containerName="manager" containerID="cri-o://084fac6a6aa0f36b4c0cd6b07da62cd642737e5d5d34961af984f44086d5b39c" gracePeriod=30
Jul 09 04:04:48.484264 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:48.484242    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75ff664d5d-5jt4k"
Jul 09 04:04:48.553933 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:48.553909    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnlhc\" (UniqueName: \"kubernetes.io/projected/82e86ffc-1e81-453e-8440-ac9ab8a0d0a5-kube-api-access-tnlhc\") pod \"82e86ffc-1e81-453e-8440-ac9ab8a0d0a5\" (UID: \"82e86ffc-1e81-453e-8440-ac9ab8a0d0a5\") "
Jul 09 04:04:48.554047 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:48.553966    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/82e86ffc-1e81-453e-8440-ac9ab8a0d0a5-webhook-cert\") pod \"82e86ffc-1e81-453e-8440-ac9ab8a0d0a5\" (UID: \"82e86ffc-1e81-453e-8440-ac9ab8a0d0a5\") "
Jul 09 04:04:48.555976 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:48.555945    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82e86ffc-1e81-453e-8440-ac9ab8a0d0a5-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "82e86ffc-1e81-453e-8440-ac9ab8a0d0a5" (UID: "82e86ffc-1e81-453e-8440-ac9ab8a0d0a5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 04:04:48.555976 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:48.555944    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82e86ffc-1e81-453e-8440-ac9ab8a0d0a5-kube-api-access-tnlhc" (OuterVolumeSpecName: "kube-api-access-tnlhc") pod "82e86ffc-1e81-453e-8440-ac9ab8a0d0a5" (UID: "82e86ffc-1e81-453e-8440-ac9ab8a0d0a5"). InnerVolumeSpecName "kube-api-access-tnlhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:04:48.655458 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:48.655431    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnlhc\" (UniqueName: \"kubernetes.io/projected/82e86ffc-1e81-453e-8440-ac9ab8a0d0a5-kube-api-access-tnlhc\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:04:48.655458 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:48.655456    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/82e86ffc-1e81-453e-8440-ac9ab8a0d0a5-webhook-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:04:49.231549 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:49.231515    2582 generic.go:356] "Generic (PLEG): container finished" podID="82e86ffc-1e81-453e-8440-ac9ab8a0d0a5" containerID="084fac6a6aa0f36b4c0cd6b07da62cd642737e5d5d34961af984f44086d5b39c" exitCode=0
Jul 09 04:04:49.231959 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:49.231563    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75ff664d5d-5jt4k"
Jul 09 04:04:49.231959 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:49.231602    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75ff664d5d-5jt4k" event={"ID":"82e86ffc-1e81-453e-8440-ac9ab8a0d0a5","Type":"ContainerDied","Data":"084fac6a6aa0f36b4c0cd6b07da62cd642737e5d5d34961af984f44086d5b39c"}
Jul 09 04:04:49.231959 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:49.231660    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75ff664d5d-5jt4k" event={"ID":"82e86ffc-1e81-453e-8440-ac9ab8a0d0a5","Type":"ContainerDied","Data":"274558c47f2f47a3a5cffae7ad3dbff3dc5af95faa53d372226ce68c9fcb9a27"}
Jul 09 04:04:49.231959 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:49.231704    2582 scope.go:117] "RemoveContainer" containerID="084fac6a6aa0f36b4c0cd6b07da62cd642737e5d5d34961af984f44086d5b39c"
Jul 09 04:04:49.240201 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:49.240181    2582 scope.go:117] "RemoveContainer" containerID="084fac6a6aa0f36b4c0cd6b07da62cd642737e5d5d34961af984f44086d5b39c"
Jul 09 04:04:49.240473 ip-10-0-134-121 kubenswrapper[2582]: E0709 04:04:49.240449    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"084fac6a6aa0f36b4c0cd6b07da62cd642737e5d5d34961af984f44086d5b39c\": container with ID starting with 084fac6a6aa0f36b4c0cd6b07da62cd642737e5d5d34961af984f44086d5b39c not found: ID does not exist" containerID="084fac6a6aa0f36b4c0cd6b07da62cd642737e5d5d34961af984f44086d5b39c"
Jul 09 04:04:49.240565 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:49.240479    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"084fac6a6aa0f36b4c0cd6b07da62cd642737e5d5d34961af984f44086d5b39c"} err="failed to get container status \"084fac6a6aa0f36b4c0cd6b07da62cd642737e5d5d34961af984f44086d5b39c\": rpc error: code = NotFound desc = could not find container \"084fac6a6aa0f36b4c0cd6b07da62cd642737e5d5d34961af984f44086d5b39c\": container with ID starting with 084fac6a6aa0f36b4c0cd6b07da62cd642737e5d5d34961af984f44086d5b39c not found: ID does not exist"
Jul 09 04:04:49.253026 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:49.253002    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75ff664d5d-5jt4k"]
Jul 09 04:04:49.260050 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:49.260032    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75ff664d5d-5jt4k"]
Jul 09 04:04:50.154383 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:04:50.154349    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82e86ffc-1e81-453e-8440-ac9ab8a0d0a5" path="/var/lib/kubelet/pods/82e86ffc-1e81-453e-8440-ac9ab8a0d0a5/volumes"
Jul 09 04:05:18.352689 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:18.352657    2582 generic.go:356] "Generic (PLEG): container finished" podID="25e8cf62-ee7f-4101-968c-f30ac9967442" containerID="b8553ec5e2e1abdd6f8ffdfbe4ae0aa9dea9e5214953c859a74f35ff42d5a137" exitCode=0
Jul 09 04:05:18.353124 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:18.352734    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc" event={"ID":"25e8cf62-ee7f-4101-968c-f30ac9967442","Type":"ContainerDied","Data":"b8553ec5e2e1abdd6f8ffdfbe4ae0aa9dea9e5214953c859a74f35ff42d5a137"}
Jul 09 04:05:18.353124 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:18.353119    2582 scope.go:117] "RemoveContainer" containerID="b8553ec5e2e1abdd6f8ffdfbe4ae0aa9dea9e5214953c859a74f35ff42d5a137"
Jul 09 04:05:18.354057 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:18.354032    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:05:18.354107 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:18.354095    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:05:18.354141 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:18.354126    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:05:19.358369 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:19.358338    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc" event={"ID":"25e8cf62-ee7f-4101-968c-f30ac9967442","Type":"ContainerStarted","Data":"ba417a691eebdcbe8cb075bde2292ce7e04cf7807cd57132f5eaeb2e6f4bb2e4"}
Jul 09 04:05:19.826662 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:19.826576    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:05:19.827044 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:19.826957    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-ks8fc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused" start-of-body=
Jul 09 04:05:19.827221 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:19.827196    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc" podUID="25e8cf62-ee7f-4101-968c-f30ac9967442" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused"
Jul 09 04:05:20.826216 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:20.826173    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-ks8fc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused" start-of-body=
Jul 09 04:05:20.826694 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:20.826257    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc" podUID="25e8cf62-ee7f-4101-968c-f30ac9967442" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused"
Jul 09 04:05:21.826721 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:21.826677    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-ks8fc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused" start-of-body=
Jul 09 04:05:21.827213 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:21.826745    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc" podUID="25e8cf62-ee7f-4101-968c-f30ac9967442" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused"
Jul 09 04:05:22.826796 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:22.826752    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-ks8fc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused" start-of-body=
Jul 09 04:05:22.827288 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:22.826818    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc" podUID="25e8cf62-ee7f-4101-968c-f30ac9967442" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.19:15021/healthz/ready\": dial tcp 10.134.0.19:15021: connect: connection refused"
Jul 09 04:05:23.830213 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:23.830186    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:05:23.830568 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:23.830462    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:05:23.831072 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:23.831053    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-ks8fc"
Jul 09 04:05:40.230723 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.230682    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77"]
Jul 09 04:05:40.231500 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.231475    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82e86ffc-1e81-453e-8440-ac9ab8a0d0a5" containerName="manager"
Jul 09 04:05:40.231595 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.231503    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="82e86ffc-1e81-453e-8440-ac9ab8a0d0a5" containerName="manager"
Jul 09 04:05:40.231663 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.231649    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="82e86ffc-1e81-453e-8440-ac9ab8a0d0a5" containerName="manager"
Jul 09 04:05:40.238442 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.238417    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77"
Jul 09 04:05:40.243116 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.243089    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 04:05:40.243239 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.243089    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 04:05:40.243239 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.243179    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 09 04:05:40.243239 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.243185    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lmz6c\""
Jul 09 04:05:40.245093 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.245069    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77"]
Jul 09 04:05:40.373821 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.373790    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd894\" (UniqueName: \"kubernetes.io/projected/c982bbf0-3c89-4db8-975e-b76c32bc23fc-kube-api-access-hd894\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xc77\" (UID: \"c982bbf0-3c89-4db8-975e-b76c32bc23fc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77"
Jul 09 04:05:40.374011 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.373851    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c982bbf0-3c89-4db8-975e-b76c32bc23fc-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xc77\" (UID: \"c982bbf0-3c89-4db8-975e-b76c32bc23fc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77"
Jul 09 04:05:40.374011 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.373928    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c982bbf0-3c89-4db8-975e-b76c32bc23fc-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xc77\" (UID: \"c982bbf0-3c89-4db8-975e-b76c32bc23fc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77"
Jul 09 04:05:40.374011 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.373953    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c982bbf0-3c89-4db8-975e-b76c32bc23fc-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xc77\" (UID: \"c982bbf0-3c89-4db8-975e-b76c32bc23fc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77"
Jul 09 04:05:40.374011 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.373968    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c982bbf0-3c89-4db8-975e-b76c32bc23fc-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xc77\" (UID: \"c982bbf0-3c89-4db8-975e-b76c32bc23fc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77"
Jul 09 04:05:40.374011 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.373989    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c982bbf0-3c89-4db8-975e-b76c32bc23fc-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xc77\" (UID: \"c982bbf0-3c89-4db8-975e-b76c32bc23fc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77"
Jul 09 04:05:40.474802 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.474768    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c982bbf0-3c89-4db8-975e-b76c32bc23fc-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xc77\" (UID: \"c982bbf0-3c89-4db8-975e-b76c32bc23fc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77"
Jul 09 04:05:40.475020 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.474817    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c982bbf0-3c89-4db8-975e-b76c32bc23fc-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xc77\" (UID: \"c982bbf0-3c89-4db8-975e-b76c32bc23fc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77"
Jul 09 04:05:40.475020 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.474848    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c982bbf0-3c89-4db8-975e-b76c32bc23fc-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xc77\" (UID: \"c982bbf0-3c89-4db8-975e-b76c32bc23fc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77"
Jul 09 04:05:40.475020 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.474868    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c982bbf0-3c89-4db8-975e-b76c32bc23fc-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xc77\" (UID: \"c982bbf0-3c89-4db8-975e-b76c32bc23fc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77"
Jul 09 04:05:40.475189 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.475017    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c982bbf0-3c89-4db8-975e-b76c32bc23fc-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xc77\" (UID: \"c982bbf0-3c89-4db8-975e-b76c32bc23fc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77"
Jul 09 04:05:40.475189 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.475080    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd894\" (UniqueName: \"kubernetes.io/projected/c982bbf0-3c89-4db8-975e-b76c32bc23fc-kube-api-access-hd894\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xc77\" (UID: \"c982bbf0-3c89-4db8-975e-b76c32bc23fc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77"
Jul 09 04:05:40.475294 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.475223    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c982bbf0-3c89-4db8-975e-b76c32bc23fc-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xc77\" (UID: \"c982bbf0-3c89-4db8-975e-b76c32bc23fc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77"
Jul 09 04:05:40.475294 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.475244    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c982bbf0-3c89-4db8-975e-b76c32bc23fc-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xc77\" (UID: \"c982bbf0-3c89-4db8-975e-b76c32bc23fc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77"
Jul 09 04:05:40.475378 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.475295    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c982bbf0-3c89-4db8-975e-b76c32bc23fc-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xc77\" (UID: \"c982bbf0-3c89-4db8-975e-b76c32bc23fc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77"
Jul 09 04:05:40.477132 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.477105    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c982bbf0-3c89-4db8-975e-b76c32bc23fc-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xc77\" (UID: \"c982bbf0-3c89-4db8-975e-b76c32bc23fc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77"
Jul 09 04:05:40.477378 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.477360    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c982bbf0-3c89-4db8-975e-b76c32bc23fc-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xc77\" (UID: \"c982bbf0-3c89-4db8-975e-b76c32bc23fc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77"
Jul 09 04:05:40.483863 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.483799    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd894\" (UniqueName: \"kubernetes.io/projected/c982bbf0-3c89-4db8-975e-b76c32bc23fc-kube-api-access-hd894\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5xc77\" (UID: \"c982bbf0-3c89-4db8-975e-b76c32bc23fc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77"
Jul 09 04:05:40.550773 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.550749    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77"
Jul 09 04:05:40.676099 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:40.676071    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77"]
Jul 09 04:05:40.677641 ip-10-0-134-121 kubenswrapper[2582]: W0709 04:05:40.677614    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc982bbf0_3c89_4db8_975e_b76c32bc23fc.slice/crio-0fb4f2bdf55bc1bc83e849fcfcd7f6317875e2315ec34f68924cc00e9cb1c436 WatchSource:0}: Error finding container 0fb4f2bdf55bc1bc83e849fcfcd7f6317875e2315ec34f68924cc00e9cb1c436: Status 404 returned error can't find the container with id 0fb4f2bdf55bc1bc83e849fcfcd7f6317875e2315ec34f68924cc00e9cb1c436
Jul 09 04:05:41.441149 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:41.441109    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77" event={"ID":"c982bbf0-3c89-4db8-975e-b76c32bc23fc","Type":"ContainerStarted","Data":"0fb4f2bdf55bc1bc83e849fcfcd7f6317875e2315ec34f68924cc00e9cb1c436"}
Jul 09 04:05:42.448362 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:42.448331    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77" event={"ID":"c982bbf0-3c89-4db8-975e-b76c32bc23fc","Type":"ContainerStarted","Data":"239b8d8f84e2e50704e0918da800a0491187ab42e1c33b5c1c6f44a38ca03b5a"}
Jul 09 04:05:42.465167 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:42.465125    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77" podStartSLOduration=1.475975421 podStartE2EDuration="2.465110187s" totalImagesPullingTime="989.134766ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:05:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:05:42.464108696 +0000 UTC m=+568.908238769" watchObservedRunningTime="2026-07-09 04:05:42.465110187 +0000 UTC m=+568.909240274"
Jul 09 04:05:49.034936 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:49.034900    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g"]
Jul 09 04:05:49.038269 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:49.038248    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g"
Jul 09 04:05:49.040872 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:49.040857    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 09 04:05:49.046674 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:49.046652    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g"]
Jul 09 04:05:49.143637 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:49.143603    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e5e0462-2392-417e-a6f5-8fe4a98e9fad-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9lz2g\" (UID: \"8e5e0462-2392-417e-a6f5-8fe4a98e9fad\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g"
Jul 09 04:05:49.143789 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:49.143662    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e5e0462-2392-417e-a6f5-8fe4a98e9fad-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9lz2g\" (UID: \"8e5e0462-2392-417e-a6f5-8fe4a98e9fad\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g"
Jul 09 04:05:49.143789 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:49.143700    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e5e0462-2392-417e-a6f5-8fe4a98e9fad-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9lz2g\" (UID: \"8e5e0462-2392-417e-a6f5-8fe4a98e9fad\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g"
Jul 09 04:05:49.143953 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:49.143795    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzj66\" (UniqueName: \"kubernetes.io/projected/8e5e0462-2392-417e-a6f5-8fe4a98e9fad-kube-api-access-bzj66\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9lz2g\" (UID: \"8e5e0462-2392-417e-a6f5-8fe4a98e9fad\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g"
Jul 09 04:05:49.143953 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:49.143824    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e5e0462-2392-417e-a6f5-8fe4a98e9fad-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9lz2g\" (UID: \"8e5e0462-2392-417e-a6f5-8fe4a98e9fad\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g"
Jul 09 04:05:49.143953 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:49.143852    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e5e0462-2392-417e-a6f5-8fe4a98e9fad-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9lz2g\" (UID: \"8e5e0462-2392-417e-a6f5-8fe4a98e9fad\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g"
Jul 09 04:05:49.245017 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:49.244972    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzj66\" (UniqueName: \"kubernetes.io/projected/8e5e0462-2392-417e-a6f5-8fe4a98e9fad-kube-api-access-bzj66\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9lz2g\" (UID: \"8e5e0462-2392-417e-a6f5-8fe4a98e9fad\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g"
Jul 09 04:05:49.245208 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:49.245037    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e5e0462-2392-417e-a6f5-8fe4a98e9fad-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9lz2g\" (UID: \"8e5e0462-2392-417e-a6f5-8fe4a98e9fad\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g"
Jul 09 04:05:49.245208 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:49.245069    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e5e0462-2392-417e-a6f5-8fe4a98e9fad-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9lz2g\" (UID: \"8e5e0462-2392-417e-a6f5-8fe4a98e9fad\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g"
Jul 09 04:05:49.245208 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:49.245124    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e5e0462-2392-417e-a6f5-8fe4a98e9fad-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9lz2g\" (UID: \"8e5e0462-2392-417e-a6f5-8fe4a98e9fad\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g"
Jul 09 04:05:49.245377 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:49.245294    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e5e0462-2392-417e-a6f5-8fe4a98e9fad-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9lz2g\" (UID: \"8e5e0462-2392-417e-a6f5-8fe4a98e9fad\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g"
Jul 09 04:05:49.245377 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:49.245348    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e5e0462-2392-417e-a6f5-8fe4a98e9fad-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9lz2g\" (UID: \"8e5e0462-2392-417e-a6f5-8fe4a98e9fad\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g"
Jul 09 04:05:49.245582 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:49.245555    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e5e0462-2392-417e-a6f5-8fe4a98e9fad-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9lz2g\" (UID: \"8e5e0462-2392-417e-a6f5-8fe4a98e9fad\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g"
Jul 09 04:05:49.245676 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:49.245602    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e5e0462-2392-417e-a6f5-8fe4a98e9fad-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9lz2g\" (UID: \"8e5e0462-2392-417e-a6f5-8fe4a98e9fad\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g"
Jul 09 04:05:49.245730 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:49.245709    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e5e0462-2392-417e-a6f5-8fe4a98e9fad-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9lz2g\" (UID: \"8e5e0462-2392-417e-a6f5-8fe4a98e9fad\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g"
Jul 09 04:05:49.247406 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:49.247381    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e5e0462-2392-417e-a6f5-8fe4a98e9fad-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9lz2g\" (UID: \"8e5e0462-2392-417e-a6f5-8fe4a98e9fad\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g"
Jul 09 04:05:49.247642 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:49.247626    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e5e0462-2392-417e-a6f5-8fe4a98e9fad-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9lz2g\" (UID: \"8e5e0462-2392-417e-a6f5-8fe4a98e9fad\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g"
Jul 09 04:05:49.252301 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:49.252280    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzj66\" (UniqueName: \"kubernetes.io/projected/8e5e0462-2392-417e-a6f5-8fe4a98e9fad-kube-api-access-bzj66\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9lz2g\" (UID: \"8e5e0462-2392-417e-a6f5-8fe4a98e9fad\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g"
Jul 09 04:05:49.348469 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:49.348404    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g"
Jul 09 04:05:49.478781 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:49.478753    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g"]
Jul 09 04:05:49.482156 ip-10-0-134-121 kubenswrapper[2582]: W0709 04:05:49.482127    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e5e0462_2392_417e_a6f5_8fe4a98e9fad.slice/crio-d2464db4711434c8da85bfb3354185d0f0e2036b59c014b3a90c28b3f0b6e3fd WatchSource:0}: Error finding container d2464db4711434c8da85bfb3354185d0f0e2036b59c014b3a90c28b3f0b6e3fd: Status 404 returned error can't find the container with id d2464db4711434c8da85bfb3354185d0f0e2036b59c014b3a90c28b3f0b6e3fd
Jul 09 04:05:50.486680 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:50.486641    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g" event={"ID":"8e5e0462-2392-417e-a6f5-8fe4a98e9fad","Type":"ContainerStarted","Data":"95c5e675b8c0d7ed580890bded9c18da5207302653c02a8d0a17431b50320f78"}
Jul 09 04:05:50.487132 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:50.486703    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g" event={"ID":"8e5e0462-2392-417e-a6f5-8fe4a98e9fad","Type":"ContainerStarted","Data":"d2464db4711434c8da85bfb3354185d0f0e2036b59c014b3a90c28b3f0b6e3fd"}
Jul 09 04:05:50.505979 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:50.505926    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g" podStartSLOduration=1.327753189 podStartE2EDuration="1.505906654s" totalImagesPullingTime="178.153465ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:05:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:05:50.505355056 +0000 UTC m=+576.949485130" watchObservedRunningTime="2026-07-09 04:05:50.505906654 +0000 UTC m=+576.950036719"
Jul 09 04:05:50.551362 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:50.551337    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77"
Jul 09 04:05:50.551480 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:50.551386    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77"
Jul 09 04:05:50.563579 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:50.563557    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77"
Jul 09 04:05:51.501406 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:51.501380    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5xc77"
Jul 09 04:05:52.837472 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:52.837438    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g"]
Jul 09 04:05:52.840697 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:52.840677    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g"
Jul 09 04:05:52.843445 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:52.843425    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 09 04:05:52.849468 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:52.849445    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g"]
Jul 09 04:05:52.977899 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:52.977866    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/466bab5e-41dc-415d-ab25-971494796aa1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g\" (UID: \"466bab5e-41dc-415d-ab25-971494796aa1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g"
Jul 09 04:05:52.978038 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:52.977923    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/466bab5e-41dc-415d-ab25-971494796aa1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g\" (UID: \"466bab5e-41dc-415d-ab25-971494796aa1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g"
Jul 09 04:05:52.978038 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:52.977952    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6npqq\" (UniqueName: \"kubernetes.io/projected/466bab5e-41dc-415d-ab25-971494796aa1-kube-api-access-6npqq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g\" (UID: \"466bab5e-41dc-415d-ab25-971494796aa1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g"
Jul 09 04:05:52.978038 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:52.977998    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/466bab5e-41dc-415d-ab25-971494796aa1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g\" (UID: \"466bab5e-41dc-415d-ab25-971494796aa1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g"
Jul 09 04:05:52.978143 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:52.978054    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/466bab5e-41dc-415d-ab25-971494796aa1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g\" (UID: \"466bab5e-41dc-415d-ab25-971494796aa1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g"
Jul 09 04:05:52.978143 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:52.978094    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/466bab5e-41dc-415d-ab25-971494796aa1-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g\" (UID: \"466bab5e-41dc-415d-ab25-971494796aa1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g"
Jul 09 04:05:53.079466 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:53.079435    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/466bab5e-41dc-415d-ab25-971494796aa1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g\" (UID: \"466bab5e-41dc-415d-ab25-971494796aa1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g"
Jul 09 04:05:53.079466 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:53.079469    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6npqq\" (UniqueName: \"kubernetes.io/projected/466bab5e-41dc-415d-ab25-971494796aa1-kube-api-access-6npqq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g\" (UID: \"466bab5e-41dc-415d-ab25-971494796aa1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g"
Jul 09 04:05:53.079695 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:53.079516    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/466bab5e-41dc-415d-ab25-971494796aa1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g\" (UID: \"466bab5e-41dc-415d-ab25-971494796aa1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g"
Jul 09 04:05:53.079695 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:53.079541    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/466bab5e-41dc-415d-ab25-971494796aa1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g\" (UID: \"466bab5e-41dc-415d-ab25-971494796aa1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g"
Jul 09 04:05:53.079695 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:53.079567    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/466bab5e-41dc-415d-ab25-971494796aa1-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g\" (UID: \"466bab5e-41dc-415d-ab25-971494796aa1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g"
Jul 09 04:05:53.079695 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:53.079612    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/466bab5e-41dc-415d-ab25-971494796aa1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g\" (UID: \"466bab5e-41dc-415d-ab25-971494796aa1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g"
Jul 09 04:05:53.079966 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:53.079939    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/466bab5e-41dc-415d-ab25-971494796aa1-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g\" (UID: \"466bab5e-41dc-415d-ab25-971494796aa1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g"
Jul 09 04:05:53.080103 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:53.079964    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/466bab5e-41dc-415d-ab25-971494796aa1-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g\" (UID: \"466bab5e-41dc-415d-ab25-971494796aa1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g"
Jul 09 04:05:53.080103 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:53.080016    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/466bab5e-41dc-415d-ab25-971494796aa1-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g\" (UID: \"466bab5e-41dc-415d-ab25-971494796aa1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g"
Jul 09 04:05:53.081695 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:53.081677    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/466bab5e-41dc-415d-ab25-971494796aa1-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g\" (UID: \"466bab5e-41dc-415d-ab25-971494796aa1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g"
Jul 09 04:05:53.082003 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:53.081986    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/466bab5e-41dc-415d-ab25-971494796aa1-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g\" (UID: \"466bab5e-41dc-415d-ab25-971494796aa1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g"
Jul 09 04:05:53.090356 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:53.090304    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6npqq\" (UniqueName: \"kubernetes.io/projected/466bab5e-41dc-415d-ab25-971494796aa1-kube-api-access-6npqq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g\" (UID: \"466bab5e-41dc-415d-ab25-971494796aa1\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g"
Jul 09 04:05:53.151858 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:53.151835    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g"
Jul 09 04:05:53.282084 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:53.282057    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g"]
Jul 09 04:05:53.283909 ip-10-0-134-121 kubenswrapper[2582]: W0709 04:05:53.283871    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod466bab5e_41dc_415d_ab25_971494796aa1.slice/crio-ba15716f9161de502bacb536547c55de796ed9855bcb33bd4e3ed89f00a22cac WatchSource:0}: Error finding container ba15716f9161de502bacb536547c55de796ed9855bcb33bd4e3ed89f00a22cac: Status 404 returned error can't find the container with id ba15716f9161de502bacb536547c55de796ed9855bcb33bd4e3ed89f00a22cac
Jul 09 04:05:53.499406 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:53.499383    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g" event={"ID":"466bab5e-41dc-415d-ab25-971494796aa1","Type":"ContainerStarted","Data":"ba15716f9161de502bacb536547c55de796ed9855bcb33bd4e3ed89f00a22cac"}
Jul 09 04:05:54.505089 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:54.505053    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g" event={"ID":"466bab5e-41dc-415d-ab25-971494796aa1","Type":"ContainerStarted","Data":"c360be66460372da4e6c0017ab20eb5ed7746fea8dc5e6225936ad070ca34792"}
Jul 09 04:05:54.521670 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:54.521623    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g" podStartSLOduration=2.338106458 podStartE2EDuration="2.521608167s" totalImagesPullingTime="183.501709ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:05:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:05:54.519969474 +0000 UTC m=+580.964099547" watchObservedRunningTime="2026-07-09 04:05:54.521608167 +0000 UTC m=+580.965738242"
Jul 09 04:05:59.348740 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:59.348709    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g"
Jul 09 04:05:59.349164 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:59.348793    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g"
Jul 09 04:05:59.360846 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:59.360824    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g"
Jul 09 04:05:59.536474 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:05:59.536446    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9lz2g"
Jul 09 04:06:03.151941 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:06:03.151907    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g"
Jul 09 04:06:03.152313 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:06:03.151957    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g"
Jul 09 04:06:03.164122 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:06:03.164099    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g"
Jul 09 04:06:03.556302 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:06:03.556221    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g"
Jul 09 04:06:14.033997 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:06:14.033969    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9jc2_33172081-e578-41b0-ae82-d9d52c06df2b/ovn-acl-logging/0.log"
Jul 09 04:06:14.035328 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:06:14.035307    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9jc2_33172081-e578-41b0-ae82-d9d52c06df2b/ovn-acl-logging/0.log"
Jul 09 04:08:41.488857 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:41.488818    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-86498dd47f-xxzz4"]
Jul 09 04:08:41.489591 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:41.489107    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-86498dd47f-xxzz4" podUID="b14ad16e-c3e9-401b-b4a9-60588d454db8" containerName="manager" containerID="cri-o://6a3c5ebba3adb8c8ee37ed778c358b9e923c10ef7ea86eaa5b225a246e3f3e27" gracePeriod=30
Jul 09 04:08:41.732178 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:41.732149    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86498dd47f-xxzz4"
Jul 09 04:08:41.848587 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:41.848515    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b14ad16e-c3e9-401b-b4a9-60588d454db8-webhook-cert\") pod \"b14ad16e-c3e9-401b-b4a9-60588d454db8\" (UID: \"b14ad16e-c3e9-401b-b4a9-60588d454db8\") "
Jul 09 04:08:41.848587 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:41.848574    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8gpz\" (UniqueName: \"kubernetes.io/projected/b14ad16e-c3e9-401b-b4a9-60588d454db8-kube-api-access-d8gpz\") pod \"b14ad16e-c3e9-401b-b4a9-60588d454db8\" (UID: \"b14ad16e-c3e9-401b-b4a9-60588d454db8\") "
Jul 09 04:08:41.850644 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:41.850618    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b14ad16e-c3e9-401b-b4a9-60588d454db8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b14ad16e-c3e9-401b-b4a9-60588d454db8" (UID: "b14ad16e-c3e9-401b-b4a9-60588d454db8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 04:08:41.850744 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:41.850618    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b14ad16e-c3e9-401b-b4a9-60588d454db8-kube-api-access-d8gpz" (OuterVolumeSpecName: "kube-api-access-d8gpz") pod "b14ad16e-c3e9-401b-b4a9-60588d454db8" (UID: "b14ad16e-c3e9-401b-b4a9-60588d454db8"). InnerVolumeSpecName "kube-api-access-d8gpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:08:41.949868 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:41.949843    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b14ad16e-c3e9-401b-b4a9-60588d454db8-webhook-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:08:41.949868 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:41.949869    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8gpz\" (UniqueName: \"kubernetes.io/projected/b14ad16e-c3e9-401b-b4a9-60588d454db8-kube-api-access-d8gpz\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:08:42.194611 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:42.194577    2582 generic.go:356] "Generic (PLEG): container finished" podID="b14ad16e-c3e9-401b-b4a9-60588d454db8" containerID="6a3c5ebba3adb8c8ee37ed778c358b9e923c10ef7ea86eaa5b225a246e3f3e27" exitCode=0
Jul 09 04:08:42.194746 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:42.194626    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86498dd47f-xxzz4"
Jul 09 04:08:42.194746 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:42.194623    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86498dd47f-xxzz4" event={"ID":"b14ad16e-c3e9-401b-b4a9-60588d454db8","Type":"ContainerDied","Data":"6a3c5ebba3adb8c8ee37ed778c358b9e923c10ef7ea86eaa5b225a246e3f3e27"}
Jul 09 04:08:42.194746 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:42.194738    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86498dd47f-xxzz4" event={"ID":"b14ad16e-c3e9-401b-b4a9-60588d454db8","Type":"ContainerDied","Data":"e2f63f7699caddc61ada9be1dcced4fa972b18f58b329fc7a97a9994f15e8f5e"}
Jul 09 04:08:42.194844 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:42.194762    2582 scope.go:117] "RemoveContainer" containerID="6a3c5ebba3adb8c8ee37ed778c358b9e923c10ef7ea86eaa5b225a246e3f3e27"
Jul 09 04:08:42.202877 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:42.202853    2582 scope.go:117] "RemoveContainer" containerID="6a3c5ebba3adb8c8ee37ed778c358b9e923c10ef7ea86eaa5b225a246e3f3e27"
Jul 09 04:08:42.203138 ip-10-0-134-121 kubenswrapper[2582]: E0709 04:08:42.203119    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a3c5ebba3adb8c8ee37ed778c358b9e923c10ef7ea86eaa5b225a246e3f3e27\": container with ID starting with 6a3c5ebba3adb8c8ee37ed778c358b9e923c10ef7ea86eaa5b225a246e3f3e27 not found: ID does not exist" containerID="6a3c5ebba3adb8c8ee37ed778c358b9e923c10ef7ea86eaa5b225a246e3f3e27"
Jul 09 04:08:42.203201 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:42.203146    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a3c5ebba3adb8c8ee37ed778c358b9e923c10ef7ea86eaa5b225a246e3f3e27"} err="failed to get container status \"6a3c5ebba3adb8c8ee37ed778c358b9e923c10ef7ea86eaa5b225a246e3f3e27\": rpc error: code = NotFound desc = could not find container \"6a3c5ebba3adb8c8ee37ed778c358b9e923c10ef7ea86eaa5b225a246e3f3e27\": container with ID starting with 6a3c5ebba3adb8c8ee37ed778c358b9e923c10ef7ea86eaa5b225a246e3f3e27 not found: ID does not exist"
Jul 09 04:08:42.213630 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:42.213605    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-86498dd47f-xxzz4"]
Jul 09 04:08:42.226672 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:42.226654    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-86498dd47f-xxzz4"]
Jul 09 04:08:42.950188 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:42.950154    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-86498dd47f-v6wjh"]
Jul 09 04:08:42.950549 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:42.950473    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b14ad16e-c3e9-401b-b4a9-60588d454db8" containerName="manager"
Jul 09 04:08:42.950549 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:42.950484    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b14ad16e-c3e9-401b-b4a9-60588d454db8" containerName="manager"
Jul 09 04:08:42.950549 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:42.950546    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b14ad16e-c3e9-401b-b4a9-60588d454db8" containerName="manager"
Jul 09 04:08:42.954624 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:42.954606    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86498dd47f-v6wjh"
Jul 09 04:08:42.957290 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:42.957268    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 09 04:08:42.958532 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:42.958505    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 09 04:08:42.958532 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:42.958507    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5rhkr\""
Jul 09 04:08:42.962213 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:42.962194    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86498dd47f-v6wjh"]
Jul 09 04:08:43.058264 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:43.058237    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/727422d3-0211-44bf-8a2a-9e511030d075-webhook-cert\") pod \"maas-controller-86498dd47f-v6wjh\" (UID: \"727422d3-0211-44bf-8a2a-9e511030d075\") " pod="opendatahub/maas-controller-86498dd47f-v6wjh"
Jul 09 04:08:43.058385 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:43.058306    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s8wz\" (UniqueName: \"kubernetes.io/projected/727422d3-0211-44bf-8a2a-9e511030d075-kube-api-access-7s8wz\") pod \"maas-controller-86498dd47f-v6wjh\" (UID: \"727422d3-0211-44bf-8a2a-9e511030d075\") " pod="opendatahub/maas-controller-86498dd47f-v6wjh"
Jul 09 04:08:43.159642 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:43.159612    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s8wz\" (UniqueName: \"kubernetes.io/projected/727422d3-0211-44bf-8a2a-9e511030d075-kube-api-access-7s8wz\") pod \"maas-controller-86498dd47f-v6wjh\" (UID: \"727422d3-0211-44bf-8a2a-9e511030d075\") " pod="opendatahub/maas-controller-86498dd47f-v6wjh"
Jul 09 04:08:43.159798 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:43.159670    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/727422d3-0211-44bf-8a2a-9e511030d075-webhook-cert\") pod \"maas-controller-86498dd47f-v6wjh\" (UID: \"727422d3-0211-44bf-8a2a-9e511030d075\") " pod="opendatahub/maas-controller-86498dd47f-v6wjh"
Jul 09 04:08:43.162015 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:43.161993    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/727422d3-0211-44bf-8a2a-9e511030d075-webhook-cert\") pod \"maas-controller-86498dd47f-v6wjh\" (UID: \"727422d3-0211-44bf-8a2a-9e511030d075\") " pod="opendatahub/maas-controller-86498dd47f-v6wjh"
Jul 09 04:08:43.167490 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:43.167471    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s8wz\" (UniqueName: \"kubernetes.io/projected/727422d3-0211-44bf-8a2a-9e511030d075-kube-api-access-7s8wz\") pod \"maas-controller-86498dd47f-v6wjh\" (UID: \"727422d3-0211-44bf-8a2a-9e511030d075\") " pod="opendatahub/maas-controller-86498dd47f-v6wjh"
Jul 09 04:08:43.265447 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:43.265378    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86498dd47f-v6wjh"
Jul 09 04:08:43.386380 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:43.386353    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86498dd47f-v6wjh"]
Jul 09 04:08:43.388663 ip-10-0-134-121 kubenswrapper[2582]: W0709 04:08:43.388633    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod727422d3_0211_44bf_8a2a_9e511030d075.slice/crio-0152d3752abe7f1ec90273b67c17682c05a07e7359e0ebce884125b1047a79ee WatchSource:0}: Error finding container 0152d3752abe7f1ec90273b67c17682c05a07e7359e0ebce884125b1047a79ee: Status 404 returned error can't find the container with id 0152d3752abe7f1ec90273b67c17682c05a07e7359e0ebce884125b1047a79ee
Jul 09 04:08:44.153379 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:44.153348    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b14ad16e-c3e9-401b-b4a9-60588d454db8" path="/var/lib/kubelet/pods/b14ad16e-c3e9-401b-b4a9-60588d454db8/volumes"
Jul 09 04:08:44.206742 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:44.206719    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86498dd47f-v6wjh" event={"ID":"727422d3-0211-44bf-8a2a-9e511030d075","Type":"ContainerStarted","Data":"ae8516468b34f5f0d216a1afd6a904088d18d9e5d204aa2481c08506356863a3"}
Jul 09 04:08:44.206836 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:44.206761    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86498dd47f-v6wjh" event={"ID":"727422d3-0211-44bf-8a2a-9e511030d075","Type":"ContainerStarted","Data":"0152d3752abe7f1ec90273b67c17682c05a07e7359e0ebce884125b1047a79ee"}
Jul 09 04:08:45.211771 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:45.211740    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86498dd47f-v6wjh"
Jul 09 04:08:45.230234 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:45.230184    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-86498dd47f-v6wjh" podStartSLOduration=2.493935669 podStartE2EDuration="3.23016786s" totalImagesPullingTime="736.232191ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:08:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:08:45.228807719 +0000 UTC m=+751.672937794" watchObservedRunningTime="2026-07-09 04:08:45.23016786 +0000 UTC m=+751.674297974"
Jul 09 04:08:56.221319 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:08:56.221293    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-86498dd47f-v6wjh"
Jul 09 04:11:14.056532 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:11:14.056457    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9jc2_33172081-e578-41b0-ae82-d9d52c06df2b/ovn-acl-logging/0.log"
Jul 09 04:11:14.058970 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:11:14.058948    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9jc2_33172081-e578-41b0-ae82-d9d52c06df2b/ovn-acl-logging/0.log"
Jul 09 04:15:00.145561 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:15:00.145526    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726175-8jm4h"]
Jul 09 04:15:00.148981 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:15:00.148955    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726175-8jm4h"
Jul 09 04:15:00.152110 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:15:00.152086    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 04:15:00.153336 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:15:00.153315    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 04:15:00.153445 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:15:00.153390    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-znghr\""
Jul 09 04:15:00.156739 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:15:00.156667    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726175-8jm4h"]
Jul 09 04:15:00.255012 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:15:00.254982    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-762ml\" (UniqueName: \"kubernetes.io/projected/aa27a62e-e5fc-46c1-8365-dfcaf926902c-kube-api-access-762ml\") pod \"maas-api-key-cleanup-29726175-8jm4h\" (UID: \"aa27a62e-e5fc-46c1-8365-dfcaf926902c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726175-8jm4h"
Jul 09 04:15:00.356281 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:15:00.356250    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-762ml\" (UniqueName: \"kubernetes.io/projected/aa27a62e-e5fc-46c1-8365-dfcaf926902c-kube-api-access-762ml\") pod \"maas-api-key-cleanup-29726175-8jm4h\" (UID: \"aa27a62e-e5fc-46c1-8365-dfcaf926902c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726175-8jm4h"
Jul 09 04:15:00.364466 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:15:00.364446    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-762ml\" (UniqueName: \"kubernetes.io/projected/aa27a62e-e5fc-46c1-8365-dfcaf926902c-kube-api-access-762ml\") pod \"maas-api-key-cleanup-29726175-8jm4h\" (UID: \"aa27a62e-e5fc-46c1-8365-dfcaf926902c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726175-8jm4h"
Jul 09 04:15:00.460970 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:15:00.460881    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726175-8jm4h"
Jul 09 04:15:00.587828 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:15:00.587802    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726175-8jm4h"]
Jul 09 04:15:00.590351 ip-10-0-134-121 kubenswrapper[2582]: W0709 04:15:00.590319    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa27a62e_e5fc_46c1_8365_dfcaf926902c.slice/crio-98f7ae524438fc9aecd581ed7711fa6eed9b72b1adf2e4b2bd8d5c8a7e82a305 WatchSource:0}: Error finding container 98f7ae524438fc9aecd581ed7711fa6eed9b72b1adf2e4b2bd8d5c8a7e82a305: Status 404 returned error can't find the container with id 98f7ae524438fc9aecd581ed7711fa6eed9b72b1adf2e4b2bd8d5c8a7e82a305
Jul 09 04:15:00.592335 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:15:00.592314    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 04:15:00.759957 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:15:00.759861    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726175-8jm4h" event={"ID":"aa27a62e-e5fc-46c1-8365-dfcaf926902c","Type":"ContainerStarted","Data":"98f7ae524438fc9aecd581ed7711fa6eed9b72b1adf2e4b2bd8d5c8a7e82a305"}
Jul 09 04:15:05.786329 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:15:05.786296    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726175-8jm4h" event={"ID":"aa27a62e-e5fc-46c1-8365-dfcaf926902c","Type":"ContainerStarted","Data":"b9e02705c9fd11692664285de1bd77a9ad938015287d7075a4492d078ed8ef8d"}
Jul 09 04:15:05.803635 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:15:05.803585    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726175-8jm4h" podStartSLOduration=1.633091764 podStartE2EDuration="5.803570565s" totalImagesPullingTime="4.170478801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:15:05.801784747 +0000 UTC m=+1132.245914821" watchObservedRunningTime="2026-07-09 04:15:05.803570565 +0000 UTC m=+1132.247700638"
Jul 09 04:16:00.011183 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:16:00.011099    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726175-8jm4h"]
Jul 09 04:16:00.011761 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:16:00.011332    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726175-8jm4h" podUID="aa27a62e-e5fc-46c1-8365-dfcaf926902c" containerName="cleanup" containerID="cri-o://b9e02705c9fd11692664285de1bd77a9ad938015287d7075a4492d078ed8ef8d" gracePeriod=30
Jul 09 04:16:14.080870 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:16:14.080762    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9jc2_33172081-e578-41b0-ae82-d9d52c06df2b/ovn-acl-logging/0.log"
Jul 09 04:16:14.086795 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:16:14.082409    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9jc2_33172081-e578-41b0-ae82-d9d52c06df2b/ovn-acl-logging/0.log"
Jul 09 04:16:30.139852 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:16:30.139822    2582 generic.go:356] "Generic (PLEG): container finished" podID="aa27a62e-e5fc-46c1-8365-dfcaf926902c" containerID="b9e02705c9fd11692664285de1bd77a9ad938015287d7075a4492d078ed8ef8d" exitCode=137
Jul 09 04:16:30.140318 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:16:30.139928    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726175-8jm4h" event={"ID":"aa27a62e-e5fc-46c1-8365-dfcaf926902c","Type":"ContainerDied","Data":"b9e02705c9fd11692664285de1bd77a9ad938015287d7075a4492d078ed8ef8d"}
Jul 09 04:16:30.199947 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:16:30.199920    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726175-8jm4h"
Jul 09 04:16:30.282385 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:16:30.282299    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-762ml\" (UniqueName: \"kubernetes.io/projected/aa27a62e-e5fc-46c1-8365-dfcaf926902c-kube-api-access-762ml\") pod \"aa27a62e-e5fc-46c1-8365-dfcaf926902c\" (UID: \"aa27a62e-e5fc-46c1-8365-dfcaf926902c\") "
Jul 09 04:16:30.284564 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:16:30.284530    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa27a62e-e5fc-46c1-8365-dfcaf926902c-kube-api-access-762ml" (OuterVolumeSpecName: "kube-api-access-762ml") pod "aa27a62e-e5fc-46c1-8365-dfcaf926902c" (UID: "aa27a62e-e5fc-46c1-8365-dfcaf926902c"). InnerVolumeSpecName "kube-api-access-762ml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:16:30.383322 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:16:30.383290    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-762ml\" (UniqueName: \"kubernetes.io/projected/aa27a62e-e5fc-46c1-8365-dfcaf926902c-kube-api-access-762ml\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:16:31.145601 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:16:31.145572    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726175-8jm4h"
Jul 09 04:16:31.145601 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:16:31.145571    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726175-8jm4h" event={"ID":"aa27a62e-e5fc-46c1-8365-dfcaf926902c","Type":"ContainerDied","Data":"98f7ae524438fc9aecd581ed7711fa6eed9b72b1adf2e4b2bd8d5c8a7e82a305"}
Jul 09 04:16:31.146245 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:16:31.145634    2582 scope.go:117] "RemoveContainer" containerID="b9e02705c9fd11692664285de1bd77a9ad938015287d7075a4492d078ed8ef8d"
Jul 09 04:16:31.176202 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:16:31.176176    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726175-8jm4h"]
Jul 09 04:16:31.177555 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:16:31.177530    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726175-8jm4h"]
Jul 09 04:16:32.153687 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:16:32.153656    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa27a62e-e5fc-46c1-8365-dfcaf926902c" path="/var/lib/kubelet/pods/aa27a62e-e5fc-46c1-8365-dfcaf926902c/volumes"
Jul 09 04:21:04.383744 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.383714    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"]
Jul 09 04:21:04.384149 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.384069    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa27a62e-e5fc-46c1-8365-dfcaf926902c" containerName="cleanup"
Jul 09 04:21:04.384149 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.384085    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa27a62e-e5fc-46c1-8365-dfcaf926902c" containerName="cleanup"
Jul 09 04:21:04.384149 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.384150    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa27a62e-e5fc-46c1-8365-dfcaf926902c" containerName="cleanup"
Jul 09 04:21:04.387106 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.387089    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.415596 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.415574    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b35226b1-openshift-default-dockercfg-9mh2t\""
Jul 09 04:21:04.428786 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.428759    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"]
Jul 09 04:21:04.494805 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.494767    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d026110e-1306-4ef7-b3df-aae3b7093fb5-istio-podinfo\") pod \"e2e-ait-b35226b1-openshift-default-96997794f-drtjj\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") " pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.495023 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.494812    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svzp8\" (UniqueName: \"kubernetes.io/projected/d026110e-1306-4ef7-b3df-aae3b7093fb5-kube-api-access-svzp8\") pod \"e2e-ait-b35226b1-openshift-default-96997794f-drtjj\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") " pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.495023 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.494906    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-workload-certs\") pod \"e2e-ait-b35226b1-openshift-default-96997794f-drtjj\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") " pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.495023 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.494953    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-istio-envoy\") pod \"e2e-ait-b35226b1-openshift-default-96997794f-drtjj\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") " pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.495203 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.495015    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-istio-data\") pod \"e2e-ait-b35226b1-openshift-default-96997794f-drtjj\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") " pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.495203 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.495047    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d026110e-1306-4ef7-b3df-aae3b7093fb5-istio-token\") pod \"e2e-ait-b35226b1-openshift-default-96997794f-drtjj\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") " pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.495203 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.495068    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-credential-socket\") pod \"e2e-ait-b35226b1-openshift-default-96997794f-drtjj\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") " pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.495203 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.495149    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-workload-socket\") pod \"e2e-ait-b35226b1-openshift-default-96997794f-drtjj\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") " pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.495203 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.495180    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d026110e-1306-4ef7-b3df-aae3b7093fb5-istiod-ca-cert\") pod \"e2e-ait-b35226b1-openshift-default-96997794f-drtjj\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") " pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.596023 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.595995    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-istio-data\") pod \"e2e-ait-b35226b1-openshift-default-96997794f-drtjj\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") " pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.596023 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.596026    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d026110e-1306-4ef7-b3df-aae3b7093fb5-istio-token\") pod \"e2e-ait-b35226b1-openshift-default-96997794f-drtjj\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") " pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.596214 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.596045    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-credential-socket\") pod \"e2e-ait-b35226b1-openshift-default-96997794f-drtjj\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") " pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.596214 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.596078    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-workload-socket\") pod \"e2e-ait-b35226b1-openshift-default-96997794f-drtjj\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") " pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.596214 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.596194    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d026110e-1306-4ef7-b3df-aae3b7093fb5-istiod-ca-cert\") pod \"e2e-ait-b35226b1-openshift-default-96997794f-drtjj\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") " pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.596373 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.596235    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d026110e-1306-4ef7-b3df-aae3b7093fb5-istio-podinfo\") pod \"e2e-ait-b35226b1-openshift-default-96997794f-drtjj\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") " pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.596373 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.596263    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svzp8\" (UniqueName: \"kubernetes.io/projected/d026110e-1306-4ef7-b3df-aae3b7093fb5-kube-api-access-svzp8\") pod \"e2e-ait-b35226b1-openshift-default-96997794f-drtjj\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") " pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.596373 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.596324    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-workload-certs\") pod \"e2e-ait-b35226b1-openshift-default-96997794f-drtjj\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") " pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.596517 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.596401    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-istio-envoy\") pod \"e2e-ait-b35226b1-openshift-default-96997794f-drtjj\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") " pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.596517 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.596412    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-istio-data\") pod \"e2e-ait-b35226b1-openshift-default-96997794f-drtjj\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") " pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.596517 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.596474    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-credential-socket\") pod \"e2e-ait-b35226b1-openshift-default-96997794f-drtjj\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") " pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.596667 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.596644    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-workload-certs\") pod \"e2e-ait-b35226b1-openshift-default-96997794f-drtjj\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") " pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.596791 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.596762    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-workload-socket\") pod \"e2e-ait-b35226b1-openshift-default-96997794f-drtjj\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") " pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.597092 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.597073    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d026110e-1306-4ef7-b3df-aae3b7093fb5-istiod-ca-cert\") pod \"e2e-ait-b35226b1-openshift-default-96997794f-drtjj\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") " pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.598673 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.598642    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-istio-envoy\") pod \"e2e-ait-b35226b1-openshift-default-96997794f-drtjj\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") " pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.598904 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.598866    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d026110e-1306-4ef7-b3df-aae3b7093fb5-istio-podinfo\") pod \"e2e-ait-b35226b1-openshift-default-96997794f-drtjj\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") " pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.612374 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.612317    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d026110e-1306-4ef7-b3df-aae3b7093fb5-istio-token\") pod \"e2e-ait-b35226b1-openshift-default-96997794f-drtjj\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") " pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.612504 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.612482    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svzp8\" (UniqueName: \"kubernetes.io/projected/d026110e-1306-4ef7-b3df-aae3b7093fb5-kube-api-access-svzp8\") pod \"e2e-ait-b35226b1-openshift-default-96997794f-drtjj\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") " pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.696363 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.696339    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:04.828593 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.828417    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"]
Jul 09 04:21:04.830723 ip-10-0-134-121 kubenswrapper[2582]: W0709 04:21:04.830694    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd026110e_1306_4ef7_b3df_aae3b7093fb5.slice/crio-f4cb8404017de554795816eed2ab9c9c27d93fc1cd78c15b4fb7ead71e9ae2fe WatchSource:0}: Error finding container f4cb8404017de554795816eed2ab9c9c27d93fc1cd78c15b4fb7ead71e9ae2fe: Status 404 returned error can't find the container with id f4cb8404017de554795816eed2ab9c9c27d93fc1cd78c15b4fb7ead71e9ae2fe
Jul 09 04:21:04.832705 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.832678    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:21:04.832765 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.832736    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:21:04.832798 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:04.832762    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:21:05.287208 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:05.287118    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj" event={"ID":"d026110e-1306-4ef7-b3df-aae3b7093fb5","Type":"ContainerStarted","Data":"41f38dffbc5f38503a5d384071fe3e55004f37aaaef2b1c628aeaa2df17b98a0"}
Jul 09 04:21:05.287208 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:05.287184    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj" event={"ID":"d026110e-1306-4ef7-b3df-aae3b7093fb5","Type":"ContainerStarted","Data":"f4cb8404017de554795816eed2ab9c9c27d93fc1cd78c15b4fb7ead71e9ae2fe"}
Jul 09 04:21:05.311862 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:05.311805    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj" podStartSLOduration=1.311786874 podStartE2EDuration="1.311786874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:21:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:21:05.3112767 +0000 UTC m=+1491.755406775" watchObservedRunningTime="2026-07-09 04:21:05.311786874 +0000 UTC m=+1491.755916948"
Jul 09 04:21:05.696688 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:05.696658    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:05.702277 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:05.702248    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:06.291206 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:06.291171    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:06.292116 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:06.292091    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:10.812163 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:10.812124    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"]
Jul 09 04:21:10.812724 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:10.812330    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj" podUID="d026110e-1306-4ef7-b3df-aae3b7093fb5" containerName="istio-proxy" containerID="cri-o://41f38dffbc5f38503a5d384071fe3e55004f37aaaef2b1c628aeaa2df17b98a0" gracePeriod=30
Jul 09 04:21:14.105372 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:14.105345    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9jc2_33172081-e578-41b0-ae82-d9d52c06df2b/ovn-acl-logging/0.log"
Jul 09 04:21:14.107871 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:14.107126    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9jc2_33172081-e578-41b0-ae82-d9d52c06df2b/ovn-acl-logging/0.log"
Jul 09 04:21:16.046174 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.046152    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:16.087586 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.087514    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d026110e-1306-4ef7-b3df-aae3b7093fb5-istio-podinfo\") pod \"d026110e-1306-4ef7-b3df-aae3b7093fb5\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") "
Jul 09 04:21:16.087586 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.087554    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svzp8\" (UniqueName: \"kubernetes.io/projected/d026110e-1306-4ef7-b3df-aae3b7093fb5-kube-api-access-svzp8\") pod \"d026110e-1306-4ef7-b3df-aae3b7093fb5\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") "
Jul 09 04:21:16.087789 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.087595    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-workload-certs\") pod \"d026110e-1306-4ef7-b3df-aae3b7093fb5\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") "
Jul 09 04:21:16.087789 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.087641    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-credential-socket\") pod \"d026110e-1306-4ef7-b3df-aae3b7093fb5\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") "
Jul 09 04:21:16.087789 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.087665    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-istio-data\") pod \"d026110e-1306-4ef7-b3df-aae3b7093fb5\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") "
Jul 09 04:21:16.087789 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.087681    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d026110e-1306-4ef7-b3df-aae3b7093fb5-istiod-ca-cert\") pod \"d026110e-1306-4ef7-b3df-aae3b7093fb5\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") "
Jul 09 04:21:16.087789 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.087724    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d026110e-1306-4ef7-b3df-aae3b7093fb5-istio-token\") pod \"d026110e-1306-4ef7-b3df-aae3b7093fb5\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") "
Jul 09 04:21:16.087789 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.087761    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-workload-socket\") pod \"d026110e-1306-4ef7-b3df-aae3b7093fb5\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") "
Jul 09 04:21:16.088099 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.087798    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-istio-envoy\") pod \"d026110e-1306-4ef7-b3df-aae3b7093fb5\" (UID: \"d026110e-1306-4ef7-b3df-aae3b7093fb5\") "
Jul 09 04:21:16.088099 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.087985    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d026110e-1306-4ef7-b3df-aae3b7093fb5" (UID: "d026110e-1306-4ef7-b3df-aae3b7093fb5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:21:16.088099 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.088004    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-istio-data" (OuterVolumeSpecName: "istio-data") pod "d026110e-1306-4ef7-b3df-aae3b7093fb5" (UID: "d026110e-1306-4ef7-b3df-aae3b7093fb5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:21:16.088099 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.088015    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d026110e-1306-4ef7-b3df-aae3b7093fb5" (UID: "d026110e-1306-4ef7-b3df-aae3b7093fb5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:21:16.088099 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.088079    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d026110e-1306-4ef7-b3df-aae3b7093fb5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d026110e-1306-4ef7-b3df-aae3b7093fb5" (UID: "d026110e-1306-4ef7-b3df-aae3b7093fb5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:21:16.088349 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.088228    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d026110e-1306-4ef7-b3df-aae3b7093fb5" (UID: "d026110e-1306-4ef7-b3df-aae3b7093fb5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:21:16.088349 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.088263    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:16.088349 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.088278    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:16.088349 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.088289    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:16.088349 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.088299    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d026110e-1306-4ef7-b3df-aae3b7093fb5-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:16.090036 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.090008    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d026110e-1306-4ef7-b3df-aae3b7093fb5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d026110e-1306-4ef7-b3df-aae3b7093fb5" (UID: "d026110e-1306-4ef7-b3df-aae3b7093fb5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 04:21:16.090224 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.090202    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d026110e-1306-4ef7-b3df-aae3b7093fb5" (UID: "d026110e-1306-4ef7-b3df-aae3b7093fb5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:21:16.090534 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.090504    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d026110e-1306-4ef7-b3df-aae3b7093fb5-kube-api-access-svzp8" (OuterVolumeSpecName: "kube-api-access-svzp8") pod "d026110e-1306-4ef7-b3df-aae3b7093fb5" (UID: "d026110e-1306-4ef7-b3df-aae3b7093fb5"). InnerVolumeSpecName "kube-api-access-svzp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:21:16.090534 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.090505    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d026110e-1306-4ef7-b3df-aae3b7093fb5-istio-token" (OuterVolumeSpecName: "istio-token") pod "d026110e-1306-4ef7-b3df-aae3b7093fb5" (UID: "d026110e-1306-4ef7-b3df-aae3b7093fb5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:21:16.189446 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.189418    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d026110e-1306-4ef7-b3df-aae3b7093fb5-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:16.189446 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.189441    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:16.189585 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.189451    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d026110e-1306-4ef7-b3df-aae3b7093fb5-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:16.189585 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.189459    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d026110e-1306-4ef7-b3df-aae3b7093fb5-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:16.189585 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.189468    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svzp8\" (UniqueName: \"kubernetes.io/projected/d026110e-1306-4ef7-b3df-aae3b7093fb5-kube-api-access-svzp8\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:16.334680 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.334646    2582 generic.go:356] "Generic (PLEG): container finished" podID="d026110e-1306-4ef7-b3df-aae3b7093fb5" containerID="41f38dffbc5f38503a5d384071fe3e55004f37aaaef2b1c628aeaa2df17b98a0" exitCode=0
Jul 09 04:21:16.334816 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.334695    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"
Jul 09 04:21:16.334816 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.334730    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj" event={"ID":"d026110e-1306-4ef7-b3df-aae3b7093fb5","Type":"ContainerDied","Data":"41f38dffbc5f38503a5d384071fe3e55004f37aaaef2b1c628aeaa2df17b98a0"}
Jul 09 04:21:16.334816 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.334785    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj" event={"ID":"d026110e-1306-4ef7-b3df-aae3b7093fb5","Type":"ContainerDied","Data":"f4cb8404017de554795816eed2ab9c9c27d93fc1cd78c15b4fb7ead71e9ae2fe"}
Jul 09 04:21:16.334816 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.334808    2582 scope.go:117] "RemoveContainer" containerID="41f38dffbc5f38503a5d384071fe3e55004f37aaaef2b1c628aeaa2df17b98a0"
Jul 09 04:21:16.343069 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.343056    2582 scope.go:117] "RemoveContainer" containerID="41f38dffbc5f38503a5d384071fe3e55004f37aaaef2b1c628aeaa2df17b98a0"
Jul 09 04:21:16.343316 ip-10-0-134-121 kubenswrapper[2582]: E0709 04:21:16.343297    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41f38dffbc5f38503a5d384071fe3e55004f37aaaef2b1c628aeaa2df17b98a0\": container with ID starting with 41f38dffbc5f38503a5d384071fe3e55004f37aaaef2b1c628aeaa2df17b98a0 not found: ID does not exist" containerID="41f38dffbc5f38503a5d384071fe3e55004f37aaaef2b1c628aeaa2df17b98a0"
Jul 09 04:21:16.343367 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.343323    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41f38dffbc5f38503a5d384071fe3e55004f37aaaef2b1c628aeaa2df17b98a0"} err="failed to get container status \"41f38dffbc5f38503a5d384071fe3e55004f37aaaef2b1c628aeaa2df17b98a0\": rpc error: code = NotFound desc = could not find container \"41f38dffbc5f38503a5d384071fe3e55004f37aaaef2b1c628aeaa2df17b98a0\": container with ID starting with 41f38dffbc5f38503a5d384071fe3e55004f37aaaef2b1c628aeaa2df17b98a0 not found: ID does not exist"
Jul 09 04:21:16.351358 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.351338    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"]
Jul 09 04:21:16.356166 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:16.356147    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b35226b1-openshift-default-96997794f-drtjj"]
Jul 09 04:21:17.313593 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.313563    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"]
Jul 09 04:21:17.314111 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.313930    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d026110e-1306-4ef7-b3df-aae3b7093fb5" containerName="istio-proxy"
Jul 09 04:21:17.314111 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.313944    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d026110e-1306-4ef7-b3df-aae3b7093fb5" containerName="istio-proxy"
Jul 09 04:21:17.314111 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.314018    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d026110e-1306-4ef7-b3df-aae3b7093fb5" containerName="istio-proxy"
Jul 09 04:21:17.318434 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.318401    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.321734 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.321713    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-dc2bcfdc-gw-openshift-default-dockercfg-5fzc2\""
Jul 09 04:21:17.335930 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.335046    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"]
Jul 09 04:21:17.400318 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.400291    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-workload-socket\") pod \"e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") " pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.400456 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.400321    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istio-data\") pod \"e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") " pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.400456 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.400345    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istio-podinfo\") pod \"e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") " pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.400456 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.400367    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istiod-ca-cert\") pod \"e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") " pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.400456 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.400432    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istio-envoy\") pod \"e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") " pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.400641 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.400489    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-credential-socket\") pod \"e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") " pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.400641 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.400551    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istio-token\") pod \"e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") " pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.400641 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.400635    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-workload-certs\") pod \"e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") " pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.400773 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.400663    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtcjk\" (UniqueName: \"kubernetes.io/projected/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-kube-api-access-gtcjk\") pod \"e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") " pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.501245 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.501210    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-workload-socket\") pod \"e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") " pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.501245 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.501247    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istio-data\") pod \"e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") " pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.501475 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.501278    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istio-podinfo\") pod \"e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") " pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.501475 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.501306    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istiod-ca-cert\") pod \"e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") " pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.501475 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.501331    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istio-envoy\") pod \"e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") " pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.501475 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.501376    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-credential-socket\") pod \"e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") " pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.501475 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.501417    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istio-token\") pod \"e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") " pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.501726 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.501488    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-workload-certs\") pod \"e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") " pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.501726 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.501539    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtcjk\" (UniqueName: \"kubernetes.io/projected/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-kube-api-access-gtcjk\") pod \"e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") " pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.501726 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.501664    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-workload-socket\") pod \"e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") " pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.502122 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.502087    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-credential-socket\") pod \"e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") " pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.502207 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.502187    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-workload-certs\") pod \"e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") " pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.502335 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.502314    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istio-data\") pod \"e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") " pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.502372 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.502335    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istiod-ca-cert\") pod \"e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") " pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.503855 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.503830    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istio-envoy\") pod \"e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") " pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.504014 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.503996    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istio-podinfo\") pod \"e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") " pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.513541 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.513522    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istio-token\") pod \"e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") " pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.514454 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.514434    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtcjk\" (UniqueName: \"kubernetes.io/projected/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-kube-api-access-gtcjk\") pod \"e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") " pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.631291 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.631255    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:17.782799 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.782768    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"]
Jul 09 04:21:17.784227 ip-10-0-134-121 kubenswrapper[2582]: W0709 04:21:17.784202    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f15a4d0_7afc_49e2_bec6_17a462d3c18e.slice/crio-a002b6ec6116197effb0222ec5c4edc1af47b445b86785a981186717ba80c97e WatchSource:0}: Error finding container a002b6ec6116197effb0222ec5c4edc1af47b445b86785a981186717ba80c97e: Status 404 returned error can't find the container with id a002b6ec6116197effb0222ec5c4edc1af47b445b86785a981186717ba80c97e
Jul 09 04:21:17.786480 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.786449    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:21:17.786555 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.786538    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:21:17.786593 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:17.786566    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:21:18.155250 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:18.155220    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d026110e-1306-4ef7-b3df-aae3b7093fb5" path="/var/lib/kubelet/pods/d026110e-1306-4ef7-b3df-aae3b7093fb5/volumes"
Jul 09 04:21:18.348421 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:18.348385    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr" event={"ID":"4f15a4d0-7afc-49e2-bec6-17a462d3c18e","Type":"ContainerStarted","Data":"7eb8a8f81e891511d5aa1748698be073f62277e16837a27d4e250374da84de3b"}
Jul 09 04:21:18.348784 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:18.348445    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr" event={"ID":"4f15a4d0-7afc-49e2-bec6-17a462d3c18e","Type":"ContainerStarted","Data":"a002b6ec6116197effb0222ec5c4edc1af47b445b86785a981186717ba80c97e"}
Jul 09 04:21:18.370345 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:18.370302    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr" podStartSLOduration=1.370286648 podStartE2EDuration="1.370286648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:21:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:21:18.370077242 +0000 UTC m=+1504.814207314" watchObservedRunningTime="2026-07-09 04:21:18.370286648 +0000 UTC m=+1504.814416721"
Jul 09 04:21:18.631984 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:18.631952    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:18.636631 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:18.636604    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:19.354504 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:19.354474    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:19.355449 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:19.355432    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:23.287507 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:23.287473    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"]
Jul 09 04:21:23.287983 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:23.287654    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr" podUID="4f15a4d0-7afc-49e2-bec6-17a462d3c18e" containerName="istio-proxy" containerID="cri-o://7eb8a8f81e891511d5aa1748698be073f62277e16837a27d4e250374da84de3b" gracePeriod=30
Jul 09 04:21:29.231515 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.231484    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:29.306191 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.306102    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-workload-certs\") pod \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") "
Jul 09 04:21:29.306191 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.306147    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-workload-socket\") pod \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") "
Jul 09 04:21:29.306191 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.306168    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istiod-ca-cert\") pod \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") "
Jul 09 04:21:29.306478 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.306208    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtcjk\" (UniqueName: \"kubernetes.io/projected/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-kube-api-access-gtcjk\") pod \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") "
Jul 09 04:21:29.306478 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.306249    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istio-envoy\") pod \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") "
Jul 09 04:21:29.306478 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.306295    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istio-token\") pod \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") "
Jul 09 04:21:29.306478 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.306341    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istio-data\") pod \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") "
Jul 09 04:21:29.306478 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.306363    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-credential-socket\") pod \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") "
Jul 09 04:21:29.306478 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.306402    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istio-podinfo\") pod \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\" (UID: \"4f15a4d0-7afc-49e2-bec6-17a462d3c18e\") "
Jul 09 04:21:29.306478 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.306403    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4f15a4d0-7afc-49e2-bec6-17a462d3c18e" (UID: "4f15a4d0-7afc-49e2-bec6-17a462d3c18e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:21:29.306791 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.306526    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4f15a4d0-7afc-49e2-bec6-17a462d3c18e" (UID: "4f15a4d0-7afc-49e2-bec6-17a462d3c18e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:21:29.306791 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.306640    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4f15a4d0-7afc-49e2-bec6-17a462d3c18e" (UID: "4f15a4d0-7afc-49e2-bec6-17a462d3c18e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:21:29.306791 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.306685    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:29.306791 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.306698    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:29.307112 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.307093    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istio-data" (OuterVolumeSpecName: "istio-data") pod "4f15a4d0-7afc-49e2-bec6-17a462d3c18e" (UID: "4f15a4d0-7afc-49e2-bec6-17a462d3c18e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:21:29.308154 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.308124    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4f15a4d0-7afc-49e2-bec6-17a462d3c18e" (UID: "4f15a4d0-7afc-49e2-bec6-17a462d3c18e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:21:29.308718 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.308689    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4f15a4d0-7afc-49e2-bec6-17a462d3c18e" (UID: "4f15a4d0-7afc-49e2-bec6-17a462d3c18e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:21:29.308832 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.308721    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-kube-api-access-gtcjk" (OuterVolumeSpecName: "kube-api-access-gtcjk") pod "4f15a4d0-7afc-49e2-bec6-17a462d3c18e" (UID: "4f15a4d0-7afc-49e2-bec6-17a462d3c18e"). InnerVolumeSpecName "kube-api-access-gtcjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:21:29.309826 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.309763    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istio-token" (OuterVolumeSpecName: "istio-token") pod "4f15a4d0-7afc-49e2-bec6-17a462d3c18e" (UID: "4f15a4d0-7afc-49e2-bec6-17a462d3c18e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:21:29.310108 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.310088    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4f15a4d0-7afc-49e2-bec6-17a462d3c18e" (UID: "4f15a4d0-7afc-49e2-bec6-17a462d3c18e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 04:21:29.355905 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.355850    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"]
Jul 09 04:21:29.356266 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.356251    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f15a4d0-7afc-49e2-bec6-17a462d3c18e" containerName="istio-proxy"
Jul 09 04:21:29.356266 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.356268    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f15a4d0-7afc-49e2-bec6-17a462d3c18e" containerName="istio-proxy"
Jul 09 04:21:29.356359 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.356329    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f15a4d0-7afc-49e2-bec6-17a462d3c18e" containerName="istio-proxy"
Jul 09 04:21:29.359544 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.359525    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.362540 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.362509    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-85095648-openshift-default-dockercfg-2hlct\""
Jul 09 04:21:29.371927 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.371901    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"]
Jul 09 04:21:29.400086 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.400055    2582 generic.go:356] "Generic (PLEG): container finished" podID="4f15a4d0-7afc-49e2-bec6-17a462d3c18e" containerID="7eb8a8f81e891511d5aa1748698be073f62277e16837a27d4e250374da84de3b" exitCode=0
Jul 09 04:21:29.400219 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.400111    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"
Jul 09 04:21:29.400219 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.400136    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr" event={"ID":"4f15a4d0-7afc-49e2-bec6-17a462d3c18e","Type":"ContainerDied","Data":"7eb8a8f81e891511d5aa1748698be073f62277e16837a27d4e250374da84de3b"}
Jul 09 04:21:29.400219 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.400207    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr" event={"ID":"4f15a4d0-7afc-49e2-bec6-17a462d3c18e","Type":"ContainerDied","Data":"a002b6ec6116197effb0222ec5c4edc1af47b445b86785a981186717ba80c97e"}
Jul 09 04:21:29.400394 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.400241    2582 scope.go:117] "RemoveContainer" containerID="7eb8a8f81e891511d5aa1748698be073f62277e16837a27d4e250374da84de3b"
Jul 09 04:21:29.408518 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.408494    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-workload-certs\") pod \"e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") " pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.408660 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.408527    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-istio-data\") pod \"e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") " pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.408660 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.408551    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-istio-envoy\") pod \"e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") " pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.408660 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.408621    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm5t6\" (UniqueName: \"kubernetes.io/projected/80ca7738-c574-43ad-869e-476c10d6333f-kube-api-access-xm5t6\") pod \"e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") " pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.409004 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.408661    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-workload-socket\") pod \"e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") " pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.409004 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.408719    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80ca7738-c574-43ad-869e-476c10d6333f-istiod-ca-cert\") pod \"e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") " pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.409004 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.408776    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80ca7738-c574-43ad-869e-476c10d6333f-istio-token\") pod \"e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") " pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.409004 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.408822    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80ca7738-c574-43ad-869e-476c10d6333f-istio-podinfo\") pod \"e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") " pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.409004 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.408849    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-credential-socket\") pod \"e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") " pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.409004 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.408941    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:29.409004 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.408955    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:29.409004 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.409001    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtcjk\" (UniqueName: \"kubernetes.io/projected/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-kube-api-access-gtcjk\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:29.409372 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.409023    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:29.409372 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.409038    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:29.409372 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.409051    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:29.409372 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.409062    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f15a4d0-7afc-49e2-bec6-17a462d3c18e-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:29.412821 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.412804    2582 scope.go:117] "RemoveContainer" containerID="7eb8a8f81e891511d5aa1748698be073f62277e16837a27d4e250374da84de3b"
Jul 09 04:21:29.413160 ip-10-0-134-121 kubenswrapper[2582]: E0709 04:21:29.413143    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7eb8a8f81e891511d5aa1748698be073f62277e16837a27d4e250374da84de3b\": container with ID starting with 7eb8a8f81e891511d5aa1748698be073f62277e16837a27d4e250374da84de3b not found: ID does not exist" containerID="7eb8a8f81e891511d5aa1748698be073f62277e16837a27d4e250374da84de3b"
Jul 09 04:21:29.413207 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.413169    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7eb8a8f81e891511d5aa1748698be073f62277e16837a27d4e250374da84de3b"} err="failed to get container status \"7eb8a8f81e891511d5aa1748698be073f62277e16837a27d4e250374da84de3b\": rpc error: code = NotFound desc = could not find container \"7eb8a8f81e891511d5aa1748698be073f62277e16837a27d4e250374da84de3b\": container with ID starting with 7eb8a8f81e891511d5aa1748698be073f62277e16837a27d4e250374da84de3b not found: ID does not exist"
Jul 09 04:21:29.425449 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.425424    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"]
Jul 09 04:21:29.432284 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.432264    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-dc2bcfdc-gw-openshift-default-869f5f7679-vkrfr"]
Jul 09 04:21:29.510160 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.510126    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-workload-socket\") pod \"e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") " pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.510328 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.510175    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80ca7738-c574-43ad-869e-476c10d6333f-istiod-ca-cert\") pod \"e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") " pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.510328 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.510198    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80ca7738-c574-43ad-869e-476c10d6333f-istio-token\") pod \"e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") " pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.510328 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.510227    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80ca7738-c574-43ad-869e-476c10d6333f-istio-podinfo\") pod \"e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") " pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.510328 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.510251    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-credential-socket\") pod \"e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") " pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.510328 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.510296    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-workload-certs\") pod \"e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") " pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.510328 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.510324    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-istio-data\") pod \"e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") " pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.510661 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.510348    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-istio-envoy\") pod \"e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") " pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.510661 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.510389    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm5t6\" (UniqueName: \"kubernetes.io/projected/80ca7738-c574-43ad-869e-476c10d6333f-kube-api-access-xm5t6\") pod \"e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") " pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.510661 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.510593    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-workload-socket\") pod \"e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") " pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.510766 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.510657    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-workload-certs\") pod \"e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") " pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.510766 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.510715    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-istio-data\") pod \"e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") " pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.510861 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.510841    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-credential-socket\") pod \"e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") " pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.511087 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.511069    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80ca7738-c574-43ad-869e-476c10d6333f-istiod-ca-cert\") pod \"e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") " pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.512579 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.512559    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-istio-envoy\") pod \"e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") " pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.512696 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.512676    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80ca7738-c574-43ad-869e-476c10d6333f-istio-podinfo\") pod \"e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") " pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.521678 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.521659    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm5t6\" (UniqueName: \"kubernetes.io/projected/80ca7738-c574-43ad-869e-476c10d6333f-kube-api-access-xm5t6\") pod \"e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") " pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.523444 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.523426    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80ca7738-c574-43ad-869e-476c10d6333f-istio-token\") pod \"e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") " pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.671667 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.671601    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:29.799445 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.799416    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"]
Jul 09 04:21:29.801062 ip-10-0-134-121 kubenswrapper[2582]: W0709 04:21:29.801037    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80ca7738_c574_43ad_869e_476c10d6333f.slice/crio-69abf0fbe5e3946d213d14addecc6f0e31d19ce532e8fb813907720e4012e807 WatchSource:0}: Error finding container 69abf0fbe5e3946d213d14addecc6f0e31d19ce532e8fb813907720e4012e807: Status 404 returned error can't find the container with id 69abf0fbe5e3946d213d14addecc6f0e31d19ce532e8fb813907720e4012e807
Jul 09 04:21:29.803211 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.803181    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:21:29.803290 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.803239    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:21:29.803290 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:29.803271    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:21:30.154690 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:30.154654    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f15a4d0-7afc-49e2-bec6-17a462d3c18e" path="/var/lib/kubelet/pods/4f15a4d0-7afc-49e2-bec6-17a462d3c18e/volumes"
Jul 09 04:21:30.406744 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:30.406659    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg" event={"ID":"80ca7738-c574-43ad-869e-476c10d6333f","Type":"ContainerStarted","Data":"37b5c2c558bba271efed3be57cd8af9416f348cecfca8c10dd8ceed2c82b0b58"}
Jul 09 04:21:30.406744 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:30.406705    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg" event={"ID":"80ca7738-c574-43ad-869e-476c10d6333f","Type":"ContainerStarted","Data":"69abf0fbe5e3946d213d14addecc6f0e31d19ce532e8fb813907720e4012e807"}
Jul 09 04:21:30.432398 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:30.432354    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg" podStartSLOduration=1.4323373240000001 podStartE2EDuration="1.432337324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:21:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:21:30.431167698 +0000 UTC m=+1516.875297783" watchObservedRunningTime="2026-07-09 04:21:30.432337324 +0000 UTC m=+1516.876467407"
Jul 09 04:21:30.672278 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:30.672187    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:30.676993 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:30.676967    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:31.411405 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:31.411363    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:31.412426 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:31.412402    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:41.464626 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:41.464594    2582 generic.go:356] "Generic (PLEG): container finished" podID="80ca7738-c574-43ad-869e-476c10d6333f" containerID="37b5c2c558bba271efed3be57cd8af9416f348cecfca8c10dd8ceed2c82b0b58" exitCode=0
Jul 09 04:21:41.465052 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:41.464676    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg" event={"ID":"80ca7738-c574-43ad-869e-476c10d6333f","Type":"ContainerDied","Data":"37b5c2c558bba271efed3be57cd8af9416f348cecfca8c10dd8ceed2c82b0b58"}
Jul 09 04:21:41.465112 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:41.465065    2582 scope.go:117] "RemoveContainer" containerID="37b5c2c558bba271efed3be57cd8af9416f348cecfca8c10dd8ceed2c82b0b58"
Jul 09 04:21:41.466035 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:41.466007    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:21:41.466137 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:41.466072    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:21:41.466137 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:41.466103    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:21:41.607902 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:41.607859    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"]
Jul 09 04:21:42.471640 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:42.471608    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg" event={"ID":"80ca7738-c574-43ad-869e-476c10d6333f","Type":"ContainerStarted","Data":"a0fc96f0e9897837017d626ffe250f9d76be26309dfa1a34863797f6a0df431e"}
Jul 09 04:21:42.472041 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:42.471732    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg" podUID="80ca7738-c574-43ad-869e-476c10d6333f" containerName="istio-proxy" containerID="cri-o://a0fc96f0e9897837017d626ffe250f9d76be26309dfa1a34863797f6a0df431e" gracePeriod=30
Jul 09 04:21:46.411630 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:46.411597    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:47.717465 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:47.717442    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:47.873107 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:47.873083    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-istio-data\") pod \"80ca7738-c574-43ad-869e-476c10d6333f\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") "
Jul 09 04:21:47.873243 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:47.873117    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-credential-socket\") pod \"80ca7738-c574-43ad-869e-476c10d6333f\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") "
Jul 09 04:21:47.873243 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:47.873141    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80ca7738-c574-43ad-869e-476c10d6333f-istiod-ca-cert\") pod \"80ca7738-c574-43ad-869e-476c10d6333f\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") "
Jul 09 04:21:47.873243 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:47.873157    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80ca7738-c574-43ad-869e-476c10d6333f-istio-token\") pod \"80ca7738-c574-43ad-869e-476c10d6333f\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") "
Jul 09 04:21:47.873243 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:47.873180    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-workload-socket\") pod \"80ca7738-c574-43ad-869e-476c10d6333f\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") "
Jul 09 04:21:47.873424 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:47.873364    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-istio-envoy\") pod \"80ca7738-c574-43ad-869e-476c10d6333f\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") "
Jul 09 04:21:47.873424 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:47.873371    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "80ca7738-c574-43ad-869e-476c10d6333f" (UID: "80ca7738-c574-43ad-869e-476c10d6333f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:21:47.873527 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:47.873421    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "80ca7738-c574-43ad-869e-476c10d6333f" (UID: "80ca7738-c574-43ad-869e-476c10d6333f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:21:47.873527 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:47.873455    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-workload-certs\") pod \"80ca7738-c574-43ad-869e-476c10d6333f\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") "
Jul 09 04:21:47.873527 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:47.873506    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80ca7738-c574-43ad-869e-476c10d6333f-istio-podinfo\") pod \"80ca7738-c574-43ad-869e-476c10d6333f\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") "
Jul 09 04:21:47.873686 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:47.873534    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xm5t6\" (UniqueName: \"kubernetes.io/projected/80ca7738-c574-43ad-869e-476c10d6333f-kube-api-access-xm5t6\") pod \"80ca7738-c574-43ad-869e-476c10d6333f\" (UID: \"80ca7738-c574-43ad-869e-476c10d6333f\") "
Jul 09 04:21:47.873686 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:47.873621    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "80ca7738-c574-43ad-869e-476c10d6333f" (UID: "80ca7738-c574-43ad-869e-476c10d6333f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:21:47.873686 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:47.873651    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80ca7738-c574-43ad-869e-476c10d6333f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "80ca7738-c574-43ad-869e-476c10d6333f" (UID: "80ca7738-c574-43ad-869e-476c10d6333f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:21:47.873845 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:47.873823    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:47.873931 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:47.873852    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:47.873931 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:47.873869    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80ca7738-c574-43ad-869e-476c10d6333f-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:47.873931 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:47.873878    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-istio-data" (OuterVolumeSpecName: "istio-data") pod "80ca7738-c574-43ad-869e-476c10d6333f" (UID: "80ca7738-c574-43ad-869e-476c10d6333f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:21:47.874090 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:47.873908    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:47.875366 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:47.875346    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80ca7738-c574-43ad-869e-476c10d6333f-istio-token" (OuterVolumeSpecName: "istio-token") pod "80ca7738-c574-43ad-869e-476c10d6333f" (UID: "80ca7738-c574-43ad-869e-476c10d6333f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:21:47.875608 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:47.875587    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80ca7738-c574-43ad-869e-476c10d6333f-kube-api-access-xm5t6" (OuterVolumeSpecName: "kube-api-access-xm5t6") pod "80ca7738-c574-43ad-869e-476c10d6333f" (UID: "80ca7738-c574-43ad-869e-476c10d6333f"). InnerVolumeSpecName "kube-api-access-xm5t6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:21:47.875824 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:47.875795    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "80ca7738-c574-43ad-869e-476c10d6333f" (UID: "80ca7738-c574-43ad-869e-476c10d6333f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:21:47.875824 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:47.875809    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/80ca7738-c574-43ad-869e-476c10d6333f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "80ca7738-c574-43ad-869e-476c10d6333f" (UID: "80ca7738-c574-43ad-869e-476c10d6333f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 04:21:47.974876 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:47.974849    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:47.974876 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:47.974872    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80ca7738-c574-43ad-869e-476c10d6333f-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:47.975022 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:47.974881    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xm5t6\" (UniqueName: \"kubernetes.io/projected/80ca7738-c574-43ad-869e-476c10d6333f-kube-api-access-xm5t6\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:47.975022 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:47.974909    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80ca7738-c574-43ad-869e-476c10d6333f-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:47.975022 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:47.974917    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80ca7738-c574-43ad-869e-476c10d6333f-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:48.316182 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.316155    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"]
Jul 09 04:21:48.316484 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.316471    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80ca7738-c574-43ad-869e-476c10d6333f" containerName="istio-proxy"
Jul 09 04:21:48.316528 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.316486    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="80ca7738-c574-43ad-869e-476c10d6333f" containerName="istio-proxy"
Jul 09 04:21:48.316528 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.316498    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80ca7738-c574-43ad-869e-476c10d6333f" containerName="istio-proxy"
Jul 09 04:21:48.316528 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.316503    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="80ca7738-c574-43ad-869e-476c10d6333f" containerName="istio-proxy"
Jul 09 04:21:48.316634 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.316568    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="80ca7738-c574-43ad-869e-476c10d6333f" containerName="istio-proxy"
Jul 09 04:21:48.319812 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.319795    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.328865 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.328845    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-64447b93-openshift-default-dockercfg-7c86m\""
Jul 09 04:21:48.369507 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.369482    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"]
Jul 09 04:21:48.479634 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.479561    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-workload-socket\") pod \"e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") " pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.479634 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.479597    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-workload-certs\") pod \"e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") " pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.479634 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.479616    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fa66252-a7be-4e40-a251-cc782532bb1d-istio-podinfo\") pod \"e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") " pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.479634 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.479634    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fa66252-a7be-4e40-a251-cc782532bb1d-istio-token\") pod \"e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") " pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.479923 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.479773    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-credential-socket\") pod \"e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") " pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.479923 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.479817    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-istio-envoy\") pod \"e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") " pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.479923 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.479872    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fa66252-a7be-4e40-a251-cc782532bb1d-istiod-ca-cert\") pod \"e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") " pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.480045 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.479935    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm54w\" (UniqueName: \"kubernetes.io/projected/9fa66252-a7be-4e40-a251-cc782532bb1d-kube-api-access-pm54w\") pod \"e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") " pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.480045 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.479995    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-istio-data\") pod \"e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") " pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.499140 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.499113    2582 generic.go:356] "Generic (PLEG): container finished" podID="80ca7738-c574-43ad-869e-476c10d6333f" containerID="a0fc96f0e9897837017d626ffe250f9d76be26309dfa1a34863797f6a0df431e" exitCode=0
Jul 09 04:21:48.499271 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.499159    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"
Jul 09 04:21:48.499271 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.499164    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg" event={"ID":"80ca7738-c574-43ad-869e-476c10d6333f","Type":"ContainerDied","Data":"a0fc96f0e9897837017d626ffe250f9d76be26309dfa1a34863797f6a0df431e"}
Jul 09 04:21:48.499271 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.499216    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg" event={"ID":"80ca7738-c574-43ad-869e-476c10d6333f","Type":"ContainerDied","Data":"69abf0fbe5e3946d213d14addecc6f0e31d19ce532e8fb813907720e4012e807"}
Jul 09 04:21:48.499271 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.499246    2582 scope.go:117] "RemoveContainer" containerID="a0fc96f0e9897837017d626ffe250f9d76be26309dfa1a34863797f6a0df431e"
Jul 09 04:21:48.507288 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.507270    2582 scope.go:117] "RemoveContainer" containerID="37b5c2c558bba271efed3be57cd8af9416f348cecfca8c10dd8ceed2c82b0b58"
Jul 09 04:21:48.514761 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.514743    2582 scope.go:117] "RemoveContainer" containerID="a0fc96f0e9897837017d626ffe250f9d76be26309dfa1a34863797f6a0df431e"
Jul 09 04:21:48.515027 ip-10-0-134-121 kubenswrapper[2582]: E0709 04:21:48.515007    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0fc96f0e9897837017d626ffe250f9d76be26309dfa1a34863797f6a0df431e\": container with ID starting with a0fc96f0e9897837017d626ffe250f9d76be26309dfa1a34863797f6a0df431e not found: ID does not exist" containerID="a0fc96f0e9897837017d626ffe250f9d76be26309dfa1a34863797f6a0df431e"
Jul 09 04:21:48.515085 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.515035    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0fc96f0e9897837017d626ffe250f9d76be26309dfa1a34863797f6a0df431e"} err="failed to get container status \"a0fc96f0e9897837017d626ffe250f9d76be26309dfa1a34863797f6a0df431e\": rpc error: code = NotFound desc = could not find container \"a0fc96f0e9897837017d626ffe250f9d76be26309dfa1a34863797f6a0df431e\": container with ID starting with a0fc96f0e9897837017d626ffe250f9d76be26309dfa1a34863797f6a0df431e not found: ID does not exist"
Jul 09 04:21:48.515085 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.515052    2582 scope.go:117] "RemoveContainer" containerID="37b5c2c558bba271efed3be57cd8af9416f348cecfca8c10dd8ceed2c82b0b58"
Jul 09 04:21:48.515281 ip-10-0-134-121 kubenswrapper[2582]: E0709 04:21:48.515263    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37b5c2c558bba271efed3be57cd8af9416f348cecfca8c10dd8ceed2c82b0b58\": container with ID starting with 37b5c2c558bba271efed3be57cd8af9416f348cecfca8c10dd8ceed2c82b0b58 not found: ID does not exist" containerID="37b5c2c558bba271efed3be57cd8af9416f348cecfca8c10dd8ceed2c82b0b58"
Jul 09 04:21:48.515324 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.515287    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37b5c2c558bba271efed3be57cd8af9416f348cecfca8c10dd8ceed2c82b0b58"} err="failed to get container status \"37b5c2c558bba271efed3be57cd8af9416f348cecfca8c10dd8ceed2c82b0b58\": rpc error: code = NotFound desc = could not find container \"37b5c2c558bba271efed3be57cd8af9416f348cecfca8c10dd8ceed2c82b0b58\": container with ID starting with 37b5c2c558bba271efed3be57cd8af9416f348cecfca8c10dd8ceed2c82b0b58 not found: ID does not exist"
Jul 09 04:21:48.520557 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.520535    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"]
Jul 09 04:21:48.530778 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.530759    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-85095648-openshift-default-6fb46f55df-v9ggg"]
Jul 09 04:21:48.580765 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.580743    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-workload-socket\") pod \"e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") " pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.580847 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.580769    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-workload-certs\") pod \"e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") " pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.580847 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.580787    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fa66252-a7be-4e40-a251-cc782532bb1d-istio-podinfo\") pod \"e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") " pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.580847 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.580801    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fa66252-a7be-4e40-a251-cc782532bb1d-istio-token\") pod \"e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") " pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.581048 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.580864    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-credential-socket\") pod \"e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") " pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.581048 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.580933    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-istio-envoy\") pod \"e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") " pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.581048 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.580981    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fa66252-a7be-4e40-a251-cc782532bb1d-istiod-ca-cert\") pod \"e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") " pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.581048 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.581004    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm54w\" (UniqueName: \"kubernetes.io/projected/9fa66252-a7be-4e40-a251-cc782532bb1d-kube-api-access-pm54w\") pod \"e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") " pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.581048 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.581035    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-istio-data\") pod \"e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") " pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.581295 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.581156    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-workload-certs\") pod \"e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") " pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.581295 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.581217    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-workload-socket\") pod \"e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") " pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.581457 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.581437    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-istio-data\") pod \"e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") " pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.581589 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.581569    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-credential-socket\") pod \"e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") " pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.581765 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.581745    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fa66252-a7be-4e40-a251-cc782532bb1d-istiod-ca-cert\") pod \"e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") " pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.583010 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.582990    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-istio-envoy\") pod \"e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") " pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.583118 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.583106    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fa66252-a7be-4e40-a251-cc782532bb1d-istio-podinfo\") pod \"e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") " pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.592725 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.592705    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fa66252-a7be-4e40-a251-cc782532bb1d-istio-token\") pod \"e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") " pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.596898 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.596868    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm54w\" (UniqueName: \"kubernetes.io/projected/9fa66252-a7be-4e40-a251-cc782532bb1d-kube-api-access-pm54w\") pod \"e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") " pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.629842 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.629825    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:48.780317 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.780290    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"]
Jul 09 04:21:48.782618 ip-10-0-134-121 kubenswrapper[2582]: W0709 04:21:48.782592    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fa66252_a7be_4e40_a251_cc782532bb1d.slice/crio-f8833d0831b99e351617aa68ed5b47678c577bb545c041ffabe3429311d357d1 WatchSource:0}: Error finding container f8833d0831b99e351617aa68ed5b47678c577bb545c041ffabe3429311d357d1: Status 404 returned error can't find the container with id f8833d0831b99e351617aa68ed5b47678c577bb545c041ffabe3429311d357d1
Jul 09 04:21:48.784653 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.784623    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:21:48.784699 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.784688    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:21:48.784732 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:48.784717    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:21:49.505914 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:49.505847    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp" event={"ID":"9fa66252-a7be-4e40-a251-cc782532bb1d","Type":"ContainerStarted","Data":"7be570f3bd0978b25b904e27143d638491d09a651bbd92b6636284e2e48a1143"}
Jul 09 04:21:49.506092 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:49.505983    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp" event={"ID":"9fa66252-a7be-4e40-a251-cc782532bb1d","Type":"ContainerStarted","Data":"f8833d0831b99e351617aa68ed5b47678c577bb545c041ffabe3429311d357d1"}
Jul 09 04:21:49.562774 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:49.562710    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp" podStartSLOduration=1.562662951 podStartE2EDuration="1.562662951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:21:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:21:49.562421452 +0000 UTC m=+1536.006551529" watchObservedRunningTime="2026-07-09 04:21:49.562662951 +0000 UTC m=+1536.006793026"
Jul 09 04:21:49.630487 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:49.630453    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:49.635247 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:49.635216    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:50.155088 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:50.155059    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80ca7738-c574-43ad-869e-476c10d6333f" path="/var/lib/kubelet/pods/80ca7738-c574-43ad-869e-476c10d6333f/volumes"
Jul 09 04:21:50.510578 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:50.510494    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:50.511310 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:50.511287    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:54.053453 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:54.053419    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"]
Jul 09 04:21:54.053936 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:54.053608    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp" podUID="9fa66252-a7be-4e40-a251-cc782532bb1d" containerName="istio-proxy" containerID="cri-o://7be570f3bd0978b25b904e27143d638491d09a651bbd92b6636284e2e48a1143" gracePeriod=30
Jul 09 04:21:59.308567 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.308533    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:59.381727 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.381690    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-istio-envoy\") pod \"9fa66252-a7be-4e40-a251-cc782532bb1d\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") "
Jul 09 04:21:59.381964 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.381748    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fa66252-a7be-4e40-a251-cc782532bb1d-istio-podinfo\") pod \"9fa66252-a7be-4e40-a251-cc782532bb1d\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") "
Jul 09 04:21:59.381964 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.381776    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fa66252-a7be-4e40-a251-cc782532bb1d-istiod-ca-cert\") pod \"9fa66252-a7be-4e40-a251-cc782532bb1d\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") "
Jul 09 04:21:59.381964 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.381804    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-workload-socket\") pod \"9fa66252-a7be-4e40-a251-cc782532bb1d\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") "
Jul 09 04:21:59.381964 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.381828    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fa66252-a7be-4e40-a251-cc782532bb1d-istio-token\") pod \"9fa66252-a7be-4e40-a251-cc782532bb1d\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") "
Jul 09 04:21:59.381964 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.381853    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pm54w\" (UniqueName: \"kubernetes.io/projected/9fa66252-a7be-4e40-a251-cc782532bb1d-kube-api-access-pm54w\") pod \"9fa66252-a7be-4e40-a251-cc782532bb1d\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") "
Jul 09 04:21:59.381964 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.381919    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-workload-certs\") pod \"9fa66252-a7be-4e40-a251-cc782532bb1d\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") "
Jul 09 04:21:59.381964 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.381956    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-credential-socket\") pod \"9fa66252-a7be-4e40-a251-cc782532bb1d\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") "
Jul 09 04:21:59.382323 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.381983    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-istio-data\") pod \"9fa66252-a7be-4e40-a251-cc782532bb1d\" (UID: \"9fa66252-a7be-4e40-a251-cc782532bb1d\") "
Jul 09 04:21:59.382323 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.382231    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9fa66252-a7be-4e40-a251-cc782532bb1d" (UID: "9fa66252-a7be-4e40-a251-cc782532bb1d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:21:59.382423 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.382319    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9fa66252-a7be-4e40-a251-cc782532bb1d" (UID: "9fa66252-a7be-4e40-a251-cc782532bb1d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:21:59.382423 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.382334    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fa66252-a7be-4e40-a251-cc782532bb1d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9fa66252-a7be-4e40-a251-cc782532bb1d" (UID: "9fa66252-a7be-4e40-a251-cc782532bb1d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:21:59.382523 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.382441    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9fa66252-a7be-4e40-a251-cc782532bb1d" (UID: "9fa66252-a7be-4e40-a251-cc782532bb1d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:21:59.382523 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.382499    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-istio-data" (OuterVolumeSpecName: "istio-data") pod "9fa66252-a7be-4e40-a251-cc782532bb1d" (UID: "9fa66252-a7be-4e40-a251-cc782532bb1d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:21:59.384204 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.384174    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9fa66252-a7be-4e40-a251-cc782532bb1d" (UID: "9fa66252-a7be-4e40-a251-cc782532bb1d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:21:59.384204 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.384176    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fa66252-a7be-4e40-a251-cc782532bb1d-istio-token" (OuterVolumeSpecName: "istio-token") pod "9fa66252-a7be-4e40-a251-cc782532bb1d" (UID: "9fa66252-a7be-4e40-a251-cc782532bb1d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:21:59.384394 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.384211    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9fa66252-a7be-4e40-a251-cc782532bb1d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9fa66252-a7be-4e40-a251-cc782532bb1d" (UID: "9fa66252-a7be-4e40-a251-cc782532bb1d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 04:21:59.384394 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.384222    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fa66252-a7be-4e40-a251-cc782532bb1d-kube-api-access-pm54w" (OuterVolumeSpecName: "kube-api-access-pm54w") pod "9fa66252-a7be-4e40-a251-cc782532bb1d" (UID: "9fa66252-a7be-4e40-a251-cc782532bb1d"). InnerVolumeSpecName "kube-api-access-pm54w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:21:59.482648 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.482617    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:59.482648 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.482642    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:59.482648 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.482653    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:59.482857 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.482661    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:59.482857 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.482669    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fa66252-a7be-4e40-a251-cc782532bb1d-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:59.482857 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.482677    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fa66252-a7be-4e40-a251-cc782532bb1d-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:59.482857 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.482685    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fa66252-a7be-4e40-a251-cc782532bb1d-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:59.482857 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.482693    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fa66252-a7be-4e40-a251-cc782532bb1d-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:59.482857 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.482701    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pm54w\" (UniqueName: \"kubernetes.io/projected/9fa66252-a7be-4e40-a251-cc782532bb1d-kube-api-access-pm54w\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:21:59.550941 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.550874    2582 generic.go:356] "Generic (PLEG): container finished" podID="9fa66252-a7be-4e40-a251-cc782532bb1d" containerID="7be570f3bd0978b25b904e27143d638491d09a651bbd92b6636284e2e48a1143" exitCode=0
Jul 09 04:21:59.550941 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.550926    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp" event={"ID":"9fa66252-a7be-4e40-a251-cc782532bb1d","Type":"ContainerDied","Data":"7be570f3bd0978b25b904e27143d638491d09a651bbd92b6636284e2e48a1143"}
Jul 09 04:21:59.550941 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.550947    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"
Jul 09 04:21:59.551173 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.550985    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp" event={"ID":"9fa66252-a7be-4e40-a251-cc782532bb1d","Type":"ContainerDied","Data":"f8833d0831b99e351617aa68ed5b47678c577bb545c041ffabe3429311d357d1"}
Jul 09 04:21:59.551173 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.551011    2582 scope.go:117] "RemoveContainer" containerID="7be570f3bd0978b25b904e27143d638491d09a651bbd92b6636284e2e48a1143"
Jul 09 04:21:59.559467 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.559409    2582 scope.go:117] "RemoveContainer" containerID="7be570f3bd0978b25b904e27143d638491d09a651bbd92b6636284e2e48a1143"
Jul 09 04:21:59.559683 ip-10-0-134-121 kubenswrapper[2582]: E0709 04:21:59.559664    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7be570f3bd0978b25b904e27143d638491d09a651bbd92b6636284e2e48a1143\": container with ID starting with 7be570f3bd0978b25b904e27143d638491d09a651bbd92b6636284e2e48a1143 not found: ID does not exist" containerID="7be570f3bd0978b25b904e27143d638491d09a651bbd92b6636284e2e48a1143"
Jul 09 04:21:59.559752 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.559692    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7be570f3bd0978b25b904e27143d638491d09a651bbd92b6636284e2e48a1143"} err="failed to get container status \"7be570f3bd0978b25b904e27143d638491d09a651bbd92b6636284e2e48a1143\": rpc error: code = NotFound desc = could not find container \"7be570f3bd0978b25b904e27143d638491d09a651bbd92b6636284e2e48a1143\": container with ID starting with 7be570f3bd0978b25b904e27143d638491d09a651bbd92b6636284e2e48a1143 not found: ID does not exist"
Jul 09 04:21:59.573040 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.573002    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"]
Jul 09 04:21:59.576675 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:21:59.576655    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-64447b93-openshift-default-5c9d49c855-6cwjp"]
Jul 09 04:22:00.159543 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:22:00.159502    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fa66252-a7be-4e40-a251-cc782532bb1d" path="/var/lib/kubelet/pods/9fa66252-a7be-4e40-a251-cc782532bb1d/volumes"
Jul 09 04:23:37.338758 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.338727    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"]
Jul 09 04:23:37.339179 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.339045    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fa66252-a7be-4e40-a251-cc782532bb1d" containerName="istio-proxy"
Jul 09 04:23:37.339179 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.339057    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fa66252-a7be-4e40-a251-cc782532bb1d" containerName="istio-proxy"
Jul 09 04:23:37.339179 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.339120    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="80ca7738-c574-43ad-869e-476c10d6333f" containerName="istio-proxy"
Jul 09 04:23:37.339179 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.339129    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fa66252-a7be-4e40-a251-cc782532bb1d" containerName="istio-proxy"
Jul 09 04:23:37.342050 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.342032    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.351154 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.351134    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-61e15e21-openshift-default-dockercfg-jcm77\""
Jul 09 04:23:37.377978 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.377950    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"]
Jul 09 04:23:37.491737 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.491699    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-credential-socket\") pod \"e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") " pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.491737 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.491741    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istio-data\") pod \"e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") " pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.491980 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.491768    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istiod-ca-cert\") pod \"e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") " pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.491980 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.491862    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istio-envoy\") pod \"e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") " pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.491980 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.491918    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istio-podinfo\") pod \"e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") " pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.492077 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.491980    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-workload-certs\") pod \"e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") " pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.492077 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.492015    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-workload-socket\") pod \"e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") " pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.492077 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.492057    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istio-token\") pod \"e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") " pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.492169 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.492082    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gggf\" (UniqueName: \"kubernetes.io/projected/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-kube-api-access-2gggf\") pod \"e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") " pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.592791 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.592727    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-credential-socket\") pod \"e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") " pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.592791 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.592757    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istio-data\") pod \"e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") " pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.592791 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.592782    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istiod-ca-cert\") pod \"e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") " pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.593059 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.592799    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istio-envoy\") pod \"e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") " pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.593059 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.592817    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istio-podinfo\") pod \"e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") " pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.593059 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.592960    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-workload-certs\") pod \"e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") " pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.593059 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.593043    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-workload-socket\") pod \"e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") " pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.593264 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.593085    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istio-token\") pod \"e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") " pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.593264 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.593111    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gggf\" (UniqueName: \"kubernetes.io/projected/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-kube-api-access-2gggf\") pod \"e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") " pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.593264 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.593179    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-credential-socket\") pod \"e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") " pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.593264 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.593245    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istio-data\") pod \"e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") " pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.593733 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.593691    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-workload-certs\") pod \"e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") " pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.594107 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.594083    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-workload-socket\") pod \"e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") " pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.594317 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.594291    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istiod-ca-cert\") pod \"e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") " pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.596182 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.596156    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istio-envoy\") pod \"e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") " pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.596369 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.596344    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istio-podinfo\") pod \"e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") " pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.604784 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.604765    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istio-token\") pod \"e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") " pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.604874 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.604847    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gggf\" (UniqueName: \"kubernetes.io/projected/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-kube-api-access-2gggf\") pod \"e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") " pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.653015 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.652995    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:37.787581 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.787557    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"]
Jul 09 04:23:37.789387 ip-10-0-134-121 kubenswrapper[2582]: W0709 04:23:37.789360    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0c19814_5fec_496a_a19f_4c3c45dd3b2e.slice/crio-ad6d4019e557e34b85ecb175e0fa40d36040df5aadebb1eceae021fd36ff2edb WatchSource:0}: Error finding container ad6d4019e557e34b85ecb175e0fa40d36040df5aadebb1eceae021fd36ff2edb: Status 404 returned error can't find the container with id ad6d4019e557e34b85ecb175e0fa40d36040df5aadebb1eceae021fd36ff2edb
Jul 09 04:23:37.791741 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.791708    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:23:37.791836 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.791788    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:23:37.791836 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.791827    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:23:37.960597 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.960565    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk" event={"ID":"e0c19814-5fec-496a-a19f-4c3c45dd3b2e","Type":"ContainerStarted","Data":"da338358974fdb1789923a29c2520bf722ce95703043aa23aefaf55ba87eca23"}
Jul 09 04:23:37.960779 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.960623    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk" event={"ID":"e0c19814-5fec-496a-a19f-4c3c45dd3b2e","Type":"ContainerStarted","Data":"ad6d4019e557e34b85ecb175e0fa40d36040df5aadebb1eceae021fd36ff2edb"}
Jul 09 04:23:37.986984 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:37.986926    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk" podStartSLOduration=0.98690496 podStartE2EDuration="986.90496ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:23:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:23:37.985226694 +0000 UTC m=+1644.429356764" watchObservedRunningTime="2026-07-09 04:23:37.98690496 +0000 UTC m=+1644.431035030"
Jul 09 04:23:38.654079 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:38.654048    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:38.658665 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:38.658640    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:38.965899 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:38.965790    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:38.966645 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:38.966622    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:53.997110 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:53.996700    2582 patch_prober.go:28] interesting pod/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": read tcp 10.134.0.2:51314->10.134.0.31:15021: read: connection reset by peer" start-of-body=
Jul 09 04:23:53.997110 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:53.996768    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk" podUID="e0c19814-5fec-496a-a19f-4c3c45dd3b2e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": read tcp 10.134.0.2:51314->10.134.0.31:15021: read: connection reset by peer"
Jul 09 04:23:55.036418 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:55.036385    2582 generic.go:356] "Generic (PLEG): container finished" podID="e0c19814-5fec-496a-a19f-4c3c45dd3b2e" containerID="da338358974fdb1789923a29c2520bf722ce95703043aa23aefaf55ba87eca23" exitCode=0
Jul 09 04:23:55.036792 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:55.036456    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk" event={"ID":"e0c19814-5fec-496a-a19f-4c3c45dd3b2e","Type":"ContainerDied","Data":"da338358974fdb1789923a29c2520bf722ce95703043aa23aefaf55ba87eca23"}
Jul 09 04:23:55.036836 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:55.036798    2582 scope.go:117] "RemoveContainer" containerID="da338358974fdb1789923a29c2520bf722ce95703043aa23aefaf55ba87eca23"
Jul 09 04:23:55.037748 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:55.037723    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:23:55.037813 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:55.037787    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:23:55.037847 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:55.037820    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:23:56.045053 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:56.045019    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk" event={"ID":"e0c19814-5fec-496a-a19f-4c3c45dd3b2e","Type":"ContainerStarted","Data":"0d99d3d2d7fc77ecb1910384c9ab3b0287147b738478c55c87d87a0009bcd025"}
Jul 09 04:23:56.653508 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:56.653477    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:23:56.653769 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:56.653745    2582 patch_prober.go:28] interesting pod/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 09 04:23:56.653850 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:56.653795    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk" podUID="e0c19814-5fec-496a-a19f-4c3c45dd3b2e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 09 04:23:57.654232 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:57.654197    2582 patch_prober.go:28] interesting pod/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 09 04:23:57.654624 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:57.654251    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk" podUID="e0c19814-5fec-496a-a19f-4c3c45dd3b2e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 09 04:23:58.655931 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:58.655873    2582 patch_prober.go:28] interesting pod/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 09 04:23:58.656335 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:58.655949    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk" podUID="e0c19814-5fec-496a-a19f-4c3c45dd3b2e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 09 04:23:59.653982 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:59.653942    2582 patch_prober.go:28] interesting pod/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 09 04:23:59.654144 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:23:59.654016    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk" podUID="e0c19814-5fec-496a-a19f-4c3c45dd3b2e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 09 04:24:00.172722 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:00.172684    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"]
Jul 09 04:24:00.173227 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:00.172943    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk" podUID="e0c19814-5fec-496a-a19f-4c3c45dd3b2e" containerName="istio-proxy" containerID="cri-o://0d99d3d2d7fc77ecb1910384c9ab3b0287147b738478c55c87d87a0009bcd025" gracePeriod=30
Jul 09 04:24:05.423062 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:05.423033    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:24:05.537756 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:05.537687    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istio-token\") pod \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") "
Jul 09 04:24:05.537756 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:05.537739    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istio-data\") pod \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") "
Jul 09 04:24:05.537958 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:05.537759    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istio-podinfo\") pod \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") "
Jul 09 04:24:05.537958 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:05.537789    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-workload-socket\") pod \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") "
Jul 09 04:24:05.537958 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:05.537815    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istio-envoy\") pod \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") "
Jul 09 04:24:05.537958 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:05.537832    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-credential-socket\") pod \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") "
Jul 09 04:24:05.537958 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:05.537955    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-workload-certs\") pod \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") "
Jul 09 04:24:05.538221 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:05.538003    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gggf\" (UniqueName: \"kubernetes.io/projected/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-kube-api-access-2gggf\") pod \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") "
Jul 09 04:24:05.538221 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:05.538039    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istiod-ca-cert\") pod \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\" (UID: \"e0c19814-5fec-496a-a19f-4c3c45dd3b2e\") "
Jul 09 04:24:05.538221 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:05.538205    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e0c19814-5fec-496a-a19f-4c3c45dd3b2e" (UID: "e0c19814-5fec-496a-a19f-4c3c45dd3b2e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:24:05.538384 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:05.538221    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e0c19814-5fec-496a-a19f-4c3c45dd3b2e" (UID: "e0c19814-5fec-496a-a19f-4c3c45dd3b2e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:24:05.538384 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:05.538355    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e0c19814-5fec-496a-a19f-4c3c45dd3b2e" (UID: "e0c19814-5fec-496a-a19f-4c3c45dd3b2e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:24:05.538495 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:05.538435    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:24:05.538495 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:05.538458    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:24:05.538495 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:05.538486    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e0c19814-5fec-496a-a19f-4c3c45dd3b2e" (UID: "e0c19814-5fec-496a-a19f-4c3c45dd3b2e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:24:05.538666 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:05.538605    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istio-data" (OuterVolumeSpecName: "istio-data") pod "e0c19814-5fec-496a-a19f-4c3c45dd3b2e" (UID: "e0c19814-5fec-496a-a19f-4c3c45dd3b2e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:24:05.540012 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:05.539977    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istio-token" (OuterVolumeSpecName: "istio-token") pod "e0c19814-5fec-496a-a19f-4c3c45dd3b2e" (UID: "e0c19814-5fec-496a-a19f-4c3c45dd3b2e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:24:05.540114 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:05.540058    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e0c19814-5fec-496a-a19f-4c3c45dd3b2e" (UID: "e0c19814-5fec-496a-a19f-4c3c45dd3b2e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:24:05.540178 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:05.540163    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-kube-api-access-2gggf" (OuterVolumeSpecName: "kube-api-access-2gggf") pod "e0c19814-5fec-496a-a19f-4c3c45dd3b2e" (UID: "e0c19814-5fec-496a-a19f-4c3c45dd3b2e"). InnerVolumeSpecName "kube-api-access-2gggf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:24:05.540308 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:05.540283    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e0c19814-5fec-496a-a19f-4c3c45dd3b2e" (UID: "e0c19814-5fec-496a-a19f-4c3c45dd3b2e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 04:24:05.639908 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:05.639851    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:24:05.639908 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:05.639909    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gggf\" (UniqueName: \"kubernetes.io/projected/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-kube-api-access-2gggf\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:24:05.640065 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:05.639927    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:24:05.640065 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:05.639939    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:24:05.640065 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:05.639950    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:24:05.640065 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:05.639961    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:24:05.640065 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:05.639972    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0c19814-5fec-496a-a19f-4c3c45dd3b2e-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:24:06.087554 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:06.087520    2582 generic.go:356] "Generic (PLEG): container finished" podID="e0c19814-5fec-496a-a19f-4c3c45dd3b2e" containerID="0d99d3d2d7fc77ecb1910384c9ab3b0287147b738478c55c87d87a0009bcd025" exitCode=0
Jul 09 04:24:06.087724 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:06.087562    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk" event={"ID":"e0c19814-5fec-496a-a19f-4c3c45dd3b2e","Type":"ContainerDied","Data":"0d99d3d2d7fc77ecb1910384c9ab3b0287147b738478c55c87d87a0009bcd025"}
Jul 09 04:24:06.087724 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:06.087602    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk" event={"ID":"e0c19814-5fec-496a-a19f-4c3c45dd3b2e","Type":"ContainerDied","Data":"ad6d4019e557e34b85ecb175e0fa40d36040df5aadebb1eceae021fd36ff2edb"}
Jul 09 04:24:06.087724 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:06.087566    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"
Jul 09 04:24:06.087724 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:06.087632    2582 scope.go:117] "RemoveContainer" containerID="0d99d3d2d7fc77ecb1910384c9ab3b0287147b738478c55c87d87a0009bcd025"
Jul 09 04:24:06.097239 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:06.097220    2582 scope.go:117] "RemoveContainer" containerID="da338358974fdb1789923a29c2520bf722ce95703043aa23aefaf55ba87eca23"
Jul 09 04:24:06.105016 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:06.104999    2582 scope.go:117] "RemoveContainer" containerID="0d99d3d2d7fc77ecb1910384c9ab3b0287147b738478c55c87d87a0009bcd025"
Jul 09 04:24:06.105239 ip-10-0-134-121 kubenswrapper[2582]: E0709 04:24:06.105224    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d99d3d2d7fc77ecb1910384c9ab3b0287147b738478c55c87d87a0009bcd025\": container with ID starting with 0d99d3d2d7fc77ecb1910384c9ab3b0287147b738478c55c87d87a0009bcd025 not found: ID does not exist" containerID="0d99d3d2d7fc77ecb1910384c9ab3b0287147b738478c55c87d87a0009bcd025"
Jul 09 04:24:06.105285 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:06.105244    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d99d3d2d7fc77ecb1910384c9ab3b0287147b738478c55c87d87a0009bcd025"} err="failed to get container status \"0d99d3d2d7fc77ecb1910384c9ab3b0287147b738478c55c87d87a0009bcd025\": rpc error: code = NotFound desc = could not find container \"0d99d3d2d7fc77ecb1910384c9ab3b0287147b738478c55c87d87a0009bcd025\": container with ID starting with 0d99d3d2d7fc77ecb1910384c9ab3b0287147b738478c55c87d87a0009bcd025 not found: ID does not exist"
Jul 09 04:24:06.105285 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:06.105260    2582 scope.go:117] "RemoveContainer" containerID="da338358974fdb1789923a29c2520bf722ce95703043aa23aefaf55ba87eca23"
Jul 09 04:24:06.105482 ip-10-0-134-121 kubenswrapper[2582]: E0709 04:24:06.105468    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da338358974fdb1789923a29c2520bf722ce95703043aa23aefaf55ba87eca23\": container with ID starting with da338358974fdb1789923a29c2520bf722ce95703043aa23aefaf55ba87eca23 not found: ID does not exist" containerID="da338358974fdb1789923a29c2520bf722ce95703043aa23aefaf55ba87eca23"
Jul 09 04:24:06.105525 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:06.105484    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da338358974fdb1789923a29c2520bf722ce95703043aa23aefaf55ba87eca23"} err="failed to get container status \"da338358974fdb1789923a29c2520bf722ce95703043aa23aefaf55ba87eca23\": rpc error: code = NotFound desc = could not find container \"da338358974fdb1789923a29c2520bf722ce95703043aa23aefaf55ba87eca23\": container with ID starting with da338358974fdb1789923a29c2520bf722ce95703043aa23aefaf55ba87eca23 not found: ID does not exist"
Jul 09 04:24:06.115763 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:06.115738    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"]
Jul 09 04:24:06.120414 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:06.120394    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-61e15e21-openshift-default-6859488b99-lm7qk"]
Jul 09 04:24:06.153996 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:06.153972    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0c19814-5fec-496a-a19f-4c3c45dd3b2e" path="/var/lib/kubelet/pods/e0c19814-5fec-496a-a19f-4c3c45dd3b2e/volumes"
Jul 09 04:24:20.250984 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.250952    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"]
Jul 09 04:24:20.251355 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.251325    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0c19814-5fec-496a-a19f-4c3c45dd3b2e" containerName="istio-proxy"
Jul 09 04:24:20.251355 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.251341    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0c19814-5fec-496a-a19f-4c3c45dd3b2e" containerName="istio-proxy"
Jul 09 04:24:20.251437 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.251361    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0c19814-5fec-496a-a19f-4c3c45dd3b2e" containerName="istio-proxy"
Jul 09 04:24:20.251437 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.251367    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0c19814-5fec-496a-a19f-4c3c45dd3b2e" containerName="istio-proxy"
Jul 09 04:24:20.251437 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.251427    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0c19814-5fec-496a-a19f-4c3c45dd3b2e" containerName="istio-proxy"
Jul 09 04:24:20.251437 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.251436    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0c19814-5fec-496a-a19f-4c3c45dd3b2e" containerName="istio-proxy"
Jul 09 04:24:20.254316 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.254298    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.257615 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.257597    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-1986c679-openshift-default-dockercfg-5cpr6\""
Jul 09 04:24:20.266746 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.266723    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"]
Jul 09 04:24:20.354411 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.354370    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-workload-socket\") pod \"e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") " pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.354701 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.354684    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-credential-socket\") pod \"e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") " pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.354841 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.354826    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istio-podinfo\") pod \"e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") " pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.355023 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.355007    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istiod-ca-cert\") pod \"e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") " pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.355165 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.355151    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stt9f\" (UniqueName: \"kubernetes.io/projected/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-kube-api-access-stt9f\") pod \"e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") " pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.355313 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.355299    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istio-data\") pod \"e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") " pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.355450 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.355436    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-workload-certs\") pod \"e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") " pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.355560 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.355548    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istio-envoy\") pod \"e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") " pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.355692 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.355669    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istio-token\") pod \"e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") " pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.456682 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.456654    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-workload-socket\") pod \"e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") " pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.456813 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.456693    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-credential-socket\") pod \"e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") " pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.456813 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.456712    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istio-podinfo\") pod \"e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") " pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.456813 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.456732    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istiod-ca-cert\") pod \"e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") " pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.456813 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.456760    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stt9f\" (UniqueName: \"kubernetes.io/projected/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-kube-api-access-stt9f\") pod \"e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") " pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.456813 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.456800    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istio-data\") pod \"e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") " pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.457123 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.456837    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-workload-certs\") pod \"e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") " pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.457123 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.456862    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istio-envoy\") pod \"e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") " pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.457123 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.456923    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istio-token\") pod \"e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") " pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.457279 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.457154    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-workload-socket\") pod \"e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") " pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.457279 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.457190    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-credential-socket\") pod \"e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") " pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.457279 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.457246    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-workload-certs\") pod \"e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") " pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.457484 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.457461    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istio-data\") pod \"e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") " pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.457770 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.457748    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istiod-ca-cert\") pod \"e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") " pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.459171 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.459154    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istio-envoy\") pod \"e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") " pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.459314 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.459296    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istio-podinfo\") pod \"e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") " pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.483454 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.483432    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istio-token\") pod \"e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") " pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.486220 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.486195    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stt9f\" (UniqueName: \"kubernetes.io/projected/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-kube-api-access-stt9f\") pod \"e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") " pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.564461 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.564403    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:20.701278 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.701252    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"]
Jul 09 04:24:20.703694 ip-10-0-134-121 kubenswrapper[2582]: W0709 04:24:20.703668    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6ec95f1_7ba0_4ef1_821c_8a960b2b76c2.slice/crio-d57485881c7a86172798cb0591da1d4843b8d59ddb5ad5ab0ddcbd9654869aed WatchSource:0}: Error finding container d57485881c7a86172798cb0591da1d4843b8d59ddb5ad5ab0ddcbd9654869aed: Status 404 returned error can't find the container with id d57485881c7a86172798cb0591da1d4843b8d59ddb5ad5ab0ddcbd9654869aed
Jul 09 04:24:20.705729 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.705695    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:24:20.705811 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.705762    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:24:20.705811 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:20.705789    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:24:21.150671 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:21.150640    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5" event={"ID":"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2","Type":"ContainerStarted","Data":"a0e010d6cdf6c7cc59d6a74f9a894ed0b1765044ad6cef5d5c6361804c7385cb"}
Jul 09 04:24:21.150846 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:21.150686    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5" event={"ID":"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2","Type":"ContainerStarted","Data":"d57485881c7a86172798cb0591da1d4843b8d59ddb5ad5ab0ddcbd9654869aed"}
Jul 09 04:24:21.170557 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:21.170503    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5" podStartSLOduration=1.170485268 podStartE2EDuration="1.170485268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:24:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:24:21.16956915 +0000 UTC m=+1687.613699231" watchObservedRunningTime="2026-07-09 04:24:21.170485268 +0000 UTC m=+1687.614615341"
Jul 09 04:24:21.565580 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:21.565499    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:21.570374 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:21.570351    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:22.154700 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:22.154671    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:22.155319 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:22.155303    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:34.203881 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:34.203849    2582 generic.go:356] "Generic (PLEG): container finished" podID="e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2" containerID="a0e010d6cdf6c7cc59d6a74f9a894ed0b1765044ad6cef5d5c6361804c7385cb" exitCode=0
Jul 09 04:24:34.204245 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:34.203926    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5" event={"ID":"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2","Type":"ContainerDied","Data":"a0e010d6cdf6c7cc59d6a74f9a894ed0b1765044ad6cef5d5c6361804c7385cb"}
Jul 09 04:24:34.204339 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:34.204323    2582 scope.go:117] "RemoveContainer" containerID="a0e010d6cdf6c7cc59d6a74f9a894ed0b1765044ad6cef5d5c6361804c7385cb"
Jul 09 04:24:34.205298 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:34.205272    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:24:34.205353 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:34.205335    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:24:34.205392 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:34.205368    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:24:35.209981 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:35.209947    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5" event={"ID":"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2","Type":"ContainerStarted","Data":"fb254b950bb632ce823fa6ba2b53046d0215c8ae468b4faa83bd4b8d5cba789c"}
Jul 09 04:24:35.565267 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:35.565185    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:35.566299 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:35.566277    2582 patch_prober.go:28] interesting pod/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 09 04:24:35.566369 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:35.566346    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5" podUID="e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 09 04:24:36.565256 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:36.565178    2582 patch_prober.go:28] interesting pod/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 09 04:24:36.565256 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:36.565228    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5" podUID="e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 09 04:24:37.154933 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:37.154863    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:37.565190 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:37.565100    2582 patch_prober.go:28] interesting pod/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 09 04:24:37.565190 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:37.565165    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5" podUID="e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 09 04:24:38.564705 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:38.564671    2582 patch_prober.go:28] interesting pod/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 09 04:24:38.564876 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:38.564732    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5" podUID="e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 09 04:24:39.565214 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:39.565173    2582 patch_prober.go:28] interesting pod/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 09 04:24:39.565598 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:39.565229    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5" podUID="e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 09 04:24:40.568801 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:40.568774    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:24:40.569671 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:24:40.569652    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:25:54.490616 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:54.490582    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"]
Jul 09 04:25:54.491222 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:54.490789    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5" podUID="e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2" containerName="istio-proxy" containerID="cri-o://fb254b950bb632ce823fa6ba2b53046d0215c8ae468b4faa83bd4b8d5cba789c" gracePeriod=30
Jul 09 04:25:55.571411 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:55.571377    2582 patch_prober.go:28] interesting pod/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 09 04:25:55.571766 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:55.571431    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5" podUID="e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 09 04:25:59.735644 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:59.735620    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:25:59.767833 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:59.767775    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istio-podinfo\") pod \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") "
Jul 09 04:25:59.767833 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:59.767805    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istio-token\") pod \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") "
Jul 09 04:25:59.768010 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:59.767840    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-workload-socket\") pod \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") "
Jul 09 04:25:59.768010 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:59.767880    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istio-envoy\") pod \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") "
Jul 09 04:25:59.768010 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:59.767937    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-credential-socket\") pod \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") "
Jul 09 04:25:59.768010 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:59.767954    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-workload-certs\") pod \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") "
Jul 09 04:25:59.768010 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:59.767987    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stt9f\" (UniqueName: \"kubernetes.io/projected/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-kube-api-access-stt9f\") pod \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") "
Jul 09 04:25:59.768211 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:59.768031    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istiod-ca-cert\") pod \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") "
Jul 09 04:25:59.768211 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:59.768058    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istio-data\") pod \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\" (UID: \"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2\") "
Jul 09 04:25:59.768211 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:59.768141    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2" (UID: "e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:25:59.768390 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:59.768371    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:25:59.768456 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:59.768397    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2" (UID: "e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:25:59.768521 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:59.768493    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2" (UID: "e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:25:59.768734 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:59.768677    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2" (UID: "e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:25:59.769388 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:59.769359    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istio-data" (OuterVolumeSpecName: "istio-data") pod "e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2" (UID: "e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:25:59.770181 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:59.770158    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2" (UID: "e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 04:25:59.770397 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:59.770379    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istio-token" (OuterVolumeSpecName: "istio-token") pod "e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2" (UID: "e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:25:59.770485 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:59.770465    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-kube-api-access-stt9f" (OuterVolumeSpecName: "kube-api-access-stt9f") pod "e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2" (UID: "e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2"). InnerVolumeSpecName "kube-api-access-stt9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:25:59.770528 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:59.770515    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2" (UID: "e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:25:59.868920 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:59.868848    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:25:59.868920 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:59.868882    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:25:59.869154 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:59.868937    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:25:59.869154 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:59.868947    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stt9f\" (UniqueName: \"kubernetes.io/projected/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-kube-api-access-stt9f\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:25:59.869154 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:59.868957    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:25:59.869154 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:59.868965    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:25:59.869154 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:59.868973    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:25:59.869154 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:25:59.868980    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:26:00.572956 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:00.572835    2582 generic.go:356] "Generic (PLEG): container finished" podID="e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2" containerID="fb254b950bb632ce823fa6ba2b53046d0215c8ae468b4faa83bd4b8d5cba789c" exitCode=0
Jul 09 04:26:00.572956 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:00.572869    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5" event={"ID":"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2","Type":"ContainerDied","Data":"fb254b950bb632ce823fa6ba2b53046d0215c8ae468b4faa83bd4b8d5cba789c"}
Jul 09 04:26:00.572956 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:00.572910    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"
Jul 09 04:26:00.572956 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:00.572951    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5" event={"ID":"e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2","Type":"ContainerDied","Data":"d57485881c7a86172798cb0591da1d4843b8d59ddb5ad5ab0ddcbd9654869aed"}
Jul 09 04:26:00.573225 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:00.572976    2582 scope.go:117] "RemoveContainer" containerID="fb254b950bb632ce823fa6ba2b53046d0215c8ae468b4faa83bd4b8d5cba789c"
Jul 09 04:26:00.581274 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:00.581239    2582 scope.go:117] "RemoveContainer" containerID="a0e010d6cdf6c7cc59d6a74f9a894ed0b1765044ad6cef5d5c6361804c7385cb"
Jul 09 04:26:00.588342 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:00.588323    2582 scope.go:117] "RemoveContainer" containerID="fb254b950bb632ce823fa6ba2b53046d0215c8ae468b4faa83bd4b8d5cba789c"
Jul 09 04:26:00.588561 ip-10-0-134-121 kubenswrapper[2582]: E0709 04:26:00.588543    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb254b950bb632ce823fa6ba2b53046d0215c8ae468b4faa83bd4b8d5cba789c\": container with ID starting with fb254b950bb632ce823fa6ba2b53046d0215c8ae468b4faa83bd4b8d5cba789c not found: ID does not exist" containerID="fb254b950bb632ce823fa6ba2b53046d0215c8ae468b4faa83bd4b8d5cba789c"
Jul 09 04:26:00.588610 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:00.588569    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb254b950bb632ce823fa6ba2b53046d0215c8ae468b4faa83bd4b8d5cba789c"} err="failed to get container status \"fb254b950bb632ce823fa6ba2b53046d0215c8ae468b4faa83bd4b8d5cba789c\": rpc error: code = NotFound desc = could not find container \"fb254b950bb632ce823fa6ba2b53046d0215c8ae468b4faa83bd4b8d5cba789c\": container with ID starting with fb254b950bb632ce823fa6ba2b53046d0215c8ae468b4faa83bd4b8d5cba789c not found: ID does not exist"
Jul 09 04:26:00.588610 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:00.588585    2582 scope.go:117] "RemoveContainer" containerID="a0e010d6cdf6c7cc59d6a74f9a894ed0b1765044ad6cef5d5c6361804c7385cb"
Jul 09 04:26:00.588827 ip-10-0-134-121 kubenswrapper[2582]: E0709 04:26:00.588812    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0e010d6cdf6c7cc59d6a74f9a894ed0b1765044ad6cef5d5c6361804c7385cb\": container with ID starting with a0e010d6cdf6c7cc59d6a74f9a894ed0b1765044ad6cef5d5c6361804c7385cb not found: ID does not exist" containerID="a0e010d6cdf6c7cc59d6a74f9a894ed0b1765044ad6cef5d5c6361804c7385cb"
Jul 09 04:26:00.588876 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:00.588829    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0e010d6cdf6c7cc59d6a74f9a894ed0b1765044ad6cef5d5c6361804c7385cb"} err="failed to get container status \"a0e010d6cdf6c7cc59d6a74f9a894ed0b1765044ad6cef5d5c6361804c7385cb\": rpc error: code = NotFound desc = could not find container \"a0e010d6cdf6c7cc59d6a74f9a894ed0b1765044ad6cef5d5c6361804c7385cb\": container with ID starting with a0e010d6cdf6c7cc59d6a74f9a894ed0b1765044ad6cef5d5c6361804c7385cb not found: ID does not exist"
Jul 09 04:26:00.591585 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:00.591565    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"]
Jul 09 04:26:00.596873 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:00.596854    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-1986c679-openshift-default-ccf6849b7-c5kf5"]
Jul 09 04:26:02.154113 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:02.154079    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2" path="/var/lib/kubelet/pods/e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2/volumes"
Jul 09 04:26:14.132192 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:14.132167    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9jc2_33172081-e578-41b0-ae82-d9d52c06df2b/ovn-acl-logging/0.log"
Jul 09 04:26:14.134725 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:14.134704    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9jc2_33172081-e578-41b0-ae82-d9d52c06df2b/ovn-acl-logging/0.log"
Jul 09 04:26:49.016268 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.016233    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"]
Jul 09 04:26:49.016755 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.016713    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2" containerName="istio-proxy"
Jul 09 04:26:49.016755 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.016731    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2" containerName="istio-proxy"
Jul 09 04:26:49.016932 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.016813    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2" containerName="istio-proxy"
Jul 09 04:26:49.019755 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.019737    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.022691 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.022676    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-e6ba0c-openshift-default-dockercfg-rfp52\""
Jul 09 04:26:49.031833 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.031810    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"]
Jul 09 04:26:49.163133 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.163104    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istio-podinfo\") pod \"e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") " pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.163302 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.163153    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istio-data\") pod \"e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") " pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.163302 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.163193    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istio-token\") pod \"e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") " pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.163302 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.163251    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-workload-socket\") pod \"e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") " pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.163302 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.163281    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-workload-certs\") pod \"e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") " pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.163515 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.163307    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc759\" (UniqueName: \"kubernetes.io/projected/5e244726-9ac3-4e51-9ab0-3e41f08923cc-kube-api-access-rc759\") pod \"e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") " pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.163515 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.163402    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istio-envoy\") pod \"e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") " pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.163515 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.163443    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-credential-socket\") pod \"e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") " pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.163515 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.163472    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istiod-ca-cert\") pod \"e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") " pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.264471 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.264428    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istio-token\") pod \"e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") " pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.264653 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.264485    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-workload-socket\") pod \"e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") " pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.264653 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.264509    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-workload-certs\") pod \"e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") " pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.264653 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.264548    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc759\" (UniqueName: \"kubernetes.io/projected/5e244726-9ac3-4e51-9ab0-3e41f08923cc-kube-api-access-rc759\") pod \"e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") " pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.264653 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.264612    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istio-envoy\") pod \"e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") " pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.264946 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.264638    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-credential-socket\") pod \"e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") " pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.264946 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.264773    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istiod-ca-cert\") pod \"e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") " pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.264946 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.264802    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istio-podinfo\") pod \"e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") " pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.264946 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.264867    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istio-data\") pod \"e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") " pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.264946 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.264923    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-workload-socket\") pod \"e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") " pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.265187 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.264949    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-workload-certs\") pod \"e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") " pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.265187 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.265072    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-credential-socket\") pod \"e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") " pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.265261 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.265187    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istio-data\") pod \"e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") " pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.265385 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.265366    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istiod-ca-cert\") pod \"e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") " pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.267154 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.267100    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istio-envoy\") pod \"e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") " pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.267253 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.267203    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istio-podinfo\") pod \"e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") " pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.273790 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.273767    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istio-token\") pod \"e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") " pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.274122 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.274101    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc759\" (UniqueName: \"kubernetes.io/projected/5e244726-9ac3-4e51-9ab0-3e41f08923cc-kube-api-access-rc759\") pod \"e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") " pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.329769 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.329747    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:49.470278 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.470197    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"]
Jul 09 04:26:49.472875 ip-10-0-134-121 kubenswrapper[2582]: W0709 04:26:49.472849    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e244726_9ac3_4e51_9ab0_3e41f08923cc.slice/crio-e9961add3560e7e65ac2ee2f902ffa4836c3d8a4d0c185a958d8ef1fe032078e WatchSource:0}: Error finding container e9961add3560e7e65ac2ee2f902ffa4836c3d8a4d0c185a958d8ef1fe032078e: Status 404 returned error can't find the container with id e9961add3560e7e65ac2ee2f902ffa4836c3d8a4d0c185a958d8ef1fe032078e
Jul 09 04:26:49.475123 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.475094    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:26:49.475206 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.475156    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:26:49.475206 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.475188    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:26:49.782559 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.782473    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q" event={"ID":"5e244726-9ac3-4e51-9ab0-3e41f08923cc","Type":"ContainerStarted","Data":"3e905128e5354c00d3deb8846d0dbc15eafbc8372b558b39c92af0c02a645f06"}
Jul 09 04:26:49.782559 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.782530    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q" event={"ID":"5e244726-9ac3-4e51-9ab0-3e41f08923cc","Type":"ContainerStarted","Data":"e9961add3560e7e65ac2ee2f902ffa4836c3d8a4d0c185a958d8ef1fe032078e"}
Jul 09 04:26:49.805462 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:49.805409    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q" podStartSLOduration=1.80539512 podStartE2EDuration="1.80539512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:26:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:26:49.803003161 +0000 UTC m=+1836.247133235" watchObservedRunningTime="2026-07-09 04:26:49.80539512 +0000 UTC m=+1836.249525198"
Jul 09 04:26:50.330122 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:50.330093    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:50.334646 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:50.334627    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:50.786967 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:50.786943    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:50.787697 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:50.787676    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:26:56.782475 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.782442    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"]
Jul 09 04:26:56.782961 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.782763    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2" containerName="istio-proxy"
Jul 09 04:26:56.782961 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.782774    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2" containerName="istio-proxy"
Jul 09 04:26:56.782961 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.782824    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6ec95f1-7ba0-4ef1-821c-8a960b2b76c2" containerName="istio-proxy"
Jul 09 04:26:56.786086 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.786064    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:56.789775 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.789753    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-6fdfb1-openshift-default-dockercfg-826zp\""
Jul 09 04:26:56.797689 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.797664    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"]
Jul 09 04:26:56.826377 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.826352    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istio-podinfo\") pod \"e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") " pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:56.826499 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.826390    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istio-data\") pod \"e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") " pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:56.826499 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.826420    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istiod-ca-cert\") pod \"e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") " pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:56.826499 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.826445    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istio-envoy\") pod \"e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") " pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:56.826499 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.826471    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-workload-certs\") pod \"e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") " pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:56.826735 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.826533    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-credential-socket\") pod \"e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") " pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:56.826735 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.826565    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istio-token\") pod \"e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") " pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:56.826735 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.826625    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-workload-socket\") pod \"e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") " pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:56.826735 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.826658    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nm9v\" (UniqueName: \"kubernetes.io/projected/a33b978e-2386-45ef-ab8c-a4d5daea3af5-kube-api-access-2nm9v\") pod \"e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") " pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:56.927452 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.927417    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istio-podinfo\") pod \"e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") " pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:56.927624 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.927455    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istio-data\") pod \"e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") " pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:56.927624 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.927484    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istiod-ca-cert\") pod \"e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") " pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:56.927624 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.927502    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istio-envoy\") pod \"e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") " pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:56.927624 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.927527    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-workload-certs\") pod \"e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") " pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:56.927624 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.927577    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-credential-socket\") pod \"e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") " pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:56.927624 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.927602    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istio-token\") pod \"e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") " pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:56.927981 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.927639    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-workload-socket\") pod \"e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") " pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:56.927981 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.927671    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nm9v\" (UniqueName: \"kubernetes.io/projected/a33b978e-2386-45ef-ab8c-a4d5daea3af5-kube-api-access-2nm9v\") pod \"e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") " pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:56.927981 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.927909    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istio-data\") pod \"e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") " pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:56.928144 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.928033    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-credential-socket\") pod \"e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") " pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:56.928144 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.928085    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-workload-certs\") pod \"e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") " pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:56.928258 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.928235    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-workload-socket\") pod \"e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") " pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:56.928322 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.928309    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istiod-ca-cert\") pod \"e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") " pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:56.929823 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.929803    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istio-envoy\") pod \"e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") " pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:56.930412 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.930392    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istio-podinfo\") pod \"e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") " pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:56.936711 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.936686    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nm9v\" (UniqueName: \"kubernetes.io/projected/a33b978e-2386-45ef-ab8c-a4d5daea3af5-kube-api-access-2nm9v\") pod \"e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") " pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:56.937350 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:56.937324    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istio-token\") pod \"e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") " pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:57.098351 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:57.098276    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:57.231076 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:57.231049    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"]
Jul 09 04:26:57.232860 ip-10-0-134-121 kubenswrapper[2582]: W0709 04:26:57.232831    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda33b978e_2386_45ef_ab8c_a4d5daea3af5.slice/crio-7dac6afe0d6ce1343884ac8808e53b5f2af4874d47add2559068da5206bdf696 WatchSource:0}: Error finding container 7dac6afe0d6ce1343884ac8808e53b5f2af4874d47add2559068da5206bdf696: Status 404 returned error can't find the container with id 7dac6afe0d6ce1343884ac8808e53b5f2af4874d47add2559068da5206bdf696
Jul 09 04:26:57.235105 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:57.235073    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:26:57.235224 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:57.235135    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:26:57.235224 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:57.235164    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:26:57.817320 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:57.817282    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj" event={"ID":"a33b978e-2386-45ef-ab8c-a4d5daea3af5","Type":"ContainerStarted","Data":"a53caf3e58281a1cc5ae8f6545d36ecbbb88fe4f9145a928bd1cb3f717949d46"}
Jul 09 04:26:57.817781 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:57.817351    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj" event={"ID":"a33b978e-2386-45ef-ab8c-a4d5daea3af5","Type":"ContainerStarted","Data":"7dac6afe0d6ce1343884ac8808e53b5f2af4874d47add2559068da5206bdf696"}
Jul 09 04:26:57.835827 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:57.835770    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj" podStartSLOduration=1.835749794 podStartE2EDuration="1.835749794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:26:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:26:57.835611698 +0000 UTC m=+1844.279741774" watchObservedRunningTime="2026-07-09 04:26:57.835749794 +0000 UTC m=+1844.279879868"
Jul 09 04:26:58.099287 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:58.099184    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:58.104581 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:58.104552    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:58.821612 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:58.821585    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:26:58.822497 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:26:58.822476    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:27:06.828030 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:06.827990    2582 patch_prober.go:28] interesting pod/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 09 04:27:06.828412 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:06.828052    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q" podUID="5e244726-9ac3-4e51-9ab0-3e41f08923cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 09 04:27:07.872799 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:07.872712    2582 generic.go:356] "Generic (PLEG): container finished" podID="5e244726-9ac3-4e51-9ab0-3e41f08923cc" containerID="3e905128e5354c00d3deb8846d0dbc15eafbc8372b558b39c92af0c02a645f06" exitCode=0
Jul 09 04:27:07.873230 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:07.872792    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q" event={"ID":"5e244726-9ac3-4e51-9ab0-3e41f08923cc","Type":"ContainerDied","Data":"3e905128e5354c00d3deb8846d0dbc15eafbc8372b558b39c92af0c02a645f06"}
Jul 09 04:27:07.873230 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:07.873203    2582 scope.go:117] "RemoveContainer" containerID="3e905128e5354c00d3deb8846d0dbc15eafbc8372b558b39c92af0c02a645f06"
Jul 09 04:27:07.874283 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:07.874255    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:27:07.874350 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:07.874324    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:27:07.874390 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:07.874361    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:27:08.879294 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:08.879259    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q" event={"ID":"5e244726-9ac3-4e51-9ab0-3e41f08923cc","Type":"ContainerStarted","Data":"52e6dcf6ba98da7a0dcc269a3317c92237d1d3d0b8e0f0f96383d24020d16465"}
Jul 09 04:27:09.331195 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:09.331089    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:27:09.331359 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:09.331230    2582 patch_prober.go:28] interesting pod/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 09 04:27:09.331359 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:09.331275    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q" podUID="5e244726-9ac3-4e51-9ab0-3e41f08923cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 09 04:27:10.333909 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:10.333287    2582 patch_prober.go:28] interesting pod/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 09 04:27:10.333909 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:10.333348    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q" podUID="5e244726-9ac3-4e51-9ab0-3e41f08923cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 09 04:27:11.330581 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:11.330113    2582 patch_prober.go:28] interesting pod/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 09 04:27:11.330581 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:11.330174    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q" podUID="5e244726-9ac3-4e51-9ab0-3e41f08923cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 09 04:27:12.331065 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:12.331016    2582 patch_prober.go:28] interesting pod/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Jul 09 04:27:12.331527 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:12.331087    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q" podUID="5e244726-9ac3-4e51-9ab0-3e41f08923cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Jul 09 04:27:13.334601 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:13.334572    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:27:13.335055 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:13.334815    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:27:13.335666 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:13.335650    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:27:14.721596 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:14.720633    2582 patch_prober.go:28] interesting pod/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": read tcp 10.134.0.2:42894->10.134.0.34:15021: read: connection reset by peer" start-of-body=
Jul 09 04:27:14.721596 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:14.720684    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj" podUID="a33b978e-2386-45ef-ab8c-a4d5daea3af5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": read tcp 10.134.0.2:42894->10.134.0.34:15021: read: connection reset by peer"
Jul 09 04:27:14.907754 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:14.906446    2582 generic.go:356] "Generic (PLEG): container finished" podID="a33b978e-2386-45ef-ab8c-a4d5daea3af5" containerID="a53caf3e58281a1cc5ae8f6545d36ecbbb88fe4f9145a928bd1cb3f717949d46" exitCode=0
Jul 09 04:27:14.907754 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:14.907187    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj" event={"ID":"a33b978e-2386-45ef-ab8c-a4d5daea3af5","Type":"ContainerDied","Data":"a53caf3e58281a1cc5ae8f6545d36ecbbb88fe4f9145a928bd1cb3f717949d46"}
Jul 09 04:27:14.907986 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:14.907808    2582 scope.go:117] "RemoveContainer" containerID="a53caf3e58281a1cc5ae8f6545d36ecbbb88fe4f9145a928bd1cb3f717949d46"
Jul 09 04:27:14.912801 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:14.912771    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:27:14.912939 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:14.912835    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:27:14.912939 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:14.912865    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:27:15.912567 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:15.912528    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj" event={"ID":"a33b978e-2386-45ef-ab8c-a4d5daea3af5","Type":"ContainerStarted","Data":"3d602d2344024e5323a48a3c5d13c39a0a601652e672bb999d6d4ae76d95deb6"}
Jul 09 04:27:16.099418 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:16.099382    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:27:16.099627 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:16.099604    2582 patch_prober.go:28] interesting pod/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 09 04:27:16.099672 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:16.099653    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj" podUID="a33b978e-2386-45ef-ab8c-a4d5daea3af5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 09 04:27:17.099499 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:17.099455    2582 patch_prober.go:28] interesting pod/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 09 04:27:17.100005 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:17.099515    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj" podUID="a33b978e-2386-45ef-ab8c-a4d5daea3af5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 09 04:27:18.098991 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:18.098951    2582 patch_prober.go:28] interesting pod/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 09 04:27:18.099165 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:18.099019    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj" podUID="a33b978e-2386-45ef-ab8c-a4d5daea3af5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 09 04:27:19.098822 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:19.098782    2582 patch_prober.go:28] interesting pod/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 09 04:27:19.099292 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:19.098848    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj" podUID="a33b978e-2386-45ef-ab8c-a4d5daea3af5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 09 04:27:20.102666 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:20.102632    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:27:20.103082 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:20.102908    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:27:20.103708 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:27:20.103690    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:29:06.443986 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:06.443880    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"]
Jul 09 04:29:06.444547 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:06.444196    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q" podUID="5e244726-9ac3-4e51-9ab0-3e41f08923cc" containerName="istio-proxy" containerID="cri-o://52e6dcf6ba98da7a0dcc269a3317c92237d1d3d0b8e0f0f96383d24020d16465" gracePeriod=30
Jul 09 04:29:11.695105 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:11.695079    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:29:11.888030 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:11.888005    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istiod-ca-cert\") pod \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") "
Jul 09 04:29:11.888198 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:11.888042    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istio-envoy\") pod \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") "
Jul 09 04:29:11.888198 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:11.888073    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istio-podinfo\") pod \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") "
Jul 09 04:29:11.888198 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:11.888117    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-credential-socket\") pod \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") "
Jul 09 04:29:11.888198 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:11.888145    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-workload-certs\") pod \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") "
Jul 09 04:29:11.888198 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:11.888177    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istio-token\") pod \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") "
Jul 09 04:29:11.888466 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:11.888211    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istio-data\") pod \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") "
Jul 09 04:29:11.888466 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:11.888245    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-workload-socket\") pod \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") "
Jul 09 04:29:11.888466 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:11.888290    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rc759\" (UniqueName: \"kubernetes.io/projected/5e244726-9ac3-4e51-9ab0-3e41f08923cc-kube-api-access-rc759\") pod \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\" (UID: \"5e244726-9ac3-4e51-9ab0-3e41f08923cc\") "
Jul 09 04:29:11.888639 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:11.888464    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5e244726-9ac3-4e51-9ab0-3e41f08923cc" (UID: "5e244726-9ac3-4e51-9ab0-3e41f08923cc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:29:11.888639 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:11.888477    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5e244726-9ac3-4e51-9ab0-3e41f08923cc" (UID: "5e244726-9ac3-4e51-9ab0-3e41f08923cc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:29:11.888639 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:11.888528    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5e244726-9ac3-4e51-9ab0-3e41f08923cc" (UID: "5e244726-9ac3-4e51-9ab0-3e41f08923cc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:29:11.888792 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:11.888646    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5e244726-9ac3-4e51-9ab0-3e41f08923cc" (UID: "5e244726-9ac3-4e51-9ab0-3e41f08923cc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:29:11.888792 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:11.888663    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:11.888792 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:11.888683    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:11.888792 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:11.888697    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:11.889136 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:11.889109    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istio-data" (OuterVolumeSpecName: "istio-data") pod "5e244726-9ac3-4e51-9ab0-3e41f08923cc" (UID: "5e244726-9ac3-4e51-9ab0-3e41f08923cc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:29:11.890383 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:11.890350    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5e244726-9ac3-4e51-9ab0-3e41f08923cc" (UID: "5e244726-9ac3-4e51-9ab0-3e41f08923cc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 04:29:11.890489 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:11.890386    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istio-token" (OuterVolumeSpecName: "istio-token") pod "5e244726-9ac3-4e51-9ab0-3e41f08923cc" (UID: "5e244726-9ac3-4e51-9ab0-3e41f08923cc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:29:11.890489 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:11.890435    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e244726-9ac3-4e51-9ab0-3e41f08923cc-kube-api-access-rc759" (OuterVolumeSpecName: "kube-api-access-rc759") pod "5e244726-9ac3-4e51-9ab0-3e41f08923cc" (UID: "5e244726-9ac3-4e51-9ab0-3e41f08923cc"). InnerVolumeSpecName "kube-api-access-rc759". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:29:11.890562 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:11.890517    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5e244726-9ac3-4e51-9ab0-3e41f08923cc" (UID: "5e244726-9ac3-4e51-9ab0-3e41f08923cc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:29:11.989814 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:11.989792    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:11.989814 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:11.989813    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:11.989969 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:11.989822    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rc759\" (UniqueName: \"kubernetes.io/projected/5e244726-9ac3-4e51-9ab0-3e41f08923cc-kube-api-access-rc759\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:11.989969 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:11.989831    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:11.989969 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:11.989840    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:11.989969 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:11.989847    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e244726-9ac3-4e51-9ab0-3e41f08923cc-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:12.415673 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:12.415595    2582 generic.go:356] "Generic (PLEG): container finished" podID="5e244726-9ac3-4e51-9ab0-3e41f08923cc" containerID="52e6dcf6ba98da7a0dcc269a3317c92237d1d3d0b8e0f0f96383d24020d16465" exitCode=0
Jul 09 04:29:12.415673 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:12.415639    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"
Jul 09 04:29:12.415846 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:12.415681    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q" event={"ID":"5e244726-9ac3-4e51-9ab0-3e41f08923cc","Type":"ContainerDied","Data":"52e6dcf6ba98da7a0dcc269a3317c92237d1d3d0b8e0f0f96383d24020d16465"}
Jul 09 04:29:12.415846 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:12.415734    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q" event={"ID":"5e244726-9ac3-4e51-9ab0-3e41f08923cc","Type":"ContainerDied","Data":"e9961add3560e7e65ac2ee2f902ffa4836c3d8a4d0c185a958d8ef1fe032078e"}
Jul 09 04:29:12.415846 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:12.415757    2582 scope.go:117] "RemoveContainer" containerID="52e6dcf6ba98da7a0dcc269a3317c92237d1d3d0b8e0f0f96383d24020d16465"
Jul 09 04:29:12.424039 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:12.424027    2582 scope.go:117] "RemoveContainer" containerID="3e905128e5354c00d3deb8846d0dbc15eafbc8372b558b39c92af0c02a645f06"
Jul 09 04:29:12.431718 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:12.431438    2582 scope.go:117] "RemoveContainer" containerID="52e6dcf6ba98da7a0dcc269a3317c92237d1d3d0b8e0f0f96383d24020d16465"
Jul 09 04:29:12.431921 ip-10-0-134-121 kubenswrapper[2582]: E0709 04:29:12.431872    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52e6dcf6ba98da7a0dcc269a3317c92237d1d3d0b8e0f0f96383d24020d16465\": container with ID starting with 52e6dcf6ba98da7a0dcc269a3317c92237d1d3d0b8e0f0f96383d24020d16465 not found: ID does not exist" containerID="52e6dcf6ba98da7a0dcc269a3317c92237d1d3d0b8e0f0f96383d24020d16465"
Jul 09 04:29:12.432019 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:12.431932    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52e6dcf6ba98da7a0dcc269a3317c92237d1d3d0b8e0f0f96383d24020d16465"} err="failed to get container status \"52e6dcf6ba98da7a0dcc269a3317c92237d1d3d0b8e0f0f96383d24020d16465\": rpc error: code = NotFound desc = could not find container \"52e6dcf6ba98da7a0dcc269a3317c92237d1d3d0b8e0f0f96383d24020d16465\": container with ID starting with 52e6dcf6ba98da7a0dcc269a3317c92237d1d3d0b8e0f0f96383d24020d16465 not found: ID does not exist"
Jul 09 04:29:12.432019 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:12.431956    2582 scope.go:117] "RemoveContainer" containerID="3e905128e5354c00d3deb8846d0dbc15eafbc8372b558b39c92af0c02a645f06"
Jul 09 04:29:12.432237 ip-10-0-134-121 kubenswrapper[2582]: E0709 04:29:12.432214    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e905128e5354c00d3deb8846d0dbc15eafbc8372b558b39c92af0c02a645f06\": container with ID starting with 3e905128e5354c00d3deb8846d0dbc15eafbc8372b558b39c92af0c02a645f06 not found: ID does not exist" containerID="3e905128e5354c00d3deb8846d0dbc15eafbc8372b558b39c92af0c02a645f06"
Jul 09 04:29:12.432284 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:12.432245    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e905128e5354c00d3deb8846d0dbc15eafbc8372b558b39c92af0c02a645f06"} err="failed to get container status \"3e905128e5354c00d3deb8846d0dbc15eafbc8372b558b39c92af0c02a645f06\": rpc error: code = NotFound desc = could not find container \"3e905128e5354c00d3deb8846d0dbc15eafbc8372b558b39c92af0c02a645f06\": container with ID starting with 3e905128e5354c00d3deb8846d0dbc15eafbc8372b558b39c92af0c02a645f06 not found: ID does not exist"
Jul 09 04:29:12.433465 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:12.433446    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"]
Jul 09 04:29:12.440052 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:12.440033    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-e6ba0c-openshift-default-6fdb84f6f9-2p44q"]
Jul 09 04:29:13.382678 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:13.382645    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"]
Jul 09 04:29:13.383135 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:13.382859    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj" podUID="a33b978e-2386-45ef-ab8c-a4d5daea3af5" containerName="istio-proxy" containerID="cri-o://3d602d2344024e5323a48a3c5d13c39a0a601652e672bb999d6d4ae76d95deb6" gracePeriod=30
Jul 09 04:29:14.155399 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.155367    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e244726-9ac3-4e51-9ab0-3e41f08923cc" path="/var/lib/kubelet/pods/5e244726-9ac3-4e51-9ab0-3e41f08923cc/volumes"
Jul 09 04:29:14.190518 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.190475    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"]
Jul 09 04:29:14.190900 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.190869    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e244726-9ac3-4e51-9ab0-3e41f08923cc" containerName="istio-proxy"
Jul 09 04:29:14.191008 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.190904    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e244726-9ac3-4e51-9ab0-3e41f08923cc" containerName="istio-proxy"
Jul 09 04:29:14.191008 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.190920    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e244726-9ac3-4e51-9ab0-3e41f08923cc" containerName="istio-proxy"
Jul 09 04:29:14.191008 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.190927    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e244726-9ac3-4e51-9ab0-3e41f08923cc" containerName="istio-proxy"
Jul 09 04:29:14.191155 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.191057    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e244726-9ac3-4e51-9ab0-3e41f08923cc" containerName="istio-proxy"
Jul 09 04:29:14.191155 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.191072    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e244726-9ac3-4e51-9ab0-3e41f08923cc" containerName="istio-proxy"
Jul 09 04:29:14.195693 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.195671    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.198368 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.198347    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-2cb3ca-openshift-default-dockercfg-28gqr\""
Jul 09 04:29:14.207019 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.206995    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"]
Jul 09 04:29:14.308209 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.308174    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8740c00b-b847-4055-af64-40ccaeb87ce8-istio-token\") pod \"e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") " pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.308395 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.308235    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-istio-data\") pod \"e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") " pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.308395 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.308340    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-workload-certs\") pod \"e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") " pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.308395 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.308385    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-workload-socket\") pod \"e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") " pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.308573 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.308432    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrjq7\" (UniqueName: \"kubernetes.io/projected/8740c00b-b847-4055-af64-40ccaeb87ce8-kube-api-access-qrjq7\") pod \"e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") " pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.308573 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.308515    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8740c00b-b847-4055-af64-40ccaeb87ce8-istio-podinfo\") pod \"e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") " pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.308674 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.308613    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-istio-envoy\") pod \"e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") " pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.308674 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.308657    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-credential-socket\") pod \"e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") " pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.308783 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.308691    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8740c00b-b847-4055-af64-40ccaeb87ce8-istiod-ca-cert\") pod \"e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") " pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.410168 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.410105    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-credential-socket\") pod \"e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") " pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.410168 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.410140    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8740c00b-b847-4055-af64-40ccaeb87ce8-istiod-ca-cert\") pod \"e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") " pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.410608 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.410172    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8740c00b-b847-4055-af64-40ccaeb87ce8-istio-token\") pod \"e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") " pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.410608 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.410201    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-istio-data\") pod \"e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") " pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.410608 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.410223    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-workload-certs\") pod \"e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") " pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.410608 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.410245    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-workload-socket\") pod \"e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") " pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.410608 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.410513    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrjq7\" (UniqueName: \"kubernetes.io/projected/8740c00b-b847-4055-af64-40ccaeb87ce8-kube-api-access-qrjq7\") pod \"e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") " pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.410608 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.410570    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8740c00b-b847-4055-af64-40ccaeb87ce8-istio-podinfo\") pod \"e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") " pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.410608 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.410586    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-credential-socket\") pod \"e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") " pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.411005 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.410667    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-istio-envoy\") pod \"e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") " pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.411005 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.410675    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-istio-data\") pod \"e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") " pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.411005 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.410971    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8740c00b-b847-4055-af64-40ccaeb87ce8-istiod-ca-cert\") pod \"e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") " pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.411005 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.410981    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-workload-certs\") pod \"e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") " pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.411225 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.411166    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-workload-socket\") pod \"e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") " pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.412819 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.412796    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-istio-envoy\") pod \"e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") " pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.413057 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.413041    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8740c00b-b847-4055-af64-40ccaeb87ce8-istio-podinfo\") pod \"e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") " pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.418845 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.418821    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8740c00b-b847-4055-af64-40ccaeb87ce8-istio-token\") pod \"e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") " pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.419097 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.419081    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrjq7\" (UniqueName: \"kubernetes.io/projected/8740c00b-b847-4055-af64-40ccaeb87ce8-kube-api-access-qrjq7\") pod \"e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") " pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.507324 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.507300    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:14.647978 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.647950    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"]
Jul 09 04:29:14.650543 ip-10-0-134-121 kubenswrapper[2582]: W0709 04:29:14.650511    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8740c00b_b847_4055_af64_40ccaeb87ce8.slice/crio-90d82aca229b3cdb57d12eb8740eaa9418f010710554d6f477e437c3ff70abc1 WatchSource:0}: Error finding container 90d82aca229b3cdb57d12eb8740eaa9418f010710554d6f477e437c3ff70abc1: Status 404 returned error can't find the container with id 90d82aca229b3cdb57d12eb8740eaa9418f010710554d6f477e437c3ff70abc1
Jul 09 04:29:14.652633 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.652600    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:29:14.652721 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.652662    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:29:14.652721 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:14.652690    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:29:15.431541 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:15.431509    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr" event={"ID":"8740c00b-b847-4055-af64-40ccaeb87ce8","Type":"ContainerStarted","Data":"922ed14a1e40310ef7f35d0681e804c946d956bcacaf95851914d32920ba5fa8"}
Jul 09 04:29:15.432009 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:15.431562    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr" event={"ID":"8740c00b-b847-4055-af64-40ccaeb87ce8","Type":"ContainerStarted","Data":"90d82aca229b3cdb57d12eb8740eaa9418f010710554d6f477e437c3ff70abc1"}
Jul 09 04:29:15.455087 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:15.455045    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr" podStartSLOduration=1.455027925 podStartE2EDuration="1.455027925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:29:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:29:15.452644381 +0000 UTC m=+1981.896774476" watchObservedRunningTime="2026-07-09 04:29:15.455027925 +0000 UTC m=+1981.899158008"
Jul 09 04:29:15.507564 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:15.507537    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:15.512260 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:15.512242    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:16.440850 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:16.438195    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:16.441778 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:16.441759    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:18.628357 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:18.628334    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:29:18.648943 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:18.648865    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istio-podinfo\") pod \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") "
Jul 09 04:29:18.649056 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:18.648957    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-credential-socket\") pod \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") "
Jul 09 04:29:18.649056 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:18.649009    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nm9v\" (UniqueName: \"kubernetes.io/projected/a33b978e-2386-45ef-ab8c-a4d5daea3af5-kube-api-access-2nm9v\") pod \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") "
Jul 09 04:29:18.649056 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:18.649041    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istio-data\") pod \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") "
Jul 09 04:29:18.649220 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:18.649076    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istiod-ca-cert\") pod \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") "
Jul 09 04:29:18.649220 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:18.649109    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-workload-socket\") pod \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") "
Jul 09 04:29:18.649220 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:18.649182    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-workload-certs\") pod \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") "
Jul 09 04:29:18.649220 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:18.649212    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istio-token\") pod \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") "
Jul 09 04:29:18.649429 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:18.649258    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istio-envoy\") pod \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\" (UID: \"a33b978e-2386-45ef-ab8c-a4d5daea3af5\") "
Jul 09 04:29:18.649429 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:18.649289    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a33b978e-2386-45ef-ab8c-a4d5daea3af5" (UID: "a33b978e-2386-45ef-ab8c-a4d5daea3af5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:29:18.649526 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:18.649459    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a33b978e-2386-45ef-ab8c-a4d5daea3af5" (UID: "a33b978e-2386-45ef-ab8c-a4d5daea3af5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:29:18.649526 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:18.649471    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a33b978e-2386-45ef-ab8c-a4d5daea3af5" (UID: "a33b978e-2386-45ef-ab8c-a4d5daea3af5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:29:18.649633 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:18.649547    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:18.649633 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:18.649565    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:18.649790 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:18.649767    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a33b978e-2386-45ef-ab8c-a4d5daea3af5" (UID: "a33b978e-2386-45ef-ab8c-a4d5daea3af5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:29:18.649873 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:18.649840    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istio-data" (OuterVolumeSpecName: "istio-data") pod "a33b978e-2386-45ef-ab8c-a4d5daea3af5" (UID: "a33b978e-2386-45ef-ab8c-a4d5daea3af5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:29:18.651156 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:18.651129    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a33b978e-2386-45ef-ab8c-a4d5daea3af5" (UID: "a33b978e-2386-45ef-ab8c-a4d5daea3af5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 04:29:18.651156 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:18.651141    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a33b978e-2386-45ef-ab8c-a4d5daea3af5-kube-api-access-2nm9v" (OuterVolumeSpecName: "kube-api-access-2nm9v") pod "a33b978e-2386-45ef-ab8c-a4d5daea3af5" (UID: "a33b978e-2386-45ef-ab8c-a4d5daea3af5"). InnerVolumeSpecName "kube-api-access-2nm9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:29:18.651434 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:18.651415    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a33b978e-2386-45ef-ab8c-a4d5daea3af5" (UID: "a33b978e-2386-45ef-ab8c-a4d5daea3af5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:29:18.651561 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:18.651549    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istio-token" (OuterVolumeSpecName: "istio-token") pod "a33b978e-2386-45ef-ab8c-a4d5daea3af5" (UID: "a33b978e-2386-45ef-ab8c-a4d5daea3af5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:29:18.750651 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:18.750622    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:18.750651 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:18.750651    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:18.750818 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:18.750665    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nm9v\" (UniqueName: \"kubernetes.io/projected/a33b978e-2386-45ef-ab8c-a4d5daea3af5-kube-api-access-2nm9v\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:18.750818 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:18.750677    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:18.750818 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:18.750688    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:18.750818 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:18.750701    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a33b978e-2386-45ef-ab8c-a4d5daea3af5-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:18.750818 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:18.750713    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a33b978e-2386-45ef-ab8c-a4d5daea3af5-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:19.451382 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:19.451349    2582 generic.go:356] "Generic (PLEG): container finished" podID="a33b978e-2386-45ef-ab8c-a4d5daea3af5" containerID="3d602d2344024e5323a48a3c5d13c39a0a601652e672bb999d6d4ae76d95deb6" exitCode=0
Jul 09 04:29:19.451579 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:19.451399    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"
Jul 09 04:29:19.451579 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:19.451429    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj" event={"ID":"a33b978e-2386-45ef-ab8c-a4d5daea3af5","Type":"ContainerDied","Data":"3d602d2344024e5323a48a3c5d13c39a0a601652e672bb999d6d4ae76d95deb6"}
Jul 09 04:29:19.451579 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:19.451493    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj" event={"ID":"a33b978e-2386-45ef-ab8c-a4d5daea3af5","Type":"ContainerDied","Data":"7dac6afe0d6ce1343884ac8808e53b5f2af4874d47add2559068da5206bdf696"}
Jul 09 04:29:19.451579 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:19.451524    2582 scope.go:117] "RemoveContainer" containerID="3d602d2344024e5323a48a3c5d13c39a0a601652e672bb999d6d4ae76d95deb6"
Jul 09 04:29:19.460633 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:19.460618    2582 scope.go:117] "RemoveContainer" containerID="a53caf3e58281a1cc5ae8f6545d36ecbbb88fe4f9145a928bd1cb3f717949d46"
Jul 09 04:29:19.468077 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:19.468059    2582 scope.go:117] "RemoveContainer" containerID="3d602d2344024e5323a48a3c5d13c39a0a601652e672bb999d6d4ae76d95deb6"
Jul 09 04:29:19.468337 ip-10-0-134-121 kubenswrapper[2582]: E0709 04:29:19.468321    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d602d2344024e5323a48a3c5d13c39a0a601652e672bb999d6d4ae76d95deb6\": container with ID starting with 3d602d2344024e5323a48a3c5d13c39a0a601652e672bb999d6d4ae76d95deb6 not found: ID does not exist" containerID="3d602d2344024e5323a48a3c5d13c39a0a601652e672bb999d6d4ae76d95deb6"
Jul 09 04:29:19.468378 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:19.468346    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d602d2344024e5323a48a3c5d13c39a0a601652e672bb999d6d4ae76d95deb6"} err="failed to get container status \"3d602d2344024e5323a48a3c5d13c39a0a601652e672bb999d6d4ae76d95deb6\": rpc error: code = NotFound desc = could not find container \"3d602d2344024e5323a48a3c5d13c39a0a601652e672bb999d6d4ae76d95deb6\": container with ID starting with 3d602d2344024e5323a48a3c5d13c39a0a601652e672bb999d6d4ae76d95deb6 not found: ID does not exist"
Jul 09 04:29:19.468378 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:19.468362    2582 scope.go:117] "RemoveContainer" containerID="a53caf3e58281a1cc5ae8f6545d36ecbbb88fe4f9145a928bd1cb3f717949d46"
Jul 09 04:29:19.468590 ip-10-0-134-121 kubenswrapper[2582]: E0709 04:29:19.468571    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a53caf3e58281a1cc5ae8f6545d36ecbbb88fe4f9145a928bd1cb3f717949d46\": container with ID starting with a53caf3e58281a1cc5ae8f6545d36ecbbb88fe4f9145a928bd1cb3f717949d46 not found: ID does not exist" containerID="a53caf3e58281a1cc5ae8f6545d36ecbbb88fe4f9145a928bd1cb3f717949d46"
Jul 09 04:29:19.468639 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:19.468593    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a53caf3e58281a1cc5ae8f6545d36ecbbb88fe4f9145a928bd1cb3f717949d46"} err="failed to get container status \"a53caf3e58281a1cc5ae8f6545d36ecbbb88fe4f9145a928bd1cb3f717949d46\": rpc error: code = NotFound desc = could not find container \"a53caf3e58281a1cc5ae8f6545d36ecbbb88fe4f9145a928bd1cb3f717949d46\": container with ID starting with a53caf3e58281a1cc5ae8f6545d36ecbbb88fe4f9145a928bd1cb3f717949d46 not found: ID does not exist"
Jul 09 04:29:19.473997 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:19.473976    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"]
Jul 09 04:29:19.477915 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:19.477895    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-6fdfb1-openshift-default-64d9c8bf97-27ftj"]
Jul 09 04:29:20.155488 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:20.155448    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a33b978e-2386-45ef-ab8c-a4d5daea3af5" path="/var/lib/kubelet/pods/a33b978e-2386-45ef-ab8c-a4d5daea3af5/volumes"
Jul 09 04:29:22.527046 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.527010    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"]
Jul 09 04:29:22.528170 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.528142    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a33b978e-2386-45ef-ab8c-a4d5daea3af5" containerName="istio-proxy"
Jul 09 04:29:22.528170 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.528165    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a33b978e-2386-45ef-ab8c-a4d5daea3af5" containerName="istio-proxy"
Jul 09 04:29:22.528360 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.528180    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a33b978e-2386-45ef-ab8c-a4d5daea3af5" containerName="istio-proxy"
Jul 09 04:29:22.528360 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.528190    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a33b978e-2386-45ef-ab8c-a4d5daea3af5" containerName="istio-proxy"
Jul 09 04:29:22.528360 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.528250    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a33b978e-2386-45ef-ab8c-a4d5daea3af5" containerName="istio-proxy"
Jul 09 04:29:22.528360 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.528259    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a33b978e-2386-45ef-ab8c-a4d5daea3af5" containerName="istio-proxy"
Jul 09 04:29:22.532983 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.532962    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.535579 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.535555    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-d61384-openshift-default-dockercfg-dzz87\""
Jul 09 04:29:22.542472 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.542440    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"]
Jul 09 04:29:22.579734 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.579704    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24797b11-3cb3-4153-a584-7ea0fa0c8279-istiod-ca-cert\") pod \"e2e-api-b-d61384-openshift-default-cd449b489-d8kw7\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") " pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.579834 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.579743    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-credential-socket\") pod \"e2e-api-b-d61384-openshift-default-cd449b489-d8kw7\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") " pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.579834 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.579790    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-istio-data\") pod \"e2e-api-b-d61384-openshift-default-cd449b489-d8kw7\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") " pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.579834 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.579819    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-workload-certs\") pod \"e2e-api-b-d61384-openshift-default-cd449b489-d8kw7\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") " pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.580038 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.579853    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24797b11-3cb3-4153-a584-7ea0fa0c8279-istio-podinfo\") pod \"e2e-api-b-d61384-openshift-default-cd449b489-d8kw7\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") " pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.580038 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.579881    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24797b11-3cb3-4153-a584-7ea0fa0c8279-istio-token\") pod \"e2e-api-b-d61384-openshift-default-cd449b489-d8kw7\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") " pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.580038 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.579932    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc7xw\" (UniqueName: \"kubernetes.io/projected/24797b11-3cb3-4153-a584-7ea0fa0c8279-kube-api-access-lc7xw\") pod \"e2e-api-b-d61384-openshift-default-cd449b489-d8kw7\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") " pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.580038 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.580021    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-istio-envoy\") pod \"e2e-api-b-d61384-openshift-default-cd449b489-d8kw7\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") " pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.580202 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.580070    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-workload-socket\") pod \"e2e-api-b-d61384-openshift-default-cd449b489-d8kw7\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") " pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.680894 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.680841    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-istio-envoy\") pod \"e2e-api-b-d61384-openshift-default-cd449b489-d8kw7\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") " pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.681047 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.680951    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-workload-socket\") pod \"e2e-api-b-d61384-openshift-default-cd449b489-d8kw7\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") " pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.681047 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.680986    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24797b11-3cb3-4153-a584-7ea0fa0c8279-istiod-ca-cert\") pod \"e2e-api-b-d61384-openshift-default-cd449b489-d8kw7\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") " pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.681047 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.681012    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-credential-socket\") pod \"e2e-api-b-d61384-openshift-default-cd449b489-d8kw7\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") " pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.681208 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.681065    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-istio-data\") pod \"e2e-api-b-d61384-openshift-default-cd449b489-d8kw7\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") " pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.681208 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.681099    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-workload-certs\") pod \"e2e-api-b-d61384-openshift-default-cd449b489-d8kw7\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") " pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.681208 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.681135    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24797b11-3cb3-4153-a584-7ea0fa0c8279-istio-podinfo\") pod \"e2e-api-b-d61384-openshift-default-cd449b489-d8kw7\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") " pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.681208 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.681163    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24797b11-3cb3-4153-a584-7ea0fa0c8279-istio-token\") pod \"e2e-api-b-d61384-openshift-default-cd449b489-d8kw7\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") " pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.681208 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.681187    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc7xw\" (UniqueName: \"kubernetes.io/projected/24797b11-3cb3-4153-a584-7ea0fa0c8279-kube-api-access-lc7xw\") pod \"e2e-api-b-d61384-openshift-default-cd449b489-d8kw7\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") " pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.681463 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.681438    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-istio-data\") pod \"e2e-api-b-d61384-openshift-default-cd449b489-d8kw7\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") " pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.681523 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.681466    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-credential-socket\") pod \"e2e-api-b-d61384-openshift-default-cd449b489-d8kw7\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") " pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.681584 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.681555    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-workload-certs\") pod \"e2e-api-b-d61384-openshift-default-cd449b489-d8kw7\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") " pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.681802 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.681774    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24797b11-3cb3-4153-a584-7ea0fa0c8279-istiod-ca-cert\") pod \"e2e-api-b-d61384-openshift-default-cd449b489-d8kw7\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") " pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.681802 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.681796    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-workload-socket\") pod \"e2e-api-b-d61384-openshift-default-cd449b489-d8kw7\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") " pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.683441 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.683423    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-istio-envoy\") pod \"e2e-api-b-d61384-openshift-default-cd449b489-d8kw7\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") " pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.683704 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.683686    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24797b11-3cb3-4153-a584-7ea0fa0c8279-istio-podinfo\") pod \"e2e-api-b-d61384-openshift-default-cd449b489-d8kw7\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") " pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.692015 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.691995    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24797b11-3cb3-4153-a584-7ea0fa0c8279-istio-token\") pod \"e2e-api-b-d61384-openshift-default-cd449b489-d8kw7\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") " pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.692149 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.692128    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc7xw\" (UniqueName: \"kubernetes.io/projected/24797b11-3cb3-4153-a584-7ea0fa0c8279-kube-api-access-lc7xw\") pod \"e2e-api-b-d61384-openshift-default-cd449b489-d8kw7\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") " pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.846257 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.846196    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:22.979065 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.979039    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"]
Jul 09 04:29:22.981269 ip-10-0-134-121 kubenswrapper[2582]: W0709 04:29:22.981241    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24797b11_3cb3_4153_a584_7ea0fa0c8279.slice/crio-3096a7d31df64ab6da6c5568d6f0fef71747df4b998a06c73e2546b2229bf2f1 WatchSource:0}: Error finding container 3096a7d31df64ab6da6c5568d6f0fef71747df4b998a06c73e2546b2229bf2f1: Status 404 returned error can't find the container with id 3096a7d31df64ab6da6c5568d6f0fef71747df4b998a06c73e2546b2229bf2f1
Jul 09 04:29:22.983635 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.983604    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:29:22.983701 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.983680    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:29:22.983752 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:22.983707    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:29:23.471775 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:23.471741    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7" event={"ID":"24797b11-3cb3-4153-a584-7ea0fa0c8279","Type":"ContainerStarted","Data":"9f40b360bd01105777803c7f89cf011a98e17f1db0dbfd54a613cd1560b02e22"}
Jul 09 04:29:23.471958 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:23.471790    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7" event={"ID":"24797b11-3cb3-4153-a584-7ea0fa0c8279","Type":"ContainerStarted","Data":"3096a7d31df64ab6da6c5568d6f0fef71747df4b998a06c73e2546b2229bf2f1"}
Jul 09 04:29:23.492654 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:23.492607    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7" podStartSLOduration=1.492590715 podStartE2EDuration="1.492590715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:29:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:29:23.490408366 +0000 UTC m=+1989.934538450" watchObservedRunningTime="2026-07-09 04:29:23.492590715 +0000 UTC m=+1989.936720797"
Jul 09 04:29:23.846882 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:23.846806    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:24.851506 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:24.851476    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:25.480291 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:25.480258    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:25.481160 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:25.481143    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:32.480054 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:32.480002    2582 patch_prober.go:28] interesting pod/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 09 04:29:32.480416 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:32.480079    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr" podUID="8740c00b-b847-4055-af64-40ccaeb87ce8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 09 04:29:33.517834 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:33.517803    2582 generic.go:356] "Generic (PLEG): container finished" podID="8740c00b-b847-4055-af64-40ccaeb87ce8" containerID="922ed14a1e40310ef7f35d0681e804c946d956bcacaf95851914d32920ba5fa8" exitCode=0
Jul 09 04:29:33.518318 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:33.517841    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr" event={"ID":"8740c00b-b847-4055-af64-40ccaeb87ce8","Type":"ContainerDied","Data":"922ed14a1e40310ef7f35d0681e804c946d956bcacaf95851914d32920ba5fa8"}
Jul 09 04:29:33.518318 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:33.518206    2582 scope.go:117] "RemoveContainer" containerID="922ed14a1e40310ef7f35d0681e804c946d956bcacaf95851914d32920ba5fa8"
Jul 09 04:29:33.519215 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:33.519185    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:29:33.519333 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:33.519268    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:29:33.519333 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:33.519312    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:29:34.526641 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:34.526582    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr" event={"ID":"8740c00b-b847-4055-af64-40ccaeb87ce8","Type":"ContainerStarted","Data":"cf5b76450b10e257c90c7bcb6f3b04bf7028f0c44376f496334f6c849f7fa2c4"}
Jul 09 04:29:35.508447 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:35.508413    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:35.508628 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:35.508458    2582 patch_prober.go:28] interesting pod/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 09 04:29:35.508628 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:35.508514    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr" podUID="8740c00b-b847-4055-af64-40ccaeb87ce8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 09 04:29:36.508103 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:36.508067    2582 patch_prober.go:28] interesting pod/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 09 04:29:36.508533 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:36.508121    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr" podUID="8740c00b-b847-4055-af64-40ccaeb87ce8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 09 04:29:37.508586 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:37.508556    2582 patch_prober.go:28] interesting pod/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 09 04:29:37.509107 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:37.509012    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr" podUID="8740c00b-b847-4055-af64-40ccaeb87ce8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 09 04:29:38.512828 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:38.512750    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:38.513280 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:38.513110    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:38.513696 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:38.513672    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:40.957129 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:40.956296    2582 patch_prober.go:28] interesting pod/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": read tcp 10.134.0.2:40994->10.134.0.36:15021: read: connection reset by peer" start-of-body=
Jul 09 04:29:40.957129 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:40.956365    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7" podUID="24797b11-3cb3-4153-a584-7ea0fa0c8279" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": read tcp 10.134.0.2:40994->10.134.0.36:15021: read: connection reset by peer"
Jul 09 04:29:41.569815 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:41.569786    2582 generic.go:356] "Generic (PLEG): container finished" podID="24797b11-3cb3-4153-a584-7ea0fa0c8279" containerID="9f40b360bd01105777803c7f89cf011a98e17f1db0dbfd54a613cd1560b02e22" exitCode=0
Jul 09 04:29:41.570018 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:41.569851    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7" event={"ID":"24797b11-3cb3-4153-a584-7ea0fa0c8279","Type":"ContainerDied","Data":"9f40b360bd01105777803c7f89cf011a98e17f1db0dbfd54a613cd1560b02e22"}
Jul 09 04:29:41.570207 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:41.570192    2582 scope.go:117] "RemoveContainer" containerID="9f40b360bd01105777803c7f89cf011a98e17f1db0dbfd54a613cd1560b02e22"
Jul 09 04:29:41.571134 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:41.571105    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:29:41.571248 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:41.571172    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:29:41.571248 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:41.571215    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:29:42.575864 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:42.575824    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7" event={"ID":"24797b11-3cb3-4153-a584-7ea0fa0c8279","Type":"ContainerStarted","Data":"7cd53775917a10bac81b6263f20d652ba691ab9b98ca3077720c3c66f40cd80d"}
Jul 09 04:29:42.846633 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:42.846536    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:42.846929 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:42.846870    2582 patch_prober.go:28] interesting pod/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 09 04:29:42.847000 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:42.846962    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7" podUID="24797b11-3cb3-4153-a584-7ea0fa0c8279" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 09 04:29:43.846611 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:43.846574    2582 patch_prober.go:28] interesting pod/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 09 04:29:43.847033 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:43.846641    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7" podUID="24797b11-3cb3-4153-a584-7ea0fa0c8279" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 09 04:29:44.347951 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:44.346413    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"]
Jul 09 04:29:44.347951 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:44.346711    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr" podUID="8740c00b-b847-4055-af64-40ccaeb87ce8" containerName="istio-proxy" containerID="cri-o://cf5b76450b10e257c90c7bcb6f3b04bf7028f0c44376f496334f6c849f7fa2c4" gracePeriod=30
Jul 09 04:29:44.846557 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:44.846515    2582 patch_prober.go:28] interesting pod/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 09 04:29:44.846753 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:44.846577    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7" podUID="24797b11-3cb3-4153-a584-7ea0fa0c8279" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 09 04:29:45.847192 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:45.847151    2582 patch_prober.go:28] interesting pod/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jul 09 04:29:45.847575 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:45.847206    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7" podUID="24797b11-3cb3-4153-a584-7ea0fa0c8279" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jul 09 04:29:46.849941 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:46.849913    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:46.850319 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:46.850174    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:46.850899 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:46.850871    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:49.608114 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.608076    2582 generic.go:356] "Generic (PLEG): container finished" podID="8740c00b-b847-4055-af64-40ccaeb87ce8" containerID="cf5b76450b10e257c90c7bcb6f3b04bf7028f0c44376f496334f6c849f7fa2c4" exitCode=0
Jul 09 04:29:49.608545 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.608162    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr" event={"ID":"8740c00b-b847-4055-af64-40ccaeb87ce8","Type":"ContainerDied","Data":"cf5b76450b10e257c90c7bcb6f3b04bf7028f0c44376f496334f6c849f7fa2c4"}
Jul 09 04:29:49.608545 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.608231    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:49.608545 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.608245    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr" event={"ID":"8740c00b-b847-4055-af64-40ccaeb87ce8","Type":"ContainerDied","Data":"90d82aca229b3cdb57d12eb8740eaa9418f010710554d6f477e437c3ff70abc1"}
Jul 09 04:29:49.608545 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.608273    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90d82aca229b3cdb57d12eb8740eaa9418f010710554d6f477e437c3ff70abc1"
Jul 09 04:29:49.608545 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.608292    2582 scope.go:117] "RemoveContainer" containerID="922ed14a1e40310ef7f35d0681e804c946d956bcacaf95851914d32920ba5fa8"
Jul 09 04:29:49.738147 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.738123    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-workload-socket\") pod \"8740c00b-b847-4055-af64-40ccaeb87ce8\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") "
Jul 09 04:29:49.738308 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.738156    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-workload-certs\") pod \"8740c00b-b847-4055-af64-40ccaeb87ce8\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") "
Jul 09 04:29:49.738308 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.738178    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8740c00b-b847-4055-af64-40ccaeb87ce8-istio-podinfo\") pod \"8740c00b-b847-4055-af64-40ccaeb87ce8\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") "
Jul 09 04:29:49.738308 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.738194    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8740c00b-b847-4055-af64-40ccaeb87ce8-istiod-ca-cert\") pod \"8740c00b-b847-4055-af64-40ccaeb87ce8\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") "
Jul 09 04:29:49.738308 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.738211    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-istio-data\") pod \"8740c00b-b847-4055-af64-40ccaeb87ce8\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") "
Jul 09 04:29:49.738308 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.738238    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8740c00b-b847-4055-af64-40ccaeb87ce8-istio-token\") pod \"8740c00b-b847-4055-af64-40ccaeb87ce8\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") "
Jul 09 04:29:49.738308 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.738255    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrjq7\" (UniqueName: \"kubernetes.io/projected/8740c00b-b847-4055-af64-40ccaeb87ce8-kube-api-access-qrjq7\") pod \"8740c00b-b847-4055-af64-40ccaeb87ce8\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") "
Jul 09 04:29:49.738308 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.738279    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-credential-socket\") pod \"8740c00b-b847-4055-af64-40ccaeb87ce8\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") "
Jul 09 04:29:49.738681 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.738326    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-istio-envoy\") pod \"8740c00b-b847-4055-af64-40ccaeb87ce8\" (UID: \"8740c00b-b847-4055-af64-40ccaeb87ce8\") "
Jul 09 04:29:49.738681 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.738426    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8740c00b-b847-4055-af64-40ccaeb87ce8" (UID: "8740c00b-b847-4055-af64-40ccaeb87ce8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:29:49.738681 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.738622    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:49.738681 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.738445    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8740c00b-b847-4055-af64-40ccaeb87ce8" (UID: "8740c00b-b847-4055-af64-40ccaeb87ce8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:29:49.738681 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.738613    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8740c00b-b847-4055-af64-40ccaeb87ce8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8740c00b-b847-4055-af64-40ccaeb87ce8" (UID: "8740c00b-b847-4055-af64-40ccaeb87ce8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:29:49.738681 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.738668    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8740c00b-b847-4055-af64-40ccaeb87ce8" (UID: "8740c00b-b847-4055-af64-40ccaeb87ce8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:29:49.739256 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.739225    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-istio-data" (OuterVolumeSpecName: "istio-data") pod "8740c00b-b847-4055-af64-40ccaeb87ce8" (UID: "8740c00b-b847-4055-af64-40ccaeb87ce8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:29:49.740457 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.740422    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8740c00b-b847-4055-af64-40ccaeb87ce8-istio-token" (OuterVolumeSpecName: "istio-token") pod "8740c00b-b847-4055-af64-40ccaeb87ce8" (UID: "8740c00b-b847-4055-af64-40ccaeb87ce8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:29:49.740457 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.740440    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8740c00b-b847-4055-af64-40ccaeb87ce8-kube-api-access-qrjq7" (OuterVolumeSpecName: "kube-api-access-qrjq7") pod "8740c00b-b847-4055-af64-40ccaeb87ce8" (UID: "8740c00b-b847-4055-af64-40ccaeb87ce8"). InnerVolumeSpecName "kube-api-access-qrjq7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:29:49.740778 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.740759    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8740c00b-b847-4055-af64-40ccaeb87ce8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8740c00b-b847-4055-af64-40ccaeb87ce8" (UID: "8740c00b-b847-4055-af64-40ccaeb87ce8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 04:29:49.740826 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.740804    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8740c00b-b847-4055-af64-40ccaeb87ce8" (UID: "8740c00b-b847-4055-af64-40ccaeb87ce8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:29:49.839417 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.839386    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:49.839417 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.839412    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8740c00b-b847-4055-af64-40ccaeb87ce8-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:49.839570 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.839424    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8740c00b-b847-4055-af64-40ccaeb87ce8-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:49.839570 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.839436    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:49.839570 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.839448    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8740c00b-b847-4055-af64-40ccaeb87ce8-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:49.839570 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.839460    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrjq7\" (UniqueName: \"kubernetes.io/projected/8740c00b-b847-4055-af64-40ccaeb87ce8-kube-api-access-qrjq7\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:49.839570 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.839472    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:49.839570 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:49.839483    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8740c00b-b847-4055-af64-40ccaeb87ce8-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:50.613250 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:50.613225    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"
Jul 09 04:29:50.667441 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:50.667406    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"]
Jul 09 04:29:50.672311 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:50.672289    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-2cb3ca-openshift-default-6484c78899-slghr"]
Jul 09 04:29:51.800270 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:51.800241    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"]
Jul 09 04:29:51.800661 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:51.800490    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7" podUID="24797b11-3cb3-4153-a584-7ea0fa0c8279" containerName="istio-proxy" containerID="cri-o://7cd53775917a10bac81b6263f20d652ba691ab9b98ca3077720c3c66f40cd80d" gracePeriod=30
Jul 09 04:29:52.154796 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.154763    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8740c00b-b847-4055-af64-40ccaeb87ce8" path="/var/lib/kubelet/pods/8740c00b-b847-4055-af64-40ccaeb87ce8/volumes"
Jul 09 04:29:52.620641 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.620611    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"]
Jul 09 04:29:52.621037 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.621022    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8740c00b-b847-4055-af64-40ccaeb87ce8" containerName="istio-proxy"
Jul 09 04:29:52.621118 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.621039    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8740c00b-b847-4055-af64-40ccaeb87ce8" containerName="istio-proxy"
Jul 09 04:29:52.621182 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.621127    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8740c00b-b847-4055-af64-40ccaeb87ce8" containerName="istio-proxy"
Jul 09 04:29:52.621182 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.621143    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8740c00b-b847-4055-af64-40ccaeb87ce8" containerName="istio-proxy"
Jul 09 04:29:52.625741 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.625721    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:52.628440 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.628416    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-6bd312-openshift-default-dockercfg-xwltb\""
Jul 09 04:29:52.636260 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.636240    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"]
Jul 09 04:29:52.762804 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.762771    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-workload-socket\") pod \"e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") " pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:52.762804 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.762806    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istio-envoy\") pod \"e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") " pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:52.763064 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.762840    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istio-token\") pod \"e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") " pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:52.763064 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.762974    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istio-data\") pod \"e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") " pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:52.763064 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.763029    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istio-podinfo\") pod \"e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") " pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:52.763230 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.763071    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfsq7\" (UniqueName: \"kubernetes.io/projected/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-kube-api-access-zfsq7\") pod \"e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") " pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:52.763230 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.763107    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-credential-socket\") pod \"e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") " pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:52.763230 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.763134    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istiod-ca-cert\") pod \"e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") " pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:52.763230 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.763168    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-workload-certs\") pod \"e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") " pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:52.863859 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.863829    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-workload-socket\") pod \"e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") " pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:52.863859 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.863863    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istio-envoy\") pod \"e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") " pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:52.864379 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.864019    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istio-token\") pod \"e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") " pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:52.864379 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.864097    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istio-data\") pod \"e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") " pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:52.864379 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.864154    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istio-podinfo\") pod \"e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") " pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:52.864379 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.864189    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfsq7\" (UniqueName: \"kubernetes.io/projected/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-kube-api-access-zfsq7\") pod \"e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") " pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:52.864379 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.864211    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-workload-socket\") pod \"e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") " pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:52.864379 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.864224    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-credential-socket\") pod \"e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") " pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:52.864379 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.864247    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istiod-ca-cert\") pod \"e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") " pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:52.864379 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.864284    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-workload-certs\") pod \"e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") " pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:52.864792 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.864442    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istio-data\") pod \"e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") " pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:52.864792 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.864474    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-credential-socket\") pod \"e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") " pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:52.864792 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.864641    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-workload-certs\") pod \"e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") " pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:52.864993 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.864972    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istiod-ca-cert\") pod \"e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") " pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:52.866206 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.866178    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istio-envoy\") pod \"e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") " pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:52.866585 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.866567    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istio-podinfo\") pod \"e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") " pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:52.873280 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.873189    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istio-token\") pod \"e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") " pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:52.873553 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.873533    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfsq7\" (UniqueName: \"kubernetes.io/projected/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-kube-api-access-zfsq7\") pod \"e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") " pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:52.939239 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:52.939217    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:53.073615 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:53.073592    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"]
Jul 09 04:29:53.075229 ip-10-0-134-121 kubenswrapper[2582]: W0709 04:29:53.075202    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7b78d3a_3e98_4dc5_8037_30f38f74b2f2.slice/crio-7ff14e5eff2ef4f33fd0b2a8aba4c2b92287dd4752971366d485824b03ae4c54 WatchSource:0}: Error finding container 7ff14e5eff2ef4f33fd0b2a8aba4c2b92287dd4752971366d485824b03ae4c54: Status 404 returned error can't find the container with id 7ff14e5eff2ef4f33fd0b2a8aba4c2b92287dd4752971366d485824b03ae4c54
Jul 09 04:29:53.077358 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:53.077326    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:29:53.077455 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:53.077392    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:29:53.077455 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:53.077420    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:29:53.635177 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:53.635136    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf" event={"ID":"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2","Type":"ContainerStarted","Data":"32aa81e366fc6a7ea4a5623f21896ba3e72f6cbbbc2438553164e22c04717ca2"}
Jul 09 04:29:53.635344 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:53.635234    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf" event={"ID":"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2","Type":"ContainerStarted","Data":"7ff14e5eff2ef4f33fd0b2a8aba4c2b92287dd4752971366d485824b03ae4c54"}
Jul 09 04:29:53.661306 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:53.661258    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf" podStartSLOduration=1.6612431669999999 podStartE2EDuration="1.661243167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:29:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:29:53.658744359 +0000 UTC m=+2020.102874433" watchObservedRunningTime="2026-07-09 04:29:53.661243167 +0000 UTC m=+2020.105373244"
Jul 09 04:29:53.940159 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:53.940087    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:54.944557 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:54.944528    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:55.645500 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:55.645468    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:55.646519 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:55.646487    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:29:57.053620 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.053597    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:57.206240 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.206208    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24797b11-3cb3-4153-a584-7ea0fa0c8279-istio-podinfo\") pod \"24797b11-3cb3-4153-a584-7ea0fa0c8279\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") "
Jul 09 04:29:57.206428 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.206260    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-credential-socket\") pod \"24797b11-3cb3-4153-a584-7ea0fa0c8279\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") "
Jul 09 04:29:57.206428 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.206297    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-istio-envoy\") pod \"24797b11-3cb3-4153-a584-7ea0fa0c8279\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") "
Jul 09 04:29:57.206428 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.206362    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-workload-certs\") pod \"24797b11-3cb3-4153-a584-7ea0fa0c8279\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") "
Jul 09 04:29:57.206428 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.206386    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-workload-socket\") pod \"24797b11-3cb3-4153-a584-7ea0fa0c8279\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") "
Jul 09 04:29:57.206645 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.206437    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24797b11-3cb3-4153-a584-7ea0fa0c8279-istio-token\") pod \"24797b11-3cb3-4153-a584-7ea0fa0c8279\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") "
Jul 09 04:29:57.206645 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.206495    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24797b11-3cb3-4153-a584-7ea0fa0c8279-istiod-ca-cert\") pod \"24797b11-3cb3-4153-a584-7ea0fa0c8279\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") "
Jul 09 04:29:57.206645 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.206525    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-istio-data\") pod \"24797b11-3cb3-4153-a584-7ea0fa0c8279\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") "
Jul 09 04:29:57.206645 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.206549    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lc7xw\" (UniqueName: \"kubernetes.io/projected/24797b11-3cb3-4153-a584-7ea0fa0c8279-kube-api-access-lc7xw\") pod \"24797b11-3cb3-4153-a584-7ea0fa0c8279\" (UID: \"24797b11-3cb3-4153-a584-7ea0fa0c8279\") "
Jul 09 04:29:57.206645 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.206617    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "24797b11-3cb3-4153-a584-7ea0fa0c8279" (UID: "24797b11-3cb3-4153-a584-7ea0fa0c8279"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:29:57.206861 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.206666    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "24797b11-3cb3-4153-a584-7ea0fa0c8279" (UID: "24797b11-3cb3-4153-a584-7ea0fa0c8279"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:29:57.206861 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.206700    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "24797b11-3cb3-4153-a584-7ea0fa0c8279" (UID: "24797b11-3cb3-4153-a584-7ea0fa0c8279"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:29:57.206977 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.206953    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:57.207050 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.206979    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:57.207050 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.206994    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:57.207050 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.207010    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24797b11-3cb3-4153-a584-7ea0fa0c8279-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "24797b11-3cb3-4153-a584-7ea0fa0c8279" (UID: "24797b11-3cb3-4153-a584-7ea0fa0c8279"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:29:57.207433 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.207412    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-istio-data" (OuterVolumeSpecName: "istio-data") pod "24797b11-3cb3-4153-a584-7ea0fa0c8279" (UID: "24797b11-3cb3-4153-a584-7ea0fa0c8279"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:29:57.208563 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.208535    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/24797b11-3cb3-4153-a584-7ea0fa0c8279-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "24797b11-3cb3-4153-a584-7ea0fa0c8279" (UID: "24797b11-3cb3-4153-a584-7ea0fa0c8279"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 04:29:57.208857 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.208840    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24797b11-3cb3-4153-a584-7ea0fa0c8279-kube-api-access-lc7xw" (OuterVolumeSpecName: "kube-api-access-lc7xw") pod "24797b11-3cb3-4153-a584-7ea0fa0c8279" (UID: "24797b11-3cb3-4153-a584-7ea0fa0c8279"). InnerVolumeSpecName "kube-api-access-lc7xw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:29:57.209052 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.209032    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "24797b11-3cb3-4153-a584-7ea0fa0c8279" (UID: "24797b11-3cb3-4153-a584-7ea0fa0c8279"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:29:57.209111 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.209054    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24797b11-3cb3-4153-a584-7ea0fa0c8279-istio-token" (OuterVolumeSpecName: "istio-token") pod "24797b11-3cb3-4153-a584-7ea0fa0c8279" (UID: "24797b11-3cb3-4153-a584-7ea0fa0c8279"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:29:57.307439 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.307409    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24797b11-3cb3-4153-a584-7ea0fa0c8279-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:57.307439 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.307436    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24797b11-3cb3-4153-a584-7ea0fa0c8279-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:57.307439 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.307445    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:57.307652 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.307453    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lc7xw\" (UniqueName: \"kubernetes.io/projected/24797b11-3cb3-4153-a584-7ea0fa0c8279-kube-api-access-lc7xw\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:57.307652 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.307463    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24797b11-3cb3-4153-a584-7ea0fa0c8279-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:57.307652 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.307471    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24797b11-3cb3-4153-a584-7ea0fa0c8279-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:29:57.656110 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.656077    2582 generic.go:356] "Generic (PLEG): container finished" podID="24797b11-3cb3-4153-a584-7ea0fa0c8279" containerID="7cd53775917a10bac81b6263f20d652ba691ab9b98ca3077720c3c66f40cd80d" exitCode=0
Jul 09 04:29:57.656266 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.656128    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"
Jul 09 04:29:57.656266 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.656165    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7" event={"ID":"24797b11-3cb3-4153-a584-7ea0fa0c8279","Type":"ContainerDied","Data":"7cd53775917a10bac81b6263f20d652ba691ab9b98ca3077720c3c66f40cd80d"}
Jul 09 04:29:57.656266 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.656220    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7" event={"ID":"24797b11-3cb3-4153-a584-7ea0fa0c8279","Type":"ContainerDied","Data":"3096a7d31df64ab6da6c5568d6f0fef71747df4b998a06c73e2546b2229bf2f1"}
Jul 09 04:29:57.656266 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.656246    2582 scope.go:117] "RemoveContainer" containerID="7cd53775917a10bac81b6263f20d652ba691ab9b98ca3077720c3c66f40cd80d"
Jul 09 04:29:57.665167 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.665150    2582 scope.go:117] "RemoveContainer" containerID="9f40b360bd01105777803c7f89cf011a98e17f1db0dbfd54a613cd1560b02e22"
Jul 09 04:29:57.672635 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.672618    2582 scope.go:117] "RemoveContainer" containerID="7cd53775917a10bac81b6263f20d652ba691ab9b98ca3077720c3c66f40cd80d"
Jul 09 04:29:57.672871 ip-10-0-134-121 kubenswrapper[2582]: E0709 04:29:57.672853    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cd53775917a10bac81b6263f20d652ba691ab9b98ca3077720c3c66f40cd80d\": container with ID starting with 7cd53775917a10bac81b6263f20d652ba691ab9b98ca3077720c3c66f40cd80d not found: ID does not exist" containerID="7cd53775917a10bac81b6263f20d652ba691ab9b98ca3077720c3c66f40cd80d"
Jul 09 04:29:57.672960 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.672879    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cd53775917a10bac81b6263f20d652ba691ab9b98ca3077720c3c66f40cd80d"} err="failed to get container status \"7cd53775917a10bac81b6263f20d652ba691ab9b98ca3077720c3c66f40cd80d\": rpc error: code = NotFound desc = could not find container \"7cd53775917a10bac81b6263f20d652ba691ab9b98ca3077720c3c66f40cd80d\": container with ID starting with 7cd53775917a10bac81b6263f20d652ba691ab9b98ca3077720c3c66f40cd80d not found: ID does not exist"
Jul 09 04:29:57.672960 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.672920    2582 scope.go:117] "RemoveContainer" containerID="9f40b360bd01105777803c7f89cf011a98e17f1db0dbfd54a613cd1560b02e22"
Jul 09 04:29:57.673174 ip-10-0-134-121 kubenswrapper[2582]: E0709 04:29:57.673156    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f40b360bd01105777803c7f89cf011a98e17f1db0dbfd54a613cd1560b02e22\": container with ID starting with 9f40b360bd01105777803c7f89cf011a98e17f1db0dbfd54a613cd1560b02e22 not found: ID does not exist" containerID="9f40b360bd01105777803c7f89cf011a98e17f1db0dbfd54a613cd1560b02e22"
Jul 09 04:29:57.673227 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.673179    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f40b360bd01105777803c7f89cf011a98e17f1db0dbfd54a613cd1560b02e22"} err="failed to get container status \"9f40b360bd01105777803c7f89cf011a98e17f1db0dbfd54a613cd1560b02e22\": rpc error: code = NotFound desc = could not find container \"9f40b360bd01105777803c7f89cf011a98e17f1db0dbfd54a613cd1560b02e22\": container with ID starting with 9f40b360bd01105777803c7f89cf011a98e17f1db0dbfd54a613cd1560b02e22 not found: ID does not exist"
Jul 09 04:29:57.681403 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.681374    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"]
Jul 09 04:29:57.687761 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:57.687739    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-d61384-openshift-default-cd449b489-d8kw7"]
Jul 09 04:29:58.153897 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:29:58.153861    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24797b11-3cb3-4153-a584-7ea0fa0c8279" path="/var/lib/kubelet/pods/24797b11-3cb3-4153-a584-7ea0fa0c8279/volumes"
Jul 09 04:30:00.595520 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.595484    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"]
Jul 09 04:30:00.596019 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.595996    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8740c00b-b847-4055-af64-40ccaeb87ce8" containerName="istio-proxy"
Jul 09 04:30:00.596019 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.596017    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8740c00b-b847-4055-af64-40ccaeb87ce8" containerName="istio-proxy"
Jul 09 04:30:00.596220 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.596033    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24797b11-3cb3-4153-a584-7ea0fa0c8279" containerName="istio-proxy"
Jul 09 04:30:00.596220 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.596042    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="24797b11-3cb3-4153-a584-7ea0fa0c8279" containerName="istio-proxy"
Jul 09 04:30:00.596220 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.596114    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="24797b11-3cb3-4153-a584-7ea0fa0c8279" containerName="istio-proxy"
Jul 09 04:30:00.596220 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.596127    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="24797b11-3cb3-4153-a584-7ea0fa0c8279" containerName="istio-proxy"
Jul 09 04:30:00.600790 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.600765    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:00.603722 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.603704    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-589b59-openshift-default-dockercfg-xjtv6\""
Jul 09 04:30:00.611553 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.611533    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"]
Jul 09 04:30:00.735486 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.735442    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istio-podinfo\") pod \"e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") " pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:00.735486 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.735485    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-credential-socket\") pod \"e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") " pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:00.735748 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.735520    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-workload-certs\") pod \"e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") " pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:00.735748 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.735582    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istio-token\") pod \"e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") " pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:00.735748 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.735664    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istiod-ca-cert\") pod \"e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") " pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:00.735748 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.735703    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-workload-socket\") pod \"e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") " pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:00.735998 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.735775    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istio-envoy\") pod \"e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") " pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:00.735998 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.735810    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istio-data\") pod \"e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") " pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:00.735998 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.735839    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwkf4\" (UniqueName: \"kubernetes.io/projected/99b52773-3cff-4048-aad3-ab6d3c9a4f48-kube-api-access-rwkf4\") pod \"e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") " pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:00.836443 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.836414    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwkf4\" (UniqueName: \"kubernetes.io/projected/99b52773-3cff-4048-aad3-ab6d3c9a4f48-kube-api-access-rwkf4\") pod \"e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") " pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:00.836443 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.836447    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istio-podinfo\") pod \"e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") " pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:00.836661 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.836469    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-credential-socket\") pod \"e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") " pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:00.836661 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.836567    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-workload-certs\") pod \"e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") " pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:00.836661 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.836600    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istio-token\") pod \"e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") " pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:00.836661 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.836660    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istiod-ca-cert\") pod \"e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") " pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:00.836870 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.836703    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-workload-socket\") pod \"e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") " pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:00.836870 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.836757    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istio-envoy\") pod \"e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") " pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:00.836870 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.836794    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istio-data\") pod \"e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") " pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:00.836870 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.836840    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-credential-socket\") pod \"e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") " pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:00.837110 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.836914    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-workload-certs\") pod \"e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") " pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:00.837179 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.837147    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istio-data\") pod \"e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") " pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:00.837179 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.837172    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-workload-socket\") pod \"e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") " pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:00.837421 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.837399    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istiod-ca-cert\") pod \"e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") " pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:00.838987 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.838969    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istio-envoy\") pod \"e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") " pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:00.839128 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.839110    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istio-podinfo\") pod \"e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") " pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:00.844813 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.844795    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istio-token\") pod \"e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") " pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:00.845034 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.845015    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwkf4\" (UniqueName: \"kubernetes.io/projected/99b52773-3cff-4048-aad3-ab6d3c9a4f48-kube-api-access-rwkf4\") pod \"e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") " pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:00.913098 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:00.913070    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:01.058573 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:01.058466    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"]
Jul 09 04:30:01.061100 ip-10-0-134-121 kubenswrapper[2582]: W0709 04:30:01.061071    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99b52773_3cff_4048_aad3_ab6d3c9a4f48.slice/crio-1652716a8890436632e5867d4a7cdc444df05dc441f65d79aa42a104bef5e83c WatchSource:0}: Error finding container 1652716a8890436632e5867d4a7cdc444df05dc441f65d79aa42a104bef5e83c: Status 404 returned error can't find the container with id 1652716a8890436632e5867d4a7cdc444df05dc441f65d79aa42a104bef5e83c
Jul 09 04:30:01.063234 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:01.063195    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:30:01.063323 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:01.063279    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:30:01.063363 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:01.063322    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:30:01.677121 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:01.677078    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd" event={"ID":"99b52773-3cff-4048-aad3-ab6d3c9a4f48","Type":"ContainerStarted","Data":"973fcbcdcb0d0d01874db5636f83db772624cf3441ebdc95fb56961107983ba4"}
Jul 09 04:30:01.677500 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:01.677183    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd" event={"ID":"99b52773-3cff-4048-aad3-ab6d3c9a4f48","Type":"ContainerStarted","Data":"1652716a8890436632e5867d4a7cdc444df05dc441f65d79aa42a104bef5e83c"}
Jul 09 04:30:01.718475 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:01.718420    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd" podStartSLOduration=1.718404192 podStartE2EDuration="1.718404192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 04:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:30:01.698117445 +0000 UTC m=+2028.142247519" watchObservedRunningTime="2026-07-09 04:30:01.718404192 +0000 UTC m=+2028.162534307"
Jul 09 04:30:01.914028 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:01.913987    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:02.924476 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:02.924442    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:03.686132 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:03.686103    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:03.687161 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:03.687139    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:09.716164 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:09.716131    2582 generic.go:356] "Generic (PLEG): container finished" podID="c7b78d3a-3e98-4dc5-8037-30f38f74b2f2" containerID="32aa81e366fc6a7ea4a5623f21896ba3e72f6cbbbc2438553164e22c04717ca2" exitCode=0
Jul 09 04:30:09.716571 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:09.716203    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf" event={"ID":"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2","Type":"ContainerDied","Data":"32aa81e366fc6a7ea4a5623f21896ba3e72f6cbbbc2438553164e22c04717ca2"}
Jul 09 04:30:09.716621 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:09.716604    2582 scope.go:117] "RemoveContainer" containerID="32aa81e366fc6a7ea4a5623f21896ba3e72f6cbbbc2438553164e22c04717ca2"
Jul 09 04:30:09.717557 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:09.717533    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:30:09.717625 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:09.717598    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:30:09.717663 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:09.717629    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:30:10.645921 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:10.645860    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:30:10.724995 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:10.724952    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf" event={"ID":"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2","Type":"ContainerStarted","Data":"03fbc5072be2083be6b9526aec641ccc5d26692edd2c711150c61fd3d90a129f"}
Jul 09 04:30:10.939920 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:10.939807    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:30:10.940943 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:10.940874    2582 patch_prober.go:28] interesting pod/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 09 04:30:10.941086 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:10.940968    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf" podUID="c7b78d3a-3e98-4dc5-8037-30f38f74b2f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 09 04:30:11.940323 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:11.940286    2582 patch_prober.go:28] interesting pod/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 09 04:30:11.941464 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:11.941430    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf" podUID="c7b78d3a-3e98-4dc5-8037-30f38f74b2f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 09 04:30:12.939983 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:12.939944    2582 patch_prober.go:28] interesting pod/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 09 04:30:12.940270 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:12.940239    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf" podUID="c7b78d3a-3e98-4dc5-8037-30f38f74b2f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 09 04:30:13.940193 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:13.940155    2582 patch_prober.go:28] interesting pod/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 09 04:30:13.940786 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:13.940754    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf" podUID="c7b78d3a-3e98-4dc5-8037-30f38f74b2f2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 09 04:30:14.945167 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:14.945133    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:30:14.945555 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:14.945385    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:30:14.946178 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:14.946161    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:30:19.494367 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:19.494180    2582 patch_prober.go:28] interesting pod/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": read tcp 10.134.0.2:52672->10.134.0.38:15021: read: connection reset by peer" start-of-body=
Jul 09 04:30:19.494367 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:19.494236    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd" podUID="99b52773-3cff-4048-aad3-ab6d3c9a4f48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": read tcp 10.134.0.2:52672->10.134.0.38:15021: read: connection reset by peer"
Jul 09 04:30:19.771995 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:19.771881    2582 generic.go:356] "Generic (PLEG): container finished" podID="99b52773-3cff-4048-aad3-ab6d3c9a4f48" containerID="973fcbcdcb0d0d01874db5636f83db772624cf3441ebdc95fb56961107983ba4" exitCode=0
Jul 09 04:30:19.771995 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:19.771958    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd" event={"ID":"99b52773-3cff-4048-aad3-ab6d3c9a4f48","Type":"ContainerDied","Data":"973fcbcdcb0d0d01874db5636f83db772624cf3441ebdc95fb56961107983ba4"}
Jul 09 04:30:19.772418 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:19.772402    2582 scope.go:117] "RemoveContainer" containerID="973fcbcdcb0d0d01874db5636f83db772624cf3441ebdc95fb56961107983ba4"
Jul 09 04:30:19.773464 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:19.773439    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:30:19.773529 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:19.773507    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:30:19.773566 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:19.773546    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 09 04:30:20.778839 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:20.778801    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd" event={"ID":"99b52773-3cff-4048-aad3-ab6d3c9a4f48","Type":"ContainerStarted","Data":"5cfe0da518f6adccb6091b72f109646481997f6195faec05bdaf4235f89ad48d"}
Jul 09 04:30:20.913396 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:20.913363    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:20.913585 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:20.913547    2582 patch_prober.go:28] interesting pod/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 09 04:30:20.913662 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:20.913601    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd" podUID="99b52773-3cff-4048-aad3-ab6d3c9a4f48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 09 04:30:21.914115 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:21.914079    2582 patch_prober.go:28] interesting pod/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 09 04:30:21.914499 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:21.914137    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd" podUID="99b52773-3cff-4048-aad3-ab6d3c9a4f48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 09 04:30:22.913876 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:22.913840    2582 patch_prober.go:28] interesting pod/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 09 04:30:22.914097 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:22.913922    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd" podUID="99b52773-3cff-4048-aad3-ab6d3c9a4f48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 09 04:30:23.913787 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:23.913745    2582 patch_prober.go:28] interesting pod/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 09 04:30:23.914270 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:23.913804    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd" podUID="99b52773-3cff-4048-aad3-ab6d3c9a4f48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 09 04:30:24.916855 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:24.916824    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:24.917247 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:24.917062    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:30:24.917867 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:30:24.917851    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:31:14.158586 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:31:14.158513    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9jc2_33172081-e578-41b0-ae82-d9d52c06df2b/ovn-acl-logging/0.log"
Jul 09 04:31:14.161001 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:31:14.160976    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9jc2_33172081-e578-41b0-ae82-d9d52c06df2b/ovn-acl-logging/0.log"
Jul 09 04:36:14.183288 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:14.183252    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9jc2_33172081-e578-41b0-ae82-d9d52c06df2b/ovn-acl-logging/0.log"
Jul 09 04:36:14.186474 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:14.186452    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9jc2_33172081-e578-41b0-ae82-d9d52c06df2b/ovn-acl-logging/0.log"
Jul 09 04:36:14.311038 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:14.311016    2582 scope.go:117] "RemoveContainer" containerID="cf5b76450b10e257c90c7bcb6f3b04bf7028f0c44376f496334f6c849f7fa2c4"
Jul 09 04:36:50.540413 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:50.540332    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"]
Jul 09 04:36:50.541004 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:50.540582    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf" podUID="c7b78d3a-3e98-4dc5-8037-30f38f74b2f2" containerName="istio-proxy" containerID="cri-o://03fbc5072be2083be6b9526aec641ccc5d26692edd2c711150c61fd3d90a129f" gracePeriod=30
Jul 09 04:36:55.784789 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:55.784760    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:36:55.916448 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:55.916418    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istio-podinfo\") pod \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") "
Jul 09 04:36:55.916613 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:55.916483    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istio-envoy\") pod \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") "
Jul 09 04:36:55.916613 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:55.916503    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istio-token\") pod \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") "
Jul 09 04:36:55.916613 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:55.916530    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfsq7\" (UniqueName: \"kubernetes.io/projected/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-kube-api-access-zfsq7\") pod \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") "
Jul 09 04:36:55.916613 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:55.916553    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-workload-socket\") pod \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") "
Jul 09 04:36:55.916613 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:55.916569    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istiod-ca-cert\") pod \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") "
Jul 09 04:36:55.916613 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:55.916598    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-workload-certs\") pod \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") "
Jul 09 04:36:55.916976 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:55.916635    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-credential-socket\") pod \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") "
Jul 09 04:36:55.916976 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:55.916660    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istio-data\") pod \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\" (UID: \"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2\") "
Jul 09 04:36:55.916976 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:55.916949    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c7b78d3a-3e98-4dc5-8037-30f38f74b2f2" (UID: "c7b78d3a-3e98-4dc5-8037-30f38f74b2f2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:36:55.917136 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:55.917015    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c7b78d3a-3e98-4dc5-8037-30f38f74b2f2" (UID: "c7b78d3a-3e98-4dc5-8037-30f38f74b2f2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:36:55.917136 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:55.917084    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c7b78d3a-3e98-4dc5-8037-30f38f74b2f2" (UID: "c7b78d3a-3e98-4dc5-8037-30f38f74b2f2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:36:55.917338 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:55.917314    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c7b78d3a-3e98-4dc5-8037-30f38f74b2f2" (UID: "c7b78d3a-3e98-4dc5-8037-30f38f74b2f2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:36:55.917910 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:55.917856    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istio-data" (OuterVolumeSpecName: "istio-data") pod "c7b78d3a-3e98-4dc5-8037-30f38f74b2f2" (UID: "c7b78d3a-3e98-4dc5-8037-30f38f74b2f2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:36:55.918799 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:55.918773    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-kube-api-access-zfsq7" (OuterVolumeSpecName: "kube-api-access-zfsq7") pod "c7b78d3a-3e98-4dc5-8037-30f38f74b2f2" (UID: "c7b78d3a-3e98-4dc5-8037-30f38f74b2f2"). InnerVolumeSpecName "kube-api-access-zfsq7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:36:55.918951 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:55.918773    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c7b78d3a-3e98-4dc5-8037-30f38f74b2f2" (UID: "c7b78d3a-3e98-4dc5-8037-30f38f74b2f2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:36:55.918951 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:55.918837    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istio-token" (OuterVolumeSpecName: "istio-token") pod "c7b78d3a-3e98-4dc5-8037-30f38f74b2f2" (UID: "c7b78d3a-3e98-4dc5-8037-30f38f74b2f2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:36:55.918951 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:55.918897    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c7b78d3a-3e98-4dc5-8037-30f38f74b2f2" (UID: "c7b78d3a-3e98-4dc5-8037-30f38f74b2f2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 04:36:56.017427 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:56.017397    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:36:56.017427 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:56.017422    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:36:56.017585 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:56.017435    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfsq7\" (UniqueName: \"kubernetes.io/projected/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-kube-api-access-zfsq7\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:36:56.017585 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:56.017449    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:36:56.017585 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:56.017462    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:36:56.017585 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:56.017475    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:36:56.017585 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:56.017486    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:36:56.017585 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:56.017499    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:36:56.017585 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:56.017511    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:36:56.511102 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:56.511069    2582 generic.go:356] "Generic (PLEG): container finished" podID="c7b78d3a-3e98-4dc5-8037-30f38f74b2f2" containerID="03fbc5072be2083be6b9526aec641ccc5d26692edd2c711150c61fd3d90a129f" exitCode=0
Jul 09 04:36:56.511266 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:56.511117    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"
Jul 09 04:36:56.511266 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:56.511150    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf" event={"ID":"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2","Type":"ContainerDied","Data":"03fbc5072be2083be6b9526aec641ccc5d26692edd2c711150c61fd3d90a129f"}
Jul 09 04:36:56.511266 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:56.511208    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf" event={"ID":"c7b78d3a-3e98-4dc5-8037-30f38f74b2f2","Type":"ContainerDied","Data":"7ff14e5eff2ef4f33fd0b2a8aba4c2b92287dd4752971366d485824b03ae4c54"}
Jul 09 04:36:56.511266 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:56.511237    2582 scope.go:117] "RemoveContainer" containerID="03fbc5072be2083be6b9526aec641ccc5d26692edd2c711150c61fd3d90a129f"
Jul 09 04:36:56.519489 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:56.519470    2582 scope.go:117] "RemoveContainer" containerID="32aa81e366fc6a7ea4a5623f21896ba3e72f6cbbbc2438553164e22c04717ca2"
Jul 09 04:36:56.527734 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:56.527715    2582 scope.go:117] "RemoveContainer" containerID="03fbc5072be2083be6b9526aec641ccc5d26692edd2c711150c61fd3d90a129f"
Jul 09 04:36:56.528012 ip-10-0-134-121 kubenswrapper[2582]: E0709 04:36:56.527990    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03fbc5072be2083be6b9526aec641ccc5d26692edd2c711150c61fd3d90a129f\": container with ID starting with 03fbc5072be2083be6b9526aec641ccc5d26692edd2c711150c61fd3d90a129f not found: ID does not exist" containerID="03fbc5072be2083be6b9526aec641ccc5d26692edd2c711150c61fd3d90a129f"
Jul 09 04:36:56.528079 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:56.528042    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03fbc5072be2083be6b9526aec641ccc5d26692edd2c711150c61fd3d90a129f"} err="failed to get container status \"03fbc5072be2083be6b9526aec641ccc5d26692edd2c711150c61fd3d90a129f\": rpc error: code = NotFound desc = could not find container \"03fbc5072be2083be6b9526aec641ccc5d26692edd2c711150c61fd3d90a129f\": container with ID starting with 03fbc5072be2083be6b9526aec641ccc5d26692edd2c711150c61fd3d90a129f not found: ID does not exist"
Jul 09 04:36:56.528079 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:56.528060    2582 scope.go:117] "RemoveContainer" containerID="32aa81e366fc6a7ea4a5623f21896ba3e72f6cbbbc2438553164e22c04717ca2"
Jul 09 04:36:56.528351 ip-10-0-134-121 kubenswrapper[2582]: E0709 04:36:56.528321    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32aa81e366fc6a7ea4a5623f21896ba3e72f6cbbbc2438553164e22c04717ca2\": container with ID starting with 32aa81e366fc6a7ea4a5623f21896ba3e72f6cbbbc2438553164e22c04717ca2 not found: ID does not exist" containerID="32aa81e366fc6a7ea4a5623f21896ba3e72f6cbbbc2438553164e22c04717ca2"
Jul 09 04:36:56.528400 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:56.528354    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32aa81e366fc6a7ea4a5623f21896ba3e72f6cbbbc2438553164e22c04717ca2"} err="failed to get container status \"32aa81e366fc6a7ea4a5623f21896ba3e72f6cbbbc2438553164e22c04717ca2\": rpc error: code = NotFound desc = could not find container \"32aa81e366fc6a7ea4a5623f21896ba3e72f6cbbbc2438553164e22c04717ca2\": container with ID starting with 32aa81e366fc6a7ea4a5623f21896ba3e72f6cbbbc2438553164e22c04717ca2 not found: ID does not exist"
Jul 09 04:36:56.529281 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:56.529263    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"]
Jul 09 04:36:56.532392 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:56.532373    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-6bd312-openshift-default-74bf87bb7f-p6rmf"]
Jul 09 04:36:57.481483 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:57.481453    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"]
Jul 09 04:36:57.481907 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:57.481670    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd" podUID="99b52773-3cff-4048-aad3-ab6d3c9a4f48" containerName="istio-proxy" containerID="cri-o://5cfe0da518f6adccb6091b72f109646481997f6195faec05bdaf4235f89ad48d" gracePeriod=30
Jul 09 04:36:58.154259 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:36:58.154224    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7b78d3a-3e98-4dc5-8037-30f38f74b2f2" path="/var/lib/kubelet/pods/c7b78d3a-3e98-4dc5-8037-30f38f74b2f2/volumes"
Jul 09 04:37:02.722411 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:02.722382    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:37:02.878244 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:02.878215    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istio-podinfo\") pod \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") "
Jul 09 04:37:02.878387 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:02.878250    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istio-envoy\") pod \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") "
Jul 09 04:37:02.878387 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:02.878272    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-credential-socket\") pod \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") "
Jul 09 04:37:02.878387 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:02.878297    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istiod-ca-cert\") pod \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") "
Jul 09 04:37:02.878387 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:02.878330    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istio-data\") pod \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") "
Jul 09 04:37:02.878387 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:02.878380    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-workload-certs\") pod \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") "
Jul 09 04:37:02.878632 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:02.878406    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwkf4\" (UniqueName: \"kubernetes.io/projected/99b52773-3cff-4048-aad3-ab6d3c9a4f48-kube-api-access-rwkf4\") pod \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") "
Jul 09 04:37:02.878632 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:02.878430    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-workload-socket\") pod \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") "
Jul 09 04:37:02.878632 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:02.878464    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istio-token\") pod \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\" (UID: \"99b52773-3cff-4048-aad3-ab6d3c9a4f48\") "
Jul 09 04:37:02.878632 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:02.878595    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "99b52773-3cff-4048-aad3-ab6d3c9a4f48" (UID: "99b52773-3cff-4048-aad3-ab6d3c9a4f48"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:37:02.878839 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:02.878762    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-credential-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:37:02.878839 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:02.878767    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "99b52773-3cff-4048-aad3-ab6d3c9a4f48" (UID: "99b52773-3cff-4048-aad3-ab6d3c9a4f48"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:37:02.878839 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:02.878786    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "99b52773-3cff-4048-aad3-ab6d3c9a4f48" (UID: "99b52773-3cff-4048-aad3-ab6d3c9a4f48"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 04:37:02.879034 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:02.878932    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "99b52773-3cff-4048-aad3-ab6d3c9a4f48" (UID: "99b52773-3cff-4048-aad3-ab6d3c9a4f48"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:37:02.879352 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:02.879322    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istio-data" (OuterVolumeSpecName: "istio-data") pod "99b52773-3cff-4048-aad3-ab6d3c9a4f48" (UID: "99b52773-3cff-4048-aad3-ab6d3c9a4f48"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:37:02.880570 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:02.880538    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "99b52773-3cff-4048-aad3-ab6d3c9a4f48" (UID: "99b52773-3cff-4048-aad3-ab6d3c9a4f48"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 04:37:02.880682 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:02.880580    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "99b52773-3cff-4048-aad3-ab6d3c9a4f48" (UID: "99b52773-3cff-4048-aad3-ab6d3c9a4f48"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 09 04:37:02.880682 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:02.880629    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istio-token" (OuterVolumeSpecName: "istio-token") pod "99b52773-3cff-4048-aad3-ab6d3c9a4f48" (UID: "99b52773-3cff-4048-aad3-ab6d3c9a4f48"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:37:02.880682 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:02.880669    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99b52773-3cff-4048-aad3-ab6d3c9a4f48-kube-api-access-rwkf4" (OuterVolumeSpecName: "kube-api-access-rwkf4") pod "99b52773-3cff-4048-aad3-ab6d3c9a4f48" (UID: "99b52773-3cff-4048-aad3-ab6d3c9a4f48"). InnerVolumeSpecName "kube-api-access-rwkf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 04:37:02.979132 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:02.979109    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istiod-ca-cert\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:37:02.979132 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:02.979132    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istio-data\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:37:02.979247 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:02.979141    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-workload-certs\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:37:02.979247 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:02.979150    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwkf4\" (UniqueName: \"kubernetes.io/projected/99b52773-3cff-4048-aad3-ab6d3c9a4f48-kube-api-access-rwkf4\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:37:02.979247 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:02.979159    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-workload-socket\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:37:02.979247 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:02.979168    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istio-token\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:37:02.979247 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:02.979176    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istio-podinfo\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:37:02.979247 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:02.979183    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/99b52773-3cff-4048-aad3-ab6d3c9a4f48-istio-envoy\") on node \"ip-10-0-134-121.ec2.internal\" DevicePath \"\""
Jul 09 04:37:03.072295 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:03.072273    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-86498dd47f-v6wjh_727422d3-0211-44bf-8a2a-9e511030d075/manager/0.log"
Jul 09 04:37:03.504766 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:03.504741    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d756d6f6f-gwmvw_1abb00fc-797d-498d-afc8-927022f790fb/copy-manifests/0.log"
Jul 09 04:37:03.522111 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:03.522074    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d756d6f6f-gwmvw_1abb00fc-797d-498d-afc8-927022f790fb/manager/0.log"
Jul 09 04:37:03.551462 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:03.551431    2582 generic.go:356] "Generic (PLEG): container finished" podID="99b52773-3cff-4048-aad3-ab6d3c9a4f48" containerID="5cfe0da518f6adccb6091b72f109646481997f6195faec05bdaf4235f89ad48d" exitCode=0
Jul 09 04:37:03.551573 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:03.551496    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"
Jul 09 04:37:03.551573 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:03.551515    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd" event={"ID":"99b52773-3cff-4048-aad3-ab6d3c9a4f48","Type":"ContainerDied","Data":"5cfe0da518f6adccb6091b72f109646481997f6195faec05bdaf4235f89ad48d"}
Jul 09 04:37:03.551666 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:03.551590    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd" event={"ID":"99b52773-3cff-4048-aad3-ab6d3c9a4f48","Type":"ContainerDied","Data":"1652716a8890436632e5867d4a7cdc444df05dc441f65d79aa42a104bef5e83c"}
Jul 09 04:37:03.551666 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:03.551618    2582 scope.go:117] "RemoveContainer" containerID="5cfe0da518f6adccb6091b72f109646481997f6195faec05bdaf4235f89ad48d"
Jul 09 04:37:03.563449 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:03.563432    2582 scope.go:117] "RemoveContainer" containerID="973fcbcdcb0d0d01874db5636f83db772624cf3441ebdc95fb56961107983ba4"
Jul 09 04:37:03.570466 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:03.570449    2582 scope.go:117] "RemoveContainer" containerID="5cfe0da518f6adccb6091b72f109646481997f6195faec05bdaf4235f89ad48d"
Jul 09 04:37:03.570699 ip-10-0-134-121 kubenswrapper[2582]: E0709 04:37:03.570678    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cfe0da518f6adccb6091b72f109646481997f6195faec05bdaf4235f89ad48d\": container with ID starting with 5cfe0da518f6adccb6091b72f109646481997f6195faec05bdaf4235f89ad48d not found: ID does not exist" containerID="5cfe0da518f6adccb6091b72f109646481997f6195faec05bdaf4235f89ad48d"
Jul 09 04:37:03.570748 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:03.570706    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cfe0da518f6adccb6091b72f109646481997f6195faec05bdaf4235f89ad48d"} err="failed to get container status \"5cfe0da518f6adccb6091b72f109646481997f6195faec05bdaf4235f89ad48d\": rpc error: code = NotFound desc = could not find container \"5cfe0da518f6adccb6091b72f109646481997f6195faec05bdaf4235f89ad48d\": container with ID starting with 5cfe0da518f6adccb6091b72f109646481997f6195faec05bdaf4235f89ad48d not found: ID does not exist"
Jul 09 04:37:03.570748 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:03.570721    2582 scope.go:117] "RemoveContainer" containerID="973fcbcdcb0d0d01874db5636f83db772624cf3441ebdc95fb56961107983ba4"
Jul 09 04:37:03.570971 ip-10-0-134-121 kubenswrapper[2582]: E0709 04:37:03.570953    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"973fcbcdcb0d0d01874db5636f83db772624cf3441ebdc95fb56961107983ba4\": container with ID starting with 973fcbcdcb0d0d01874db5636f83db772624cf3441ebdc95fb56961107983ba4 not found: ID does not exist" containerID="973fcbcdcb0d0d01874db5636f83db772624cf3441ebdc95fb56961107983ba4"
Jul 09 04:37:03.571019 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:03.570977    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"973fcbcdcb0d0d01874db5636f83db772624cf3441ebdc95fb56961107983ba4"} err="failed to get container status \"973fcbcdcb0d0d01874db5636f83db772624cf3441ebdc95fb56961107983ba4\": rpc error: code = NotFound desc = could not find container \"973fcbcdcb0d0d01874db5636f83db772624cf3441ebdc95fb56961107983ba4\": container with ID starting with 973fcbcdcb0d0d01874db5636f83db772624cf3441ebdc95fb56961107983ba4 not found: ID does not exist"
Jul 09 04:37:03.575406 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:03.575386    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"]
Jul 09 04:37:03.580091 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:03.580070    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-589b59-openshift-default-67cfb5c59-mxlsd"]
Jul 09 04:37:04.154098 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:04.154069    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99b52773-3cff-4048-aad3-ab6d3c9a4f48" path="/var/lib/kubelet/pods/99b52773-3cff-4048-aad3-ab6d3c9a4f48/volumes"
Jul 09 04:37:06.373736 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:06.373703    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4f99q5_856dc76d-4779-4d58-95a0-c07a0196d498/istio-proxy/0.log"
Jul 09 04:37:06.491087 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:06.491044    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lwtn9_72461646-3392-44e7-a9ba-5085d22cbb88/discovery/0.log"
Jul 09 04:37:06.814055 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:06.813979    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ks8fc_25e8cf62-ee7f-4101-968c-f30ac9967442/istio-proxy/1.log"
Jul 09 04:37:07.559445 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:07.559417    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-5xc77_c982bbf0-3c89-4db8-975e-b76c32bc23fc/main/0.log"
Jul 09 04:37:07.665285 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:07.665261    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-9lz2g_8e5e0462-2392-417e-a6f5-8fe4a98e9fad/main/0.log"
Jul 09 04:37:07.771019 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:07.770994    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbpct5g_466bab5e-41dc-415d-ab25-971494796aa1/main/0.log"
Jul 09 04:37:14.252281 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:14.252228    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pckd6_babf27a7-be72-48d0-b348-d2697acd6584/global-pull-secret-syncer/0.log"
Jul 09 04:37:14.428148 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:14.428105    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-x2dmv_fda0b7cf-903a-43d4-b8d9-769a9f62a7ff/konnectivity-agent/0.log"
Jul 09 04:37:14.481342 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:14.481315    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-121.ec2.internal_b2391f67a4d0a7377532ffd51db564eb/haproxy/0.log"
Jul 09 04:37:21.807179 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:21.807148    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hcs2f_6e7fce95-2eaa-4b3b-a7bb-86db7a41b637/node-exporter/0.log"
Jul 09 04:37:21.825098 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:21.825075    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hcs2f_6e7fce95-2eaa-4b3b-a7bb-86db7a41b637/kube-rbac-proxy/0.log"
Jul 09 04:37:21.844363 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:21.844345    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hcs2f_6e7fce95-2eaa-4b3b-a7bb-86db7a41b637/init-textfile/0.log"
Jul 09 04:37:22.062019 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:22.061954    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2de2d64c-3c67-4013-85ee-381cac7650c8/prometheus/0.log"
Jul 09 04:37:22.080726 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:22.080704    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2de2d64c-3c67-4013-85ee-381cac7650c8/config-reloader/0.log"
Jul 09 04:37:22.105399 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:22.105376    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2de2d64c-3c67-4013-85ee-381cac7650c8/thanos-sidecar/0.log"
Jul 09 04:37:22.124832 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:22.124816    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2de2d64c-3c67-4013-85ee-381cac7650c8/kube-rbac-proxy-web/0.log"
Jul 09 04:37:22.144083 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:22.144056    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2de2d64c-3c67-4013-85ee-381cac7650c8/kube-rbac-proxy/0.log"
Jul 09 04:37:22.163464 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:22.163441    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2de2d64c-3c67-4013-85ee-381cac7650c8/kube-rbac-proxy-thanos/0.log"
Jul 09 04:37:22.183293 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:22.183272    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2de2d64c-3c67-4013-85ee-381cac7650c8/init-config-reloader/0.log"
Jul 09 04:37:24.198169 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.198141    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2mv72/perf-node-gather-daemonset-68bqj"]
Jul 09 04:37:24.198531 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.198444    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99b52773-3cff-4048-aad3-ab6d3c9a4f48" containerName="istio-proxy"
Jul 09 04:37:24.198531 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.198456    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="99b52773-3cff-4048-aad3-ab6d3c9a4f48" containerName="istio-proxy"
Jul 09 04:37:24.198531 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.198464    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7b78d3a-3e98-4dc5-8037-30f38f74b2f2" containerName="istio-proxy"
Jul 09 04:37:24.198531 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.198469    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7b78d3a-3e98-4dc5-8037-30f38f74b2f2" containerName="istio-proxy"
Jul 09 04:37:24.198531 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.198477    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24797b11-3cb3-4153-a584-7ea0fa0c8279" containerName="istio-proxy"
Jul 09 04:37:24.198531 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.198483    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="24797b11-3cb3-4153-a584-7ea0fa0c8279" containerName="istio-proxy"
Jul 09 04:37:24.198531 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.198493    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99b52773-3cff-4048-aad3-ab6d3c9a4f48" containerName="istio-proxy"
Jul 09 04:37:24.198531 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.198498    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="99b52773-3cff-4048-aad3-ab6d3c9a4f48" containerName="istio-proxy"
Jul 09 04:37:24.198531 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.198507    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7b78d3a-3e98-4dc5-8037-30f38f74b2f2" containerName="istio-proxy"
Jul 09 04:37:24.198531 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.198512    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7b78d3a-3e98-4dc5-8037-30f38f74b2f2" containerName="istio-proxy"
Jul 09 04:37:24.198845 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.198560    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="99b52773-3cff-4048-aad3-ab6d3c9a4f48" containerName="istio-proxy"
Jul 09 04:37:24.198845 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.198567    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="99b52773-3cff-4048-aad3-ab6d3c9a4f48" containerName="istio-proxy"
Jul 09 04:37:24.198845 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.198576    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7b78d3a-3e98-4dc5-8037-30f38f74b2f2" containerName="istio-proxy"
Jul 09 04:37:24.198845 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.198582    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7b78d3a-3e98-4dc5-8037-30f38f74b2f2" containerName="istio-proxy"
Jul 09 04:37:24.201714 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.201690    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-68bqj"
Jul 09 04:37:24.204664 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.204639    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2mv72\"/\"kube-root-ca.crt\""
Jul 09 04:37:24.206014 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.205994    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2mv72\"/\"default-dockercfg-cgqvf\""
Jul 09 04:37:24.206111 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.205996    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2mv72\"/\"openshift-service-ca.crt\""
Jul 09 04:37:24.210020 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.209996    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2mv72/perf-node-gather-daemonset-68bqj"]
Jul 09 04:37:24.250648 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.250623    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b7edf2c3-857d-46d2-bfec-bfd8db664be2-podres\") pod \"perf-node-gather-daemonset-68bqj\" (UID: \"b7edf2c3-857d-46d2-bfec-bfd8db664be2\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-68bqj"
Jul 09 04:37:24.250766 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.250673    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7edf2c3-857d-46d2-bfec-bfd8db664be2-sys\") pod \"perf-node-gather-daemonset-68bqj\" (UID: \"b7edf2c3-857d-46d2-bfec-bfd8db664be2\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-68bqj"
Jul 09 04:37:24.250766 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.250690    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgg54\" (UniqueName: \"kubernetes.io/projected/b7edf2c3-857d-46d2-bfec-bfd8db664be2-kube-api-access-zgg54\") pod \"perf-node-gather-daemonset-68bqj\" (UID: \"b7edf2c3-857d-46d2-bfec-bfd8db664be2\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-68bqj"
Jul 09 04:37:24.250766 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.250721    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7edf2c3-857d-46d2-bfec-bfd8db664be2-lib-modules\") pod \"perf-node-gather-daemonset-68bqj\" (UID: \"b7edf2c3-857d-46d2-bfec-bfd8db664be2\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-68bqj"
Jul 09 04:37:24.250766 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.250764    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b7edf2c3-857d-46d2-bfec-bfd8db664be2-proc\") pod \"perf-node-gather-daemonset-68bqj\" (UID: \"b7edf2c3-857d-46d2-bfec-bfd8db664be2\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-68bqj"
Jul 09 04:37:24.351681 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.351661    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgg54\" (UniqueName: \"kubernetes.io/projected/b7edf2c3-857d-46d2-bfec-bfd8db664be2-kube-api-access-zgg54\") pod \"perf-node-gather-daemonset-68bqj\" (UID: \"b7edf2c3-857d-46d2-bfec-bfd8db664be2\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-68bqj"
Jul 09 04:37:24.351792 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.351691    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7edf2c3-857d-46d2-bfec-bfd8db664be2-lib-modules\") pod \"perf-node-gather-daemonset-68bqj\" (UID: \"b7edf2c3-857d-46d2-bfec-bfd8db664be2\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-68bqj"
Jul 09 04:37:24.351792 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.351731    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b7edf2c3-857d-46d2-bfec-bfd8db664be2-proc\") pod \"perf-node-gather-daemonset-68bqj\" (UID: \"b7edf2c3-857d-46d2-bfec-bfd8db664be2\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-68bqj"
Jul 09 04:37:24.351792 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.351756    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b7edf2c3-857d-46d2-bfec-bfd8db664be2-podres\") pod \"perf-node-gather-daemonset-68bqj\" (UID: \"b7edf2c3-857d-46d2-bfec-bfd8db664be2\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-68bqj"
Jul 09 04:37:24.351946 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.351801    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7edf2c3-857d-46d2-bfec-bfd8db664be2-sys\") pod \"perf-node-gather-daemonset-68bqj\" (UID: \"b7edf2c3-857d-46d2-bfec-bfd8db664be2\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-68bqj"
Jul 09 04:37:24.351946 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.351863    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7edf2c3-857d-46d2-bfec-bfd8db664be2-sys\") pod \"perf-node-gather-daemonset-68bqj\" (UID: \"b7edf2c3-857d-46d2-bfec-bfd8db664be2\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-68bqj"
Jul 09 04:37:24.351946 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.351871    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b7edf2c3-857d-46d2-bfec-bfd8db664be2-proc\") pod \"perf-node-gather-daemonset-68bqj\" (UID: \"b7edf2c3-857d-46d2-bfec-bfd8db664be2\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-68bqj"
Jul 09 04:37:24.351946 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.351871    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7edf2c3-857d-46d2-bfec-bfd8db664be2-lib-modules\") pod \"perf-node-gather-daemonset-68bqj\" (UID: \"b7edf2c3-857d-46d2-bfec-bfd8db664be2\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-68bqj"
Jul 09 04:37:24.352090 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.351951    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b7edf2c3-857d-46d2-bfec-bfd8db664be2-podres\") pod \"perf-node-gather-daemonset-68bqj\" (UID: \"b7edf2c3-857d-46d2-bfec-bfd8db664be2\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-68bqj"
Jul 09 04:37:24.361122 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.361103    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgg54\" (UniqueName: \"kubernetes.io/projected/b7edf2c3-857d-46d2-bfec-bfd8db664be2-kube-api-access-zgg54\") pod \"perf-node-gather-daemonset-68bqj\" (UID: \"b7edf2c3-857d-46d2-bfec-bfd8db664be2\") " pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-68bqj"
Jul 09 04:37:24.512346 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.512281    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-68bqj"
Jul 09 04:37:24.638641 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:24.638617    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2mv72/perf-node-gather-daemonset-68bqj"]
Jul 09 04:37:24.640503 ip-10-0-134-121 kubenswrapper[2582]: W0709 04:37:24.640476    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb7edf2c3_857d_46d2_bfec_bfd8db664be2.slice/crio-a9fa1dd01895556a89d58781e08ab404cd44a8670d70bd10b1abccd461a56f77 WatchSource:0}: Error finding container a9fa1dd01895556a89d58781e08ab404cd44a8670d70bd10b1abccd461a56f77: Status 404 returned error can't find the container with id a9fa1dd01895556a89d58781e08ab404cd44a8670d70bd10b1abccd461a56f77
Jul 09 04:37:25.640349 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:25.640304    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-68bqj" event={"ID":"b7edf2c3-857d-46d2-bfec-bfd8db664be2","Type":"ContainerStarted","Data":"73489f836d55b67a603b72a18063a282baa07d0f397cde1e657f78b17f4c983b"}
Jul 09 04:37:25.640706 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:25.640393    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-68bqj" event={"ID":"b7edf2c3-857d-46d2-bfec-bfd8db664be2","Type":"ContainerStarted","Data":"a9fa1dd01895556a89d58781e08ab404cd44a8670d70bd10b1abccd461a56f77"}
Jul 09 04:37:25.640706 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:25.640419    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-68bqj"
Jul 09 04:37:25.656524 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:25.656480    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-68bqj" podStartSLOduration=1.656467593 podStartE2EDuration="1.656467593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 04:37:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 04:37:25.655358084 +0000 UTC m=+2472.099488169" watchObservedRunningTime="2026-07-09 04:37:25.656467593 +0000 UTC m=+2472.100597737"
Jul 09 04:37:26.537307 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:26.537270    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9klq9_6e5de089-67a0-409d-b5dc-4ac5c979b266/dns/0.log"
Jul 09 04:37:26.555640 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:26.555605    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9klq9_6e5de089-67a0-409d-b5dc-4ac5c979b266/kube-rbac-proxy/0.log"
Jul 09 04:37:26.663182 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:26.663160    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xh8sc_6ee14835-1a14-4e38-aee4-078038e51d39/dns-node-resolver/0.log"
Jul 09 04:37:27.180900 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:27.180855    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7m8zc_5c0183f4-6c4a-4d0f-9455-79191c11022e/node-ca/0.log"
Jul 09 04:37:28.134109 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:28.134048    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4f99q5_856dc76d-4779-4d58-95a0-c07a0196d498/istio-proxy/0.log"
Jul 09 04:37:28.325044 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:28.325018    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lwtn9_72461646-3392-44e7-a9ba-5085d22cbb88/discovery/0.log"
Jul 09 04:37:28.393591 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:28.393522    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ks8fc_25e8cf62-ee7f-4101-968c-f30ac9967442/istio-proxy/0.log"
Jul 09 04:37:28.448169 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:28.448123    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ks8fc_25e8cf62-ee7f-4101-968c-f30ac9967442/istio-proxy/1.log"
Jul 09 04:37:29.225191 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:29.225163    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-89ht9_6b55c1aa-edd7-4de7-8379-ec449c32ed67/serve-healthcheck-canary/0.log"
Jul 09 04:37:29.864672 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:29.864641    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m78bd_3ddbc84e-053b-4692-8d2a-7312ffde9752/kube-rbac-proxy/0.log"
Jul 09 04:37:29.883898 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:29.883863    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m78bd_3ddbc84e-053b-4692-8d2a-7312ffde9752/exporter/0.log"
Jul 09 04:37:29.904479 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:29.904426    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-m78bd_3ddbc84e-053b-4692-8d2a-7312ffde9752/extractor/0.log"
Jul 09 04:37:31.653601 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:31.653575    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2mv72/perf-node-gather-daemonset-68bqj"
Jul 09 04:37:32.244573 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:32.244522    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-86498dd47f-v6wjh_727422d3-0211-44bf-8a2a-9e511030d075/manager/0.log"
Jul 09 04:37:32.488543 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:32.488513    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d756d6f6f-gwmvw_1abb00fc-797d-498d-afc8-927022f790fb/manager/0.log"
Jul 09 04:37:32.503378 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:32.503323    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d756d6f6f-gwmvw_1abb00fc-797d-498d-afc8-927022f790fb/copy-manifests/0.log"
Jul 09 04:37:33.918092 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:33.918066    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-789458d7cb-gc7dh_32e98a40-2535-4314-b00c-f13e5e1f5205/manager/0.log"
Jul 09 04:37:34.469479 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:34.469402    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4f99q5_856dc76d-4779-4d58-95a0-c07a0196d498/istio-proxy/0.log"
Jul 09 04:37:34.653920 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:34.653876    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lwtn9_72461646-3392-44e7-a9ba-5085d22cbb88/discovery/0.log"
Jul 09 04:37:34.710413 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:34.710387    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ks8fc_25e8cf62-ee7f-4101-968c-f30ac9967442/istio-proxy/0.log"
Jul 09 04:37:34.766306 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:34.766226    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ks8fc_25e8cf62-ee7f-4101-968c-f30ac9967442/istio-proxy/1.log"
Jul 09 04:37:36.039428 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:36.039363    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4f99q5_856dc76d-4779-4d58-95a0-c07a0196d498/istio-proxy/0.log"
Jul 09 04:37:36.233073 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:36.233048    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-lwtn9_72461646-3392-44e7-a9ba-5085d22cbb88/discovery/0.log"
Jul 09 04:37:36.278804 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:36.278775    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ks8fc_25e8cf62-ee7f-4101-968c-f30ac9967442/istio-proxy/0.log"
Jul 09 04:37:36.339875 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:36.339807    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-ks8fc_25e8cf62-ee7f-4101-968c-f30ac9967442/istio-proxy/1.log"
Jul 09 04:37:38.802331 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:38.802305    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-tf5wr_1a6cb4fd-e8a1-4d8f-92d1-04b37ab2fc0e/migrator/0.log"
Jul 09 04:37:38.821294 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:38.821265    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-tf5wr_1a6cb4fd-e8a1-4d8f-92d1-04b37ab2fc0e/graceful-termination/0.log"
Jul 09 04:37:40.153422 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:40.153392    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2dg7h_4b516d27-7195-483b-af5d-d68ba511a331/kube-multus-additional-cni-plugins/0.log"
Jul 09 04:37:40.176738 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:40.176708    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2dg7h_4b516d27-7195-483b-af5d-d68ba511a331/egress-router-binary-copy/0.log"
Jul 09 04:37:40.196395 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:40.196368    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2dg7h_4b516d27-7195-483b-af5d-d68ba511a331/cni-plugins/0.log"
Jul 09 04:37:40.218431 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:40.218403    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2dg7h_4b516d27-7195-483b-af5d-d68ba511a331/bond-cni-plugin/0.log"
Jul 09 04:37:40.237609 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:40.237589    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2dg7h_4b516d27-7195-483b-af5d-d68ba511a331/routeoverride-cni/0.log"
Jul 09 04:37:40.258635 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:40.258608    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2dg7h_4b516d27-7195-483b-af5d-d68ba511a331/whereabouts-cni-bincopy/0.log"
Jul 09 04:37:40.277971 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:40.277945    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2dg7h_4b516d27-7195-483b-af5d-d68ba511a331/whereabouts-cni/0.log"
Jul 09 04:37:40.606818 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:40.606791    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gtc4l_d6e75e5d-b20e-4dc5-9531-940a7b7f13f4/kube-multus/0.log"
Jul 09 04:37:40.627531 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:40.627508    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7tm6g_bf8932b3-3cac-4cb8-a827-361f7df4639d/network-metrics-daemon/0.log"
Jul 09 04:37:40.644638 ip-10-0-134-121 kubenswrapper[2582]: I0709 04:37:40.644616    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7tm6g_bf8932b3-3cac-4cb8-a827-361f7df4639d/kube-rbac-proxy/0.log"