Jul 09 16:51:00.016796 ip-10-0-128-34 systemd[1]: Starting Kubernetes Kubelet... Jul 09 16:51:00.406106 ip-10-0-128-34 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 16:51:00.406106 ip-10-0-128-34 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 16:51:00.406106 ip-10-0-128-34 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 16:51:00.406106 ip-10-0-128-34 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 16:51:00.406106 ip-10-0-128-34 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 16:51:00.406912 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.406185 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 16:51:00.411793 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411770 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:51:00.411793 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411789 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:51:00.411793 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411794 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:51:00.411793 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411798 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:51:00.411793 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411802 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:51:00.412106 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411806 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:51:00.412106 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411810 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:51:00.412106 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411814 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:51:00.412106 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411821 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:51:00.412106 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411828 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:51:00.412106 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411832 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:51:00.412106 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411835 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:51:00.412106 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411839 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:51:00.412106 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411843 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:51:00.412106 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411848 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:51:00.412106 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411857 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:51:00.412106 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411861 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:51:00.412106 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411865 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:51:00.412106 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411869 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:51:00.412106 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411872 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:51:00.412106 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411876 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:51:00.412106 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411880 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:51:00.412106 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411884 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:51:00.412106 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411888 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:51:00.412895 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411891 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:51:00.412895 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411895 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:51:00.412895 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411899 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:51:00.412895 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411903 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:51:00.412895 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411908 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:51:00.412895 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411912 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:51:00.412895 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411916 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:51:00.412895 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411921 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:51:00.412895 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411927 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:51:00.412895 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411932 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:51:00.412895 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411936 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:51:00.412895 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411940 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:51:00.412895 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411946 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:51:00.412895 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411951 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:51:00.412895 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411957 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:51:00.412895 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411962 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:51:00.412895 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411967 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:51:00.412895 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411971 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:51:00.412895 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411976 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:51:00.413612 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411980 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:51:00.413612 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411984 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:51:00.413612 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411989 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:51:00.413612 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411993 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:51:00.413612 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.411997 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:51:00.413612 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412002 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:51:00.413612 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412006 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:51:00.413612 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412011 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:51:00.413612 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412015 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:51:00.413612 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412019 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:51:00.413612 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412024 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:51:00.413612 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412028 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:51:00.413612 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412033 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:51:00.413612 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412037 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:51:00.413612 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412042 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:51:00.413612 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412046 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:51:00.413612 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412050 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:51:00.413612 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412055 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:51:00.413612 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412059 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:51:00.413612 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412063 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:51:00.413612 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412068 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:51:00.414126 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412072 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:51:00.414126 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412081 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:51:00.414126 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412087 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:51:00.414126 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412092 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:51:00.414126 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412096 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:51:00.414126 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412102 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:51:00.414126 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412107 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:51:00.414126 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412112 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:51:00.414126 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412119 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:51:00.414126 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412124 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:51:00.414126 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412129 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:51:00.414126 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412134 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:51:00.414126 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412139 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:51:00.414126 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412143 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:51:00.414126 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412148 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:51:00.414126 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412152 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:51:00.414126 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412156 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:51:00.414126 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412161 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:51:00.414126 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412165 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:51:00.414715 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412172 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:51:00.414715 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412177 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:51:00.414715 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412181 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:51:00.414715 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412186 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:51:00.414715 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412192 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:51:00.414715 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412197 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:51:00.414715 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412201 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:51:00.414715 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412205 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:51:00.414715 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412210 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:51:00.414715 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412214 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:51:00.414715 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412219 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:51:00.414715 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412223 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:51:00.414715 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412228 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:51:00.414715 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412233 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:51:00.414715 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412237 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:51:00.414715 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.412241 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:51:00.415798 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415781 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:51:00.415798 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415798 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:51:00.415870 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415803 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:51:00.415870 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415806 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:51:00.415870 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415809 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:51:00.415870 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415812 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:51:00.415870 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415815 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:51:00.415870 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415818 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:51:00.415870 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415821 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:51:00.415870 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415824 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:51:00.415870 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415826 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:51:00.415870 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415829 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:51:00.415870 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415831 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:51:00.415870 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415834 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:51:00.415870 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415836 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:51:00.415870 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415839 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:51:00.415870 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415841 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:51:00.415870 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415844 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:51:00.415870 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415846 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:51:00.415870 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415849 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:51:00.415870 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415851 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:51:00.415870 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415853 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:51:00.416362 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415856 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:51:00.416362 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415858 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:51:00.416362 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415861 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:51:00.416362 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415863 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:51:00.416362 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415866 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:51:00.416362 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415868 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:51:00.416362 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415871 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:51:00.416362 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415873 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:51:00.416362 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415876 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:51:00.416362 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415881 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:51:00.416362 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415884 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:51:00.416362 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415888 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:51:00.416362 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415890 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:51:00.416362 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415892 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:51:00.416362 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415895 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:51:00.416362 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415897 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:51:00.416362 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415900 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:51:00.416362 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415902 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:51:00.416362 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415904 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:51:00.416362 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415907 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:51:00.416918 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415909 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:51:00.416918 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415911 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:51:00.416918 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415914 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:51:00.416918 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415916 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:51:00.416918 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415919 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:51:00.416918 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415922 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:51:00.416918 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415924 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:51:00.416918 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415927 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:51:00.416918 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415929 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:51:00.416918 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415932 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:51:00.416918 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415934 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:51:00.416918 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415937 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:51:00.416918 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415940 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:51:00.416918 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415944 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:51:00.416918 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415946 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:51:00.416918 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415949 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:51:00.416918 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415951 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:51:00.416918 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415954 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:51:00.416918 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415956 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:51:00.417381 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415959 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:51:00.417381 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415963 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:51:00.417381 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415966 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:51:00.417381 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415969 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:51:00.417381 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415972 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:51:00.417381 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415975 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:51:00.417381 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415978 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:51:00.417381 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415980 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:51:00.417381 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415983 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:51:00.417381 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415986 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:51:00.417381 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415988 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:51:00.417381 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415991 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:51:00.417381 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415994 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:51:00.417381 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415996 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:51:00.417381 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.415999 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:51:00.417381 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416001 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:51:00.417381 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416004 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:51:00.417381 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416006 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:51:00.417381 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416010 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:51:00.417381 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416012 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:51:00.417896 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416015 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:51:00.417896 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416018 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:51:00.417896 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416021 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:51:00.417896 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416024 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:51:00.417896 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416026 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:51:00.417896 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416029 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:51:00.417896 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416031 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:51:00.417896 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416035 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:51:00.417896 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416038 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:51:00.417896 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416041 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:51:00.417896 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416044 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:51:00.417896 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416046 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:51:00.417896 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416049 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:51:00.417896 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416051 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:51:00.417896 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416054 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:51:00.417896 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416057 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:51:00.417896 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416059 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:51:00.417896 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416062 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:51:00.417896 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416969 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:51:00.418353 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416978 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:51:00.418353 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416982 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:51:00.418353 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416985 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:51:00.418353 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416987 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:51:00.418353 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416992 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:51:00.418353 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416995 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:51:00.418353 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.416998 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:51:00.418353 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417001 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:51:00.418353 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417003 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:51:00.418353 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417006 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:51:00.418353 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417009 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:51:00.418353 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417011 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:51:00.418353 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417013 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:51:00.418353 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417016 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:51:00.418353 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417018 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:51:00.418353 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417022 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:51:00.418353 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417024 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:51:00.418353 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417027 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:51:00.418353 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417029 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:51:00.418836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417032 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:51:00.418836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417034 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:51:00.418836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417037 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:51:00.418836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417040 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:51:00.418836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417042 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:51:00.418836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417045 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:51:00.418836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417047 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:51:00.418836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417050 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:51:00.418836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417052 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:51:00.418836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417071 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:51:00.418836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417076 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:51:00.418836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417079 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:51:00.418836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417082 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:51:00.418836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417085 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:51:00.418836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417088 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:51:00.418836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417091 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:51:00.418836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417093 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:51:00.418836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417096 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:51:00.418836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417099 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:51:00.418836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417101 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:51:00.419319 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417104 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:51:00.419319 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417106 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:51:00.419319 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417108 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:51:00.419319 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417111 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:51:00.419319 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417113 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:51:00.419319 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417116 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:51:00.419319 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417118 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:51:00.419319 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417121 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:51:00.419319 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417123 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:51:00.419319 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417126 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:51:00.419319 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417129 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:51:00.419319 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417132 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:51:00.419319 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417134 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:51:00.419319 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417137 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:51:00.419319 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417139 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:51:00.419319 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417142 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:51:00.419319 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417144 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:51:00.419319 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417147 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:51:00.419319 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417149 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:51:00.419319 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417151 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:51:00.419836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417154 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:51:00.419836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417157 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:51:00.419836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417159 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:51:00.419836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417162 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:51:00.419836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417164 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:51:00.419836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417166 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:51:00.419836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417170 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:51:00.419836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417173 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:51:00.419836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417175 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:51:00.419836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417178 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:51:00.419836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417182 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:51:00.419836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417185 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:51:00.419836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417188 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:51:00.419836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417190 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:51:00.419836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417192 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:51:00.419836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417195 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:51:00.419836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417198 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:51:00.419836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417200 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:51:00.419836 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417202 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:51:00.420293 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417205 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:51:00.420293 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417207 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:51:00.420293 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417209 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:51:00.420293 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417212 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:51:00.420293 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417215 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:51:00.420293 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417218 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:51:00.420293 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417220 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:51:00.420293 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417223 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:51:00.420293 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417225 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:51:00.420293 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417228 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:51:00.420293 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417230 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:51:00.420293 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417232 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:51:00.420293 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417235 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:51:00.420293 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417237 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:51:00.420293 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417242 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:51:00.420293 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417244 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:51:00.420293 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417247 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:51:00.420293 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417249 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:51:00.420293 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417252 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:51:00.420293 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417254 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:51:00.420799 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417320 2580 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 16:51:00.420799 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417327 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 16:51:00.420799 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417332 2580 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 16:51:00.420799 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417337 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 16:51:00.420799 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417349 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 16:51:00.420799 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417353 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 16:51:00.420799 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417357 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 16:51:00.420799 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417361 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 16:51:00.420799 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417364 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 16:51:00.420799 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417366 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 16:51:00.420799 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417369 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 16:51:00.420799 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417373 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 16:51:00.420799 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417376 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 16:51:00.420799 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417379 2580 flags.go:64] FLAG: --cgroup-root="" Jul 09 16:51:00.420799 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417381 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 16:51:00.420799 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417384 2580 flags.go:64] FLAG: --client-ca-file="" Jul 09 16:51:00.420799 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417389 2580 flags.go:64] FLAG: --cloud-provider="external" Jul 09 16:51:00.420799 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417392 2580 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 16:51:00.420799 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417397 2580 flags.go:64] FLAG: --cluster-domain="" Jul 09 16:51:00.420799 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417400 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 16:51:00.420799 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417402 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 16:51:00.420799 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417405 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 16:51:00.420799 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417408 2580 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 16:51:00.420799 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417412 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 16:51:00.421359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417415 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 16:51:00.421359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417418 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 16:51:00.421359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417423 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 16:51:00.421359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417426 2580 flags.go:64] FLAG: --contention-profiling="false" Jul 09 16:51:00.421359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417429 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 16:51:00.421359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417432 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 16:51:00.421359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417435 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 16:51:00.421359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417438 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 16:51:00.421359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417442 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 16:51:00.421359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417445 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 16:51:00.421359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417448 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 16:51:00.421359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417450 2580 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 16:51:00.421359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417453 2580 flags.go:64] FLAG: --enable-server="true" Jul 09 16:51:00.421359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417456 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 16:51:00.421359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417460 2580 flags.go:64] FLAG: --event-burst="100" Jul 09 16:51:00.421359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417463 2580 flags.go:64] FLAG: --event-qps="50" Jul 09 16:51:00.421359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417466 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 16:51:00.421359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417469 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 16:51:00.421359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417471 2580 flags.go:64] FLAG: --eviction-hard="" Jul 09 16:51:00.421359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417487 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 16:51:00.421359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417491 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 16:51:00.421359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417493 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 16:51:00.421359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417496 2580 flags.go:64] FLAG: --eviction-soft="" Jul 09 16:51:00.421359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417499 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 16:51:00.421359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417502 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 16:51:00.422050 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417505 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 16:51:00.422050 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417508 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 16:51:00.422050 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417511 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 16:51:00.422050 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417514 2580 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 16:51:00.422050 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417516 2580 flags.go:64] FLAG: --feature-gates="" Jul 09 16:51:00.422050 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417520 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 16:51:00.422050 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417523 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 16:51:00.422050 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417526 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 16:51:00.422050 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417529 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 16:51:00.422050 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417533 2580 flags.go:64] FLAG: --healthz-port="10248" Jul 09 16:51:00.422050 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417536 2580 flags.go:64] FLAG: --help="false" Jul 09 16:51:00.422050 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417539 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-128-34.ec2.internal" Jul 09 16:51:00.422050 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417542 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 16:51:00.422050 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417545 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 16:51:00.422050 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417548 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 16:51:00.422050 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417551 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 16:51:00.422050 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417554 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 16:51:00.422050 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417557 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 16:51:00.422050 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417559 2580 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 16:51:00.422050 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417562 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 16:51:00.422050 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417565 2580 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 16:51:00.422050 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417567 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 16:51:00.422050 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417570 2580 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 16:51:00.422050 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417573 2580 flags.go:64] FLAG: --kube-reserved="" Jul 09 16:51:00.422662 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417576 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 16:51:00.422662 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417578 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 16:51:00.422662 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417581 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 16:51:00.422662 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417584 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 16:51:00.422662 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417586 2580 flags.go:64] FLAG: --lock-file="" Jul 09 16:51:00.422662 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417589 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 16:51:00.422662 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417591 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 16:51:00.422662 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417595 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 16:51:00.422662 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417601 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 16:51:00.422662 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417604 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 16:51:00.422662 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417607 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 16:51:00.422662 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417609 2580 flags.go:64] FLAG: --logging-format="text" Jul 09 16:51:00.422662 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417612 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 16:51:00.422662 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417615 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 16:51:00.422662 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417618 2580 flags.go:64] FLAG: --manifest-url="" Jul 09 16:51:00.422662 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417620 2580 flags.go:64] FLAG: --manifest-url-header="" Jul 09 16:51:00.422662 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417625 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 16:51:00.422662 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417629 2580 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 16:51:00.422662 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417633 2580 flags.go:64] FLAG: --max-pods="110" Jul 09 16:51:00.422662 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417636 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 16:51:00.422662 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417639 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 16:51:00.422662 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417642 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 16:51:00.422662 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417645 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 16:51:00.422662 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417648 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 16:51:00.422662 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417651 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 16:51:00.423289 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417653 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 16:51:00.423289 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417660 2580 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 16:51:00.423289 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417664 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 16:51:00.423289 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417666 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 16:51:00.423289 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417670 2580 flags.go:64] FLAG: --pod-cidr="" Jul 09 16:51:00.423289 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417673 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 09 16:51:00.423289 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417679 2580 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 16:51:00.423289 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417682 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 16:51:00.423289 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417685 2580 flags.go:64] FLAG: --pods-per-core="0" Jul 09 16:51:00.423289 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417687 2580 flags.go:64] FLAG: --port="10250" Jul 09 16:51:00.423289 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417690 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 16:51:00.423289 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417693 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-009e4ae91763d0d82" Jul 09 16:51:00.423289 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417696 2580 flags.go:64] FLAG: --qos-reserved="" Jul 09 16:51:00.423289 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417699 2580 flags.go:64] FLAG: --read-only-port="10255" Jul 09 16:51:00.423289 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417702 2580 flags.go:64] FLAG: --register-node="true" Jul 09 16:51:00.423289 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417704 2580 flags.go:64] FLAG: --register-with-taints="" Jul 09 16:51:00.423289 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417708 2580 flags.go:64] FLAG: --registry-burst="10" Jul 09 16:51:00.423289 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417711 2580 flags.go:64] FLAG: --registry-qps="5" Jul 09 16:51:00.423289 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417714 2580 flags.go:64] FLAG: --reserved-cpus="" Jul 09 16:51:00.423289 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417717 2580 flags.go:64] FLAG: --reserved-memory="" Jul 09 16:51:00.423289 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417720 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 16:51:00.423289 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417723 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 16:51:00.423289 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417725 2580 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 16:51:00.423289 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417728 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 16:51:00.423289 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417732 2580 flags.go:64] FLAG: --runonce="false" Jul 09 16:51:00.423936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417735 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 16:51:00.423936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417738 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 16:51:00.423936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417741 2580 flags.go:64] FLAG: --seccomp-default="false" Jul 09 16:51:00.423936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417743 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 16:51:00.423936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417746 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 16:51:00.423936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417749 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 16:51:00.423936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417752 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 16:51:00.423936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417755 2580 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 16:51:00.423936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417757 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 16:51:00.423936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417760 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 16:51:00.423936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417763 2580 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 16:51:00.423936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417765 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 16:51:00.423936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417768 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 16:51:00.423936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417771 2580 flags.go:64] FLAG: --system-cgroups="" Jul 09 16:51:00.423936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417775 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 16:51:00.423936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417780 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 16:51:00.423936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417783 2580 flags.go:64] FLAG: --tls-cert-file="" Jul 09 16:51:00.423936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417786 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 16:51:00.423936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417790 2580 flags.go:64] FLAG: --tls-min-version="" Jul 09 16:51:00.423936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417793 2580 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 16:51:00.423936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417795 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 16:51:00.423936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417798 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 16:51:00.423936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417801 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 16:51:00.423936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417804 2580 flags.go:64] FLAG: --v="2" Jul 09 16:51:00.423936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417807 2580 flags.go:64] FLAG: --version="false" Jul 09 16:51:00.424602 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417812 2580 flags.go:64] FLAG: --vmodule="" Jul 09 16:51:00.424602 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417815 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 16:51:00.424602 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.417818 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 16:51:00.424602 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417947 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:51:00.424602 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417951 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:51:00.424602 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417954 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:51:00.424602 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417958 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:51:00.424602 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417960 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:51:00.424602 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417963 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:51:00.424602 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417965 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:51:00.424602 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417968 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:51:00.424602 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417970 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:51:00.424602 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417973 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:51:00.424602 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417975 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:51:00.424602 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417978 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:51:00.424602 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417980 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:51:00.424602 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417983 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:51:00.424602 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417985 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:51:00.424602 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417988 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:51:00.424602 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417990 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:51:00.424602 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417993 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:51:00.425120 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417996 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:51:00.425120 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.417999 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:51:00.425120 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418002 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:51:00.425120 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418004 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:51:00.425120 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418007 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:51:00.425120 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418010 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:51:00.425120 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418012 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:51:00.425120 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418015 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:51:00.425120 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418017 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:51:00.425120 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418020 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:51:00.425120 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418022 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:51:00.425120 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418025 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:51:00.425120 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418028 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:51:00.425120 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418030 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:51:00.425120 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418033 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:51:00.425120 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418035 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:51:00.425120 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418038 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:51:00.425120 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418040 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:51:00.425120 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418043 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:51:00.425120 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418045 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:51:00.425666 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418048 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:51:00.425666 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418052 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:51:00.425666 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418055 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:51:00.425666 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418058 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:51:00.425666 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418060 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:51:00.425666 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418063 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:51:00.425666 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418066 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:51:00.425666 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418068 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:51:00.425666 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418071 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:51:00.425666 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418073 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:51:00.425666 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418075 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:51:00.425666 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418078 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:51:00.425666 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418082 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:51:00.425666 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418084 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:51:00.425666 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418087 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:51:00.425666 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418089 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:51:00.425666 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418092 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:51:00.425666 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418094 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:51:00.425666 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418097 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:51:00.425666 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418099 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:51:00.426155 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418102 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:51:00.426155 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418105 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:51:00.426155 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418107 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:51:00.426155 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418110 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:51:00.426155 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418113 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:51:00.426155 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418118 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:51:00.426155 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418121 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:51:00.426155 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418124 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:51:00.426155 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418128 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:51:00.426155 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418131 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:51:00.426155 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418133 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:51:00.426155 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418137 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:51:00.426155 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418139 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:51:00.426155 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418142 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:51:00.426155 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418144 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:51:00.426155 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418147 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:51:00.426155 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418149 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:51:00.426155 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418151 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:51:00.426605 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418156 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:51:00.426605 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418159 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:51:00.426605 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418162 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:51:00.426605 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418164 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:51:00.426605 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418167 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:51:00.426605 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418170 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:51:00.426605 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418174 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:51:00.426605 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418176 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:51:00.426605 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418179 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:51:00.426605 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418181 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:51:00.426605 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418184 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:51:00.426605 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418186 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:51:00.426605 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418189 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:51:00.426605 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418191 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:51:00.426605 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418193 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:51:00.426605 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418196 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:51:00.426605 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418198 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:51:00.426605 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418201 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:51:00.426605 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418203 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:51:00.426605 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418206 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:51:00.427100 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418209 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:51:00.427100 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418211 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:51:00.427100 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.418214 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:51:00.427100 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.418909 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 16:51:00.427100 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.425716 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 09 16:51:00.427100 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.425731 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 16:51:00.427100 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.425749 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 16:51:00.427100 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.425756 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 16:51:00.427100 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425812 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:51:00.427100 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425817 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:51:00.427100 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425820 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:51:00.427100 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425823 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:51:00.427100 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425826 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:51:00.427100 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425829 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:51:00.427100 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425832 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:51:00.427472 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425835 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:51:00.427472 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425837 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:51:00.427472 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425840 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:51:00.427472 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425842 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:51:00.427472 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425845 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:51:00.427472 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425848 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:51:00.427472 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425851 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:51:00.427472 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425854 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:51:00.427472 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425856 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:51:00.427472 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425859 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:51:00.427472 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425863 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:51:00.427472 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425866 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:51:00.427472 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425870 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:51:00.427472 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425873 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:51:00.427472 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425876 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:51:00.427472 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425879 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:51:00.427472 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425881 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:51:00.427472 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425884 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:51:00.427472 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425887 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:51:00.427950 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425889 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:51:00.427950 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425891 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:51:00.427950 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425894 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:51:00.427950 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425898 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:51:00.427950 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425901 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:51:00.427950 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425905 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:51:00.427950 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425909 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:51:00.427950 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425912 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:51:00.427950 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425914 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:51:00.427950 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425917 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:51:00.427950 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425919 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:51:00.427950 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425922 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:51:00.427950 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425925 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:51:00.427950 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425927 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:51:00.427950 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425930 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:51:00.427950 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425933 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:51:00.427950 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425935 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:51:00.427950 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425938 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:51:00.427950 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425940 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:51:00.428418 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425943 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:51:00.428418 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425945 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:51:00.428418 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425948 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:51:00.428418 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425950 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:51:00.428418 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425953 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:51:00.428418 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425955 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:51:00.428418 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425958 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:51:00.428418 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425961 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:51:00.428418 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425963 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:51:00.428418 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425966 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:51:00.428418 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425968 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:51:00.428418 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425971 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:51:00.428418 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425973 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:51:00.428418 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425976 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:51:00.428418 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425978 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:51:00.428418 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425981 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:51:00.428418 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425984 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:51:00.428418 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425988 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:51:00.428418 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425990 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:51:00.428418 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425993 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:51:00.428941 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425995 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:51:00.428941 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.425998 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:51:00.428941 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426000 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:51:00.428941 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426003 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:51:00.428941 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426005 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:51:00.428941 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426008 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:51:00.428941 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426010 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:51:00.428941 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426013 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:51:00.428941 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426015 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:51:00.428941 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426018 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:51:00.428941 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426020 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:51:00.428941 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426022 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:51:00.428941 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426025 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:51:00.428941 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426027 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:51:00.428941 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426030 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:51:00.428941 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426032 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:51:00.428941 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426035 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:51:00.428941 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426037 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:51:00.428941 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426039 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:51:00.428941 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426042 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:51:00.429534 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426044 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:51:00.429534 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426046 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:51:00.429534 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426049 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:51:00.429534 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426051 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:51:00.429534 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426054 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:51:00.429534 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426056 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:51:00.429534 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426058 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:51:00.429534 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426061 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:51:00.429534 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426064 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:51:00.429534 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426066 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:51:00.429534 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426069 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:51:00.429534 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426072 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:51:00.429534 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426075 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:51:00.429534 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426077 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:51:00.429534 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.426082 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 16:51:00.429924 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426194 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 16:51:00.429924 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426199 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 16:51:00.429924 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426202 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 16:51:00.429924 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426205 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 16:51:00.429924 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426207 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 16:51:00.429924 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426210 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 16:51:00.429924 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426212 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 16:51:00.429924 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426215 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 16:51:00.429924 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426217 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 16:51:00.429924 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426220 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 16:51:00.429924 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426222 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 16:51:00.429924 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426225 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 16:51:00.429924 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426228 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 16:51:00.429924 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426230 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 16:51:00.429924 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426232 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 16:51:00.429924 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426235 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 16:51:00.429924 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426237 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 16:51:00.429924 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426240 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 16:51:00.429924 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426242 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 16:51:00.429924 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426245 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 16:51:00.430409 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426247 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 16:51:00.430409 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426249 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 16:51:00.430409 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426252 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 16:51:00.430409 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426254 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 16:51:00.430409 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426256 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 16:51:00.430409 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426260 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 16:51:00.430409 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426262 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 16:51:00.430409 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426265 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 16:51:00.430409 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426268 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 16:51:00.430409 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426270 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 16:51:00.430409 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426273 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 16:51:00.430409 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426275 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 16:51:00.430409 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426278 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 16:51:00.430409 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426280 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 16:51:00.430409 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426283 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 16:51:00.430409 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426285 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 16:51:00.430409 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426288 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 16:51:00.430409 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426290 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 16:51:00.430409 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426292 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 16:51:00.430409 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426295 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 16:51:00.430927 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426297 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 16:51:00.430927 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426299 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 16:51:00.430927 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426302 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 16:51:00.430927 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426304 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 16:51:00.430927 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426308 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 16:51:00.430927 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426312 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 16:51:00.430927 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426315 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 16:51:00.430927 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426318 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 16:51:00.430927 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426321 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 16:51:00.430927 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426324 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 16:51:00.430927 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426326 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 16:51:00.430927 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426329 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 16:51:00.430927 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426332 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 16:51:00.430927 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426335 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 16:51:00.430927 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426338 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 16:51:00.430927 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426340 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 16:51:00.430927 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426343 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 16:51:00.430927 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426346 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 16:51:00.430927 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426349 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 16:51:00.431404 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426351 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 16:51:00.431404 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426354 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 16:51:00.431404 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426357 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 16:51:00.431404 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426359 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 16:51:00.431404 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426362 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 16:51:00.431404 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426364 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 16:51:00.431404 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426366 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 16:51:00.431404 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426369 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 16:51:00.431404 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426371 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 16:51:00.431404 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426374 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 16:51:00.431404 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426376 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 16:51:00.431404 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426378 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 16:51:00.431404 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426381 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 16:51:00.431404 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426383 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 16:51:00.431404 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426386 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 16:51:00.431404 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426388 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 16:51:00.431404 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426392 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 16:51:00.431404 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426395 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 16:51:00.431404 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426398 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 16:51:00.431892 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426400 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 16:51:00.431892 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426403 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 16:51:00.431892 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426406 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 16:51:00.431892 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426408 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 16:51:00.431892 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426411 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 09 16:51:00.431892 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426413 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 16:51:00.431892 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426416 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 16:51:00.431892 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426418 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 16:51:00.431892 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426421 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 16:51:00.431892 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426423 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 16:51:00.431892 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426425 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 16:51:00.431892 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426429 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 16:51:00.431892 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426431 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 16:51:00.431892 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426434 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 16:51:00.431892 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426436 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 16:51:00.431892 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426438 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 16:51:00.431892 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426442 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 16:51:00.431892 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426444 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 16:51:00.431892 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426446 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 16:51:00.431892 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426449 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 16:51:00.432359 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:00.426451 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 16:51:00.432359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.426456 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 16:51:00.432359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.426586 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 16:51:00.432359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.428795 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 16:51:00.432359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.430815 2580 server.go:1019] "Starting client certificate rotation" Jul 09 16:51:00.432359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.430916 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 16:51:00.432359 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.430952 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 16:51:00.434073 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.434059 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 16:51:00.437146 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.437129 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 16:51:00.449022 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.449000 2580 log.go:25] "Validated CRI v1 runtime API" Jul 09 16:51:00.451019 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.451004 2580 log.go:25] "Validated CRI v1 image API" Jul 09 16:51:00.452494 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.452460 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 16:51:00.456549 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.456531 2580 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 bbcbb176-e0a9-4733-ac91-10f68edf151c:/dev/nvme0n1p3 c21f189a-7f00-4dfa-b70e-2e6b3433f6af:/dev/nvme0n1p4] Jul 09 16:51:00.456621 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.456547 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 16:51:00.460564 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.460548 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 16:51:00.462812 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.462697 2580 manager.go:216] Machine: {Timestamp:2026-07-09 16:51:00.460712916 +0000 UTC m=+0.337265834 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100095 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20ec44aba6bf9a29ac7c1006ee0f4f SystemUUID:ec20ec44-aba6-bf9a-29ac-7c1006ee0f4f BootID:e9064697-5311-4a85-887b-7730ce6f5ffc Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ac:72:ef:9d:dd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ac:72:ef:9d:dd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:90:21:4b:9d:d0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 16:51:00.462812 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.462811 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 16:51:00.462921 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.462887 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 16:51:00.465413 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.465379 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 16:51:00.465576 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.465409 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-34.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 16:51:00.466083 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.466074 2580 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 16:51:00.466116 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.466085 2580 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 16:51:00.466116 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.466093 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 16:51:00.466713 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.466703 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 16:51:00.468056 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.468047 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 16:51:00.470958 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.470947 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 09 16:51:00.471231 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.471221 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 16:51:00.471260 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.471253 2580 kubelet.go:486] "Attempting to sync node with API server" Jul 09 16:51:00.471296 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.471266 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 16:51:00.471296 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.471281 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 16:51:00.471296 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.471291 2580 kubelet.go:398] "Adding apiserver pod source" Jul 09 16:51:00.471384 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.471300 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 16:51:00.471636 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.471624 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 16:51:00.471680 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.471642 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 16:51:00.475184 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.475167 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 09 16:51:00.477271 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.477253 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 16:51:00.477350 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.477295 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 16:51:00.477512 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.477499 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 16:51:00.477582 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.477520 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 16:51:00.477582 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.477530 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 16:51:00.477582 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.477539 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 16:51:00.477582 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.477553 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 16:51:00.477582 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.477563 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 16:51:00.478062 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.478052 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 16:51:00.478113 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.478065 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 16:51:00.478113 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.478076 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 16:51:00.478113 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.478085 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 16:51:00.478113 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.478106 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 16:51:00.478241 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.478119 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 16:51:00.478860 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.478848 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 16:51:00.478917 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.478863 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 16:51:00.481017 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.480988 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-34.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 16:51:00.481017 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.480999 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-76mww" Jul 09 16:51:00.481130 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:00.481051 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-34.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 16:51:00.481130 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:00.481058 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 16:51:00.482240 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.482227 2580 server.go:1268] "Started kubelet" Jul 09 16:51:00.482318 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.482290 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 16:51:00.482742 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.482593 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 16:51:00.482742 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.482655 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 16:51:00.483013 ip-10-0-128-34 systemd[1]: Started Kubernetes Kubelet. Jul 09 16:51:00.488216 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.487443 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 16:51:00.488934 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.488910 2580 server.go:310] "Adding debug handlers to kubelet server" Jul 09 16:51:00.489259 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.489236 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-76mww" Jul 09 16:51:00.489383 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:00.489354 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 16:51:00.493817 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.493785 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 16:51:00.493817 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.493800 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 16:51:00.493948 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:00.493887 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-34.ec2.internal\" not found" Jul 09 16:51:00.493948 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:00.492814 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-34.ec2.internal.18c0ad2cd3cadef8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-34.ec2.internal,UID:ip-10-0-128-34.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-34.ec2.internal,},FirstTimestamp:2026-07-09 16:51:00.482170616 +0000 UTC m=+0.358723528,LastTimestamp:2026-07-09 16:51:00.482170616 +0000 UTC m=+0.358723528,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-34.ec2.internal,}" Jul 09 16:51:00.494626 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.494516 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 16:51:00.494626 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.494522 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 16:51:00.494626 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.494538 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 16:51:00.494626 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.494607 2580 reconstruct.go:97] "Volume reconstruction finished" Jul 09 16:51:00.494626 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.494617 2580 reconciler.go:29] "Reconciler: start to sync state" Jul 09 16:51:00.495232 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.495216 2580 factory.go:55] Registering systemd factory Jul 09 16:51:00.495296 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.495239 2580 factory.go:223] Registration of the systemd container factory successfully Jul 09 16:51:00.495456 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.495438 2580 factory.go:153] Registering CRI-O factory Jul 09 16:51:00.495456 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.495458 2580 factory.go:223] Registration of the crio container factory successfully Jul 09 16:51:00.495579 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.495552 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 16:51:00.495579 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.495576 2580 factory.go:103] Registering Raw factory Jul 09 16:51:00.495659 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.495592 2580 manager.go:1196] Started watching for new ooms in manager Jul 09 16:51:00.496169 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.496150 2580 manager.go:349] Starting recovery of all containers Jul 09 16:51:00.504319 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.504169 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:51:00.505353 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.505337 2580 manager.go:354] Recovery completed Jul 09 16:51:00.506509 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:00.506454 2580 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 09 16:51:00.507450 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:00.507431 2580 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-34.ec2.internal\" not found" node="ip-10-0-128-34.ec2.internal" Jul 09 16:51:00.509453 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.509439 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:51:00.511251 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.511234 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-34.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:51:00.511333 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.511267 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-34.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:51:00.511333 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.511282 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-34.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:51:00.511824 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.511811 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 16:51:00.511824 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.511823 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 16:51:00.511918 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.511839 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 09 16:51:00.511918 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.511874 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:51:00.512655 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.512639 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-34.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:51:00.512725 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.512673 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-34.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:51:00.512725 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.512685 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-34.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:51:00.513206 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.513192 2580 policy_none.go:49] "None policy: Start" Jul 09 16:51:00.513241 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.513212 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 16:51:00.513241 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.513222 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 16:51:00.514239 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.514227 2580 policy_none.go:47] "Start" Jul 09 16:51:00.550817 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.550805 2580 manager.go:337] "Starting Device Plugin manager" Jul 09 16:51:00.550906 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:00.550840 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 16:51:00.550906 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.550850 2580 server.go:87] "Starting device plugin registration server" Jul 09 16:51:00.551085 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.551073 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 16:51:00.551153 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.551087 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 16:51:00.551208 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.551160 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 16:51:00.551254 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.551228 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 16:51:00.551254 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.551238 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 16:51:00.551789 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:00.551770 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 16:51:00.551884 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:00.551823 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-34.ec2.internal\" not found" Jul 09 16:51:00.651791 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.651756 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:51:00.653210 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.652972 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-34.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:51:00.653210 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.652998 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-34.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:51:00.653210 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.653009 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-34.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:51:00.653210 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.653037 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-34.ec2.internal" Jul 09 16:51:00.657881 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.657822 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 16:51:00.659264 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.659240 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 16:51:00.659365 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.659287 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 16:51:00.659365 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.659311 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 16:51:00.659365 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:00.659352 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 16:51:00.660961 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.660945 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-34.ec2.internal" Jul 09 16:51:00.661054 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:00.660971 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-34.ec2.internal\": node \"ip-10-0-128-34.ec2.internal\" not found" Jul 09 16:51:00.661825 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.661807 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:51:00.705629 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:00.705604 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-34.ec2.internal\" not found" Jul 09 16:51:00.759756 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.759707 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-34.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-34.ec2.internal"] Jul 09 16:51:00.759875 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.759797 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:51:00.760738 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.760723 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-34.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:51:00.760799 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.760752 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-34.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:51:00.760799 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.760763 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-34.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:51:00.762077 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.762066 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:51:00.762263 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.762227 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-34.ec2.internal" Jul 09 16:51:00.762324 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.762279 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:51:00.762763 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.762748 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-34.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:51:00.762844 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.762772 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-34.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:51:00.762844 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.762749 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-34.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:51:00.762844 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.762797 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-34.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:51:00.762844 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.762806 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-34.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:51:00.762844 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.762782 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-34.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:51:00.764137 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.764122 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-34.ec2.internal" Jul 09 16:51:00.764189 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.764149 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 16:51:00.764857 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.764841 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-34.ec2.internal" event="NodeHasSufficientMemory" Jul 09 16:51:00.764936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.764888 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-34.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 16:51:00.764936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.764898 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-34.ec2.internal" event="NodeHasSufficientPID" Jul 09 16:51:00.789118 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:00.789096 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-34.ec2.internal\" not found" node="ip-10-0-128-34.ec2.internal" Jul 09 16:51:00.793687 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:00.793672 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-34.ec2.internal\" not found" node="ip-10-0-128-34.ec2.internal" Jul 09 16:51:00.796762 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.796746 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9f5f719f4ba8d3ed82df03e5db9cbe1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-34.ec2.internal\" (UID: \"d9f5f719f4ba8d3ed82df03e5db9cbe1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-34.ec2.internal" Jul 09 16:51:00.796821 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.796769 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c328db57ded294448d0f09b85263bba6-config\") pod \"kube-apiserver-proxy-ip-10-0-128-34.ec2.internal\" (UID: \"c328db57ded294448d0f09b85263bba6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-34.ec2.internal" Jul 09 16:51:00.796821 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.796799 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d9f5f719f4ba8d3ed82df03e5db9cbe1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-34.ec2.internal\" (UID: \"d9f5f719f4ba8d3ed82df03e5db9cbe1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-34.ec2.internal" Jul 09 16:51:00.805805 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:00.805787 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-34.ec2.internal\" not found" Jul 09 16:51:00.897747 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.897719 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d9f5f719f4ba8d3ed82df03e5db9cbe1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-34.ec2.internal\" (UID: \"d9f5f719f4ba8d3ed82df03e5db9cbe1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-34.ec2.internal" Jul 09 16:51:00.897841 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.897757 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9f5f719f4ba8d3ed82df03e5db9cbe1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-34.ec2.internal\" (UID: \"d9f5f719f4ba8d3ed82df03e5db9cbe1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-34.ec2.internal" Jul 09 16:51:00.897841 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.897778 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c328db57ded294448d0f09b85263bba6-config\") pod \"kube-apiserver-proxy-ip-10-0-128-34.ec2.internal\" (UID: \"c328db57ded294448d0f09b85263bba6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-34.ec2.internal" Jul 09 16:51:00.897841 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.897778 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d9f5f719f4ba8d3ed82df03e5db9cbe1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-34.ec2.internal\" (UID: \"d9f5f719f4ba8d3ed82df03e5db9cbe1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-34.ec2.internal" Jul 09 16:51:00.897841 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.897802 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c328db57ded294448d0f09b85263bba6-config\") pod \"kube-apiserver-proxy-ip-10-0-128-34.ec2.internal\" (UID: \"c328db57ded294448d0f09b85263bba6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-34.ec2.internal" Jul 09 16:51:00.897977 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:00.897841 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d9f5f719f4ba8d3ed82df03e5db9cbe1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-34.ec2.internal\" (UID: \"d9f5f719f4ba8d3ed82df03e5db9cbe1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-34.ec2.internal" Jul 09 16:51:00.906844 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:00.906823 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-34.ec2.internal\" not found" Jul 09 16:51:01.007716 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:01.007647 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-34.ec2.internal\" not found" Jul 09 16:51:02.602689 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:02.602662 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-34.ec2.internal" Jul 09 16:51:02.608911 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:02.608888 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-34.ec2.internal" Jul 09 16:51:02.620316 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:02.620297 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-34.ec2.internal\" not found" Jul 09 16:51:02.720824 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:02.720788 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-34.ec2.internal\" not found" Jul 09 16:51:02.821417 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:02.821350 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-34.ec2.internal\" not found" Jul 09 16:51:02.922045 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:02.922014 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-34.ec2.internal\" not found" Jul 09 16:51:02.941187 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:02.941164 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 16:51:02.941351 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:02.941331 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 16:51:02.941415 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:02.941341 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 16:51:03.005465 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:03.005429 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 16:46:01 +0000 UTC" deadline="2028-03-27 16:07:03.301865338 +0000 UTC" Jul 09 16:51:03.005465 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:03.005458 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15047h16m0.296412353s" Jul 09 16:51:03.022466 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:03.022446 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-34.ec2.internal\" not found" Jul 09 16:51:03.123102 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:03.123076 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-34.ec2.internal\" not found" Jul 09 16:51:03.207701 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:03.207672 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:51:03.252864 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:03.252828 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9f5f719f4ba8d3ed82df03e5db9cbe1.slice/crio-41857ba919cc864cd58676830c77ca8704b39635d13c990f0c4d43b40543bae2 WatchSource:0}: Error finding container 41857ba919cc864cd58676830c77ca8704b39635d13c990f0c4d43b40543bae2: Status 404 returned error can't find the container with id 41857ba919cc864cd58676830c77ca8704b39635d13c990f0c4d43b40543bae2 Jul 09 16:51:03.256391 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:03.256377 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 16:51:03.306447 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:03.306425 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-34.ec2.internal" Jul 09 16:51:03.315125 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:03.315108 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 16:51:03.317461 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:03.317449 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-34.ec2.internal" Jul 09 16:51:03.327351 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:03.327333 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 16:51:03.573810 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:03.573740 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:51:03.585076 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:03.585049 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc328db57ded294448d0f09b85263bba6.slice/crio-efe78f6ba8ea19eafceac5af68b0a630c08c6a020bcf17c63fb5f8aa2a07de89 WatchSource:0}: Error finding container efe78f6ba8ea19eafceac5af68b0a630c08c6a020bcf17c63fb5f8aa2a07de89: Status 404 returned error can't find the container with id efe78f6ba8ea19eafceac5af68b0a630c08c6a020bcf17c63fb5f8aa2a07de89 Jul 09 16:51:03.984050 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:03.984023 2580 apiserver.go:52] "Watching apiserver" Jul 09 16:51:03.993215 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:03.993193 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 16:51:03.993585 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:03.993566 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-vv786","openshift-network-diagnostics/network-check-target-bl5d7","openshift-network-operator/iptables-alerter-8vrq6","openshift-ovn-kubernetes/ovnkube-node-pcwtl","kube-system/global-pull-secret-syncer-6ncs8","kube-system/konnectivity-agent-v9qrc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-34.ec2.internal","openshift-multus/multus-p2289","openshift-multus/network-metrics-daemon-4xnp4","kube-system/kube-apiserver-proxy-ip-10-0-128-34.ec2.internal","openshift-cluster-node-tuning-operator/tuned-kbkxl","openshift-dns/node-resolver-kgbtw","openshift-image-registry/node-ca-r8p6t"] Jul 09 16:51:03.995105 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:03.995087 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q" Jul 09 16:51:03.996131 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:03.996114 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kgbtw" Jul 09 16:51:03.997153 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:03.997129 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sstx6\"" Jul 09 16:51:03.997253 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:03.997167 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 16:51:03.997253 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:03.997219 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8vrq6" Jul 09 16:51:03.997364 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:03.997347 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 16:51:03.998784 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:03.998732 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 16:51:03.998949 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:03.998930 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 16:51:03.999034 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:03.998929 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 16:51:03.999798 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:03.999180 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-k6zt8\"" Jul 09 16:51:03.999987 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:03.999969 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 16:51:04.000157 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.000139 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 16:51:04.000248 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:03.999970 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h5lwr\"" Jul 09 16:51:04.000988 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.000514 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 16:51:04.001636 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.001620 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.003043 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.003023 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:04.003139 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:04.003089 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ncs8" podUID="b588a7a9-4426-4011-a6e2-e88403477517" Jul 09 16:51:04.003552 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.003537 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4fv94\"" Jul 09 16:51:04.003628 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.003583 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 16:51:04.003781 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.003767 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 16:51:04.004125 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.004054 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 16:51:04.004488 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.004471 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 16:51:04.004596 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.004578 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 16:51:04.004710 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.004697 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 16:51:04.005072 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.005029 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v9qrc" Jul 09 16:51:04.006584 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.006563 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 16:51:04.006767 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.006748 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-btp7k\"" Jul 09 16:51:04.007027 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.007010 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 16:51:04.007132 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.007116 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 16:51:04.007915 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.007898 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p2289" Jul 09 16:51:04.009095 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.009079 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vv786" Jul 09 16:51:04.010031 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.010017 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 16:51:04.010554 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.010417 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 16:51:04.010554 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.010470 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 16:51:04.010554 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.010542 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:04.010706 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:04.010614 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bl5d7" podUID="2e904774-10d9-43ac-a1b8-f1ca369a6dc8" Jul 09 16:51:04.010706 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.010695 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 16:51:04.010900 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.010883 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pqpkc\"" Jul 09 16:51:04.011254 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.011239 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 16:51:04.011346 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.011324 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-w7h9m\"" Jul 09 16:51:04.011456 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.011443 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 16:51:04.011948 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.011933 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:04.012010 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:04.011993 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xnp4" podUID="cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913" Jul 09 16:51:04.013840 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.013822 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r8p6t" Jul 09 16:51:04.015271 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.015255 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.015699 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.015680 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 16:51:04.015959 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.015936 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 16:51:04.016039 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.015969 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 16:51:04.016039 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.015941 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2tjj5\"" Jul 09 16:51:04.017698 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.017677 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 16:51:04.017774 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.017680 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tvbt7\"" Jul 09 16:51:04.017904 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.017891 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 16:51:04.017904 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.017899 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-host-cni-netd\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.018000 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.017920 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8f7baf6c-53e6-49ce-bb21-0872229d89de-sys-fs\") pod \"aws-ebs-csi-driver-node-lg55q\" (UID: \"8f7baf6c-53e6-49ce-bb21-0872229d89de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q" Jul 09 16:51:04.018000 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.017956 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-var-lib-openvswitch\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.018000 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.017980 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/12995bc0-2245-4f06-aad5-b496fd24f0b1-ovnkube-script-lib\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.018117 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018014 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-node-log\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.018117 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018048 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr56j\" (UniqueName: \"kubernetes.io/projected/12995bc0-2245-4f06-aad5-b496fd24f0b1-kube-api-access-cr56j\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.018117 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018066 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-os-release\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.018117 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018087 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-host-var-lib-kubelet\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.018117 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018102 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-host-slash\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.018117 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018117 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-etc-openvswitch\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.018344 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018131 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt252\" (UniqueName: \"kubernetes.io/projected/d32c3245-4bca-41b7-9b6f-4b2f2fbd4dfc-kube-api-access-qt252\") pod \"iptables-alerter-8vrq6\" (UID: \"d32c3245-4bca-41b7-9b6f-4b2f2fbd4dfc\") " pod="openshift-network-operator/iptables-alerter-8vrq6" Jul 09 16:51:04.018344 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018149 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-host-cni-bin\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.018344 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018165 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/73f90b5e-46be-448d-9429-79bebdd0c83e-konnectivity-ca\") pod \"konnectivity-agent-v9qrc\" (UID: \"73f90b5e-46be-448d-9429-79bebdd0c83e\") " pod="kube-system/konnectivity-agent-v9qrc" Jul 09 16:51:04.018344 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018187 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-multus-cni-dir\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.018344 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018221 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-cnibin\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.018344 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018252 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8f7baf6c-53e6-49ce-bb21-0872229d89de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lg55q\" (UID: \"8f7baf6c-53e6-49ce-bb21-0872229d89de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q" Jul 09 16:51:04.018344 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018297 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/73f90b5e-46be-448d-9429-79bebdd0c83e-agent-certs\") pod \"konnectivity-agent-v9qrc\" (UID: \"73f90b5e-46be-448d-9429-79bebdd0c83e\") " pod="kube-system/konnectivity-agent-v9qrc" Jul 09 16:51:04.018344 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018329 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-run-openvswitch\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.018677 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018351 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/12995bc0-2245-4f06-aad5-b496fd24f0b1-ovnkube-config\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.018677 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018390 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-host-run-multus-certs\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.018677 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018447 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8f7baf6c-53e6-49ce-bb21-0872229d89de-registration-dir\") pod \"aws-ebs-csi-driver-node-lg55q\" (UID: \"8f7baf6c-53e6-49ce-bb21-0872229d89de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q" Jul 09 16:51:04.018677 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018473 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-run-systemd\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.018677 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018497 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.018677 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018526 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/12995bc0-2245-4f06-aad5-b496fd24f0b1-env-overrides\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.018677 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018549 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbbb42c9-70b4-4367-937d-b8e13c0c10c6-tmp-dir\") pod \"node-resolver-kgbtw\" (UID: \"bbbb42c9-70b4-4367-937d-b8e13c0c10c6\") " pod="openshift-dns/node-resolver-kgbtw" Jul 09 16:51:04.018677 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018574 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d32c3245-4bca-41b7-9b6f-4b2f2fbd4dfc-iptables-alerter-script\") pod \"iptables-alerter-8vrq6\" (UID: \"d32c3245-4bca-41b7-9b6f-4b2f2fbd4dfc\") " pod="openshift-network-operator/iptables-alerter-8vrq6" Jul 09 16:51:04.018677 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018598 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8f7baf6c-53e6-49ce-bb21-0872229d89de-socket-dir\") pod \"aws-ebs-csi-driver-node-lg55q\" (UID: \"8f7baf6c-53e6-49ce-bb21-0872229d89de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q" Jul 09 16:51:04.018677 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018635 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-host-run-ovn-kubernetes\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.018677 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018662 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-host-run-netns\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.019122 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018690 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-host-var-lib-cni-bin\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.019122 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018713 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-hostroot\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.019122 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018735 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl4w7\" (UniqueName: \"kubernetes.io/projected/bbbb42c9-70b4-4367-937d-b8e13c0c10c6-kube-api-access-tl4w7\") pod \"node-resolver-kgbtw\" (UID: \"bbbb42c9-70b4-4367-937d-b8e13c0c10c6\") " pod="openshift-dns/node-resolver-kgbtw" Jul 09 16:51:04.019122 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018762 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4df64\" (UniqueName: \"kubernetes.io/projected/8f7baf6c-53e6-49ce-bb21-0872229d89de-kube-api-access-4df64\") pod \"aws-ebs-csi-driver-node-lg55q\" (UID: \"8f7baf6c-53e6-49ce-bb21-0872229d89de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q" Jul 09 16:51:04.019122 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018800 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-systemd-units\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.019122 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018822 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-host-run-netns\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.019122 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018856 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b588a7a9-4426-4011-a6e2-e88403477517-original-pull-secret\") pod \"global-pull-secret-syncer-6ncs8\" (UID: \"b588a7a9-4426-4011-a6e2-e88403477517\") " pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:04.019122 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018889 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-host-var-lib-cni-multus\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.019122 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018913 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bbbb42c9-70b4-4367-937d-b8e13c0c10c6-hosts-file\") pod \"node-resolver-kgbtw\" (UID: \"bbbb42c9-70b4-4367-937d-b8e13c0c10c6\") " pod="openshift-dns/node-resolver-kgbtw" Jul 09 16:51:04.019122 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018938 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8f7baf6c-53e6-49ce-bb21-0872229d89de-device-dir\") pod \"aws-ebs-csi-driver-node-lg55q\" (UID: \"8f7baf6c-53e6-49ce-bb21-0872229d89de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q" Jul 09 16:51:04.019122 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018962 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-system-cni-dir\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.019122 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.018986 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-multus-socket-dir-parent\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.019122 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.019007 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b588a7a9-4426-4011-a6e2-e88403477517-dbus\") pod \"global-pull-secret-syncer-6ncs8\" (UID: \"b588a7a9-4426-4011-a6e2-e88403477517\") " pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:04.019122 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.019040 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-multus-daemon-config\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.019122 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.019070 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8f7baf6c-53e6-49ce-bb21-0872229d89de-etc-selinux\") pod \"aws-ebs-csi-driver-node-lg55q\" (UID: \"8f7baf6c-53e6-49ce-bb21-0872229d89de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q" Jul 09 16:51:04.019122 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.019109 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-run-ovn\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.019605 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.019149 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-etc-kubernetes\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.019605 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.019168 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw6wq\" (UniqueName: \"kubernetes.io/projected/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-kube-api-access-tw6wq\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.019605 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.019182 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d32c3245-4bca-41b7-9b6f-4b2f2fbd4dfc-host-slash\") pod \"iptables-alerter-8vrq6\" (UID: \"d32c3245-4bca-41b7-9b6f-4b2f2fbd4dfc\") " pod="openshift-network-operator/iptables-alerter-8vrq6" Jul 09 16:51:04.019605 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.019204 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-host-kubelet\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.019605 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.019250 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/12995bc0-2245-4f06-aad5-b496fd24f0b1-ovn-node-metrics-cert\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.019605 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.019263 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b588a7a9-4426-4011-a6e2-e88403477517-kubelet-config\") pod \"global-pull-secret-syncer-6ncs8\" (UID: \"b588a7a9-4426-4011-a6e2-e88403477517\") " pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:04.019605 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.019297 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-host-run-k8s-cni-cncf-io\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.019605 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.019322 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-multus-conf-dir\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.019605 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.019338 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-cni-binary-copy\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.019605 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.019351 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-log-socket\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.023934 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.023915 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 16:51:04.060017 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.059997 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ph4tr" Jul 09 16:51:04.065915 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.065899 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:51:04.073649 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.073630 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ph4tr" Jul 09 16:51:04.107945 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.107921 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 16:51:04.119736 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.119701 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-sys\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.119736 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.119736 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-lib-modules\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.119938 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.119752 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-var-lib-kubelet\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.119938 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.119770 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b588a7a9-4426-4011-a6e2-e88403477517-dbus\") pod \"global-pull-secret-syncer-6ncs8\" (UID: \"b588a7a9-4426-4011-a6e2-e88403477517\") " pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:04.119938 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.119820 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-multus-daemon-config\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.119938 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.119886 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/971e1a9a-5666-4e2e-b0bc-c3ea99d4ee9e-host\") pod \"node-ca-r8p6t\" (UID: \"971e1a9a-5666-4e2e-b0bc-c3ea99d4ee9e\") " pod="openshift-image-registry/node-ca-r8p6t" Jul 09 16:51:04.119938 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.119932 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/971e1a9a-5666-4e2e-b0bc-c3ea99d4ee9e-serviceca\") pod \"node-ca-r8p6t\" (UID: \"971e1a9a-5666-4e2e-b0bc-c3ea99d4ee9e\") " pod="openshift-image-registry/node-ca-r8p6t" Jul 09 16:51:04.120226 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.119955 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-etc-systemd\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.120226 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.119976 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-run\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.120226 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.119985 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b588a7a9-4426-4011-a6e2-e88403477517-dbus\") pod \"global-pull-secret-syncer-6ncs8\" (UID: \"b588a7a9-4426-4011-a6e2-e88403477517\") " pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:04.120226 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120007 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8f7baf6c-53e6-49ce-bb21-0872229d89de-etc-selinux\") pod \"aws-ebs-csi-driver-node-lg55q\" (UID: \"8f7baf6c-53e6-49ce-bb21-0872229d89de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q" Jul 09 16:51:04.120226 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120043 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-run-ovn\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.120226 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120101 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-run-ovn\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.120226 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120115 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-etc-kubernetes\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.120226 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120141 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw6wq\" (UniqueName: \"kubernetes.io/projected/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-kube-api-access-tw6wq\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.120226 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120164 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d32c3245-4bca-41b7-9b6f-4b2f2fbd4dfc-host-slash\") pod \"iptables-alerter-8vrq6\" (UID: \"d32c3245-4bca-41b7-9b6f-4b2f2fbd4dfc\") " pod="openshift-network-operator/iptables-alerter-8vrq6" Jul 09 16:51:04.120226 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120179 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8f7baf6c-53e6-49ce-bb21-0872229d89de-etc-selinux\") pod \"aws-ebs-csi-driver-node-lg55q\" (UID: \"8f7baf6c-53e6-49ce-bb21-0872229d89de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q" Jul 09 16:51:04.120725 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120243 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-etc-kubernetes\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.120725 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120246 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d32c3245-4bca-41b7-9b6f-4b2f2fbd4dfc-host-slash\") pod \"iptables-alerter-8vrq6\" (UID: \"d32c3245-4bca-41b7-9b6f-4b2f2fbd4dfc\") " pod="openshift-network-operator/iptables-alerter-8vrq6" Jul 09 16:51:04.120725 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120188 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a0702a8-5e0f-4188-b630-85082fa9cb36-os-release\") pod \"multus-additional-cni-plugins-vv786\" (UID: \"5a0702a8-5e0f-4188-b630-85082fa9cb36\") " pod="openshift-multus/multus-additional-cni-plugins-vv786" Jul 09 16:51:04.120725 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120316 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-host-kubelet\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.120725 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120346 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/12995bc0-2245-4f06-aad5-b496fd24f0b1-ovn-node-metrics-cert\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.120725 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120375 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a0702a8-5e0f-4188-b630-85082fa9cb36-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vv786\" (UID: \"5a0702a8-5e0f-4188-b630-85082fa9cb36\") " pod="openshift-multus/multus-additional-cni-plugins-vv786" Jul 09 16:51:04.120725 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120400 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tj54\" (UniqueName: \"kubernetes.io/projected/5a0702a8-5e0f-4188-b630-85082fa9cb36-kube-api-access-8tj54\") pod \"multus-additional-cni-plugins-vv786\" (UID: \"5a0702a8-5e0f-4188-b630-85082fa9cb36\") " pod="openshift-multus/multus-additional-cni-plugins-vv786" Jul 09 16:51:04.120725 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120419 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-host-kubelet\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.120725 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120426 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b588a7a9-4426-4011-a6e2-e88403477517-kubelet-config\") pod \"global-pull-secret-syncer-6ncs8\" (UID: \"b588a7a9-4426-4011-a6e2-e88403477517\") " pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:04.120725 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120451 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-host-run-k8s-cni-cncf-io\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.120725 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120460 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-multus-daemon-config\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.120725 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120476 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-multus-conf-dir\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.120725 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120483 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b588a7a9-4426-4011-a6e2-e88403477517-kubelet-config\") pod \"global-pull-secret-syncer-6ncs8\" (UID: \"b588a7a9-4426-4011-a6e2-e88403477517\") " pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:04.120725 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120517 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-etc-modprobe-d\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.120725 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120534 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-host-run-k8s-cni-cncf-io\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.120725 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120542 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-cni-binary-copy\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.120725 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120549 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-multus-conf-dir\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.121619 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120564 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-log-socket\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.121619 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120603 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-host-cni-netd\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.121619 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120605 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-log-socket\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.121619 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120635 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5a0702a8-5e0f-4188-b630-85082fa9cb36-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vv786\" (UID: \"5a0702a8-5e0f-4188-b630-85082fa9cb36\") " pod="openshift-multus/multus-additional-cni-plugins-vv786" Jul 09 16:51:04.121619 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120648 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-host-cni-netd\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.121619 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120669 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2frs\" (UniqueName: \"kubernetes.io/projected/2e904774-10d9-43ac-a1b8-f1ca369a6dc8-kube-api-access-z2frs\") pod \"network-check-target-bl5d7\" (UID: \"2e904774-10d9-43ac-a1b8-f1ca369a6dc8\") " pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:04.121619 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120689 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b016980-cd0d-4bbe-b741-c5f96abe1e36-etc-tuned\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.121619 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120708 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8f7baf6c-53e6-49ce-bb21-0872229d89de-sys-fs\") pod \"aws-ebs-csi-driver-node-lg55q\" (UID: \"8f7baf6c-53e6-49ce-bb21-0872229d89de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q" Jul 09 16:51:04.121619 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120724 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-var-lib-openvswitch\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.121619 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120730 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 16:51:04.121619 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120740 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/12995bc0-2245-4f06-aad5-b496fd24f0b1-ovnkube-script-lib\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.121619 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120784 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-node-log\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.121619 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120788 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-var-lib-openvswitch\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.121619 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120819 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr56j\" (UniqueName: \"kubernetes.io/projected/12995bc0-2245-4f06-aad5-b496fd24f0b1-kube-api-access-cr56j\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.121619 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120832 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-node-log\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.121619 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120843 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-os-release\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.121619 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120867 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-host-var-lib-kubelet\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.122556 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120893 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a0702a8-5e0f-4188-b630-85082fa9cb36-cni-binary-copy\") pod \"multus-additional-cni-plugins-vv786\" (UID: \"5a0702a8-5e0f-4188-b630-85082fa9cb36\") " pod="openshift-multus/multus-additional-cni-plugins-vv786" Jul 09 16:51:04.122556 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120917 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-etc-sysctl-conf\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.122556 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120939 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-host-slash\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.122556 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120954 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-etc-openvswitch\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.122556 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120968 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt252\" (UniqueName: \"kubernetes.io/projected/d32c3245-4bca-41b7-9b6f-4b2f2fbd4dfc-kube-api-access-qt252\") pod \"iptables-alerter-8vrq6\" (UID: \"d32c3245-4bca-41b7-9b6f-4b2f2fbd4dfc\") " pod="openshift-network-operator/iptables-alerter-8vrq6" Jul 09 16:51:04.122556 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120984 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5a0702a8-5e0f-4188-b630-85082fa9cb36-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vv786\" (UID: \"5a0702a8-5e0f-4188-b630-85082fa9cb36\") " pod="openshift-multus/multus-additional-cni-plugins-vv786" Jul 09 16:51:04.122556 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.120999 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-host\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.122556 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121014 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-host-cni-bin\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.122556 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121029 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/73f90b5e-46be-448d-9429-79bebdd0c83e-konnectivity-ca\") pod \"konnectivity-agent-v9qrc\" (UID: \"73f90b5e-46be-448d-9429-79bebdd0c83e\") " pod="kube-system/konnectivity-agent-v9qrc" Jul 09 16:51:04.122556 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121045 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-multus-cni-dir\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.122556 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121046 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-cni-binary-copy\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.122556 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121060 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-cnibin\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.122556 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121071 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-host-slash\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.122556 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121074 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skztk\" (UniqueName: \"kubernetes.io/projected/971e1a9a-5666-4e2e-b0bc-c3ea99d4ee9e-kube-api-access-skztk\") pod \"node-ca-r8p6t\" (UID: \"971e1a9a-5666-4e2e-b0bc-c3ea99d4ee9e\") " pod="openshift-image-registry/node-ca-r8p6t" Jul 09 16:51:04.122556 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121140 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-host-cni-bin\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.122556 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121145 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8f7baf6c-53e6-49ce-bb21-0872229d89de-sys-fs\") pod \"aws-ebs-csi-driver-node-lg55q\" (UID: \"8f7baf6c-53e6-49ce-bb21-0872229d89de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q" Jul 09 16:51:04.122556 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121175 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-etc-openvswitch\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.123318 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121197 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-host-var-lib-kubelet\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.123318 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121221 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-etc-sysctl-d\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.123318 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121250 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8f7baf6c-53e6-49ce-bb21-0872229d89de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lg55q\" (UID: \"8f7baf6c-53e6-49ce-bb21-0872229d89de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q" Jul 09 16:51:04.123318 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121254 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-os-release\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.123318 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121265 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/73f90b5e-46be-448d-9429-79bebdd0c83e-agent-certs\") pod \"konnectivity-agent-v9qrc\" (UID: \"73f90b5e-46be-448d-9429-79bebdd0c83e\") " pod="kube-system/konnectivity-agent-v9qrc" Jul 09 16:51:04.123318 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121301 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a0702a8-5e0f-4188-b630-85082fa9cb36-system-cni-dir\") pod \"multus-additional-cni-plugins-vv786\" (UID: \"5a0702a8-5e0f-4188-b630-85082fa9cb36\") " pod="openshift-multus/multus-additional-cni-plugins-vv786" Jul 09 16:51:04.123318 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121295 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/12995bc0-2245-4f06-aad5-b496fd24f0b1-ovnkube-script-lib\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.123318 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121331 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-multus-cni-dir\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.123318 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121376 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8f7baf6c-53e6-49ce-bb21-0872229d89de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lg55q\" (UID: \"8f7baf6c-53e6-49ce-bb21-0872229d89de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q" Jul 09 16:51:04.123318 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121418 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-cnibin\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.123318 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121467 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b016980-cd0d-4bbe-b741-c5f96abe1e36-tmp\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.123318 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121497 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-run-openvswitch\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.123318 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121522 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/12995bc0-2245-4f06-aad5-b496fd24f0b1-ovnkube-config\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.123318 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121547 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-host-run-multus-certs\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.123318 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121573 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a0702a8-5e0f-4188-b630-85082fa9cb36-cnibin\") pod \"multus-additional-cni-plugins-vv786\" (UID: \"5a0702a8-5e0f-4188-b630-85082fa9cb36\") " pod="openshift-multus/multus-additional-cni-plugins-vv786" Jul 09 16:51:04.123318 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121578 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-run-openvswitch\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.123318 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121599 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdncp\" (UniqueName: \"kubernetes.io/projected/cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913-kube-api-access-sdncp\") pod \"network-metrics-daemon-4xnp4\" (UID: \"cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913\") " pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:04.124074 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121636 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-host-run-multus-certs\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.124074 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121628 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8f7baf6c-53e6-49ce-bb21-0872229d89de-registration-dir\") pod \"aws-ebs-csi-driver-node-lg55q\" (UID: \"8f7baf6c-53e6-49ce-bb21-0872229d89de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q" Jul 09 16:51:04.124074 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121674 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-run-systemd\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.124074 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121704 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.124074 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121736 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8f7baf6c-53e6-49ce-bb21-0872229d89de-registration-dir\") pod \"aws-ebs-csi-driver-node-lg55q\" (UID: \"8f7baf6c-53e6-49ce-bb21-0872229d89de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q" Jul 09 16:51:04.124074 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121748 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-run-systemd\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.124074 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121778 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/12995bc0-2245-4f06-aad5-b496fd24f0b1-env-overrides\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.124074 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121804 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbbb42c9-70b4-4367-937d-b8e13c0c10c6-tmp-dir\") pod \"node-resolver-kgbtw\" (UID: \"bbbb42c9-70b4-4367-937d-b8e13c0c10c6\") " pod="openshift-dns/node-resolver-kgbtw" Jul 09 16:51:04.124074 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121814 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/73f90b5e-46be-448d-9429-79bebdd0c83e-konnectivity-ca\") pod \"konnectivity-agent-v9qrc\" (UID: \"73f90b5e-46be-448d-9429-79bebdd0c83e\") " pod="kube-system/konnectivity-agent-v9qrc" Jul 09 16:51:04.124074 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121828 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d32c3245-4bca-41b7-9b6f-4b2f2fbd4dfc-iptables-alerter-script\") pod \"iptables-alerter-8vrq6\" (UID: \"d32c3245-4bca-41b7-9b6f-4b2f2fbd4dfc\") " pod="openshift-network-operator/iptables-alerter-8vrq6" Jul 09 16:51:04.124074 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121856 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-etc-kubernetes\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.124074 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121857 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.124074 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121880 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8f7baf6c-53e6-49ce-bb21-0872229d89de-socket-dir\") pod \"aws-ebs-csi-driver-node-lg55q\" (UID: \"8f7baf6c-53e6-49ce-bb21-0872229d89de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q" Jul 09 16:51:04.124074 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.121967 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8f7baf6c-53e6-49ce-bb21-0872229d89de-socket-dir\") pod \"aws-ebs-csi-driver-node-lg55q\" (UID: \"8f7baf6c-53e6-49ce-bb21-0872229d89de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q" Jul 09 16:51:04.124074 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122001 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-host-run-ovn-kubernetes\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.124074 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122026 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-host-run-netns\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.124074 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122051 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-host-var-lib-cni-bin\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.124779 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122074 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-hostroot\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.124779 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122096 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h48w8\" (UniqueName: \"kubernetes.io/projected/8b016980-cd0d-4bbe-b741-c5f96abe1e36-kube-api-access-h48w8\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.124779 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122115 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbbb42c9-70b4-4367-937d-b8e13c0c10c6-tmp-dir\") pod \"node-resolver-kgbtw\" (UID: \"bbbb42c9-70b4-4367-937d-b8e13c0c10c6\") " pod="openshift-dns/node-resolver-kgbtw" Jul 09 16:51:04.124779 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122156 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-host-run-ovn-kubernetes\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.124779 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122171 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/12995bc0-2245-4f06-aad5-b496fd24f0b1-ovnkube-config\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.124779 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122190 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/12995bc0-2245-4f06-aad5-b496fd24f0b1-env-overrides\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.124779 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122119 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl4w7\" (UniqueName: \"kubernetes.io/projected/bbbb42c9-70b4-4367-937d-b8e13c0c10c6-kube-api-access-tl4w7\") pod \"node-resolver-kgbtw\" (UID: \"bbbb42c9-70b4-4367-937d-b8e13c0c10c6\") " pod="openshift-dns/node-resolver-kgbtw" Jul 09 16:51:04.124779 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122193 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-host-run-netns\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.124779 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122238 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4df64\" (UniqueName: \"kubernetes.io/projected/8f7baf6c-53e6-49ce-bb21-0872229d89de-kube-api-access-4df64\") pod \"aws-ebs-csi-driver-node-lg55q\" (UID: \"8f7baf6c-53e6-49ce-bb21-0872229d89de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q" Jul 09 16:51:04.124779 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122227 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-hostroot\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.124779 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122294 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-systemd-units\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.124779 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122321 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-host-run-netns\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.124779 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122352 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b588a7a9-4426-4011-a6e2-e88403477517-original-pull-secret\") pod \"global-pull-secret-syncer-6ncs8\" (UID: \"b588a7a9-4426-4011-a6e2-e88403477517\") " pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:04.124779 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122374 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-host-run-netns\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.124779 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122377 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-host-var-lib-cni-multus\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.124779 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122355 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/12995bc0-2245-4f06-aad5-b496fd24f0b1-systemd-units\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.124779 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122417 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-host-var-lib-cni-bin\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.124779 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122425 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-host-var-lib-cni-multus\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.125403 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122443 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913-metrics-certs\") pod \"network-metrics-daemon-4xnp4\" (UID: \"cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913\") " pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:04.125403 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122461 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d32c3245-4bca-41b7-9b6f-4b2f2fbd4dfc-iptables-alerter-script\") pod \"iptables-alerter-8vrq6\" (UID: \"d32c3245-4bca-41b7-9b6f-4b2f2fbd4dfc\") " pod="openshift-network-operator/iptables-alerter-8vrq6" Jul 09 16:51:04.125403 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122482 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bbbb42c9-70b4-4367-937d-b8e13c0c10c6-hosts-file\") pod \"node-resolver-kgbtw\" (UID: \"bbbb42c9-70b4-4367-937d-b8e13c0c10c6\") " pod="openshift-dns/node-resolver-kgbtw" Jul 09 16:51:04.125403 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:04.122493 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:51:04.125403 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122511 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8f7baf6c-53e6-49ce-bb21-0872229d89de-device-dir\") pod \"aws-ebs-csi-driver-node-lg55q\" (UID: \"8f7baf6c-53e6-49ce-bb21-0872229d89de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q" Jul 09 16:51:04.125403 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122525 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-system-cni-dir\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.125403 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122540 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-multus-socket-dir-parent\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.125403 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122556 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-etc-sysconfig\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.125403 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122580 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bbbb42c9-70b4-4367-937d-b8e13c0c10c6-hosts-file\") pod \"node-resolver-kgbtw\" (UID: \"bbbb42c9-70b4-4367-937d-b8e13c0c10c6\") " pod="openshift-dns/node-resolver-kgbtw" Jul 09 16:51:04.125403 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122618 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-system-cni-dir\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.125403 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122649 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-multus-socket-dir-parent\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.125403 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.122647 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8f7baf6c-53e6-49ce-bb21-0872229d89de-device-dir\") pod \"aws-ebs-csi-driver-node-lg55q\" (UID: \"8f7baf6c-53e6-49ce-bb21-0872229d89de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q" Jul 09 16:51:04.125403 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:04.122679 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b588a7a9-4426-4011-a6e2-e88403477517-original-pull-secret podName:b588a7a9-4426-4011-a6e2-e88403477517 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:04.622649461 +0000 UTC m=+2.987401354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b588a7a9-4426-4011-a6e2-e88403477517-original-pull-secret") pod "global-pull-secret-syncer-6ncs8" (UID: "b588a7a9-4426-4011-a6e2-e88403477517") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:51:04.125403 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.124716 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/73f90b5e-46be-448d-9429-79bebdd0c83e-agent-certs\") pod \"konnectivity-agent-v9qrc\" (UID: \"73f90b5e-46be-448d-9429-79bebdd0c83e\") " pod="kube-system/konnectivity-agent-v9qrc" Jul 09 16:51:04.125403 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.125148 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/12995bc0-2245-4f06-aad5-b496fd24f0b1-ovn-node-metrics-cert\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.136109 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.135514 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw6wq\" (UniqueName: \"kubernetes.io/projected/cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9-kube-api-access-tw6wq\") pod \"multus-p2289\" (UID: \"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9\") " pod="openshift-multus/multus-p2289" Jul 09 16:51:04.136109 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.136057 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr56j\" (UniqueName: \"kubernetes.io/projected/12995bc0-2245-4f06-aad5-b496fd24f0b1-kube-api-access-cr56j\") pod \"ovnkube-node-pcwtl\" (UID: \"12995bc0-2245-4f06-aad5-b496fd24f0b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.136815 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.136787 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt252\" (UniqueName: \"kubernetes.io/projected/d32c3245-4bca-41b7-9b6f-4b2f2fbd4dfc-kube-api-access-qt252\") pod \"iptables-alerter-8vrq6\" (UID: \"d32c3245-4bca-41b7-9b6f-4b2f2fbd4dfc\") " pod="openshift-network-operator/iptables-alerter-8vrq6" Jul 09 16:51:04.137746 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.137726 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl4w7\" (UniqueName: \"kubernetes.io/projected/bbbb42c9-70b4-4367-937d-b8e13c0c10c6-kube-api-access-tl4w7\") pod \"node-resolver-kgbtw\" (UID: \"bbbb42c9-70b4-4367-937d-b8e13c0c10c6\") " pod="openshift-dns/node-resolver-kgbtw" Jul 09 16:51:04.138830 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.138807 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4df64\" (UniqueName: \"kubernetes.io/projected/8f7baf6c-53e6-49ce-bb21-0872229d89de-kube-api-access-4df64\") pod \"aws-ebs-csi-driver-node-lg55q\" (UID: \"8f7baf6c-53e6-49ce-bb21-0872229d89de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q" Jul 09 16:51:04.177032 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.176973 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-34.ec2.internal" event={"ID":"c328db57ded294448d0f09b85263bba6","Type":"ContainerStarted","Data":"efe78f6ba8ea19eafceac5af68b0a630c08c6a020bcf17c63fb5f8aa2a07de89"} Jul 09 16:51:04.178725 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.178691 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-34.ec2.internal" event={"ID":"d9f5f719f4ba8d3ed82df03e5db9cbe1","Type":"ContainerStarted","Data":"41857ba919cc864cd58676830c77ca8704b39635d13c990f0c4d43b40543bae2"} Jul 09 16:51:04.223706 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.223672 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skztk\" (UniqueName: \"kubernetes.io/projected/971e1a9a-5666-4e2e-b0bc-c3ea99d4ee9e-kube-api-access-skztk\") pod \"node-ca-r8p6t\" (UID: \"971e1a9a-5666-4e2e-b0bc-c3ea99d4ee9e\") " pod="openshift-image-registry/node-ca-r8p6t" Jul 09 16:51:04.223863 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.223715 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-etc-sysctl-d\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.223863 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.223742 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a0702a8-5e0f-4188-b630-85082fa9cb36-system-cni-dir\") pod \"multus-additional-cni-plugins-vv786\" (UID: \"5a0702a8-5e0f-4188-b630-85082fa9cb36\") " pod="openshift-multus/multus-additional-cni-plugins-vv786" Jul 09 16:51:04.223863 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.223766 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b016980-cd0d-4bbe-b741-c5f96abe1e36-tmp\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.223863 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.223792 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a0702a8-5e0f-4188-b630-85082fa9cb36-cnibin\") pod \"multus-additional-cni-plugins-vv786\" (UID: \"5a0702a8-5e0f-4188-b630-85082fa9cb36\") " pod="openshift-multus/multus-additional-cni-plugins-vv786" Jul 09 16:51:04.223863 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.223816 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdncp\" (UniqueName: \"kubernetes.io/projected/cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913-kube-api-access-sdncp\") pod \"network-metrics-daemon-4xnp4\" (UID: \"cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913\") " pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:04.223863 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.223842 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-etc-kubernetes\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.224157 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.223867 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h48w8\" (UniqueName: \"kubernetes.io/projected/8b016980-cd0d-4bbe-b741-c5f96abe1e36-kube-api-access-h48w8\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.224157 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.223906 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913-metrics-certs\") pod \"network-metrics-daemon-4xnp4\" (UID: \"cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913\") " pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:04.224157 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.223930 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-etc-sysconfig\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.224157 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.223951 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-sys\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.224157 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.223972 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-lib-modules\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.224157 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.223995 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-var-lib-kubelet\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.224157 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.224018 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/971e1a9a-5666-4e2e-b0bc-c3ea99d4ee9e-host\") pod \"node-ca-r8p6t\" (UID: \"971e1a9a-5666-4e2e-b0bc-c3ea99d4ee9e\") " pod="openshift-image-registry/node-ca-r8p6t" Jul 09 16:51:04.224157 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.224040 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/971e1a9a-5666-4e2e-b0bc-c3ea99d4ee9e-serviceca\") pod \"node-ca-r8p6t\" (UID: \"971e1a9a-5666-4e2e-b0bc-c3ea99d4ee9e\") " pod="openshift-image-registry/node-ca-r8p6t" Jul 09 16:51:04.224157 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.224061 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-etc-systemd\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.224157 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.224082 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-run\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.224157 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.224108 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a0702a8-5e0f-4188-b630-85082fa9cb36-os-release\") pod \"multus-additional-cni-plugins-vv786\" (UID: \"5a0702a8-5e0f-4188-b630-85082fa9cb36\") " pod="openshift-multus/multus-additional-cni-plugins-vv786" Jul 09 16:51:04.224157 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.224134 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a0702a8-5e0f-4188-b630-85082fa9cb36-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vv786\" (UID: \"5a0702a8-5e0f-4188-b630-85082fa9cb36\") " pod="openshift-multus/multus-additional-cni-plugins-vv786" Jul 09 16:51:04.224707 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.224170 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tj54\" (UniqueName: \"kubernetes.io/projected/5a0702a8-5e0f-4188-b630-85082fa9cb36-kube-api-access-8tj54\") pod \"multus-additional-cni-plugins-vv786\" (UID: \"5a0702a8-5e0f-4188-b630-85082fa9cb36\") " pod="openshift-multus/multus-additional-cni-plugins-vv786" Jul 09 16:51:04.224707 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.224197 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-etc-modprobe-d\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.224707 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.224235 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5a0702a8-5e0f-4188-b630-85082fa9cb36-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vv786\" (UID: \"5a0702a8-5e0f-4188-b630-85082fa9cb36\") " pod="openshift-multus/multus-additional-cni-plugins-vv786" Jul 09 16:51:04.224707 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.224261 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2frs\" (UniqueName: \"kubernetes.io/projected/2e904774-10d9-43ac-a1b8-f1ca369a6dc8-kube-api-access-z2frs\") pod \"network-check-target-bl5d7\" (UID: \"2e904774-10d9-43ac-a1b8-f1ca369a6dc8\") " pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:04.224707 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.224305 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b016980-cd0d-4bbe-b741-c5f96abe1e36-etc-tuned\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.224707 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.224338 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a0702a8-5e0f-4188-b630-85082fa9cb36-cni-binary-copy\") pod \"multus-additional-cni-plugins-vv786\" (UID: \"5a0702a8-5e0f-4188-b630-85082fa9cb36\") " pod="openshift-multus/multus-additional-cni-plugins-vv786" Jul 09 16:51:04.224707 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.224363 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-etc-sysctl-conf\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.224707 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.224391 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5a0702a8-5e0f-4188-b630-85082fa9cb36-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vv786\" (UID: \"5a0702a8-5e0f-4188-b630-85082fa9cb36\") " pod="openshift-multus/multus-additional-cni-plugins-vv786" Jul 09 16:51:04.224707 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.224415 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-host\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.224707 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.224509 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-host\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.224985 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.224881 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-etc-sysctl-d\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.224985 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.224931 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a0702a8-5e0f-4188-b630-85082fa9cb36-system-cni-dir\") pod \"multus-additional-cni-plugins-vv786\" (UID: \"5a0702a8-5e0f-4188-b630-85082fa9cb36\") " pod="openshift-multus/multus-additional-cni-plugins-vv786" Jul 09 16:51:04.225128 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.225107 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-etc-systemd\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.225210 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.225166 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a0702a8-5e0f-4188-b630-85082fa9cb36-cnibin\") pod \"multus-additional-cni-plugins-vv786\" (UID: \"5a0702a8-5e0f-4188-b630-85082fa9cb36\") " pod="openshift-multus/multus-additional-cni-plugins-vv786" Jul 09 16:51:04.225266 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.225242 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-sys\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.225343 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.225309 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-var-lib-kubelet\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.225391 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.225348 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/971e1a9a-5666-4e2e-b0bc-c3ea99d4ee9e-host\") pod \"node-ca-r8p6t\" (UID: \"971e1a9a-5666-4e2e-b0bc-c3ea99d4ee9e\") " pod="openshift-image-registry/node-ca-r8p6t" Jul 09 16:51:04.225463 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.225442 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-etc-kubernetes\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.225620 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.225598 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-run\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.225716 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:04.225699 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:51:04.225767 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.225736 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/971e1a9a-5666-4e2e-b0bc-c3ea99d4ee9e-serviceca\") pod \"node-ca-r8p6t\" (UID: \"971e1a9a-5666-4e2e-b0bc-c3ea99d4ee9e\") " pod="openshift-image-registry/node-ca-r8p6t" Jul 09 16:51:04.225767 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:04.225759 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913-metrics-certs podName:cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:04.725742721 +0000 UTC m=+3.090494632 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913-metrics-certs") pod "network-metrics-daemon-4xnp4" (UID: "cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:51:04.225905 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.225886 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a0702a8-5e0f-4188-b630-85082fa9cb36-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vv786\" (UID: \"5a0702a8-5e0f-4188-b630-85082fa9cb36\") " pod="openshift-multus/multus-additional-cni-plugins-vv786" Jul 09 16:51:04.225970 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.225908 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-etc-sysconfig\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.226024 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.225966 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a0702a8-5e0f-4188-b630-85082fa9cb36-os-release\") pod \"multus-additional-cni-plugins-vv786\" (UID: \"5a0702a8-5e0f-4188-b630-85082fa9cb36\") " pod="openshift-multus/multus-additional-cni-plugins-vv786" Jul 09 16:51:04.226024 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.225992 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-lib-modules\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.226118 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.226066 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-etc-modprobe-d\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.226118 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.225991 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5a0702a8-5e0f-4188-b630-85082fa9cb36-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vv786\" (UID: \"5a0702a8-5e0f-4188-b630-85082fa9cb36\") " pod="openshift-multus/multus-additional-cni-plugins-vv786" Jul 09 16:51:04.226824 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.226274 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a0702a8-5e0f-4188-b630-85082fa9cb36-cni-binary-copy\") pod \"multus-additional-cni-plugins-vv786\" (UID: \"5a0702a8-5e0f-4188-b630-85082fa9cb36\") " pod="openshift-multus/multus-additional-cni-plugins-vv786" Jul 09 16:51:04.226824 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.226438 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8b016980-cd0d-4bbe-b741-c5f96abe1e36-etc-sysctl-conf\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.226824 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.226759 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5a0702a8-5e0f-4188-b630-85082fa9cb36-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vv786\" (UID: \"5a0702a8-5e0f-4188-b630-85082fa9cb36\") " pod="openshift-multus/multus-additional-cni-plugins-vv786" Jul 09 16:51:04.228719 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.228696 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8b016980-cd0d-4bbe-b741-c5f96abe1e36-etc-tuned\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.234136 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:04.234088 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:51:04.234136 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:04.234111 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:51:04.234136 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:04.234123 2580 projected.go:196] Error preparing data for projected volume kube-api-access-z2frs for pod openshift-network-diagnostics/network-check-target-bl5d7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:51:04.234362 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:04.234188 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e904774-10d9-43ac-a1b8-f1ca369a6dc8-kube-api-access-z2frs podName:2e904774-10d9-43ac-a1b8-f1ca369a6dc8 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:04.734170427 +0000 UTC m=+3.098922335 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-z2frs" (UniqueName: "kubernetes.io/projected/2e904774-10d9-43ac-a1b8-f1ca369a6dc8-kube-api-access-z2frs") pod "network-check-target-bl5d7" (UID: "2e904774-10d9-43ac-a1b8-f1ca369a6dc8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:51:04.235749 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.235732 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8b016980-cd0d-4bbe-b741-c5f96abe1e36-tmp\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.240765 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.240738 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tj54\" (UniqueName: \"kubernetes.io/projected/5a0702a8-5e0f-4188-b630-85082fa9cb36-kube-api-access-8tj54\") pod \"multus-additional-cni-plugins-vv786\" (UID: \"5a0702a8-5e0f-4188-b630-85082fa9cb36\") " pod="openshift-multus/multus-additional-cni-plugins-vv786" Jul 09 16:51:04.240867 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.240762 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h48w8\" (UniqueName: \"kubernetes.io/projected/8b016980-cd0d-4bbe-b741-c5f96abe1e36-kube-api-access-h48w8\") pod \"tuned-kbkxl\" (UID: \"8b016980-cd0d-4bbe-b741-c5f96abe1e36\") " pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.241412 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.241387 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdncp\" (UniqueName: \"kubernetes.io/projected/cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913-kube-api-access-sdncp\") pod \"network-metrics-daemon-4xnp4\" (UID: \"cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913\") " pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:04.243662 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.243639 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skztk\" (UniqueName: \"kubernetes.io/projected/971e1a9a-5666-4e2e-b0bc-c3ea99d4ee9e-kube-api-access-skztk\") pod \"node-ca-r8p6t\" (UID: \"971e1a9a-5666-4e2e-b0bc-c3ea99d4ee9e\") " pod="openshift-image-registry/node-ca-r8p6t" Jul 09 16:51:04.273185 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.273161 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 16:51:04.308194 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.308170 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q" Jul 09 16:51:04.314066 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.314040 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kgbtw" Jul 09 16:51:04.319194 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:04.319171 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f7baf6c_53e6_49ce_bb21_0872229d89de.slice/crio-84fb373febd3fe257960a4d9cc7bb6dd5b3c65619ddac64ebcba193b8f0a0601 WatchSource:0}: Error finding container 84fb373febd3fe257960a4d9cc7bb6dd5b3c65619ddac64ebcba193b8f0a0601: Status 404 returned error can't find the container with id 84fb373febd3fe257960a4d9cc7bb6dd5b3c65619ddac64ebcba193b8f0a0601 Jul 09 16:51:04.321424 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.321403 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8vrq6" Jul 09 16:51:04.325780 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:04.325754 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbbb42c9_70b4_4367_937d_b8e13c0c10c6.slice/crio-6f0e1e99045096dfe0ca01d60f30ca0252c6005387569f5ef37158ac95a71934 WatchSource:0}: Error finding container 6f0e1e99045096dfe0ca01d60f30ca0252c6005387569f5ef37158ac95a71934: Status 404 returned error can't find the container with id 6f0e1e99045096dfe0ca01d60f30ca0252c6005387569f5ef37158ac95a71934 Jul 09 16:51:04.326598 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.326443 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r8p6t" Jul 09 16:51:04.331369 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.331339 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:04.333068 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:04.333041 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd32c3245_4bca_41b7_9b6f_4b2f2fbd4dfc.slice/crio-5e126fbc79c8a2ff8590fff00f23734f1ede2421aa3199fe64fb4605edd78792 WatchSource:0}: Error finding container 5e126fbc79c8a2ff8590fff00f23734f1ede2421aa3199fe64fb4605edd78792: Status 404 returned error can't find the container with id 5e126fbc79c8a2ff8590fff00f23734f1ede2421aa3199fe64fb4605edd78792 Jul 09 16:51:04.339460 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.339421 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v9qrc" Jul 09 16:51:04.343092 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:04.343065 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod971e1a9a_5666_4e2e_b0bc_c3ea99d4ee9e.slice/crio-5e87128bb5870dac6508408ce3b7b37e5866b9c3245b87bb7ecbb9bd1b97b46b WatchSource:0}: Error finding container 5e87128bb5870dac6508408ce3b7b37e5866b9c3245b87bb7ecbb9bd1b97b46b: Status 404 returned error can't find the container with id 5e87128bb5870dac6508408ce3b7b37e5866b9c3245b87bb7ecbb9bd1b97b46b Jul 09 16:51:04.344322 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.344298 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p2289" Jul 09 16:51:04.349338 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.349316 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vv786" Jul 09 16:51:04.352597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.352581 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" Jul 09 16:51:04.365834 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:04.365797 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd1f84c4_0cf3_400f_ae55_4d0fd5be8fa9.slice/crio-2f56e21cb1af7bcbb4ce309d024ad430c61cc99e8426503b7c8dd785919467d7 WatchSource:0}: Error finding container 2f56e21cb1af7bcbb4ce309d024ad430c61cc99e8426503b7c8dd785919467d7: Status 404 returned error can't find the container with id 2f56e21cb1af7bcbb4ce309d024ad430c61cc99e8426503b7c8dd785919467d7 Jul 09 16:51:04.370099 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:04.370075 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a0702a8_5e0f_4188_b630_85082fa9cb36.slice/crio-c1c5b0d982c8987e711a5d7fa76ac12bcabf17574c94f31f334e81a2ed291e2d WatchSource:0}: Error finding container c1c5b0d982c8987e711a5d7fa76ac12bcabf17574c94f31f334e81a2ed291e2d: Status 404 returned error can't find the container with id c1c5b0d982c8987e711a5d7fa76ac12bcabf17574c94f31f334e81a2ed291e2d Jul 09 16:51:04.373143 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:04.373124 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b016980_cd0d_4bbe_b741_c5f96abe1e36.slice/crio-ae790ce13fce356b1c3e2f23cbd2e520f969099d6a4ff3b416a1b2eea2eec7ee WatchSource:0}: Error finding container ae790ce13fce356b1c3e2f23cbd2e520f969099d6a4ff3b416a1b2eea2eec7ee: Status 404 returned error can't find the container with id ae790ce13fce356b1c3e2f23cbd2e520f969099d6a4ff3b416a1b2eea2eec7ee Jul 09 16:51:04.628218 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.628177 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b588a7a9-4426-4011-a6e2-e88403477517-original-pull-secret\") pod \"global-pull-secret-syncer-6ncs8\" (UID: \"b588a7a9-4426-4011-a6e2-e88403477517\") " pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:04.628392 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:04.628342 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:51:04.628464 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:04.628422 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b588a7a9-4426-4011-a6e2-e88403477517-original-pull-secret podName:b588a7a9-4426-4011-a6e2-e88403477517 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:05.628399567 +0000 UTC m=+3.993151462 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b588a7a9-4426-4011-a6e2-e88403477517-original-pull-secret") pod "global-pull-secret-syncer-6ncs8" (UID: "b588a7a9-4426-4011-a6e2-e88403477517") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:51:04.728646 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.728593 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913-metrics-certs\") pod \"network-metrics-daemon-4xnp4\" (UID: \"cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913\") " pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:04.728822 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:04.728768 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:51:04.728889 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:04.728853 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913-metrics-certs podName:cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:05.728833027 +0000 UTC m=+4.093584946 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913-metrics-certs") pod "network-metrics-daemon-4xnp4" (UID: "cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:51:04.829770 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:04.829737 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2frs\" (UniqueName: \"kubernetes.io/projected/2e904774-10d9-43ac-a1b8-f1ca369a6dc8-kube-api-access-z2frs\") pod \"network-check-target-bl5d7\" (UID: \"2e904774-10d9-43ac-a1b8-f1ca369a6dc8\") " pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:04.829963 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:04.829943 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:51:04.830025 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:04.829972 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:51:04.830025 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:04.829986 2580 projected.go:196] Error preparing data for projected volume kube-api-access-z2frs for pod openshift-network-diagnostics/network-check-target-bl5d7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:51:04.830125 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:04.830076 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e904774-10d9-43ac-a1b8-f1ca369a6dc8-kube-api-access-z2frs podName:2e904774-10d9-43ac-a1b8-f1ca369a6dc8 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:05.830037581 +0000 UTC m=+4.194789492 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-z2frs" (UniqueName: "kubernetes.io/projected/2e904774-10d9-43ac-a1b8-f1ca369a6dc8-kube-api-access-z2frs") pod "network-check-target-bl5d7" (UID: "2e904774-10d9-43ac-a1b8-f1ca369a6dc8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:51:05.076184 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:05.076005 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 16:46:04 +0000 UTC" deadline="2028-03-03 21:38:09.889695831 +0000 UTC" Jul 09 16:51:05.076184 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:05.076046 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14476h47m4.813656483s" Jul 09 16:51:05.171873 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:05.171835 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:05.172027 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:05.171969 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ncs8" podUID="b588a7a9-4426-4011-a6e2-e88403477517" Jul 09 16:51:05.182945 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:05.182908 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" event={"ID":"8b016980-cd0d-4bbe-b741-c5f96abe1e36","Type":"ContainerStarted","Data":"ae790ce13fce356b1c3e2f23cbd2e520f969099d6a4ff3b416a1b2eea2eec7ee"} Jul 09 16:51:05.186556 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:05.186522 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vv786" event={"ID":"5a0702a8-5e0f-4188-b630-85082fa9cb36","Type":"ContainerStarted","Data":"c1c5b0d982c8987e711a5d7fa76ac12bcabf17574c94f31f334e81a2ed291e2d"} Jul 09 16:51:05.188430 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:05.188408 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v9qrc" event={"ID":"73f90b5e-46be-448d-9429-79bebdd0c83e","Type":"ContainerStarted","Data":"d1d35eec74e600c9a593fc4e3aed08ef326198bf7bc7135eb796b60eedc14fe3"} Jul 09 16:51:05.190656 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:05.190632 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r8p6t" event={"ID":"971e1a9a-5666-4e2e-b0bc-c3ea99d4ee9e","Type":"ContainerStarted","Data":"5e87128bb5870dac6508408ce3b7b37e5866b9c3245b87bb7ecbb9bd1b97b46b"} Jul 09 16:51:05.192404 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:05.192377 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8vrq6" event={"ID":"d32c3245-4bca-41b7-9b6f-4b2f2fbd4dfc","Type":"ContainerStarted","Data":"5e126fbc79c8a2ff8590fff00f23734f1ede2421aa3199fe64fb4605edd78792"} Jul 09 16:51:05.194770 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:05.194746 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p2289" event={"ID":"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9","Type":"ContainerStarted","Data":"2f56e21cb1af7bcbb4ce309d024ad430c61cc99e8426503b7c8dd785919467d7"} Jul 09 16:51:05.197037 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:05.197013 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" event={"ID":"12995bc0-2245-4f06-aad5-b496fd24f0b1","Type":"ContainerStarted","Data":"c714292240029a1bed707e4b0b9899e3220a3ed8bd5af02c15d2435574c89781"} Jul 09 16:51:05.198835 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:05.198808 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kgbtw" event={"ID":"bbbb42c9-70b4-4367-937d-b8e13c0c10c6","Type":"ContainerStarted","Data":"6f0e1e99045096dfe0ca01d60f30ca0252c6005387569f5ef37158ac95a71934"} Jul 09 16:51:05.200711 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:05.200689 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q" event={"ID":"8f7baf6c-53e6-49ce-bb21-0872229d89de","Type":"ContainerStarted","Data":"84fb373febd3fe257960a4d9cc7bb6dd5b3c65619ddac64ebcba193b8f0a0601"} Jul 09 16:51:05.637628 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:05.637580 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b588a7a9-4426-4011-a6e2-e88403477517-original-pull-secret\") pod \"global-pull-secret-syncer-6ncs8\" (UID: \"b588a7a9-4426-4011-a6e2-e88403477517\") " pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:05.637896 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:05.637871 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:51:05.637982 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:05.637959 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b588a7a9-4426-4011-a6e2-e88403477517-original-pull-secret podName:b588a7a9-4426-4011-a6e2-e88403477517 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:07.637937598 +0000 UTC m=+6.002689499 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b588a7a9-4426-4011-a6e2-e88403477517-original-pull-secret") pod "global-pull-secret-syncer-6ncs8" (UID: "b588a7a9-4426-4011-a6e2-e88403477517") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:51:05.738377 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:05.738335 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913-metrics-certs\") pod \"network-metrics-daemon-4xnp4\" (UID: \"cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913\") " pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:05.738544 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:05.738507 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:51:05.738620 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:05.738578 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913-metrics-certs podName:cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:07.738558556 +0000 UTC m=+6.103310467 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913-metrics-certs") pod "network-metrics-daemon-4xnp4" (UID: "cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:51:05.839140 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:05.839100 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2frs\" (UniqueName: \"kubernetes.io/projected/2e904774-10d9-43ac-a1b8-f1ca369a6dc8-kube-api-access-z2frs\") pod \"network-check-target-bl5d7\" (UID: \"2e904774-10d9-43ac-a1b8-f1ca369a6dc8\") " pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:05.839376 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:05.839357 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:51:05.839464 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:05.839386 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:51:05.839464 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:05.839399 2580 projected.go:196] Error preparing data for projected volume kube-api-access-z2frs for pod openshift-network-diagnostics/network-check-target-bl5d7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:51:05.839562 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:05.839477 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e904774-10d9-43ac-a1b8-f1ca369a6dc8-kube-api-access-z2frs podName:2e904774-10d9-43ac-a1b8-f1ca369a6dc8 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:07.839443415 +0000 UTC m=+6.204195332 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-z2frs" (UniqueName: "kubernetes.io/projected/2e904774-10d9-43ac-a1b8-f1ca369a6dc8-kube-api-access-z2frs") pod "network-check-target-bl5d7" (UID: "2e904774-10d9-43ac-a1b8-f1ca369a6dc8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:51:06.076871 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:06.076757 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 16:46:04 +0000 UTC" deadline="2028-01-23 10:32:54.23591106 +0000 UTC" Jul 09 16:51:06.076871 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:06.076821 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13505h41m48.159094612s" Jul 09 16:51:06.174151 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:06.174111 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:06.174359 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:06.174259 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xnp4" podUID="cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913" Jul 09 16:51:06.174669 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:06.174651 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:06.174777 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:06.174743 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bl5d7" podUID="2e904774-10d9-43ac-a1b8-f1ca369a6dc8" Jul 09 16:51:07.172314 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:07.171894 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:07.172314 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:07.171995 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ncs8" podUID="b588a7a9-4426-4011-a6e2-e88403477517" Jul 09 16:51:07.663502 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:07.663411 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b588a7a9-4426-4011-a6e2-e88403477517-original-pull-secret\") pod \"global-pull-secret-syncer-6ncs8\" (UID: \"b588a7a9-4426-4011-a6e2-e88403477517\") " pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:07.663682 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:07.663652 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:51:07.663764 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:07.663725 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b588a7a9-4426-4011-a6e2-e88403477517-original-pull-secret podName:b588a7a9-4426-4011-a6e2-e88403477517 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:11.663704981 +0000 UTC m=+10.028456894 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b588a7a9-4426-4011-a6e2-e88403477517-original-pull-secret") pod "global-pull-secret-syncer-6ncs8" (UID: "b588a7a9-4426-4011-a6e2-e88403477517") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:51:07.764022 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:07.763979 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913-metrics-certs\") pod \"network-metrics-daemon-4xnp4\" (UID: \"cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913\") " pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:07.764183 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:07.764162 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:51:07.764248 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:07.764238 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913-metrics-certs podName:cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:11.764217754 +0000 UTC m=+10.128969657 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913-metrics-certs") pod "network-metrics-daemon-4xnp4" (UID: "cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:51:07.865299 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:07.865068 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2frs\" (UniqueName: \"kubernetes.io/projected/2e904774-10d9-43ac-a1b8-f1ca369a6dc8-kube-api-access-z2frs\") pod \"network-check-target-bl5d7\" (UID: \"2e904774-10d9-43ac-a1b8-f1ca369a6dc8\") " pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:07.865299 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:07.865271 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:51:07.865531 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:07.865320 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:51:07.865531 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:07.865335 2580 projected.go:196] Error preparing data for projected volume kube-api-access-z2frs for pod openshift-network-diagnostics/network-check-target-bl5d7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:51:07.865531 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:07.865399 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e904774-10d9-43ac-a1b8-f1ca369a6dc8-kube-api-access-z2frs podName:2e904774-10d9-43ac-a1b8-f1ca369a6dc8 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:11.865377827 +0000 UTC m=+10.230129750 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-z2frs" (UniqueName: "kubernetes.io/projected/2e904774-10d9-43ac-a1b8-f1ca369a6dc8-kube-api-access-z2frs") pod "network-check-target-bl5d7" (UID: "2e904774-10d9-43ac-a1b8-f1ca369a6dc8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:51:08.174566 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:08.173769 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:08.174566 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:08.173917 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xnp4" podUID="cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913" Jul 09 16:51:08.174566 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:08.174308 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:08.174566 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:08.174405 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bl5d7" podUID="2e904774-10d9-43ac-a1b8-f1ca369a6dc8" Jul 09 16:51:09.172117 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:09.172080 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:09.172340 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:09.172227 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ncs8" podUID="b588a7a9-4426-4011-a6e2-e88403477517" Jul 09 16:51:10.171652 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:10.171566 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:10.172071 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:10.171567 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:10.172071 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:10.171705 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bl5d7" podUID="2e904774-10d9-43ac-a1b8-f1ca369a6dc8" Jul 09 16:51:10.172071 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:10.171804 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xnp4" podUID="cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913" Jul 09 16:51:11.172300 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:11.172252 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:11.172773 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:11.172397 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ncs8" podUID="b588a7a9-4426-4011-a6e2-e88403477517" Jul 09 16:51:11.697656 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:11.697615 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b588a7a9-4426-4011-a6e2-e88403477517-original-pull-secret\") pod \"global-pull-secret-syncer-6ncs8\" (UID: \"b588a7a9-4426-4011-a6e2-e88403477517\") " pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:11.697823 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:11.697807 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:51:11.697888 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:11.697872 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b588a7a9-4426-4011-a6e2-e88403477517-original-pull-secret podName:b588a7a9-4426-4011-a6e2-e88403477517 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:19.697857089 +0000 UTC m=+18.062608984 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b588a7a9-4426-4011-a6e2-e88403477517-original-pull-secret") pod "global-pull-secret-syncer-6ncs8" (UID: "b588a7a9-4426-4011-a6e2-e88403477517") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:51:11.798422 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:11.798333 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913-metrics-certs\") pod \"network-metrics-daemon-4xnp4\" (UID: \"cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913\") " pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:11.798607 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:11.798540 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:51:11.798668 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:11.798612 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913-metrics-certs podName:cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:19.798591359 +0000 UTC m=+18.163343259 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913-metrics-certs") pod "network-metrics-daemon-4xnp4" (UID: "cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:51:11.899331 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:11.899295 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2frs\" (UniqueName: \"kubernetes.io/projected/2e904774-10d9-43ac-a1b8-f1ca369a6dc8-kube-api-access-z2frs\") pod \"network-check-target-bl5d7\" (UID: \"2e904774-10d9-43ac-a1b8-f1ca369a6dc8\") " pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:11.899526 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:11.899468 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:51:11.899526 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:11.899492 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:51:11.899526 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:11.899506 2580 projected.go:196] Error preparing data for projected volume kube-api-access-z2frs for pod openshift-network-diagnostics/network-check-target-bl5d7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:51:11.899646 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:11.899579 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e904774-10d9-43ac-a1b8-f1ca369a6dc8-kube-api-access-z2frs podName:2e904774-10d9-43ac-a1b8-f1ca369a6dc8 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:19.899556519 +0000 UTC m=+18.264308416 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-z2frs" (UniqueName: "kubernetes.io/projected/2e904774-10d9-43ac-a1b8-f1ca369a6dc8-kube-api-access-z2frs") pod "network-check-target-bl5d7" (UID: "2e904774-10d9-43ac-a1b8-f1ca369a6dc8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:51:12.172824 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:12.172783 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:12.173307 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:12.172914 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xnp4" podUID="cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913" Jul 09 16:51:12.173307 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:12.173002 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:12.173307 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:12.173107 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bl5d7" podUID="2e904774-10d9-43ac-a1b8-f1ca369a6dc8" Jul 09 16:51:13.172224 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:13.172179 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:13.172404 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:13.172336 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ncs8" podUID="b588a7a9-4426-4011-a6e2-e88403477517" Jul 09 16:51:14.173595 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:14.173558 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:14.173999 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:14.173672 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bl5d7" podUID="2e904774-10d9-43ac-a1b8-f1ca369a6dc8" Jul 09 16:51:14.174060 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:14.174019 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:14.174157 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:14.174124 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xnp4" podUID="cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913" Jul 09 16:51:15.171880 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:15.171842 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:15.172046 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:15.171978 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ncs8" podUID="b588a7a9-4426-4011-a6e2-e88403477517" Jul 09 16:51:16.171388 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:16.171355 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:16.171851 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:16.171361 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:16.171851 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:16.171487 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xnp4" podUID="cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913" Jul 09 16:51:16.171851 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:16.171567 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bl5d7" podUID="2e904774-10d9-43ac-a1b8-f1ca369a6dc8" Jul 09 16:51:17.171840 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:17.171798 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:17.172267 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:17.171938 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ncs8" podUID="b588a7a9-4426-4011-a6e2-e88403477517" Jul 09 16:51:18.174628 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:18.174586 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:18.175106 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:18.174722 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xnp4" podUID="cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913" Jul 09 16:51:18.175106 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:18.174750 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:18.175106 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:18.174866 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bl5d7" podUID="2e904774-10d9-43ac-a1b8-f1ca369a6dc8" Jul 09 16:51:19.172031 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:19.171998 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:19.172294 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:19.172129 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ncs8" podUID="b588a7a9-4426-4011-a6e2-e88403477517" Jul 09 16:51:19.762031 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:19.761989 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b588a7a9-4426-4011-a6e2-e88403477517-original-pull-secret\") pod \"global-pull-secret-syncer-6ncs8\" (UID: \"b588a7a9-4426-4011-a6e2-e88403477517\") " pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:19.762485 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:19.762125 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:51:19.762485 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:19.762175 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b588a7a9-4426-4011-a6e2-e88403477517-original-pull-secret podName:b588a7a9-4426-4011-a6e2-e88403477517 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:35.762160087 +0000 UTC m=+34.126911981 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b588a7a9-4426-4011-a6e2-e88403477517-original-pull-secret") pod "global-pull-secret-syncer-6ncs8" (UID: "b588a7a9-4426-4011-a6e2-e88403477517") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:51:19.862388 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:19.862349 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913-metrics-certs\") pod \"network-metrics-daemon-4xnp4\" (UID: \"cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913\") " pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:19.862570 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:19.862518 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:51:19.862641 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:19.862586 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913-metrics-certs podName:cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:35.862567286 +0000 UTC m=+34.227319180 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913-metrics-certs") pod "network-metrics-daemon-4xnp4" (UID: "cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:51:19.963489 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:19.963452 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2frs\" (UniqueName: \"kubernetes.io/projected/2e904774-10d9-43ac-a1b8-f1ca369a6dc8-kube-api-access-z2frs\") pod \"network-check-target-bl5d7\" (UID: \"2e904774-10d9-43ac-a1b8-f1ca369a6dc8\") " pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:19.963679 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:19.963603 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:51:19.963679 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:19.963622 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:51:19.963679 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:19.963636 2580 projected.go:196] Error preparing data for projected volume kube-api-access-z2frs for pod openshift-network-diagnostics/network-check-target-bl5d7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:51:19.963837 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:19.963691 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e904774-10d9-43ac-a1b8-f1ca369a6dc8-kube-api-access-z2frs podName:2e904774-10d9-43ac-a1b8-f1ca369a6dc8 nodeName:}" failed. No retries permitted until 2026-07-09 16:51:35.963671484 +0000 UTC m=+34.328423395 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-z2frs" (UniqueName: "kubernetes.io/projected/2e904774-10d9-43ac-a1b8-f1ca369a6dc8-kube-api-access-z2frs") pod "network-check-target-bl5d7" (UID: "2e904774-10d9-43ac-a1b8-f1ca369a6dc8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:51:20.171830 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:20.171799 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:20.172036 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:20.171925 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xnp4" podUID="cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913" Jul 09 16:51:20.172036 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:20.172011 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:20.172158 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:20.172118 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bl5d7" podUID="2e904774-10d9-43ac-a1b8-f1ca369a6dc8" Jul 09 16:51:21.171981 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:21.171942 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:21.172486 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:21.172090 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ncs8" podUID="b588a7a9-4426-4011-a6e2-e88403477517" Jul 09 16:51:22.173234 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:22.173190 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:22.173674 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:22.173237 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:22.173674 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:22.173357 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xnp4" podUID="cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913" Jul 09 16:51:22.173674 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:22.173490 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bl5d7" podUID="2e904774-10d9-43ac-a1b8-f1ca369a6dc8" Jul 09 16:51:23.171842 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:23.171804 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:23.172019 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:23.171928 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ncs8" podUID="b588a7a9-4426-4011-a6e2-e88403477517" Jul 09 16:51:24.171716 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:24.171659 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:24.172075 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:24.171763 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xnp4" podUID="cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913" Jul 09 16:51:24.172137 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:24.172107 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:24.172210 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:24.172169 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bl5d7" podUID="2e904774-10d9-43ac-a1b8-f1ca369a6dc8" Jul 09 16:51:24.243459 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:24.243409 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-34.ec2.internal" event={"ID":"c328db57ded294448d0f09b85263bba6","Type":"ContainerStarted","Data":"4e97fb5af8b2d512de8010e3918339325705bd2c882ff239b77f3e856c1e4c91"} Jul 09 16:51:24.244918 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:24.244897 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" event={"ID":"8b016980-cd0d-4bbe-b741-c5f96abe1e36","Type":"ContainerStarted","Data":"832671bbaceab358c6752b8027f9d486e3bd3f5b8160b658e5d55dd59a134521"} Jul 09 16:51:24.265255 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:24.265212 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-34.ec2.internal" podStartSLOduration=21.265196667 podStartE2EDuration="21.265196667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:51:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:24.256773706 +0000 UTC m=+22.621525621" watchObservedRunningTime="2026-07-09 16:51:24.265196667 +0000 UTC m=+22.629948592" Jul 09 16:51:25.171900 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:25.171742 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:25.172587 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:25.171976 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ncs8" podUID="b588a7a9-4426-4011-a6e2-e88403477517" Jul 09 16:51:25.251447 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:25.251409 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p2289" event={"ID":"cd1f84c4-0cf3-400f-ae55-4d0fd5be8fa9","Type":"ContainerStarted","Data":"bbc495d7e6151ea8d3b55aeca9caa3242ce7a948bfc1e4841a917d3d095c0576"} Jul 09 16:51:25.254026 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:25.253991 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pcwtl_12995bc0-2245-4f06-aad5-b496fd24f0b1/ovn-acl-logging/0.log" Jul 09 16:51:25.254412 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:25.254391 2580 generic.go:356] "Generic (PLEG): container finished" podID="12995bc0-2245-4f06-aad5-b496fd24f0b1" containerID="803a628d0a8ecbc6e423155289402691118d9f8c3b50f8391a4f3f07b831c91b" exitCode=1 Jul 09 16:51:25.254495 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:25.254454 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" event={"ID":"12995bc0-2245-4f06-aad5-b496fd24f0b1","Type":"ContainerStarted","Data":"c36b06884cf8d3b1945d46ad7f195524cedabb0c68e732327fdc5b471bffe8fb"} Jul 09 16:51:25.254537 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:25.254518 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" event={"ID":"12995bc0-2245-4f06-aad5-b496fd24f0b1","Type":"ContainerStarted","Data":"6b2f1912d268c5a120983d92b0026f1ac4c0326b1b3b85f902deb51b0512450b"} Jul 09 16:51:25.254572 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:25.254552 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" event={"ID":"12995bc0-2245-4f06-aad5-b496fd24f0b1","Type":"ContainerStarted","Data":"8c219da29953e44312e67b712dddcc9ef68bde8dc8c9aa845369e9c054f6f8e8"} Jul 09 16:51:25.254614 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:25.254581 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" event={"ID":"12995bc0-2245-4f06-aad5-b496fd24f0b1","Type":"ContainerStarted","Data":"9e8311808189074b38eb68ae32af9dbc69ccbc19afb3769eb0775635aa51e98d"} Jul 09 16:51:25.254614 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:25.254609 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" event={"ID":"12995bc0-2245-4f06-aad5-b496fd24f0b1","Type":"ContainerDied","Data":"803a628d0a8ecbc6e423155289402691118d9f8c3b50f8391a4f3f07b831c91b"} Jul 09 16:51:25.254709 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:25.254639 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" event={"ID":"12995bc0-2245-4f06-aad5-b496fd24f0b1","Type":"ContainerStarted","Data":"1cfda0ac03d9bf08eacbb9414230af4d0f665c50c308c6a5a9dc988812e29393"} Jul 09 16:51:25.267804 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:25.267654 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-p2289" podStartSLOduration=3.585080157 podStartE2EDuration="23.267641354s" totalImagesPullingTime="19.682561197s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:25.267163479 +0000 UTC m=+23.631915396" watchObservedRunningTime="2026-07-09 16:51:25.267641354 +0000 UTC m=+23.632393285" Jul 09 16:51:25.283147 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:25.283048 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kbkxl" podStartSLOduration=3.625141257 podStartE2EDuration="23.283030472s" totalImagesPullingTime="19.657889215s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:25.282365596 +0000 UTC m=+23.647117513" watchObservedRunningTime="2026-07-09 16:51:25.283030472 +0000 UTC m=+23.647782389" Jul 09 16:51:26.171756 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:26.171582 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:26.171937 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:26.171639 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:26.171937 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:26.171835 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xnp4" podUID="cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913" Jul 09 16:51:26.171937 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:26.171918 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bl5d7" podUID="2e904774-10d9-43ac-a1b8-f1ca369a6dc8" Jul 09 16:51:26.258717 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:26.258686 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kgbtw" event={"ID":"bbbb42c9-70b4-4367-937d-b8e13c0c10c6","Type":"ContainerStarted","Data":"6aa753e5233947c2d04d416bd6db0c2d3494795e35b7323214f7079fb9f2eca1"} Jul 09 16:51:26.260147 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:26.260123 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q" event={"ID":"8f7baf6c-53e6-49ce-bb21-0872229d89de","Type":"ContainerStarted","Data":"24060feb124c94cd0bc5dce1955453f8b1170c48bf47839bc982c0f047915e1e"} Jul 09 16:51:26.261747 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:26.261721 2580 generic.go:356] "Generic (PLEG): container finished" podID="d9f5f719f4ba8d3ed82df03e5db9cbe1" containerID="558313e2cb2292dae1959907baa7e3ccac74fd03d7cc46679fe8f1ce86798324" exitCode=0 Jul 09 16:51:26.261915 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:26.261777 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-34.ec2.internal" event={"ID":"d9f5f719f4ba8d3ed82df03e5db9cbe1","Type":"ContainerDied","Data":"558313e2cb2292dae1959907baa7e3ccac74fd03d7cc46679fe8f1ce86798324"} Jul 09 16:51:26.263210 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:26.263189 2580 generic.go:356] "Generic (PLEG): container finished" podID="5a0702a8-5e0f-4188-b630-85082fa9cb36" containerID="689235bd2ee648a4e3871a96cb1fa9632823d30f229329c440e8201d264b4466" exitCode=0 Jul 09 16:51:26.263335 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:26.263247 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vv786" event={"ID":"5a0702a8-5e0f-4188-b630-85082fa9cb36","Type":"ContainerDied","Data":"689235bd2ee648a4e3871a96cb1fa9632823d30f229329c440e8201d264b4466"} Jul 09 16:51:26.264707 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:26.264689 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v9qrc" event={"ID":"73f90b5e-46be-448d-9429-79bebdd0c83e","Type":"ContainerStarted","Data":"c029dd50863c3697af6fd266299d5099075aa465857772f21b29d6a6644ffdac"} Jul 09 16:51:26.266167 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:26.266149 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r8p6t" event={"ID":"971e1a9a-5666-4e2e-b0bc-c3ea99d4ee9e","Type":"ContainerStarted","Data":"e215a3e89136b5a5fadcf2d94336fca8d32ca64fb911a87ee3f28ffc3adcc9ae"} Jul 09 16:51:26.267635 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:26.267613 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8vrq6" event={"ID":"d32c3245-4bca-41b7-9b6f-4b2f2fbd4dfc","Type":"ContainerStarted","Data":"2cd4dd134a74b8da4b606b191084888714051f6e3185174794e0db19a895a46b"} Jul 09 16:51:26.273936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:26.273848 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kgbtw" podStartSLOduration=4.629678804 podStartE2EDuration="24.273837884s" totalImagesPullingTime="19.64415908s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:26.273812576 +0000 UTC m=+24.638564493" watchObservedRunningTime="2026-07-09 16:51:26.273837884 +0000 UTC m=+24.638589800" Jul 09 16:51:26.319468 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:26.319447 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 16:51:26.330439 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:26.330388 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8vrq6" podStartSLOduration=4.616205184 podStartE2EDuration="24.330366363s" totalImagesPullingTime="19.714161179s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:26.329719105 +0000 UTC m=+24.694471022" watchObservedRunningTime="2026-07-09 16:51:26.330366363 +0000 UTC m=+24.695118279" Jul 09 16:51:26.356673 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:26.356630 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-v9qrc" podStartSLOduration=13.113553641 podStartE2EDuration="24.356614669s" totalImagesPullingTime="11.243061028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:26.355876557 +0000 UTC m=+24.720628473" watchObservedRunningTime="2026-07-09 16:51:26.356614669 +0000 UTC m=+24.721366584" Jul 09 16:51:27.076839 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:27.076746 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T16:51:26.319464368Z","UUID":"f0dc645d-56f0-491f-a3b6-f3b056a87f1a","Handler":null,"Name":"","Endpoint":""} Jul 09 16:51:27.078347 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:27.078325 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 16:51:27.078470 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:27.078360 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 16:51:27.171663 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:27.171643 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:27.171774 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:27.171756 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ncs8" podUID="b588a7a9-4426-4011-a6e2-e88403477517" Jul 09 16:51:27.275633 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:27.273091 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pcwtl_12995bc0-2245-4f06-aad5-b496fd24f0b1/ovn-acl-logging/0.log" Jul 09 16:51:27.276150 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:27.276116 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" event={"ID":"12995bc0-2245-4f06-aad5-b496fd24f0b1","Type":"ContainerStarted","Data":"6f1c626af0b476a83a4958583263ee4edf3b3c4345fd7802e93473df2a824316"} Jul 09 16:51:27.277956 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:27.277934 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q" event={"ID":"8f7baf6c-53e6-49ce-bb21-0872229d89de","Type":"ContainerStarted","Data":"819cb874ce9dec1e1ce2050b6f467081d6369ed0d86c0d738ab6571046b1ee4e"} Jul 09 16:51:27.279886 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:27.279835 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-34.ec2.internal" event={"ID":"d9f5f719f4ba8d3ed82df03e5db9cbe1","Type":"ContainerStarted","Data":"cc260f4de5e0c9a0690c5fca9fe177b706814a7651bb590175604082138fd209"} Jul 09 16:51:27.294428 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:27.294381 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-34.ec2.internal" podStartSLOduration=24.294367588 podStartE2EDuration="24.294367588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:51:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:27.29395506 +0000 UTC m=+25.658706975" watchObservedRunningTime="2026-07-09 16:51:27.294367588 +0000 UTC m=+25.659119503" Jul 09 16:51:27.294704 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:27.294680 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-r8p6t" podStartSLOduration=5.640530225 podStartE2EDuration="25.294672635s" totalImagesPullingTime="19.65414241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:26.373694594 +0000 UTC m=+24.738446536" watchObservedRunningTime="2026-07-09 16:51:27.294672635 +0000 UTC m=+25.659424551" Jul 09 16:51:27.503679 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:27.503653 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kgbtw_bbbb42c9-70b4-4367-937d-b8e13c0c10c6/dns-node-resolver/0.log" Jul 09 16:51:27.526129 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:27.526097 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-v9qrc" Jul 09 16:51:27.526773 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:27.526742 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-v9qrc" Jul 09 16:51:28.171948 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:28.171731 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:28.172145 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:28.171787 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:28.172145 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:28.171977 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xnp4" podUID="cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913" Jul 09 16:51:28.172145 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:28.172036 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bl5d7" podUID="2e904774-10d9-43ac-a1b8-f1ca369a6dc8" Jul 09 16:51:28.285236 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:28.285174 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q" event={"ID":"8f7baf6c-53e6-49ce-bb21-0872229d89de","Type":"ContainerStarted","Data":"4283b5e39ae050b3d8c6fbb817d48828747c0047c0011292af252324e58177ac"} Jul 09 16:51:28.302419 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:28.302359 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lg55q" podStartSLOduration=4.143228775 podStartE2EDuration="26.302338069s" totalImagesPullingTime="22.159109294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:51:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:28.301721719 +0000 UTC m=+26.666473636" watchObservedRunningTime="2026-07-09 16:51:28.302338069 +0000 UTC m=+26.667089986" Jul 09 16:51:28.325880 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:28.325853 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-v9qrc" Jul 09 16:51:28.326391 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:28.326370 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-v9qrc" Jul 09 16:51:28.684905 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:28.684879 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r8p6t_971e1a9a-5666-4e2e-b0bc-c3ea99d4ee9e/node-ca/0.log" Jul 09 16:51:29.171616 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:29.171586 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:29.171800 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:29.171704 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ncs8" podUID="b588a7a9-4426-4011-a6e2-e88403477517" Jul 09 16:51:30.171805 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:30.171610 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:30.172635 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:30.171610 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:30.172635 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:30.171919 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xnp4" podUID="cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913" Jul 09 16:51:30.172635 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:30.171981 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bl5d7" podUID="2e904774-10d9-43ac-a1b8-f1ca369a6dc8" Jul 09 16:51:30.296897 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:30.296865 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pcwtl_12995bc0-2245-4f06-aad5-b496fd24f0b1/ovn-acl-logging/0.log" Jul 09 16:51:30.298063 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:30.298041 2580 scope.go:117] "RemoveContainer" containerID="803a628d0a8ecbc6e423155289402691118d9f8c3b50f8391a4f3f07b831c91b" Jul 09 16:51:30.298440 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:30.298414 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" event={"ID":"12995bc0-2245-4f06-aad5-b496fd24f0b1","Type":"ContainerStarted","Data":"74bc0bb3421b77eced1abf56142dc46734b8ee0d95e184f6c561a426b90e77b8"} Jul 09 16:51:30.298600 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:30.298584 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:30.298683 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:30.298667 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:30.298848 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:30.298826 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:30.316702 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:30.316619 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:30.317619 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:30.317597 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:51:31.171833 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:31.171802 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:31.172273 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:31.171909 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ncs8" podUID="b588a7a9-4426-4011-a6e2-e88403477517" Jul 09 16:51:32.172147 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:32.172120 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:32.172564 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:32.172262 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bl5d7" podUID="2e904774-10d9-43ac-a1b8-f1ca369a6dc8" Jul 09 16:51:32.172564 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:32.172309 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:32.172564 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:32.172390 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xnp4" podUID="cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913" Jul 09 16:51:32.304099 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:32.304062 2580 generic.go:356] "Generic (PLEG): container finished" podID="5a0702a8-5e0f-4188-b630-85082fa9cb36" containerID="46c6cff660cc580929f0251f200dc2fefc0a10aa6fb348ab62fe1602e458b617" exitCode=0 Jul 09 16:51:32.304274 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:32.304142 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vv786" event={"ID":"5a0702a8-5e0f-4188-b630-85082fa9cb36","Type":"ContainerDied","Data":"46c6cff660cc580929f0251f200dc2fefc0a10aa6fb348ab62fe1602e458b617"} Jul 09 16:51:32.307917 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:32.307890 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pcwtl_12995bc0-2245-4f06-aad5-b496fd24f0b1/ovn-acl-logging/0.log" Jul 09 16:51:32.308293 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:32.308251 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" event={"ID":"12995bc0-2245-4f06-aad5-b496fd24f0b1","Type":"ContainerStarted","Data":"2715d1877f2b280147ebe6dcb0e37532e9e254035f7cb31494ec76f2abef0f89"} Jul 09 16:51:32.361848 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:32.361810 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" podStartSLOduration=10.632185992 podStartE2EDuration="30.361797134s" totalImagesPullingTime="19.729611142s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:32.361236898 +0000 UTC m=+30.725988814" watchObservedRunningTime="2026-07-09 16:51:32.361797134 +0000 UTC m=+30.726549050" Jul 09 16:51:33.172113 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:33.172090 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:33.172217 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:33.172175 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ncs8" podUID="b588a7a9-4426-4011-a6e2-e88403477517" Jul 09 16:51:33.312291 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:33.312241 2580 generic.go:356] "Generic (PLEG): container finished" podID="5a0702a8-5e0f-4188-b630-85082fa9cb36" containerID="fce315a4c4ba6202be8986c9d368f6288219ad2ba741f63ff93d06bbb585260a" exitCode=0 Jul 09 16:51:33.312443 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:33.312326 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vv786" event={"ID":"5a0702a8-5e0f-4188-b630-85082fa9cb36","Type":"ContainerDied","Data":"fce315a4c4ba6202be8986c9d368f6288219ad2ba741f63ff93d06bbb585260a"} Jul 09 16:51:34.171698 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:34.171663 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:34.171864 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:34.171777 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xnp4" podUID="cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913" Jul 09 16:51:34.171864 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:34.171836 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:34.172004 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:34.171926 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bl5d7" podUID="2e904774-10d9-43ac-a1b8-f1ca369a6dc8" Jul 09 16:51:34.317092 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:34.317001 2580 generic.go:356] "Generic (PLEG): container finished" podID="5a0702a8-5e0f-4188-b630-85082fa9cb36" containerID="e2a994faf4cb39a086144f8085cc97de7e275c40918e8ed4291094532bfd13dc" exitCode=0 Jul 09 16:51:34.317092 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:34.317054 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vv786" event={"ID":"5a0702a8-5e0f-4188-b630-85082fa9cb36","Type":"ContainerDied","Data":"e2a994faf4cb39a086144f8085cc97de7e275c40918e8ed4291094532bfd13dc"} Jul 09 16:51:35.171679 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:35.171637 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:35.171862 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:35.171772 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ncs8" podUID="b588a7a9-4426-4011-a6e2-e88403477517" Jul 09 16:51:35.781490 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:35.781447 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b588a7a9-4426-4011-a6e2-e88403477517-original-pull-secret\") pod \"global-pull-secret-syncer-6ncs8\" (UID: \"b588a7a9-4426-4011-a6e2-e88403477517\") " pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:35.781988 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:35.781609 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 16:51:35.781988 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:35.781680 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b588a7a9-4426-4011-a6e2-e88403477517-original-pull-secret podName:b588a7a9-4426-4011-a6e2-e88403477517 nodeName:}" failed. No retries permitted until 2026-07-09 16:52:07.781662955 +0000 UTC m=+66.146414864 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b588a7a9-4426-4011-a6e2-e88403477517-original-pull-secret") pod "global-pull-secret-syncer-6ncs8" (UID: "b588a7a9-4426-4011-a6e2-e88403477517") : object "kube-system"/"original-pull-secret" not registered Jul 09 16:51:35.882901 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:35.882863 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913-metrics-certs\") pod \"network-metrics-daemon-4xnp4\" (UID: \"cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913\") " pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:35.883068 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:35.883028 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:51:35.883135 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:35.883100 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913-metrics-certs podName:cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913 nodeName:}" failed. No retries permitted until 2026-07-09 16:52:07.883085683 +0000 UTC m=+66.247837579 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913-metrics-certs") pod "network-metrics-daemon-4xnp4" (UID: "cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 16:51:35.983502 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:35.983464 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2frs\" (UniqueName: \"kubernetes.io/projected/2e904774-10d9-43ac-a1b8-f1ca369a6dc8-kube-api-access-z2frs\") pod \"network-check-target-bl5d7\" (UID: \"2e904774-10d9-43ac-a1b8-f1ca369a6dc8\") " pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:35.983652 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:35.983598 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 16:51:35.983652 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:35.983612 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 16:51:35.983652 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:35.983621 2580 projected.go:196] Error preparing data for projected volume kube-api-access-z2frs for pod openshift-network-diagnostics/network-check-target-bl5d7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:51:35.983788 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:35.983671 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e904774-10d9-43ac-a1b8-f1ca369a6dc8-kube-api-access-z2frs podName:2e904774-10d9-43ac-a1b8-f1ca369a6dc8 nodeName:}" failed. No retries permitted until 2026-07-09 16:52:07.983658031 +0000 UTC m=+66.348409925 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-z2frs" (UniqueName: "kubernetes.io/projected/2e904774-10d9-43ac-a1b8-f1ca369a6dc8-kube-api-access-z2frs") pod "network-check-target-bl5d7" (UID: "2e904774-10d9-43ac-a1b8-f1ca369a6dc8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 16:51:36.171494 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:36.171460 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:36.171494 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:36.171473 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:36.171738 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:36.171636 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xnp4" podUID="cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913" Jul 09 16:51:36.171799 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:36.171760 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bl5d7" podUID="2e904774-10d9-43ac-a1b8-f1ca369a6dc8" Jul 09 16:51:37.172119 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:37.172074 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:37.172550 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:37.172201 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ncs8" podUID="b588a7a9-4426-4011-a6e2-e88403477517" Jul 09 16:51:38.171871 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:38.171834 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:38.172067 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:38.171844 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:38.172067 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:38.171973 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bl5d7" podUID="2e904774-10d9-43ac-a1b8-f1ca369a6dc8" Jul 09 16:51:38.172067 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:38.172036 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xnp4" podUID="cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913" Jul 09 16:51:39.172103 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:39.172079 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:39.172238 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:39.172179 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ncs8" podUID="b588a7a9-4426-4011-a6e2-e88403477517" Jul 09 16:51:39.331853 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:39.331817 2580 generic.go:356] "Generic (PLEG): container finished" podID="5a0702a8-5e0f-4188-b630-85082fa9cb36" containerID="0e3c5c34330437cf55a222c3ec2f4c1fd8353bbacad283b15075c6cb715f82ef" exitCode=0 Jul 09 16:51:39.332015 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:39.331885 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vv786" event={"ID":"5a0702a8-5e0f-4188-b630-85082fa9cb36","Type":"ContainerDied","Data":"0e3c5c34330437cf55a222c3ec2f4c1fd8353bbacad283b15075c6cb715f82ef"} Jul 09 16:51:40.172003 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:40.171975 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:40.172172 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:40.172082 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xnp4" podUID="cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913" Jul 09 16:51:40.172222 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:40.172167 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:40.172331 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:40.172309 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bl5d7" podUID="2e904774-10d9-43ac-a1b8-f1ca369a6dc8" Jul 09 16:51:40.336638 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:40.336596 2580 generic.go:356] "Generic (PLEG): container finished" podID="5a0702a8-5e0f-4188-b630-85082fa9cb36" containerID="6439aed27016d7b02cebf6c6c6e88e4c6e910e11be30882233f515a132ea8269" exitCode=0 Jul 09 16:51:40.336638 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:40.336636 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vv786" event={"ID":"5a0702a8-5e0f-4188-b630-85082fa9cb36","Type":"ContainerDied","Data":"6439aed27016d7b02cebf6c6c6e88e4c6e910e11be30882233f515a132ea8269"} Jul 09 16:51:41.172275 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:41.172241 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:41.172437 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:41.172363 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ncs8" podUID="b588a7a9-4426-4011-a6e2-e88403477517" Jul 09 16:51:41.341964 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:41.341922 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vv786" event={"ID":"5a0702a8-5e0f-4188-b630-85082fa9cb36","Type":"ContainerStarted","Data":"a56550ac9ab4f5da0bcb02da14a284068c0c13b0259a7dbbc71e7ad51913bba7"} Jul 09 16:51:41.364268 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:41.364221 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vv786" podStartSLOduration=8.05047242 podStartE2EDuration="39.364207283s" totalImagesPullingTime="31.313734863s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:51:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:41.363683975 +0000 UTC m=+39.728435890" watchObservedRunningTime="2026-07-09 16:51:41.364207283 +0000 UTC m=+39.728959195" Jul 09 16:51:42.174506 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:42.174479 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:42.174872 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:42.174568 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bl5d7" podUID="2e904774-10d9-43ac-a1b8-f1ca369a6dc8" Jul 09 16:51:42.174872 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:42.174616 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:42.174872 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:42.174702 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xnp4" podUID="cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913" Jul 09 16:51:43.171754 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:43.171722 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:43.171931 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:43.171825 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ncs8" podUID="b588a7a9-4426-4011-a6e2-e88403477517" Jul 09 16:51:44.171762 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:44.171720 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:44.172244 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:44.171819 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bl5d7" podUID="2e904774-10d9-43ac-a1b8-f1ca369a6dc8" Jul 09 16:51:44.172244 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:44.171848 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:44.172244 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:44.171902 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xnp4" podUID="cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913" Jul 09 16:51:45.171638 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:45.171607 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:45.171808 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:45.171709 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ncs8" podUID="b588a7a9-4426-4011-a6e2-e88403477517" Jul 09 16:51:46.174151 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:46.174122 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:46.174531 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:46.174122 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:46.174531 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:46.174228 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bl5d7" podUID="2e904774-10d9-43ac-a1b8-f1ca369a6dc8" Jul 09 16:51:46.174531 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:46.174327 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xnp4" podUID="cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913" Jul 09 16:51:47.172034 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:47.172000 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:47.172205 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:47.172105 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ncs8" podUID="b588a7a9-4426-4011-a6e2-e88403477517" Jul 09 16:51:48.177336 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:48.177303 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:48.177714 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:48.177303 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:48.177714 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:48.177426 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xnp4" podUID="cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913" Jul 09 16:51:48.177714 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:48.177461 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bl5d7" podUID="2e904774-10d9-43ac-a1b8-f1ca369a6dc8" Jul 09 16:51:49.171749 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:49.171720 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:49.171910 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:49.171845 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ncs8" podUID="b588a7a9-4426-4011-a6e2-e88403477517" Jul 09 16:51:49.289661 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:49.289627 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6ncs8"] Jul 09 16:51:49.292401 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:49.292370 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4xnp4"] Jul 09 16:51:49.292542 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:49.292485 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:49.292627 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:49.292605 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xnp4" podUID="cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913" Jul 09 16:51:49.293024 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:49.292999 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bl5d7"] Jul 09 16:51:49.293138 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:49.293076 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:49.293197 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:49.293159 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bl5d7" podUID="2e904774-10d9-43ac-a1b8-f1ca369a6dc8" Jul 09 16:51:49.359380 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:49.359347 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:49.359537 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:49.359475 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ncs8" podUID="b588a7a9-4426-4011-a6e2-e88403477517" Jul 09 16:51:51.172310 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:51.172250 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:51.172904 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:51.172250 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:51.172904 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:51.172388 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ncs8" podUID="b588a7a9-4426-4011-a6e2-e88403477517" Jul 09 16:51:51.172904 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:51.172250 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:51.172904 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:51.172461 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xnp4" podUID="cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913" Jul 09 16:51:51.172904 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:51.172526 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bl5d7" podUID="2e904774-10d9-43ac-a1b8-f1ca369a6dc8" Jul 09 16:51:53.172162 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.172132 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:53.172496 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.172181 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:53.172496 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.172181 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:53.172496 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:53.172247 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ncs8" podUID="b588a7a9-4426-4011-a6e2-e88403477517" Jul 09 16:51:53.172496 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:53.172337 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bl5d7" podUID="2e904774-10d9-43ac-a1b8-f1ca369a6dc8" Jul 09 16:51:53.172496 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:51:53.172437 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4xnp4" podUID="cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913" Jul 09 16:51:53.471877 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.471803 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-34.ec2.internal" event="NodeReady" Jul 09 16:51:53.472030 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.471946 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 16:51:53.501230 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.501197 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c7455868b-kffv6"] Jul 09 16:51:53.522310 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.522273 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6blm6"] Jul 09 16:51:53.522470 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.522382 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:51:53.524748 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.524723 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-f446k\"" Jul 09 16:51:53.524872 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.524752 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 16:51:53.524872 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.524752 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 16:51:53.524872 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.524829 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 16:51:53.530420 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.530402 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 16:51:53.548399 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.548375 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ksjzw"] Jul 09 16:51:53.548514 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.548498 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6blm6" Jul 09 16:51:53.550822 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.550802 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 16:51:53.550932 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.550839 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 16:51:53.550932 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.550850 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 16:51:53.550932 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.550881 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pbgfq\"" Jul 09 16:51:53.568428 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.568408 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c7455868b-kffv6"] Jul 09 16:51:53.568428 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.568437 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ksjzw"] Jul 09 16:51:53.568575 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.568458 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6blm6"] Jul 09 16:51:53.568575 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.568536 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ksjzw" Jul 09 16:51:53.571367 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.571345 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 16:51:53.571498 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.571479 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 16:51:53.571498 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.571492 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 16:51:53.571621 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.571533 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7gwx2\"" Jul 09 16:51:53.571675 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.571664 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 16:51:53.600558 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.600525 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a849d2c0-577a-4acb-b564-88b57b5a9467-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ksjzw\" (UID: \"a849d2c0-577a-4acb-b564-88b57b5a9467\") " pod="openshift-insights/insights-runtime-extractor-ksjzw" Jul 09 16:51:53.600670 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.600560 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a849d2c0-577a-4acb-b564-88b57b5a9467-crio-socket\") pod \"insights-runtime-extractor-ksjzw\" (UID: \"a849d2c0-577a-4acb-b564-88b57b5a9467\") " pod="openshift-insights/insights-runtime-extractor-ksjzw" Jul 09 16:51:53.600670 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.600606 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkpdq\" (UniqueName: \"kubernetes.io/projected/4fb615a0-9cfe-4db6-85b6-780fda9a647e-kube-api-access-zkpdq\") pod \"ingress-canary-6blm6\" (UID: \"4fb615a0-9cfe-4db6-85b6-780fda9a647e\") " pod="openshift-ingress-canary/ingress-canary-6blm6" Jul 09 16:51:53.600670 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.600621 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5csb\" (UniqueName: \"kubernetes.io/projected/a849d2c0-577a-4acb-b564-88b57b5a9467-kube-api-access-f5csb\") pod \"insights-runtime-extractor-ksjzw\" (UID: \"a849d2c0-577a-4acb-b564-88b57b5a9467\") " pod="openshift-insights/insights-runtime-extractor-ksjzw" Jul 09 16:51:53.600780 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.600684 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36101bde-6cdc-43fd-befb-e435e56754d1-registry-tls\") pod \"image-registry-6c7455868b-kffv6\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:51:53.600780 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.600718 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36101bde-6cdc-43fd-befb-e435e56754d1-registry-certificates\") pod \"image-registry-6c7455868b-kffv6\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:51:53.600780 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.600733 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36101bde-6cdc-43fd-befb-e435e56754d1-bound-sa-token\") pod \"image-registry-6c7455868b-kffv6\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:51:53.600780 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.600751 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fb615a0-9cfe-4db6-85b6-780fda9a647e-cert\") pod \"ingress-canary-6blm6\" (UID: \"4fb615a0-9cfe-4db6-85b6-780fda9a647e\") " pod="openshift-ingress-canary/ingress-canary-6blm6" Jul 09 16:51:53.600780 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.600766 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a849d2c0-577a-4acb-b564-88b57b5a9467-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ksjzw\" (UID: \"a849d2c0-577a-4acb-b564-88b57b5a9467\") " pod="openshift-insights/insights-runtime-extractor-ksjzw" Jul 09 16:51:53.600926 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.600780 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36101bde-6cdc-43fd-befb-e435e56754d1-installation-pull-secrets\") pod \"image-registry-6c7455868b-kffv6\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:51:53.600926 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.600797 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk6b4\" (UniqueName: \"kubernetes.io/projected/36101bde-6cdc-43fd-befb-e435e56754d1-kube-api-access-pk6b4\") pod \"image-registry-6c7455868b-kffv6\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:51:53.600926 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.600847 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36101bde-6cdc-43fd-befb-e435e56754d1-ca-trust-extracted\") pod \"image-registry-6c7455868b-kffv6\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:51:53.600926 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.600870 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36101bde-6cdc-43fd-befb-e435e56754d1-trusted-ca\") pod \"image-registry-6c7455868b-kffv6\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:51:53.600926 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.600890 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a849d2c0-577a-4acb-b564-88b57b5a9467-data-volume\") pod \"insights-runtime-extractor-ksjzw\" (UID: \"a849d2c0-577a-4acb-b564-88b57b5a9467\") " pod="openshift-insights/insights-runtime-extractor-ksjzw" Jul 09 16:51:53.600926 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.600908 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36101bde-6cdc-43fd-befb-e435e56754d1-image-registry-private-configuration\") pod \"image-registry-6c7455868b-kffv6\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:51:53.611678 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.611652 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lsxt4"] Jul 09 16:51:53.634411 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.634387 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lsxt4"] Jul 09 16:51:53.634530 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.634500 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lsxt4" Jul 09 16:51:53.636806 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.636779 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 16:51:53.636932 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.636852 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 16:51:53.636932 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.636895 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pdg8n\"" Jul 09 16:51:53.701544 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.701508 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a849d2c0-577a-4acb-b564-88b57b5a9467-data-volume\") pod \"insights-runtime-extractor-ksjzw\" (UID: \"a849d2c0-577a-4acb-b564-88b57b5a9467\") " pod="openshift-insights/insights-runtime-extractor-ksjzw" Jul 09 16:51:53.701544 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.701546 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36101bde-6cdc-43fd-befb-e435e56754d1-image-registry-private-configuration\") pod \"image-registry-6c7455868b-kffv6\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:51:53.701712 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.701575 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a849d2c0-577a-4acb-b564-88b57b5a9467-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ksjzw\" (UID: \"a849d2c0-577a-4acb-b564-88b57b5a9467\") " pod="openshift-insights/insights-runtime-extractor-ksjzw" Jul 09 16:51:53.701712 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.701606 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a849d2c0-577a-4acb-b564-88b57b5a9467-crio-socket\") pod \"insights-runtime-extractor-ksjzw\" (UID: \"a849d2c0-577a-4acb-b564-88b57b5a9467\") " pod="openshift-insights/insights-runtime-extractor-ksjzw" Jul 09 16:51:53.701712 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.701636 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/308c5900-bf1d-46c1-aba0-72ed4234d313-config-volume\") pod \"dns-default-lsxt4\" (UID: \"308c5900-bf1d-46c1-aba0-72ed4234d313\") " pod="openshift-dns/dns-default-lsxt4" Jul 09 16:51:53.701712 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.701700 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkpdq\" (UniqueName: \"kubernetes.io/projected/4fb615a0-9cfe-4db6-85b6-780fda9a647e-kube-api-access-zkpdq\") pod \"ingress-canary-6blm6\" (UID: \"4fb615a0-9cfe-4db6-85b6-780fda9a647e\") " pod="openshift-ingress-canary/ingress-canary-6blm6" Jul 09 16:51:53.701902 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.701724 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5csb\" (UniqueName: \"kubernetes.io/projected/a849d2c0-577a-4acb-b564-88b57b5a9467-kube-api-access-f5csb\") pod \"insights-runtime-extractor-ksjzw\" (UID: \"a849d2c0-577a-4acb-b564-88b57b5a9467\") " pod="openshift-insights/insights-runtime-extractor-ksjzw" Jul 09 16:51:53.701902 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.701792 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36101bde-6cdc-43fd-befb-e435e56754d1-registry-tls\") pod \"image-registry-6c7455868b-kffv6\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:51:53.701902 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.701834 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36101bde-6cdc-43fd-befb-e435e56754d1-registry-certificates\") pod \"image-registry-6c7455868b-kffv6\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:51:53.701902 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.701844 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a849d2c0-577a-4acb-b564-88b57b5a9467-crio-socket\") pod \"insights-runtime-extractor-ksjzw\" (UID: \"a849d2c0-577a-4acb-b564-88b57b5a9467\") " pod="openshift-insights/insights-runtime-extractor-ksjzw" Jul 09 16:51:53.701902 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.701861 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36101bde-6cdc-43fd-befb-e435e56754d1-bound-sa-token\") pod \"image-registry-6c7455868b-kffv6\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:51:53.701902 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.701885 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a849d2c0-577a-4acb-b564-88b57b5a9467-data-volume\") pod \"insights-runtime-extractor-ksjzw\" (UID: \"a849d2c0-577a-4acb-b564-88b57b5a9467\") " pod="openshift-insights/insights-runtime-extractor-ksjzw" Jul 09 16:51:53.701902 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.701894 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fb615a0-9cfe-4db6-85b6-780fda9a647e-cert\") pod \"ingress-canary-6blm6\" (UID: \"4fb615a0-9cfe-4db6-85b6-780fda9a647e\") " pod="openshift-ingress-canary/ingress-canary-6blm6" Jul 09 16:51:53.702223 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.701919 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a849d2c0-577a-4acb-b564-88b57b5a9467-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ksjzw\" (UID: \"a849d2c0-577a-4acb-b564-88b57b5a9467\") " pod="openshift-insights/insights-runtime-extractor-ksjzw" Jul 09 16:51:53.702223 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.702039 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36101bde-6cdc-43fd-befb-e435e56754d1-installation-pull-secrets\") pod \"image-registry-6c7455868b-kffv6\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:51:53.702223 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.702078 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk6b4\" (UniqueName: \"kubernetes.io/projected/36101bde-6cdc-43fd-befb-e435e56754d1-kube-api-access-pk6b4\") pod \"image-registry-6c7455868b-kffv6\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:51:53.702223 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.702105 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/308c5900-bf1d-46c1-aba0-72ed4234d313-metrics-tls\") pod \"dns-default-lsxt4\" (UID: \"308c5900-bf1d-46c1-aba0-72ed4234d313\") " pod="openshift-dns/dns-default-lsxt4" Jul 09 16:51:53.702223 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.702142 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/308c5900-bf1d-46c1-aba0-72ed4234d313-tmp-dir\") pod \"dns-default-lsxt4\" (UID: \"308c5900-bf1d-46c1-aba0-72ed4234d313\") " pod="openshift-dns/dns-default-lsxt4" Jul 09 16:51:53.702223 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.702168 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36101bde-6cdc-43fd-befb-e435e56754d1-ca-trust-extracted\") pod \"image-registry-6c7455868b-kffv6\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:51:53.702223 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.702192 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45sd2\" (UniqueName: \"kubernetes.io/projected/308c5900-bf1d-46c1-aba0-72ed4234d313-kube-api-access-45sd2\") pod \"dns-default-lsxt4\" (UID: \"308c5900-bf1d-46c1-aba0-72ed4234d313\") " pod="openshift-dns/dns-default-lsxt4" Jul 09 16:51:53.702591 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.702227 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36101bde-6cdc-43fd-befb-e435e56754d1-trusted-ca\") pod \"image-registry-6c7455868b-kffv6\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:51:53.702591 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.702512 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a849d2c0-577a-4acb-b564-88b57b5a9467-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ksjzw\" (UID: \"a849d2c0-577a-4acb-b564-88b57b5a9467\") " pod="openshift-insights/insights-runtime-extractor-ksjzw" Jul 09 16:51:53.702746 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.702699 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36101bde-6cdc-43fd-befb-e435e56754d1-registry-certificates\") pod \"image-registry-6c7455868b-kffv6\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:51:53.702860 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.702839 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36101bde-6cdc-43fd-befb-e435e56754d1-ca-trust-extracted\") pod \"image-registry-6c7455868b-kffv6\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:51:53.706247 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.706216 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a849d2c0-577a-4acb-b564-88b57b5a9467-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ksjzw\" (UID: \"a849d2c0-577a-4acb-b564-88b57b5a9467\") " pod="openshift-insights/insights-runtime-extractor-ksjzw" Jul 09 16:51:53.706247 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.706242 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36101bde-6cdc-43fd-befb-e435e56754d1-registry-tls\") pod \"image-registry-6c7455868b-kffv6\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:51:53.706381 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.706248 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4fb615a0-9cfe-4db6-85b6-780fda9a647e-cert\") pod \"ingress-canary-6blm6\" (UID: \"4fb615a0-9cfe-4db6-85b6-780fda9a647e\") " pod="openshift-ingress-canary/ingress-canary-6blm6" Jul 09 16:51:53.706381 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.706330 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36101bde-6cdc-43fd-befb-e435e56754d1-installation-pull-secrets\") pod \"image-registry-6c7455868b-kffv6\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:51:53.706381 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.706366 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36101bde-6cdc-43fd-befb-e435e56754d1-image-registry-private-configuration\") pod \"image-registry-6c7455868b-kffv6\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:51:53.709321 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.709295 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36101bde-6cdc-43fd-befb-e435e56754d1-bound-sa-token\") pod \"image-registry-6c7455868b-kffv6\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:51:53.709321 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.709304 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5csb\" (UniqueName: \"kubernetes.io/projected/a849d2c0-577a-4acb-b564-88b57b5a9467-kube-api-access-f5csb\") pod \"insights-runtime-extractor-ksjzw\" (UID: \"a849d2c0-577a-4acb-b564-88b57b5a9467\") " pod="openshift-insights/insights-runtime-extractor-ksjzw" Jul 09 16:51:53.709547 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.709531 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk6b4\" (UniqueName: \"kubernetes.io/projected/36101bde-6cdc-43fd-befb-e435e56754d1-kube-api-access-pk6b4\") pod \"image-registry-6c7455868b-kffv6\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:51:53.710312 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.710295 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkpdq\" (UniqueName: \"kubernetes.io/projected/4fb615a0-9cfe-4db6-85b6-780fda9a647e-kube-api-access-zkpdq\") pod \"ingress-canary-6blm6\" (UID: \"4fb615a0-9cfe-4db6-85b6-780fda9a647e\") " pod="openshift-ingress-canary/ingress-canary-6blm6" Jul 09 16:51:53.716566 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.716546 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36101bde-6cdc-43fd-befb-e435e56754d1-trusted-ca\") pod \"image-registry-6c7455868b-kffv6\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:51:53.803604 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.803493 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/308c5900-bf1d-46c1-aba0-72ed4234d313-config-volume\") pod \"dns-default-lsxt4\" (UID: \"308c5900-bf1d-46c1-aba0-72ed4234d313\") " pod="openshift-dns/dns-default-lsxt4" Jul 09 16:51:53.803604 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.803581 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/308c5900-bf1d-46c1-aba0-72ed4234d313-metrics-tls\") pod \"dns-default-lsxt4\" (UID: \"308c5900-bf1d-46c1-aba0-72ed4234d313\") " pod="openshift-dns/dns-default-lsxt4" Jul 09 16:51:53.803930 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.803620 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/308c5900-bf1d-46c1-aba0-72ed4234d313-tmp-dir\") pod \"dns-default-lsxt4\" (UID: \"308c5900-bf1d-46c1-aba0-72ed4234d313\") " pod="openshift-dns/dns-default-lsxt4" Jul 09 16:51:53.803930 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.803643 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45sd2\" (UniqueName: \"kubernetes.io/projected/308c5900-bf1d-46c1-aba0-72ed4234d313-kube-api-access-45sd2\") pod \"dns-default-lsxt4\" (UID: \"308c5900-bf1d-46c1-aba0-72ed4234d313\") " pod="openshift-dns/dns-default-lsxt4" Jul 09 16:51:53.804009 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.803952 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/308c5900-bf1d-46c1-aba0-72ed4234d313-tmp-dir\") pod \"dns-default-lsxt4\" (UID: \"308c5900-bf1d-46c1-aba0-72ed4234d313\") " pod="openshift-dns/dns-default-lsxt4" Jul 09 16:51:53.804158 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.804139 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/308c5900-bf1d-46c1-aba0-72ed4234d313-config-volume\") pod \"dns-default-lsxt4\" (UID: \"308c5900-bf1d-46c1-aba0-72ed4234d313\") " pod="openshift-dns/dns-default-lsxt4" Jul 09 16:51:53.806116 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.806097 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/308c5900-bf1d-46c1-aba0-72ed4234d313-metrics-tls\") pod \"dns-default-lsxt4\" (UID: \"308c5900-bf1d-46c1-aba0-72ed4234d313\") " pod="openshift-dns/dns-default-lsxt4" Jul 09 16:51:53.811533 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.811514 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45sd2\" (UniqueName: \"kubernetes.io/projected/308c5900-bf1d-46c1-aba0-72ed4234d313-kube-api-access-45sd2\") pod \"dns-default-lsxt4\" (UID: \"308c5900-bf1d-46c1-aba0-72ed4234d313\") " pod="openshift-dns/dns-default-lsxt4" Jul 09 16:51:53.833505 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.833483 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:51:53.856773 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.856752 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6blm6" Jul 09 16:51:53.878593 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.878573 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ksjzw" Jul 09 16:51:53.943543 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:53.943508 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lsxt4" Jul 09 16:51:54.059703 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:54.059673 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c7455868b-kffv6"] Jul 09 16:51:54.061849 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:54.061793 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ksjzw"] Jul 09 16:51:54.063337 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:54.063312 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6blm6"] Jul 09 16:51:54.066112 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:54.066083 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36101bde_6cdc_43fd_befb_e435e56754d1.slice/crio-63436cb24b4aadc88983177fa3342f63d0eeb11f325f1dd1dbf2c08fc3b2a81c WatchSource:0}: Error finding container 63436cb24b4aadc88983177fa3342f63d0eeb11f325f1dd1dbf2c08fc3b2a81c: Status 404 returned error can't find the container with id 63436cb24b4aadc88983177fa3342f63d0eeb11f325f1dd1dbf2c08fc3b2a81c Jul 09 16:51:54.067414 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:54.067389 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda849d2c0_577a_4acb_b564_88b57b5a9467.slice/crio-3a12effa519c1369a0212d24ce3b2f1f5f278e5e8ab81f6111c1a28f0e21a4f2 WatchSource:0}: Error finding container 3a12effa519c1369a0212d24ce3b2f1f5f278e5e8ab81f6111c1a28f0e21a4f2: Status 404 returned error can't find the container with id 3a12effa519c1369a0212d24ce3b2f1f5f278e5e8ab81f6111c1a28f0e21a4f2 Jul 09 16:51:54.068695 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:54.068367 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fb615a0_9cfe_4db6_85b6_780fda9a647e.slice/crio-3abb7b1e77506c31ce04bef26f8d7c3159d7683717cc2273a4f93321d91c5ae9 WatchSource:0}: Error finding container 3abb7b1e77506c31ce04bef26f8d7c3159d7683717cc2273a4f93321d91c5ae9: Status 404 returned error can't find the container with id 3abb7b1e77506c31ce04bef26f8d7c3159d7683717cc2273a4f93321d91c5ae9 Jul 09 16:51:54.122773 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:54.122748 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lsxt4"] Jul 09 16:51:54.126424 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:51:54.126398 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod308c5900_bf1d_46c1_aba0_72ed4234d313.slice/crio-08b650e2dd9c594c25b9210a264695053f6917262d0377411d812d09ec312b60 WatchSource:0}: Error finding container 08b650e2dd9c594c25b9210a264695053f6917262d0377411d812d09ec312b60: Status 404 returned error can't find the container with id 08b650e2dd9c594c25b9210a264695053f6917262d0377411d812d09ec312b60 Jul 09 16:51:54.371964 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:54.371765 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ksjzw" event={"ID":"a849d2c0-577a-4acb-b564-88b57b5a9467","Type":"ContainerStarted","Data":"3a12effa519c1369a0212d24ce3b2f1f5f278e5e8ab81f6111c1a28f0e21a4f2"} Jul 09 16:51:54.373518 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:54.373482 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c7455868b-kffv6" event={"ID":"36101bde-6cdc-43fd-befb-e435e56754d1","Type":"ContainerStarted","Data":"8dc8f0b3141d75166f737de9f6c646fdb1f85629f751f98d409d2abb61e95096"} Jul 09 16:51:54.373660 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:54.373531 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c7455868b-kffv6" event={"ID":"36101bde-6cdc-43fd-befb-e435e56754d1","Type":"ContainerStarted","Data":"63436cb24b4aadc88983177fa3342f63d0eeb11f325f1dd1dbf2c08fc3b2a81c"} Jul 09 16:51:54.373660 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:54.373599 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:51:54.374708 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:54.374688 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6blm6" event={"ID":"4fb615a0-9cfe-4db6-85b6-780fda9a647e","Type":"ContainerStarted","Data":"3abb7b1e77506c31ce04bef26f8d7c3159d7683717cc2273a4f93321d91c5ae9"} Jul 09 16:51:54.375840 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:54.375822 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lsxt4" event={"ID":"308c5900-bf1d-46c1-aba0-72ed4234d313","Type":"ContainerStarted","Data":"08b650e2dd9c594c25b9210a264695053f6917262d0377411d812d09ec312b60"} Jul 09 16:51:54.398736 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:54.398687 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6c7455868b-kffv6" podStartSLOduration=80.398670303 podStartE2EDuration="1m20.398670303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:50:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:51:54.39776815 +0000 UTC m=+52.762520067" watchObservedRunningTime="2026-07-09 16:51:54.398670303 +0000 UTC m=+52.763422219" Jul 09 16:51:55.172128 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:55.172093 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:51:55.172400 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:55.172375 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:51:55.173020 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:55.172997 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:51:55.177451 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:55.177427 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 16:51:55.177766 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:55.177750 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 16:51:55.177976 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:55.177960 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4z5xv\"" Jul 09 16:51:55.178177 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:55.178162 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k87dn\"" Jul 09 16:51:55.178451 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:55.178427 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 16:51:55.178640 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:51:55.178625 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 16:52:00.395514 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:00.395471 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6blm6" event={"ID":"4fb615a0-9cfe-4db6-85b6-780fda9a647e","Type":"ContainerStarted","Data":"d1a432ffbb54aeb27f37bbda244e4d42f4823abd251f52aab57bd2fa3a7c60c9"} Jul 09 16:52:00.397375 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:00.397349 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lsxt4" event={"ID":"308c5900-bf1d-46c1-aba0-72ed4234d313","Type":"ContainerStarted","Data":"51f3c7438136314583bad5ec49098463b841ea3cf5608e86d6878b0415ad9dda"} Jul 09 16:52:00.397501 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:00.397395 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lsxt4" event={"ID":"308c5900-bf1d-46c1-aba0-72ed4234d313","Type":"ContainerStarted","Data":"d593a1b6391347b99a478cb727e9ebbe814fbdb1e24a871520c1c748bb4651fa"} Jul 09 16:52:00.397501 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:00.397422 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lsxt4" Jul 09 16:52:00.398971 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:00.398947 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ksjzw" event={"ID":"a849d2c0-577a-4acb-b564-88b57b5a9467","Type":"ContainerStarted","Data":"431e8c54433c1cceb62c1c274121733a5f2a6926655436cbce6f44df73e01b81"} Jul 09 16:52:00.411937 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:00.411899 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6blm6" podStartSLOduration=2.131099115 podStartE2EDuration="7.411885696s" totalImagesPullingTime="5.280786581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:00.410627375 +0000 UTC m=+58.775379304" watchObservedRunningTime="2026-07-09 16:52:00.411885696 +0000 UTC m=+58.776637612" Jul 09 16:52:00.428735 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:00.428678 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lsxt4" podStartSLOduration=2.226144532 podStartE2EDuration="7.428665824s" totalImagesPullingTime="5.202521292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:00.428599897 +0000 UTC m=+58.793351815" watchObservedRunningTime="2026-07-09 16:52:00.428665824 +0000 UTC m=+58.793417731" Jul 09 16:52:01.404875 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:01.404837 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ksjzw" event={"ID":"a849d2c0-577a-4acb-b564-88b57b5a9467","Type":"ContainerStarted","Data":"6039b0ee1b236cf670fc66b3a6a0027d29d9fd893d7dc338ada465b60ee3c894"} Jul 09 16:52:02.671520 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.671481 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zqbv5"] Jul 09 16:52:02.674567 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.674545 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:02.676522 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.676500 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q92qp\"" Jul 09 16:52:02.676645 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.676549 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 16:52:02.677309 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.677116 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 16:52:02.677309 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.677165 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 16:52:02.677481 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.677387 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 16:52:02.677481 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.677399 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 16:52:02.677561 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.677507 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 16:52:02.779401 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.779359 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c650802e-74d2-474d-8475-68031e8986b5-node-exporter-wtmp\") pod \"node-exporter-zqbv5\" (UID: \"c650802e-74d2-474d-8475-68031e8986b5\") " pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:02.779576 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.779410 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c650802e-74d2-474d-8475-68031e8986b5-node-exporter-textfile\") pod \"node-exporter-zqbv5\" (UID: \"c650802e-74d2-474d-8475-68031e8986b5\") " pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:02.779576 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.779444 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c650802e-74d2-474d-8475-68031e8986b5-root\") pod \"node-exporter-zqbv5\" (UID: \"c650802e-74d2-474d-8475-68031e8986b5\") " pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:02.779576 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.779469 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c650802e-74d2-474d-8475-68031e8986b5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zqbv5\" (UID: \"c650802e-74d2-474d-8475-68031e8986b5\") " pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:02.779576 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.779539 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c650802e-74d2-474d-8475-68031e8986b5-metrics-client-ca\") pod \"node-exporter-zqbv5\" (UID: \"c650802e-74d2-474d-8475-68031e8986b5\") " pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:02.779765 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.779585 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c650802e-74d2-474d-8475-68031e8986b5-sys\") pod \"node-exporter-zqbv5\" (UID: \"c650802e-74d2-474d-8475-68031e8986b5\") " pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:02.779765 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.779611 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c650802e-74d2-474d-8475-68031e8986b5-node-exporter-tls\") pod \"node-exporter-zqbv5\" (UID: \"c650802e-74d2-474d-8475-68031e8986b5\") " pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:02.779765 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.779665 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c650802e-74d2-474d-8475-68031e8986b5-node-exporter-accelerators-collector-config\") pod \"node-exporter-zqbv5\" (UID: \"c650802e-74d2-474d-8475-68031e8986b5\") " pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:02.779765 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.779683 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7l66\" (UniqueName: \"kubernetes.io/projected/c650802e-74d2-474d-8475-68031e8986b5-kube-api-access-v7l66\") pod \"node-exporter-zqbv5\" (UID: \"c650802e-74d2-474d-8475-68031e8986b5\") " pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:02.881015 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.880978 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c650802e-74d2-474d-8475-68031e8986b5-root\") pod \"node-exporter-zqbv5\" (UID: \"c650802e-74d2-474d-8475-68031e8986b5\") " pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:02.881192 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.881035 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c650802e-74d2-474d-8475-68031e8986b5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zqbv5\" (UID: \"c650802e-74d2-474d-8475-68031e8986b5\") " pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:02.881192 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.881073 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c650802e-74d2-474d-8475-68031e8986b5-metrics-client-ca\") pod \"node-exporter-zqbv5\" (UID: \"c650802e-74d2-474d-8475-68031e8986b5\") " pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:02.881192 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.881100 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c650802e-74d2-474d-8475-68031e8986b5-sys\") pod \"node-exporter-zqbv5\" (UID: \"c650802e-74d2-474d-8475-68031e8986b5\") " pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:02.881192 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.881115 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c650802e-74d2-474d-8475-68031e8986b5-node-exporter-tls\") pod \"node-exporter-zqbv5\" (UID: \"c650802e-74d2-474d-8475-68031e8986b5\") " pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:02.881192 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.881125 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c650802e-74d2-474d-8475-68031e8986b5-root\") pod \"node-exporter-zqbv5\" (UID: \"c650802e-74d2-474d-8475-68031e8986b5\") " pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:02.881192 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.881143 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c650802e-74d2-474d-8475-68031e8986b5-node-exporter-accelerators-collector-config\") pod \"node-exporter-zqbv5\" (UID: \"c650802e-74d2-474d-8475-68031e8986b5\") " pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:02.881192 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.881175 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7l66\" (UniqueName: \"kubernetes.io/projected/c650802e-74d2-474d-8475-68031e8986b5-kube-api-access-v7l66\") pod \"node-exporter-zqbv5\" (UID: \"c650802e-74d2-474d-8475-68031e8986b5\") " pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:02.881539 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.881196 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c650802e-74d2-474d-8475-68031e8986b5-sys\") pod \"node-exporter-zqbv5\" (UID: \"c650802e-74d2-474d-8475-68031e8986b5\") " pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:02.881539 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.881242 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c650802e-74d2-474d-8475-68031e8986b5-node-exporter-wtmp\") pod \"node-exporter-zqbv5\" (UID: \"c650802e-74d2-474d-8475-68031e8986b5\") " pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:02.881539 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.881261 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c650802e-74d2-474d-8475-68031e8986b5-node-exporter-textfile\") pod \"node-exporter-zqbv5\" (UID: \"c650802e-74d2-474d-8475-68031e8986b5\") " pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:02.881539 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.881489 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c650802e-74d2-474d-8475-68031e8986b5-node-exporter-wtmp\") pod \"node-exporter-zqbv5\" (UID: \"c650802e-74d2-474d-8475-68031e8986b5\") " pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:02.881671 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.881629 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c650802e-74d2-474d-8475-68031e8986b5-node-exporter-textfile\") pod \"node-exporter-zqbv5\" (UID: \"c650802e-74d2-474d-8475-68031e8986b5\") " pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:02.881880 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.881854 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c650802e-74d2-474d-8475-68031e8986b5-metrics-client-ca\") pod \"node-exporter-zqbv5\" (UID: \"c650802e-74d2-474d-8475-68031e8986b5\") " pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:02.882025 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.881854 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c650802e-74d2-474d-8475-68031e8986b5-node-exporter-accelerators-collector-config\") pod \"node-exporter-zqbv5\" (UID: \"c650802e-74d2-474d-8475-68031e8986b5\") " pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:02.885678 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.885654 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c650802e-74d2-474d-8475-68031e8986b5-node-exporter-tls\") pod \"node-exporter-zqbv5\" (UID: \"c650802e-74d2-474d-8475-68031e8986b5\") " pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:02.885678 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.885666 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c650802e-74d2-474d-8475-68031e8986b5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zqbv5\" (UID: \"c650802e-74d2-474d-8475-68031e8986b5\") " pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:02.889945 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.889921 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7l66\" (UniqueName: \"kubernetes.io/projected/c650802e-74d2-474d-8475-68031e8986b5-kube-api-access-v7l66\") pod \"node-exporter-zqbv5\" (UID: \"c650802e-74d2-474d-8475-68031e8986b5\") " pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:02.986104 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:02.986022 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zqbv5" Jul 09 16:52:03.325747 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:03.325665 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pcwtl" Jul 09 16:52:03.581316 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:52:03.581267 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc650802e_74d2_474d_8475_68031e8986b5.slice/crio-cdce067a311d0d1d5b63d68d505ff9250effe3b7751ebd71cb4a6c9d5b1daf0f WatchSource:0}: Error finding container cdce067a311d0d1d5b63d68d505ff9250effe3b7751ebd71cb4a6c9d5b1daf0f: Status 404 returned error can't find the container with id cdce067a311d0d1d5b63d68d505ff9250effe3b7751ebd71cb4a6c9d5b1daf0f Jul 09 16:52:04.416695 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:04.416658 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zqbv5" event={"ID":"c650802e-74d2-474d-8475-68031e8986b5","Type":"ContainerStarted","Data":"cdce067a311d0d1d5b63d68d505ff9250effe3b7751ebd71cb4a6c9d5b1daf0f"} Jul 09 16:52:04.418559 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:04.418537 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ksjzw" event={"ID":"a849d2c0-577a-4acb-b564-88b57b5a9467","Type":"ContainerStarted","Data":"f20489fb9ffdf8c7421aee1713bc818088ee58cb935201ec50492ce215b7d26a"} Jul 09 16:52:04.434142 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:04.434064 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ksjzw" podStartSLOduration=2.026612808 podStartE2EDuration="11.434048271s" totalImagesPullingTime="9.407435463s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:51:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:04.433421202 +0000 UTC m=+62.798173119" watchObservedRunningTime="2026-07-09 16:52:04.434048271 +0000 UTC m=+62.798800184" Jul 09 16:52:06.426893 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:06.426858 2580 generic.go:356] "Generic (PLEG): container finished" podID="c650802e-74d2-474d-8475-68031e8986b5" containerID="c1a8aa84670a34169dc03e5b0fc1db39c4f6b53a50f1611cd4cc19dca4f0820c" exitCode=0 Jul 09 16:52:06.427271 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:06.426936 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zqbv5" event={"ID":"c650802e-74d2-474d-8475-68031e8986b5","Type":"ContainerDied","Data":"c1a8aa84670a34169dc03e5b0fc1db39c4f6b53a50f1611cd4cc19dca4f0820c"} Jul 09 16:52:07.371961 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.371925 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-xpxpq"] Jul 09 16:52:07.373745 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.373721 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xpxpq" Jul 09 16:52:07.376225 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.376201 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 09 16:52:07.376225 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.376219 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-26l6s\"" Jul 09 16:52:07.383496 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.383474 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-xpxpq"] Jul 09 16:52:07.399981 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.399950 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7895f9689c-jpnrz"] Jul 09 16:52:07.401970 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.401945 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7895f9689c-jpnrz" Jul 09 16:52:07.404274 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.404249 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 16:52:07.404274 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.404304 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 16:52:07.404274 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.404308 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 16:52:07.404561 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.404345 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 16:52:07.404561 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.404380 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 16:52:07.404561 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.404308 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 16:52:07.404685 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.404625 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 16:52:07.405033 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.405016 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tnbw7\"" Jul 09 16:52:07.409641 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.409623 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 16:52:07.418819 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.418794 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7895f9689c-jpnrz"] Jul 09 16:52:07.419030 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.419012 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnfzm\" (UniqueName: \"kubernetes.io/projected/64a5e6ab-7168-4b12-8925-5e899de8d1e8-kube-api-access-xnfzm\") pod \"monitoring-plugin-5f68df7f58-xpxpq\" (UID: \"64a5e6ab-7168-4b12-8925-5e899de8d1e8\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xpxpq" Jul 09 16:52:07.419088 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.419062 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/64a5e6ab-7168-4b12-8925-5e899de8d1e8-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-xpxpq\" (UID: \"64a5e6ab-7168-4b12-8925-5e899de8d1e8\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xpxpq" Jul 09 16:52:07.433500 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.433476 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zqbv5" event={"ID":"c650802e-74d2-474d-8475-68031e8986b5","Type":"ContainerStarted","Data":"8f96ff0d851148f8d860d8a78ad8d920a66839c17162ebc3090120c82594a935"} Jul 09 16:52:07.433888 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.433518 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zqbv5" event={"ID":"c650802e-74d2-474d-8475-68031e8986b5","Type":"ContainerStarted","Data":"b02a365f9833c8bed00b82f2855b7fedc6ebb5db49f479117d7d90c6deca1684"} Jul 09 16:52:07.455636 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.455592 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zqbv5" podStartSLOduration=3.299426577 podStartE2EDuration="5.455577426s" totalImagesPullingTime="2.083556438s" totalInitContainerRuntime="72.594411ms" isStatefulPod=true podCreationTimestamp="2026-07-09 16:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:07.455298609 +0000 UTC m=+65.820050534" watchObservedRunningTime="2026-07-09 16:52:07.455577426 +0000 UTC m=+65.820329343" Jul 09 16:52:07.520081 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.520049 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/552ea3d9-af00-4685-84b2-b959f968b5a3-console-oauth-config\") pod \"console-7895f9689c-jpnrz\" (UID: \"552ea3d9-af00-4685-84b2-b959f968b5a3\") " pod="openshift-console/console-7895f9689c-jpnrz" Jul 09 16:52:07.520081 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.520084 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xnk4\" (UniqueName: \"kubernetes.io/projected/552ea3d9-af00-4685-84b2-b959f968b5a3-kube-api-access-6xnk4\") pod \"console-7895f9689c-jpnrz\" (UID: \"552ea3d9-af00-4685-84b2-b959f968b5a3\") " pod="openshift-console/console-7895f9689c-jpnrz" Jul 09 16:52:07.520356 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.520105 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnfzm\" (UniqueName: \"kubernetes.io/projected/64a5e6ab-7168-4b12-8925-5e899de8d1e8-kube-api-access-xnfzm\") pod \"monitoring-plugin-5f68df7f58-xpxpq\" (UID: \"64a5e6ab-7168-4b12-8925-5e899de8d1e8\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xpxpq" Jul 09 16:52:07.520356 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.520120 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/552ea3d9-af00-4685-84b2-b959f968b5a3-console-serving-cert\") pod \"console-7895f9689c-jpnrz\" (UID: \"552ea3d9-af00-4685-84b2-b959f968b5a3\") " pod="openshift-console/console-7895f9689c-jpnrz" Jul 09 16:52:07.520356 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.520238 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/64a5e6ab-7168-4b12-8925-5e899de8d1e8-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-xpxpq\" (UID: \"64a5e6ab-7168-4b12-8925-5e899de8d1e8\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xpxpq" Jul 09 16:52:07.520356 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:52:07.520311 2580 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 09 16:52:07.520356 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:52:07.520361 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64a5e6ab-7168-4b12-8925-5e899de8d1e8-monitoring-plugin-cert podName:64a5e6ab-7168-4b12-8925-5e899de8d1e8 nodeName:}" failed. No retries permitted until 2026-07-09 16:52:08.020345616 +0000 UTC m=+66.385097510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/64a5e6ab-7168-4b12-8925-5e899de8d1e8-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-xpxpq" (UID: "64a5e6ab-7168-4b12-8925-5e899de8d1e8") : secret "monitoring-plugin-cert" not found Jul 09 16:52:07.520606 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.520389 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/552ea3d9-af00-4685-84b2-b959f968b5a3-oauth-serving-cert\") pod \"console-7895f9689c-jpnrz\" (UID: \"552ea3d9-af00-4685-84b2-b959f968b5a3\") " pod="openshift-console/console-7895f9689c-jpnrz" Jul 09 16:52:07.520606 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.520425 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/552ea3d9-af00-4685-84b2-b959f968b5a3-console-config\") pod \"console-7895f9689c-jpnrz\" (UID: \"552ea3d9-af00-4685-84b2-b959f968b5a3\") " pod="openshift-console/console-7895f9689c-jpnrz" Jul 09 16:52:07.520606 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.520447 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/552ea3d9-af00-4685-84b2-b959f968b5a3-service-ca\") pod \"console-7895f9689c-jpnrz\" (UID: \"552ea3d9-af00-4685-84b2-b959f968b5a3\") " pod="openshift-console/console-7895f9689c-jpnrz" Jul 09 16:52:07.520606 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.520475 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/552ea3d9-af00-4685-84b2-b959f968b5a3-trusted-ca-bundle\") pod \"console-7895f9689c-jpnrz\" (UID: \"552ea3d9-af00-4685-84b2-b959f968b5a3\") " pod="openshift-console/console-7895f9689c-jpnrz" Jul 09 16:52:07.528415 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.528389 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnfzm\" (UniqueName: \"kubernetes.io/projected/64a5e6ab-7168-4b12-8925-5e899de8d1e8-kube-api-access-xnfzm\") pod \"monitoring-plugin-5f68df7f58-xpxpq\" (UID: \"64a5e6ab-7168-4b12-8925-5e899de8d1e8\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xpxpq" Jul 09 16:52:07.620997 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.620968 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/552ea3d9-af00-4685-84b2-b959f968b5a3-console-oauth-config\") pod \"console-7895f9689c-jpnrz\" (UID: \"552ea3d9-af00-4685-84b2-b959f968b5a3\") " pod="openshift-console/console-7895f9689c-jpnrz" Jul 09 16:52:07.621111 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.621001 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xnk4\" (UniqueName: \"kubernetes.io/projected/552ea3d9-af00-4685-84b2-b959f968b5a3-kube-api-access-6xnk4\") pod \"console-7895f9689c-jpnrz\" (UID: \"552ea3d9-af00-4685-84b2-b959f968b5a3\") " pod="openshift-console/console-7895f9689c-jpnrz" Jul 09 16:52:07.621111 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.621024 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/552ea3d9-af00-4685-84b2-b959f968b5a3-console-serving-cert\") pod \"console-7895f9689c-jpnrz\" (UID: \"552ea3d9-af00-4685-84b2-b959f968b5a3\") " pod="openshift-console/console-7895f9689c-jpnrz" Jul 09 16:52:07.621183 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.621121 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/552ea3d9-af00-4685-84b2-b959f968b5a3-oauth-serving-cert\") pod \"console-7895f9689c-jpnrz\" (UID: \"552ea3d9-af00-4685-84b2-b959f968b5a3\") " pod="openshift-console/console-7895f9689c-jpnrz" Jul 09 16:52:07.621183 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.621151 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/552ea3d9-af00-4685-84b2-b959f968b5a3-console-config\") pod \"console-7895f9689c-jpnrz\" (UID: \"552ea3d9-af00-4685-84b2-b959f968b5a3\") " pod="openshift-console/console-7895f9689c-jpnrz" Jul 09 16:52:07.621183 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.621171 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/552ea3d9-af00-4685-84b2-b959f968b5a3-service-ca\") pod \"console-7895f9689c-jpnrz\" (UID: \"552ea3d9-af00-4685-84b2-b959f968b5a3\") " pod="openshift-console/console-7895f9689c-jpnrz" Jul 09 16:52:07.621351 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.621193 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/552ea3d9-af00-4685-84b2-b959f968b5a3-trusted-ca-bundle\") pod \"console-7895f9689c-jpnrz\" (UID: \"552ea3d9-af00-4685-84b2-b959f968b5a3\") " pod="openshift-console/console-7895f9689c-jpnrz" Jul 09 16:52:07.621932 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.621902 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/552ea3d9-af00-4685-84b2-b959f968b5a3-oauth-serving-cert\") pod \"console-7895f9689c-jpnrz\" (UID: \"552ea3d9-af00-4685-84b2-b959f968b5a3\") " pod="openshift-console/console-7895f9689c-jpnrz" Jul 09 16:52:07.621932 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.621927 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/552ea3d9-af00-4685-84b2-b959f968b5a3-service-ca\") pod \"console-7895f9689c-jpnrz\" (UID: \"552ea3d9-af00-4685-84b2-b959f968b5a3\") " pod="openshift-console/console-7895f9689c-jpnrz" Jul 09 16:52:07.622124 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.621993 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/552ea3d9-af00-4685-84b2-b959f968b5a3-trusted-ca-bundle\") pod \"console-7895f9689c-jpnrz\" (UID: \"552ea3d9-af00-4685-84b2-b959f968b5a3\") " pod="openshift-console/console-7895f9689c-jpnrz" Jul 09 16:52:07.622187 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.622164 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/552ea3d9-af00-4685-84b2-b959f968b5a3-console-config\") pod \"console-7895f9689c-jpnrz\" (UID: \"552ea3d9-af00-4685-84b2-b959f968b5a3\") " pod="openshift-console/console-7895f9689c-jpnrz" Jul 09 16:52:07.623701 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.623673 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/552ea3d9-af00-4685-84b2-b959f968b5a3-console-oauth-config\") pod \"console-7895f9689c-jpnrz\" (UID: \"552ea3d9-af00-4685-84b2-b959f968b5a3\") " pod="openshift-console/console-7895f9689c-jpnrz" Jul 09 16:52:07.623775 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.623707 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/552ea3d9-af00-4685-84b2-b959f968b5a3-console-serving-cert\") pod \"console-7895f9689c-jpnrz\" (UID: \"552ea3d9-af00-4685-84b2-b959f968b5a3\") " pod="openshift-console/console-7895f9689c-jpnrz" Jul 09 16:52:07.629199 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.629179 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xnk4\" (UniqueName: \"kubernetes.io/projected/552ea3d9-af00-4685-84b2-b959f968b5a3-kube-api-access-6xnk4\") pod \"console-7895f9689c-jpnrz\" (UID: \"552ea3d9-af00-4685-84b2-b959f968b5a3\") " pod="openshift-console/console-7895f9689c-jpnrz" Jul 09 16:52:07.710314 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.710269 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7895f9689c-jpnrz" Jul 09 16:52:07.792202 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.792162 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf"] Jul 09 16:52:07.794581 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.794559 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" Jul 09 16:52:07.798007 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.797981 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 09 16:52:07.798906 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.797986 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9gqsm\"" Jul 09 16:52:07.798906 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.798395 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 09 16:52:07.799057 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.798987 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 09 16:52:07.800138 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.799403 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 09 16:52:07.800138 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.799641 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 09 16:52:07.807568 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.807198 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 09 16:52:07.810757 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.810732 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf"] Jul 09 16:52:07.822587 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.822561 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b588a7a9-4426-4011-a6e2-e88403477517-original-pull-secret\") pod \"global-pull-secret-syncer-6ncs8\" (UID: \"b588a7a9-4426-4011-a6e2-e88403477517\") " pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:52:07.824684 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.824668 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 16:52:07.835184 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.835161 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b588a7a9-4426-4011-a6e2-e88403477517-original-pull-secret\") pod \"global-pull-secret-syncer-6ncs8\" (UID: \"b588a7a9-4426-4011-a6e2-e88403477517\") " pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:52:07.837691 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.837668 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7895f9689c-jpnrz"] Jul 09 16:52:07.840661 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:52:07.840639 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod552ea3d9_af00_4685_84b2_b959f968b5a3.slice/crio-d26e79adf401692a1ce591dfc425c7da409f8b1c2b3c58e9f3974ee7d7f43342 WatchSource:0}: Error finding container d26e79adf401692a1ce591dfc425c7da409f8b1c2b3c58e9f3974ee7d7f43342: Status 404 returned error can't find the container with id d26e79adf401692a1ce591dfc425c7da409f8b1c2b3c58e9f3974ee7d7f43342 Jul 09 16:52:07.923705 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.923637 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2c2a29a-d185-4b24-af9d-1784385c0473-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c87f6d55c-xb9zf\" (UID: \"c2c2a29a-d185-4b24-af9d-1784385c0473\") " pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" Jul 09 16:52:07.923705 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.923681 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c2c2a29a-d185-4b24-af9d-1784385c0473-telemeter-client-tls\") pod \"telemeter-client-5c87f6d55c-xb9zf\" (UID: \"c2c2a29a-d185-4b24-af9d-1784385c0473\") " pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" Jul 09 16:52:07.923852 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.923714 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913-metrics-certs\") pod \"network-metrics-daemon-4xnp4\" (UID: \"cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913\") " pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:52:07.923852 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.923775 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2c2a29a-d185-4b24-af9d-1784385c0473-metrics-client-ca\") pod \"telemeter-client-5c87f6d55c-xb9zf\" (UID: \"c2c2a29a-d185-4b24-af9d-1784385c0473\") " pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" Jul 09 16:52:07.923852 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.923812 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2c2a29a-d185-4b24-af9d-1784385c0473-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c87f6d55c-xb9zf\" (UID: \"c2c2a29a-d185-4b24-af9d-1784385c0473\") " pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" Jul 09 16:52:07.923852 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.923839 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggmvq\" (UniqueName: \"kubernetes.io/projected/c2c2a29a-d185-4b24-af9d-1784385c0473-kube-api-access-ggmvq\") pod \"telemeter-client-5c87f6d55c-xb9zf\" (UID: \"c2c2a29a-d185-4b24-af9d-1784385c0473\") " pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" Jul 09 16:52:07.924012 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.923884 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c2c2a29a-d185-4b24-af9d-1784385c0473-federate-client-tls\") pod \"telemeter-client-5c87f6d55c-xb9zf\" (UID: \"c2c2a29a-d185-4b24-af9d-1784385c0473\") " pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" Jul 09 16:52:07.924012 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.923909 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c2c2a29a-d185-4b24-af9d-1784385c0473-secret-telemeter-client\") pod \"telemeter-client-5c87f6d55c-xb9zf\" (UID: \"c2c2a29a-d185-4b24-af9d-1784385c0473\") " pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" Jul 09 16:52:07.924099 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.924025 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2c2a29a-d185-4b24-af9d-1784385c0473-serving-certs-ca-bundle\") pod \"telemeter-client-5c87f6d55c-xb9zf\" (UID: \"c2c2a29a-d185-4b24-af9d-1784385c0473\") " pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" Jul 09 16:52:07.926153 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.926140 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 16:52:07.937155 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:07.937132 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913-metrics-certs\") pod \"network-metrics-daemon-4xnp4\" (UID: \"cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913\") " pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:52:08.024386 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.024366 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c2c2a29a-d185-4b24-af9d-1784385c0473-secret-telemeter-client\") pod \"telemeter-client-5c87f6d55c-xb9zf\" (UID: \"c2c2a29a-d185-4b24-af9d-1784385c0473\") " pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" Jul 09 16:52:08.024499 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.024400 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2frs\" (UniqueName: \"kubernetes.io/projected/2e904774-10d9-43ac-a1b8-f1ca369a6dc8-kube-api-access-z2frs\") pod \"network-check-target-bl5d7\" (UID: \"2e904774-10d9-43ac-a1b8-f1ca369a6dc8\") " pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:52:08.024499 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.024422 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2c2a29a-d185-4b24-af9d-1784385c0473-serving-certs-ca-bundle\") pod \"telemeter-client-5c87f6d55c-xb9zf\" (UID: \"c2c2a29a-d185-4b24-af9d-1784385c0473\") " pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" Jul 09 16:52:08.024639 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.024617 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2c2a29a-d185-4b24-af9d-1784385c0473-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c87f6d55c-xb9zf\" (UID: \"c2c2a29a-d185-4b24-af9d-1784385c0473\") " pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" Jul 09 16:52:08.024695 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.024674 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c2c2a29a-d185-4b24-af9d-1784385c0473-telemeter-client-tls\") pod \"telemeter-client-5c87f6d55c-xb9zf\" (UID: \"c2c2a29a-d185-4b24-af9d-1784385c0473\") " pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" Jul 09 16:52:08.024744 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.024723 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/64a5e6ab-7168-4b12-8925-5e899de8d1e8-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-xpxpq\" (UID: \"64a5e6ab-7168-4b12-8925-5e899de8d1e8\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xpxpq" Jul 09 16:52:08.024797 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.024750 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2c2a29a-d185-4b24-af9d-1784385c0473-metrics-client-ca\") pod \"telemeter-client-5c87f6d55c-xb9zf\" (UID: \"c2c2a29a-d185-4b24-af9d-1784385c0473\") " pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" Jul 09 16:52:08.024797 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.024776 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2c2a29a-d185-4b24-af9d-1784385c0473-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c87f6d55c-xb9zf\" (UID: \"c2c2a29a-d185-4b24-af9d-1784385c0473\") " pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" Jul 09 16:52:08.024894 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.024804 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggmvq\" (UniqueName: \"kubernetes.io/projected/c2c2a29a-d185-4b24-af9d-1784385c0473-kube-api-access-ggmvq\") pod \"telemeter-client-5c87f6d55c-xb9zf\" (UID: \"c2c2a29a-d185-4b24-af9d-1784385c0473\") " pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" Jul 09 16:52:08.024894 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.024835 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c2c2a29a-d185-4b24-af9d-1784385c0473-federate-client-tls\") pod \"telemeter-client-5c87f6d55c-xb9zf\" (UID: \"c2c2a29a-d185-4b24-af9d-1784385c0473\") " pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" Jul 09 16:52:08.025168 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.025144 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2c2a29a-d185-4b24-af9d-1784385c0473-serving-certs-ca-bundle\") pod \"telemeter-client-5c87f6d55c-xb9zf\" (UID: \"c2c2a29a-d185-4b24-af9d-1784385c0473\") " pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" Jul 09 16:52:08.026016 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.025991 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2c2a29a-d185-4b24-af9d-1784385c0473-metrics-client-ca\") pod \"telemeter-client-5c87f6d55c-xb9zf\" (UID: \"c2c2a29a-d185-4b24-af9d-1784385c0473\") " pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" Jul 09 16:52:08.026331 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.026300 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2c2a29a-d185-4b24-af9d-1784385c0473-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c87f6d55c-xb9zf\" (UID: \"c2c2a29a-d185-4b24-af9d-1784385c0473\") " pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" Jul 09 16:52:08.026744 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.026721 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 16:52:08.027705 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.027678 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c2c2a29a-d185-4b24-af9d-1784385c0473-federate-client-tls\") pod \"telemeter-client-5c87f6d55c-xb9zf\" (UID: \"c2c2a29a-d185-4b24-af9d-1784385c0473\") " pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" Jul 09 16:52:08.027784 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.027703 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c2c2a29a-d185-4b24-af9d-1784385c0473-telemeter-client-tls\") pod \"telemeter-client-5c87f6d55c-xb9zf\" (UID: \"c2c2a29a-d185-4b24-af9d-1784385c0473\") " pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" Jul 09 16:52:08.027784 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.027776 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c2c2a29a-d185-4b24-af9d-1784385c0473-secret-telemeter-client\") pod \"telemeter-client-5c87f6d55c-xb9zf\" (UID: \"c2c2a29a-d185-4b24-af9d-1784385c0473\") " pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" Jul 09 16:52:08.027856 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.027784 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2c2a29a-d185-4b24-af9d-1784385c0473-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c87f6d55c-xb9zf\" (UID: \"c2c2a29a-d185-4b24-af9d-1784385c0473\") " pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" Jul 09 16:52:08.028022 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.028008 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/64a5e6ab-7168-4b12-8925-5e899de8d1e8-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-xpxpq\" (UID: \"64a5e6ab-7168-4b12-8925-5e899de8d1e8\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xpxpq" Jul 09 16:52:08.032627 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.032610 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggmvq\" (UniqueName: \"kubernetes.io/projected/c2c2a29a-d185-4b24-af9d-1784385c0473-kube-api-access-ggmvq\") pod \"telemeter-client-5c87f6d55c-xb9zf\" (UID: \"c2c2a29a-d185-4b24-af9d-1784385c0473\") " pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" Jul 09 16:52:08.037171 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.037156 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 16:52:08.047818 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.047794 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2frs\" (UniqueName: \"kubernetes.io/projected/2e904774-10d9-43ac-a1b8-f1ca369a6dc8-kube-api-access-z2frs\") pod \"network-check-target-bl5d7\" (UID: \"2e904774-10d9-43ac-a1b8-f1ca369a6dc8\") " pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:52:08.091852 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.091830 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ncs8" Jul 09 16:52:08.106714 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.106647 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4z5xv\"" Jul 09 16:52:08.110536 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.110468 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" Jul 09 16:52:08.112137 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.112079 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k87dn\"" Jul 09 16:52:08.115173 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.115113 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:52:08.120430 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.120352 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4xnp4" Jul 09 16:52:08.272758 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.272683 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6ncs8"] Jul 09 16:52:08.277436 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:52:08.276946 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb588a7a9_4426_4011_a6e2_e88403477517.slice/crio-c0dc596cd7d7210c663ea19169dc88fe7df5a1b84088e1fa55978b377b687daa WatchSource:0}: Error finding container c0dc596cd7d7210c663ea19169dc88fe7df5a1b84088e1fa55978b377b687daa: Status 404 returned error can't find the container with id c0dc596cd7d7210c663ea19169dc88fe7df5a1b84088e1fa55978b377b687daa Jul 09 16:52:08.282776 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.282751 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xpxpq" Jul 09 16:52:08.291942 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.291838 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf"] Jul 09 16:52:08.295388 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:52:08.295361 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2c2a29a_d185_4b24_af9d_1784385c0473.slice/crio-c2e472bc9a31e23876a9e1d87aaa93a3ce57a2c2bc90785cba746b1891913217 WatchSource:0}: Error finding container c2e472bc9a31e23876a9e1d87aaa93a3ce57a2c2bc90785cba746b1891913217: Status 404 returned error can't find the container with id c2e472bc9a31e23876a9e1d87aaa93a3ce57a2c2bc90785cba746b1891913217 Jul 09 16:52:08.308816 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.308786 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bl5d7"] Jul 09 16:52:08.314254 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:52:08.314226 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e904774_10d9_43ac_a1b8_f1ca369a6dc8.slice/crio-9f398c71438e51aa48ce08058eb638fcc14ec3a7599f46a81729dab7caf00a50 WatchSource:0}: Error finding container 9f398c71438e51aa48ce08058eb638fcc14ec3a7599f46a81729dab7caf00a50: Status 404 returned error can't find the container with id 9f398c71438e51aa48ce08058eb638fcc14ec3a7599f46a81729dab7caf00a50 Jul 09 16:52:08.327357 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.327330 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4xnp4"] Jul 09 16:52:08.330559 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:52:08.330532 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbd5a8c7_96f1_4cf6_b6d3_8f863f05c913.slice/crio-1a55a2e32ba679052efd378e22472403f9919e00f84a1af9dd0dc614b6dda211 WatchSource:0}: Error finding container 1a55a2e32ba679052efd378e22472403f9919e00f84a1af9dd0dc614b6dda211: Status 404 returned error can't find the container with id 1a55a2e32ba679052efd378e22472403f9919e00f84a1af9dd0dc614b6dda211 Jul 09 16:52:08.428501 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.428473 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-xpxpq"] Jul 09 16:52:08.433623 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:52:08.433357 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64a5e6ab_7168_4b12_8925_5e899de8d1e8.slice/crio-d320335df98843701e587a46b2b3b452328ee78e5755eff1c19f53d4b1958460 WatchSource:0}: Error finding container d320335df98843701e587a46b2b3b452328ee78e5755eff1c19f53d4b1958460: Status 404 returned error can't find the container with id d320335df98843701e587a46b2b3b452328ee78e5755eff1c19f53d4b1958460 Jul 09 16:52:08.440458 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.440430 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bl5d7" event={"ID":"2e904774-10d9-43ac-a1b8-f1ca369a6dc8","Type":"ContainerStarted","Data":"9f398c71438e51aa48ce08058eb638fcc14ec3a7599f46a81729dab7caf00a50"} Jul 09 16:52:08.441793 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.441770 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7895f9689c-jpnrz" event={"ID":"552ea3d9-af00-4685-84b2-b959f968b5a3","Type":"ContainerStarted","Data":"d26e79adf401692a1ce591dfc425c7da409f8b1c2b3c58e9f3974ee7d7f43342"} Jul 09 16:52:08.443327 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.443298 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" event={"ID":"c2c2a29a-d185-4b24-af9d-1784385c0473","Type":"ContainerStarted","Data":"c2e472bc9a31e23876a9e1d87aaa93a3ce57a2c2bc90785cba746b1891913217"} Jul 09 16:52:08.444561 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.444536 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xpxpq" event={"ID":"64a5e6ab-7168-4b12-8925-5e899de8d1e8","Type":"ContainerStarted","Data":"d320335df98843701e587a46b2b3b452328ee78e5755eff1c19f53d4b1958460"} Jul 09 16:52:08.445668 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.445644 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4xnp4" event={"ID":"cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913","Type":"ContainerStarted","Data":"1a55a2e32ba679052efd378e22472403f9919e00f84a1af9dd0dc614b6dda211"} Jul 09 16:52:08.447360 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:08.447331 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6ncs8" event={"ID":"b588a7a9-4426-4011-a6e2-e88403477517","Type":"ContainerStarted","Data":"c0dc596cd7d7210c663ea19169dc88fe7df5a1b84088e1fa55978b377b687daa"} Jul 09 16:52:10.407607 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:10.407575 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lsxt4" Jul 09 16:52:11.044529 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:11.043601 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c7455868b-kffv6"] Jul 09 16:52:11.050456 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:11.050399 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:52:15.480576 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:15.480535 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xpxpq" event={"ID":"64a5e6ab-7168-4b12-8925-5e899de8d1e8","Type":"ContainerStarted","Data":"d78ef78f6cc437a71425bb2c96418890dafe62c7167f529c4a2f36821ae05301"} Jul 09 16:52:15.481039 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:15.480638 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xpxpq" Jul 09 16:52:15.482677 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:15.482634 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4xnp4" event={"ID":"cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913","Type":"ContainerStarted","Data":"8e23a50abf48cd983f169b43757ff3eb51920d3c080c69bcb619cf5262f0753e"} Jul 09 16:52:15.482813 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:15.482696 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4xnp4" event={"ID":"cbd5a8c7-96f1-4cf6-b6d3-8f863f05c913","Type":"ContainerStarted","Data":"031d76423c206ce851dbba6f0f25a66a1bebc671d131c8fe619bd6e293f2e380"} Jul 09 16:52:15.484384 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:15.484351 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6ncs8" event={"ID":"b588a7a9-4426-4011-a6e2-e88403477517","Type":"ContainerStarted","Data":"27e6a0d7f4978221d80f42c8864ca67213eb9f358446c7532bdec03451468e60"} Jul 09 16:52:15.486757 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:15.486730 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bl5d7" event={"ID":"2e904774-10d9-43ac-a1b8-f1ca369a6dc8","Type":"ContainerStarted","Data":"8e3424d08ec94ba12a775e8be971bcb13f89796ee2398f75a74be92c50af8579"} Jul 09 16:52:15.486872 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:15.486807 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:52:15.487060 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:15.487040 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xpxpq" Jul 09 16:52:15.488325 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:15.488302 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7895f9689c-jpnrz" event={"ID":"552ea3d9-af00-4685-84b2-b959f968b5a3","Type":"ContainerStarted","Data":"85f7792a6f7b9db07a858265fb057274066d95eee99bcaa2b36cc190c15b308c"} Jul 09 16:52:15.489729 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:15.489711 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" event={"ID":"c2c2a29a-d185-4b24-af9d-1784385c0473","Type":"ContainerStarted","Data":"015d82eb1cecd4775d6e1d9ef352d03a86a7b3f3242244b63abe34ae7f32a49f"} Jul 09 16:52:15.494143 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:15.494106 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xpxpq" podStartSLOduration=1.8195002200000001 podStartE2EDuration="8.494093402s" totalImagesPullingTime="6.674593182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:52:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:15.493107877 +0000 UTC m=+73.857859793" watchObservedRunningTime="2026-07-09 16:52:15.494093402 +0000 UTC m=+73.858845335" Jul 09 16:52:15.531477 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:15.531379 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4xnp4" podStartSLOduration=66.759205172 podStartE2EDuration="1m13.531361063s" totalImagesPullingTime="6.772155891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:15.518957638 +0000 UTC m=+73.883709555" watchObservedRunningTime="2026-07-09 16:52:15.531361063 +0000 UTC m=+73.896112981" Jul 09 16:52:15.531877 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:15.531845 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6ncs8" podStartSLOduration=66.691728588 podStartE2EDuration="1m13.531838124s" totalImagesPullingTime="6.840109536s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:15.530745611 +0000 UTC m=+73.895497528" watchObservedRunningTime="2026-07-09 16:52:15.531838124 +0000 UTC m=+73.896590033" Jul 09 16:52:15.543444 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:15.543399 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bl5d7" podStartSLOduration=66.754996991 podStartE2EDuration="1m13.54338432s" totalImagesPullingTime="6.788387329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:51:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:15.542909658 +0000 UTC m=+73.907661574" watchObservedRunningTime="2026-07-09 16:52:15.54338432 +0000 UTC m=+73.908136237" Jul 09 16:52:15.558454 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:15.558407 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7895f9689c-jpnrz" podStartSLOduration=1.321014894 podStartE2EDuration="8.558387873s" totalImagesPullingTime="7.237372979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:52:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:15.558034362 +0000 UTC m=+73.922786302" watchObservedRunningTime="2026-07-09 16:52:15.558387873 +0000 UTC m=+73.923139794" Jul 09 16:52:16.495253 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:16.495212 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" event={"ID":"c2c2a29a-d185-4b24-af9d-1784385c0473","Type":"ContainerStarted","Data":"2a9808038c3f3dd90324c672a5fef31b0ba6b5886b2d27b87c8d689cb7be54e7"} Jul 09 16:52:16.495691 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:16.495305 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" event={"ID":"c2c2a29a-d185-4b24-af9d-1784385c0473","Type":"ContainerStarted","Data":"e438eb8a401769d8dcebbbf907320efe35de5cc58be930c2d31ec714f2816cde"} Jul 09 16:52:16.516812 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:16.516761 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5c87f6d55c-xb9zf" podStartSLOduration=1.712843887 podStartE2EDuration="9.516744417s" totalImagesPullingTime="7.80390053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:52:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:52:16.515456317 +0000 UTC m=+74.880208232" watchObservedRunningTime="2026-07-09 16:52:16.516744417 +0000 UTC m=+74.881496333" Jul 09 16:52:17.285699 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:17.285660 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7895f9689c-jpnrz"] Jul 09 16:52:17.711107 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:17.711050 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7895f9689c-jpnrz" Jul 09 16:52:36.074175 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.074024 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6c7455868b-kffv6" podUID="36101bde-6cdc-43fd-befb-e435e56754d1" containerName="registry" containerID="cri-o://8dc8f0b3141d75166f737de9f6c646fdb1f85629f751f98d409d2abb61e95096" gracePeriod=30 Jul 09 16:52:36.318947 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.318923 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:52:36.439798 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.439757 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36101bde-6cdc-43fd-befb-e435e56754d1-trusted-ca\") pod \"36101bde-6cdc-43fd-befb-e435e56754d1\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " Jul 09 16:52:36.439993 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.439833 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pk6b4\" (UniqueName: \"kubernetes.io/projected/36101bde-6cdc-43fd-befb-e435e56754d1-kube-api-access-pk6b4\") pod \"36101bde-6cdc-43fd-befb-e435e56754d1\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " Jul 09 16:52:36.439993 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.439864 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36101bde-6cdc-43fd-befb-e435e56754d1-installation-pull-secrets\") pod \"36101bde-6cdc-43fd-befb-e435e56754d1\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " Jul 09 16:52:36.439993 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.439879 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36101bde-6cdc-43fd-befb-e435e56754d1-image-registry-private-configuration\") pod \"36101bde-6cdc-43fd-befb-e435e56754d1\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " Jul 09 16:52:36.439993 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.439905 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36101bde-6cdc-43fd-befb-e435e56754d1-registry-tls\") pod \"36101bde-6cdc-43fd-befb-e435e56754d1\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " Jul 09 16:52:36.439993 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.439963 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36101bde-6cdc-43fd-befb-e435e56754d1-ca-trust-extracted\") pod \"36101bde-6cdc-43fd-befb-e435e56754d1\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " Jul 09 16:52:36.439993 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.439986 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36101bde-6cdc-43fd-befb-e435e56754d1-registry-certificates\") pod \"36101bde-6cdc-43fd-befb-e435e56754d1\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " Jul 09 16:52:36.440347 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.440002 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36101bde-6cdc-43fd-befb-e435e56754d1-bound-sa-token\") pod \"36101bde-6cdc-43fd-befb-e435e56754d1\" (UID: \"36101bde-6cdc-43fd-befb-e435e56754d1\") " Jul 09 16:52:36.440347 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.440170 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36101bde-6cdc-43fd-befb-e435e56754d1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "36101bde-6cdc-43fd-befb-e435e56754d1" (UID: "36101bde-6cdc-43fd-befb-e435e56754d1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:52:36.440755 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.440642 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36101bde-6cdc-43fd-befb-e435e56754d1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "36101bde-6cdc-43fd-befb-e435e56754d1" (UID: "36101bde-6cdc-43fd-befb-e435e56754d1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:52:36.442786 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.442745 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36101bde-6cdc-43fd-befb-e435e56754d1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "36101bde-6cdc-43fd-befb-e435e56754d1" (UID: "36101bde-6cdc-43fd-befb-e435e56754d1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:52:36.442786 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.442758 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36101bde-6cdc-43fd-befb-e435e56754d1-kube-api-access-pk6b4" (OuterVolumeSpecName: "kube-api-access-pk6b4") pod "36101bde-6cdc-43fd-befb-e435e56754d1" (UID: "36101bde-6cdc-43fd-befb-e435e56754d1"). InnerVolumeSpecName "kube-api-access-pk6b4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:52:36.442941 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.442825 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36101bde-6cdc-43fd-befb-e435e56754d1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "36101bde-6cdc-43fd-befb-e435e56754d1" (UID: "36101bde-6cdc-43fd-befb-e435e56754d1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:52:36.443066 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.443049 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36101bde-6cdc-43fd-befb-e435e56754d1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "36101bde-6cdc-43fd-befb-e435e56754d1" (UID: "36101bde-6cdc-43fd-befb-e435e56754d1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:52:36.443164 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.443135 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36101bde-6cdc-43fd-befb-e435e56754d1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "36101bde-6cdc-43fd-befb-e435e56754d1" (UID: "36101bde-6cdc-43fd-befb-e435e56754d1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:52:36.448153 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.448126 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36101bde-6cdc-43fd-befb-e435e56754d1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "36101bde-6cdc-43fd-befb-e435e56754d1" (UID: "36101bde-6cdc-43fd-befb-e435e56754d1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:52:36.541385 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.541353 2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/36101bde-6cdc-43fd-befb-e435e56754d1-installation-pull-secrets\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:52:36.541385 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.541381 2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/36101bde-6cdc-43fd-befb-e435e56754d1-image-registry-private-configuration\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:52:36.541385 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.541393 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/36101bde-6cdc-43fd-befb-e435e56754d1-registry-tls\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:52:36.541597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.541402 2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/36101bde-6cdc-43fd-befb-e435e56754d1-ca-trust-extracted\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:52:36.541597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.541410 2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/36101bde-6cdc-43fd-befb-e435e56754d1-registry-certificates\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:52:36.541597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.541418 2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/36101bde-6cdc-43fd-befb-e435e56754d1-bound-sa-token\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:52:36.541597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.541426 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/36101bde-6cdc-43fd-befb-e435e56754d1-trusted-ca\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:52:36.541597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.541433 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pk6b4\" (UniqueName: \"kubernetes.io/projected/36101bde-6cdc-43fd-befb-e435e56754d1-kube-api-access-pk6b4\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:52:36.563882 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.563852 2580 generic.go:356] "Generic (PLEG): container finished" podID="36101bde-6cdc-43fd-befb-e435e56754d1" containerID="8dc8f0b3141d75166f737de9f6c646fdb1f85629f751f98d409d2abb61e95096" exitCode=0 Jul 09 16:52:36.563998 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.563887 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c7455868b-kffv6" event={"ID":"36101bde-6cdc-43fd-befb-e435e56754d1","Type":"ContainerDied","Data":"8dc8f0b3141d75166f737de9f6c646fdb1f85629f751f98d409d2abb61e95096"} Jul 09 16:52:36.563998 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.563898 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c7455868b-kffv6" Jul 09 16:52:36.563998 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.563923 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c7455868b-kffv6" event={"ID":"36101bde-6cdc-43fd-befb-e435e56754d1","Type":"ContainerDied","Data":"63436cb24b4aadc88983177fa3342f63d0eeb11f325f1dd1dbf2c08fc3b2a81c"} Jul 09 16:52:36.563998 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.563941 2580 scope.go:117] "RemoveContainer" containerID="8dc8f0b3141d75166f737de9f6c646fdb1f85629f751f98d409d2abb61e95096" Jul 09 16:52:36.572735 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.572717 2580 scope.go:117] "RemoveContainer" containerID="8dc8f0b3141d75166f737de9f6c646fdb1f85629f751f98d409d2abb61e95096" Jul 09 16:52:36.573005 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:52:36.572982 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dc8f0b3141d75166f737de9f6c646fdb1f85629f751f98d409d2abb61e95096\": container with ID starting with 8dc8f0b3141d75166f737de9f6c646fdb1f85629f751f98d409d2abb61e95096 not found: ID does not exist" containerID="8dc8f0b3141d75166f737de9f6c646fdb1f85629f751f98d409d2abb61e95096" Jul 09 16:52:36.573083 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.573017 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dc8f0b3141d75166f737de9f6c646fdb1f85629f751f98d409d2abb61e95096"} err="failed to get container status \"8dc8f0b3141d75166f737de9f6c646fdb1f85629f751f98d409d2abb61e95096\": rpc error: code = NotFound desc = could not find container \"8dc8f0b3141d75166f737de9f6c646fdb1f85629f751f98d409d2abb61e95096\": container with ID starting with 8dc8f0b3141d75166f737de9f6c646fdb1f85629f751f98d409d2abb61e95096 not found: ID does not exist" Jul 09 16:52:36.585831 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.585799 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c7455868b-kffv6"] Jul 09 16:52:36.586911 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:36.586887 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6c7455868b-kffv6"] Jul 09 16:52:38.176037 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:38.176002 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36101bde-6cdc-43fd-befb-e435e56754d1" path="/var/lib/kubelet/pods/36101bde-6cdc-43fd-befb-e435e56754d1/volumes" Jul 09 16:52:42.519229 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:42.519188 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7895f9689c-jpnrz" podUID="552ea3d9-af00-4685-84b2-b959f968b5a3" containerName="console" containerID="cri-o://85f7792a6f7b9db07a858265fb057274066d95eee99bcaa2b36cc190c15b308c" gracePeriod=15 Jul 09 16:52:42.790492 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:42.790435 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7895f9689c-jpnrz" Jul 09 16:52:42.883612 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:42.883582 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/552ea3d9-af00-4685-84b2-b959f968b5a3-service-ca\") pod \"552ea3d9-af00-4685-84b2-b959f968b5a3\" (UID: \"552ea3d9-af00-4685-84b2-b959f968b5a3\") " Jul 09 16:52:42.883798 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:42.883622 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xnk4\" (UniqueName: \"kubernetes.io/projected/552ea3d9-af00-4685-84b2-b959f968b5a3-kube-api-access-6xnk4\") pod \"552ea3d9-af00-4685-84b2-b959f968b5a3\" (UID: \"552ea3d9-af00-4685-84b2-b959f968b5a3\") " Jul 09 16:52:42.883798 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:42.883643 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/552ea3d9-af00-4685-84b2-b959f968b5a3-console-oauth-config\") pod \"552ea3d9-af00-4685-84b2-b959f968b5a3\" (UID: \"552ea3d9-af00-4685-84b2-b959f968b5a3\") " Jul 09 16:52:42.883798 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:42.883665 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/552ea3d9-af00-4685-84b2-b959f968b5a3-console-serving-cert\") pod \"552ea3d9-af00-4685-84b2-b959f968b5a3\" (UID: \"552ea3d9-af00-4685-84b2-b959f968b5a3\") " Jul 09 16:52:42.883958 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:42.883868 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/552ea3d9-af00-4685-84b2-b959f968b5a3-trusted-ca-bundle\") pod \"552ea3d9-af00-4685-84b2-b959f968b5a3\" (UID: \"552ea3d9-af00-4685-84b2-b959f968b5a3\") " Jul 09 16:52:42.883958 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:42.883912 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/552ea3d9-af00-4685-84b2-b959f968b5a3-console-config\") pod \"552ea3d9-af00-4685-84b2-b959f968b5a3\" (UID: \"552ea3d9-af00-4685-84b2-b959f968b5a3\") " Jul 09 16:52:42.884065 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:42.883965 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/552ea3d9-af00-4685-84b2-b959f968b5a3-oauth-serving-cert\") pod \"552ea3d9-af00-4685-84b2-b959f968b5a3\" (UID: \"552ea3d9-af00-4685-84b2-b959f968b5a3\") " Jul 09 16:52:42.884123 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:42.884047 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/552ea3d9-af00-4685-84b2-b959f968b5a3-service-ca" (OuterVolumeSpecName: "service-ca") pod "552ea3d9-af00-4685-84b2-b959f968b5a3" (UID: "552ea3d9-af00-4685-84b2-b959f968b5a3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:52:42.884224 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:42.884200 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/552ea3d9-af00-4685-84b2-b959f968b5a3-service-ca\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:52:42.884443 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:42.884415 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/552ea3d9-af00-4685-84b2-b959f968b5a3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "552ea3d9-af00-4685-84b2-b959f968b5a3" (UID: "552ea3d9-af00-4685-84b2-b959f968b5a3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:52:42.884643 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:42.884600 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/552ea3d9-af00-4685-84b2-b959f968b5a3-console-config" (OuterVolumeSpecName: "console-config") pod "552ea3d9-af00-4685-84b2-b959f968b5a3" (UID: "552ea3d9-af00-4685-84b2-b959f968b5a3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:52:42.884748 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:42.884651 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/552ea3d9-af00-4685-84b2-b959f968b5a3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "552ea3d9-af00-4685-84b2-b959f968b5a3" (UID: "552ea3d9-af00-4685-84b2-b959f968b5a3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:52:42.886188 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:42.886160 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/552ea3d9-af00-4685-84b2-b959f968b5a3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "552ea3d9-af00-4685-84b2-b959f968b5a3" (UID: "552ea3d9-af00-4685-84b2-b959f968b5a3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:52:42.886259 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:42.886169 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/552ea3d9-af00-4685-84b2-b959f968b5a3-kube-api-access-6xnk4" (OuterVolumeSpecName: "kube-api-access-6xnk4") pod "552ea3d9-af00-4685-84b2-b959f968b5a3" (UID: "552ea3d9-af00-4685-84b2-b959f968b5a3"). InnerVolumeSpecName "kube-api-access-6xnk4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:52:42.886259 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:42.886210 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/552ea3d9-af00-4685-84b2-b959f968b5a3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "552ea3d9-af00-4685-84b2-b959f968b5a3" (UID: "552ea3d9-af00-4685-84b2-b959f968b5a3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:52:42.984905 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:42.984873 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xnk4\" (UniqueName: \"kubernetes.io/projected/552ea3d9-af00-4685-84b2-b959f968b5a3-kube-api-access-6xnk4\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:52:42.984905 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:42.984901 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/552ea3d9-af00-4685-84b2-b959f968b5a3-console-oauth-config\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:52:42.984905 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:42.984910 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/552ea3d9-af00-4685-84b2-b959f968b5a3-console-serving-cert\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:52:42.985079 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:42.984920 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/552ea3d9-af00-4685-84b2-b959f968b5a3-trusted-ca-bundle\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:52:42.985079 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:42.984929 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/552ea3d9-af00-4685-84b2-b959f968b5a3-console-config\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:52:42.985079 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:42.984939 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/552ea3d9-af00-4685-84b2-b959f968b5a3-oauth-serving-cert\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:52:43.589887 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:43.589848 2580 generic.go:356] "Generic (PLEG): container finished" podID="552ea3d9-af00-4685-84b2-b959f968b5a3" containerID="85f7792a6f7b9db07a858265fb057274066d95eee99bcaa2b36cc190c15b308c" exitCode=0 Jul 09 16:52:43.590324 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:43.589900 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7895f9689c-jpnrz" Jul 09 16:52:43.590324 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:43.589903 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7895f9689c-jpnrz" event={"ID":"552ea3d9-af00-4685-84b2-b959f968b5a3","Type":"ContainerDied","Data":"85f7792a6f7b9db07a858265fb057274066d95eee99bcaa2b36cc190c15b308c"} Jul 09 16:52:43.590324 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:43.589952 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7895f9689c-jpnrz" event={"ID":"552ea3d9-af00-4685-84b2-b959f968b5a3","Type":"ContainerDied","Data":"d26e79adf401692a1ce591dfc425c7da409f8b1c2b3c58e9f3974ee7d7f43342"} Jul 09 16:52:43.590324 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:43.589980 2580 scope.go:117] "RemoveContainer" containerID="85f7792a6f7b9db07a858265fb057274066d95eee99bcaa2b36cc190c15b308c" Jul 09 16:52:43.598574 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:43.598557 2580 scope.go:117] "RemoveContainer" containerID="85f7792a6f7b9db07a858265fb057274066d95eee99bcaa2b36cc190c15b308c" Jul 09 16:52:43.598864 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:52:43.598839 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85f7792a6f7b9db07a858265fb057274066d95eee99bcaa2b36cc190c15b308c\": container with ID starting with 85f7792a6f7b9db07a858265fb057274066d95eee99bcaa2b36cc190c15b308c not found: ID does not exist" containerID="85f7792a6f7b9db07a858265fb057274066d95eee99bcaa2b36cc190c15b308c" Jul 09 16:52:43.598916 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:43.598875 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85f7792a6f7b9db07a858265fb057274066d95eee99bcaa2b36cc190c15b308c"} err="failed to get container status \"85f7792a6f7b9db07a858265fb057274066d95eee99bcaa2b36cc190c15b308c\": rpc error: code = NotFound desc = could not find container \"85f7792a6f7b9db07a858265fb057274066d95eee99bcaa2b36cc190c15b308c\": container with ID starting with 85f7792a6f7b9db07a858265fb057274066d95eee99bcaa2b36cc190c15b308c not found: ID does not exist" Jul 09 16:52:43.609772 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:43.609751 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7895f9689c-jpnrz"] Jul 09 16:52:43.615033 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:43.615012 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7895f9689c-jpnrz"] Jul 09 16:52:44.175726 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:44.175692 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="552ea3d9-af00-4685-84b2-b959f968b5a3" path="/var/lib/kubelet/pods/552ea3d9-af00-4685-84b2-b959f968b5a3/volumes" Jul 09 16:52:46.497678 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:52:46.497648 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bl5d7" Jul 09 16:53:25.557334 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.557301 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d945d484-6xmdl"] Jul 09 16:53:25.557805 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.557523 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="552ea3d9-af00-4685-84b2-b959f968b5a3" containerName="console" Jul 09 16:53:25.557805 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.557534 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="552ea3d9-af00-4685-84b2-b959f968b5a3" containerName="console" Jul 09 16:53:25.557805 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.557545 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36101bde-6cdc-43fd-befb-e435e56754d1" containerName="registry" Jul 09 16:53:25.557805 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.557551 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="36101bde-6cdc-43fd-befb-e435e56754d1" containerName="registry" Jul 09 16:53:25.557805 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.557598 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="552ea3d9-af00-4685-84b2-b959f968b5a3" containerName="console" Jul 09 16:53:25.557805 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.557605 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="36101bde-6cdc-43fd-befb-e435e56754d1" containerName="registry" Jul 09 16:53:25.559215 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.559199 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:53:25.561292 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.561253 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 16:53:25.561518 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.561499 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 16:53:25.562065 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.562044 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 16:53:25.562179 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.562162 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 16:53:25.562530 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.562475 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 16:53:25.562530 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.562485 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 16:53:25.562690 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.562570 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tnbw7\"" Jul 09 16:53:25.562690 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.562674 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 16:53:25.569992 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.569965 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 16:53:25.571446 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.571425 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d945d484-6xmdl"] Jul 09 16:53:25.662093 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.662010 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 16:53:25.664552 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.664533 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.666899 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.666872 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 16:53:25.667011 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.666927 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 16:53:25.667011 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.666873 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 16:53:25.667206 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.667184 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 16:53:25.667250 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.667237 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 16:53:25.667313 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.667195 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 16:53:25.667393 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.667195 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 16:53:25.667470 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.667310 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4prsk\"" Jul 09 16:53:25.667470 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.667407 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 16:53:25.673441 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.673423 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 16:53:25.674491 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.674473 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/841337e2-6846-4efb-b4d1-7f19bbf815f7-console-oauth-config\") pod \"console-6d945d484-6xmdl\" (UID: \"841337e2-6846-4efb-b4d1-7f19bbf815f7\") " pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:53:25.674552 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.674499 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/841337e2-6846-4efb-b4d1-7f19bbf815f7-console-serving-cert\") pod \"console-6d945d484-6xmdl\" (UID: \"841337e2-6846-4efb-b4d1-7f19bbf815f7\") " pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:53:25.674552 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.674520 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/841337e2-6846-4efb-b4d1-7f19bbf815f7-trusted-ca-bundle\") pod \"console-6d945d484-6xmdl\" (UID: \"841337e2-6846-4efb-b4d1-7f19bbf815f7\") " pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:53:25.674552 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.674537 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/841337e2-6846-4efb-b4d1-7f19bbf815f7-console-config\") pod \"console-6d945d484-6xmdl\" (UID: \"841337e2-6846-4efb-b4d1-7f19bbf815f7\") " pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:53:25.674677 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.674558 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/841337e2-6846-4efb-b4d1-7f19bbf815f7-service-ca\") pod \"console-6d945d484-6xmdl\" (UID: \"841337e2-6846-4efb-b4d1-7f19bbf815f7\") " pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:53:25.674677 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.674625 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/841337e2-6846-4efb-b4d1-7f19bbf815f7-oauth-serving-cert\") pod \"console-6d945d484-6xmdl\" (UID: \"841337e2-6846-4efb-b4d1-7f19bbf815f7\") " pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:53:25.674767 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.674684 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjd8t\" (UniqueName: \"kubernetes.io/projected/841337e2-6846-4efb-b4d1-7f19bbf815f7-kube-api-access-qjd8t\") pod \"console-6d945d484-6xmdl\" (UID: \"841337e2-6846-4efb-b4d1-7f19bbf815f7\") " pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:53:25.681391 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.681370 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 16:53:25.775707 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.775665 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/40a0b84f-1bdd-4e29-804a-f0902466512b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.775898 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.775718 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjd8t\" (UniqueName: \"kubernetes.io/projected/841337e2-6846-4efb-b4d1-7f19bbf815f7-kube-api-access-qjd8t\") pod \"console-6d945d484-6xmdl\" (UID: \"841337e2-6846-4efb-b4d1-7f19bbf815f7\") " pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:53:25.775898 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.775737 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40a0b84f-1bdd-4e29-804a-f0902466512b-config-out\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.775898 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.775758 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/40a0b84f-1bdd-4e29-804a-f0902466512b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.775898 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.775782 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40a0b84f-1bdd-4e29-804a-f0902466512b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.775898 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.775801 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/40a0b84f-1bdd-4e29-804a-f0902466512b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.775898 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.775821 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/841337e2-6846-4efb-b4d1-7f19bbf815f7-console-oauth-config\") pod \"console-6d945d484-6xmdl\" (UID: \"841337e2-6846-4efb-b4d1-7f19bbf815f7\") " pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:53:25.775898 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.775846 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/841337e2-6846-4efb-b4d1-7f19bbf815f7-console-serving-cert\") pod \"console-6d945d484-6xmdl\" (UID: \"841337e2-6846-4efb-b4d1-7f19bbf815f7\") " pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:53:25.776208 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.775955 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/40a0b84f-1bdd-4e29-804a-f0902466512b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.776208 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.776002 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40a0b84f-1bdd-4e29-804a-f0902466512b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.776208 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.776037 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/841337e2-6846-4efb-b4d1-7f19bbf815f7-trusted-ca-bundle\") pod \"console-6d945d484-6xmdl\" (UID: \"841337e2-6846-4efb-b4d1-7f19bbf815f7\") " pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:53:25.776208 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.776098 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/841337e2-6846-4efb-b4d1-7f19bbf815f7-console-config\") pod \"console-6d945d484-6xmdl\" (UID: \"841337e2-6846-4efb-b4d1-7f19bbf815f7\") " pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:53:25.776208 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.776140 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwbq2\" (UniqueName: \"kubernetes.io/projected/40a0b84f-1bdd-4e29-804a-f0902466512b-kube-api-access-kwbq2\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.776208 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.776176 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/841337e2-6846-4efb-b4d1-7f19bbf815f7-service-ca\") pod \"console-6d945d484-6xmdl\" (UID: \"841337e2-6846-4efb-b4d1-7f19bbf815f7\") " pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:53:25.776208 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.776201 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40a0b84f-1bdd-4e29-804a-f0902466512b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.776609 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.776236 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40a0b84f-1bdd-4e29-804a-f0902466512b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.776609 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.776265 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40a0b84f-1bdd-4e29-804a-f0902466512b-web-config\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.776609 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.776338 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40a0b84f-1bdd-4e29-804a-f0902466512b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.776609 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.776392 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/40a0b84f-1bdd-4e29-804a-f0902466512b-config-volume\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.776609 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.776426 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/841337e2-6846-4efb-b4d1-7f19bbf815f7-oauth-serving-cert\") pod \"console-6d945d484-6xmdl\" (UID: \"841337e2-6846-4efb-b4d1-7f19bbf815f7\") " pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:53:25.777024 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.776886 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/841337e2-6846-4efb-b4d1-7f19bbf815f7-console-config\") pod \"console-6d945d484-6xmdl\" (UID: \"841337e2-6846-4efb-b4d1-7f19bbf815f7\") " pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:53:25.777024 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.776974 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/841337e2-6846-4efb-b4d1-7f19bbf815f7-service-ca\") pod \"console-6d945d484-6xmdl\" (UID: \"841337e2-6846-4efb-b4d1-7f19bbf815f7\") " pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:53:25.777133 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.777115 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/841337e2-6846-4efb-b4d1-7f19bbf815f7-oauth-serving-cert\") pod \"console-6d945d484-6xmdl\" (UID: \"841337e2-6846-4efb-b4d1-7f19bbf815f7\") " pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:53:25.777236 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.777211 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/841337e2-6846-4efb-b4d1-7f19bbf815f7-trusted-ca-bundle\") pod \"console-6d945d484-6xmdl\" (UID: \"841337e2-6846-4efb-b4d1-7f19bbf815f7\") " pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:53:25.778644 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.778621 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/841337e2-6846-4efb-b4d1-7f19bbf815f7-console-oauth-config\") pod \"console-6d945d484-6xmdl\" (UID: \"841337e2-6846-4efb-b4d1-7f19bbf815f7\") " pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:53:25.778744 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.778648 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/841337e2-6846-4efb-b4d1-7f19bbf815f7-console-serving-cert\") pod \"console-6d945d484-6xmdl\" (UID: \"841337e2-6846-4efb-b4d1-7f19bbf815f7\") " pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:53:25.783065 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.783043 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjd8t\" (UniqueName: \"kubernetes.io/projected/841337e2-6846-4efb-b4d1-7f19bbf815f7-kube-api-access-qjd8t\") pod \"console-6d945d484-6xmdl\" (UID: \"841337e2-6846-4efb-b4d1-7f19bbf815f7\") " pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:53:25.871131 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.871097 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:53:25.877007 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.876975 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwbq2\" (UniqueName: \"kubernetes.io/projected/40a0b84f-1bdd-4e29-804a-f0902466512b-kube-api-access-kwbq2\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.877122 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.877026 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40a0b84f-1bdd-4e29-804a-f0902466512b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.877122 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.877061 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40a0b84f-1bdd-4e29-804a-f0902466512b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.877122 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.877089 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40a0b84f-1bdd-4e29-804a-f0902466512b-web-config\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.877122 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.877111 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40a0b84f-1bdd-4e29-804a-f0902466512b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.877341 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.877137 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/40a0b84f-1bdd-4e29-804a-f0902466512b-config-volume\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.877341 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.877172 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/40a0b84f-1bdd-4e29-804a-f0902466512b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.877424 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.877389 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40a0b84f-1bdd-4e29-804a-f0902466512b-config-out\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.877472 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.877429 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/40a0b84f-1bdd-4e29-804a-f0902466512b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.877526 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.877471 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40a0b84f-1bdd-4e29-804a-f0902466512b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.877526 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.877505 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/40a0b84f-1bdd-4e29-804a-f0902466512b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.877626 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.877537 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/40a0b84f-1bdd-4e29-804a-f0902466512b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.877626 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.877581 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40a0b84f-1bdd-4e29-804a-f0902466512b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.878258 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.878224 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40a0b84f-1bdd-4e29-804a-f0902466512b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.878541 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.878515 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/40a0b84f-1bdd-4e29-804a-f0902466512b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.878658 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.878633 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40a0b84f-1bdd-4e29-804a-f0902466512b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.880681 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.880658 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/40a0b84f-1bdd-4e29-804a-f0902466512b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.881106 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.881073 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/40a0b84f-1bdd-4e29-804a-f0902466512b-config-volume\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.881895 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.881765 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/40a0b84f-1bdd-4e29-804a-f0902466512b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.881895 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.881796 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/40a0b84f-1bdd-4e29-804a-f0902466512b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.882066 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.881905 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/40a0b84f-1bdd-4e29-804a-f0902466512b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.882066 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.882023 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/40a0b84f-1bdd-4e29-804a-f0902466512b-config-out\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.882339 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.882130 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/40a0b84f-1bdd-4e29-804a-f0902466512b-web-config\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.882898 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.882873 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/40a0b84f-1bdd-4e29-804a-f0902466512b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.883394 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.883367 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/40a0b84f-1bdd-4e29-804a-f0902466512b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.884837 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.884815 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwbq2\" (UniqueName: \"kubernetes.io/projected/40a0b84f-1bdd-4e29-804a-f0902466512b-kube-api-access-kwbq2\") pod \"alertmanager-main-0\" (UID: \"40a0b84f-1bdd-4e29-804a-f0902466512b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.973913 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.973880 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 16:53:25.997889 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:25.997863 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d945d484-6xmdl"] Jul 09 16:53:26.001259 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:53:26.001227 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod841337e2_6846_4efb_b4d1_7f19bbf815f7.slice/crio-9fbe87094b0121c40e560fab5315c9a7e16fefcf954ad11db72c2cd7bd66ebac WatchSource:0}: Error finding container 9fbe87094b0121c40e560fab5315c9a7e16fefcf954ad11db72c2cd7bd66ebac: Status 404 returned error can't find the container with id 9fbe87094b0121c40e560fab5315c9a7e16fefcf954ad11db72c2cd7bd66ebac Jul 09 16:53:26.115424 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:26.115395 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 16:53:26.117752 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:53:26.117721 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40a0b84f_1bdd_4e29_804a_f0902466512b.slice/crio-06ebe9501f79dd81df6d75a593e2c4a3b068c43501e5c5659e5b2aa1e275a2b0 WatchSource:0}: Error finding container 06ebe9501f79dd81df6d75a593e2c4a3b068c43501e5c5659e5b2aa1e275a2b0: Status 404 returned error can't find the container with id 06ebe9501f79dd81df6d75a593e2c4a3b068c43501e5c5659e5b2aa1e275a2b0 Jul 09 16:53:26.730541 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:26.730504 2580 generic.go:356] "Generic (PLEG): container finished" podID="40a0b84f-1bdd-4e29-804a-f0902466512b" containerID="42f7b30e0f899efe9eaaa7d0c628ead2159bf9e9804f9ce7e5da44a40bb453c1" exitCode=0 Jul 09 16:53:26.730969 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:26.730597 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40a0b84f-1bdd-4e29-804a-f0902466512b","Type":"ContainerDied","Data":"42f7b30e0f899efe9eaaa7d0c628ead2159bf9e9804f9ce7e5da44a40bb453c1"} Jul 09 16:53:26.730969 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:26.730682 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40a0b84f-1bdd-4e29-804a-f0902466512b","Type":"ContainerStarted","Data":"06ebe9501f79dd81df6d75a593e2c4a3b068c43501e5c5659e5b2aa1e275a2b0"} Jul 09 16:53:26.732148 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:26.732125 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d945d484-6xmdl" event={"ID":"841337e2-6846-4efb-b4d1-7f19bbf815f7","Type":"ContainerStarted","Data":"29dbb3496b4ffa0307d81675187b4c7639477944d1baabe8d41d41b3ff553b69"} Jul 09 16:53:26.732247 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:26.732167 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d945d484-6xmdl" event={"ID":"841337e2-6846-4efb-b4d1-7f19bbf815f7","Type":"ContainerStarted","Data":"9fbe87094b0121c40e560fab5315c9a7e16fefcf954ad11db72c2cd7bd66ebac"} Jul 09 16:53:26.775777 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:26.775728 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d945d484-6xmdl" podStartSLOduration=1.775712647 podStartE2EDuration="1.775712647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:53:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:53:26.775076109 +0000 UTC m=+145.139828022" watchObservedRunningTime="2026-07-09 16:53:26.775712647 +0000 UTC m=+145.140464563" Jul 09 16:53:30.749389 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:30.749349 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40a0b84f-1bdd-4e29-804a-f0902466512b","Type":"ContainerStarted","Data":"1d6f6849803a7db8f05ae347aa946964d2749fcb61aa78fbd021aa3c3d7ba9b2"} Jul 09 16:53:30.749770 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:30.749448 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40a0b84f-1bdd-4e29-804a-f0902466512b","Type":"ContainerStarted","Data":"efe4f072a32f559f9566c36576a75281fdc037d3b5a85e2b3effbbb366f9335a"} Jul 09 16:53:30.749770 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:30.749475 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40a0b84f-1bdd-4e29-804a-f0902466512b","Type":"ContainerStarted","Data":"eddb65bacd9f5afeb08a8c63d22d67ebd16c0c393d1a8bd34f819dad6677aa83"} Jul 09 16:53:30.749770 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:30.749499 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40a0b84f-1bdd-4e29-804a-f0902466512b","Type":"ContainerStarted","Data":"c8b9caaa0656f3428029e5c663c780ca0b99621f53ddad355836ac6de92a76e0"} Jul 09 16:53:30.749770 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:30.749523 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40a0b84f-1bdd-4e29-804a-f0902466512b","Type":"ContainerStarted","Data":"87092501718ccf736318f706ecffbca990922bbb7e6a3decd571bde4144c9783"} Jul 09 16:53:31.758396 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:31.758365 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"40a0b84f-1bdd-4e29-804a-f0902466512b","Type":"ContainerStarted","Data":"dc19d177b9781344733f9e07775e0d84f40151fcf25409703c05bea26e436270"} Jul 09 16:53:31.784427 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:31.784361 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.58905254 podStartE2EDuration="6.784343663s" totalImagesPullingTime="4.180197221s" totalInitContainerRuntime="15.093902ms" isStatefulPod=false podCreationTimestamp="2026-07-09 16:53:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:53:31.782762506 +0000 UTC m=+150.147514422" watchObservedRunningTime="2026-07-09 16:53:31.784343663 +0000 UTC m=+150.149095579" Jul 09 16:53:35.871794 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:35.871755 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:53:35.872160 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:35.871814 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:53:35.876469 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:35.876448 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:53:36.781001 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:53:36.780961 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:54:17.607684 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:17.607637 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8"] Jul 09 16:54:17.611115 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:17.611090 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8" Jul 09 16:54:17.613559 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:17.613538 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 16:54:17.613690 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:17.613669 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2z4jg\"" Jul 09 16:54:17.614353 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:17.614337 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 16:54:17.620457 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:17.620434 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8"] Jul 09 16:54:17.663004 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:17.662964 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f795a6f-b10f-4ccc-b420-4d06fd8d3a95-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8\" (UID: \"8f795a6f-b10f-4ccc-b420-4d06fd8d3a95\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8" Jul 09 16:54:17.663004 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:17.663011 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f795a6f-b10f-4ccc-b420-4d06fd8d3a95-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8\" (UID: \"8f795a6f-b10f-4ccc-b420-4d06fd8d3a95\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8" Jul 09 16:54:17.663231 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:17.663084 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dktb\" (UniqueName: \"kubernetes.io/projected/8f795a6f-b10f-4ccc-b420-4d06fd8d3a95-kube-api-access-8dktb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8\" (UID: \"8f795a6f-b10f-4ccc-b420-4d06fd8d3a95\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8" Jul 09 16:54:17.764240 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:17.764204 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f795a6f-b10f-4ccc-b420-4d06fd8d3a95-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8\" (UID: \"8f795a6f-b10f-4ccc-b420-4d06fd8d3a95\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8" Jul 09 16:54:17.764419 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:17.764266 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dktb\" (UniqueName: \"kubernetes.io/projected/8f795a6f-b10f-4ccc-b420-4d06fd8d3a95-kube-api-access-8dktb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8\" (UID: \"8f795a6f-b10f-4ccc-b420-4d06fd8d3a95\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8" Jul 09 16:54:17.764419 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:17.764344 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f795a6f-b10f-4ccc-b420-4d06fd8d3a95-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8\" (UID: \"8f795a6f-b10f-4ccc-b420-4d06fd8d3a95\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8" Jul 09 16:54:17.764652 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:17.764628 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f795a6f-b10f-4ccc-b420-4d06fd8d3a95-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8\" (UID: \"8f795a6f-b10f-4ccc-b420-4d06fd8d3a95\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8" Jul 09 16:54:17.764721 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:17.764656 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f795a6f-b10f-4ccc-b420-4d06fd8d3a95-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8\" (UID: \"8f795a6f-b10f-4ccc-b420-4d06fd8d3a95\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8" Jul 09 16:54:17.772746 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:17.772727 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dktb\" (UniqueName: \"kubernetes.io/projected/8f795a6f-b10f-4ccc-b420-4d06fd8d3a95-kube-api-access-8dktb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8\" (UID: \"8f795a6f-b10f-4ccc-b420-4d06fd8d3a95\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8" Jul 09 16:54:17.921047 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:17.920960 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8" Jul 09 16:54:18.045674 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:18.045642 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8"] Jul 09 16:54:18.048829 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:54:18.048802 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f795a6f_b10f_4ccc_b420_4d06fd8d3a95.slice/crio-12510e5d4a1a31ca26d74e9f0ce5c8385f03fc7a6104502d61bd735b8576b138 WatchSource:0}: Error finding container 12510e5d4a1a31ca26d74e9f0ce5c8385f03fc7a6104502d61bd735b8576b138: Status 404 returned error can't find the container with id 12510e5d4a1a31ca26d74e9f0ce5c8385f03fc7a6104502d61bd735b8576b138 Jul 09 16:54:18.925241 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:18.925198 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8" event={"ID":"8f795a6f-b10f-4ccc-b420-4d06fd8d3a95","Type":"ContainerStarted","Data":"12510e5d4a1a31ca26d74e9f0ce5c8385f03fc7a6104502d61bd735b8576b138"} Jul 09 16:54:26.956022 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:26.955979 2580 generic.go:356] "Generic (PLEG): container finished" podID="8f795a6f-b10f-4ccc-b420-4d06fd8d3a95" containerID="12a90d569495ce913a610dc5ceb2e2d5f13ac1ba03e5a0e2cc183fa6ef820a39" exitCode=0 Jul 09 16:54:26.956433 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:26.956039 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8" event={"ID":"8f795a6f-b10f-4ccc-b420-4d06fd8d3a95","Type":"ContainerDied","Data":"12a90d569495ce913a610dc5ceb2e2d5f13ac1ba03e5a0e2cc183fa6ef820a39"} Jul 09 16:54:44.018305 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:44.018248 2580 generic.go:356] "Generic (PLEG): container finished" podID="8f795a6f-b10f-4ccc-b420-4d06fd8d3a95" containerID="d823dad4e04aa04d19d4f39ff591f0ce66abc4c5dd68c5832c9ebcaf266106b3" exitCode=0 Jul 09 16:54:44.018747 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:44.018319 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8" event={"ID":"8f795a6f-b10f-4ccc-b420-4d06fd8d3a95","Type":"ContainerDied","Data":"d823dad4e04aa04d19d4f39ff591f0ce66abc4c5dd68c5832c9ebcaf266106b3"} Jul 09 16:54:53.058881 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:53.058844 2580 generic.go:356] "Generic (PLEG): container finished" podID="8f795a6f-b10f-4ccc-b420-4d06fd8d3a95" containerID="2cb3f902f41ac7de70b31563c48e113b85d74e0c075dd2613635ceb6d0d130d6" exitCode=0 Jul 09 16:54:53.058881 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:53.058890 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8" event={"ID":"8f795a6f-b10f-4ccc-b420-4d06fd8d3a95","Type":"ContainerDied","Data":"2cb3f902f41ac7de70b31563c48e113b85d74e0c075dd2613635ceb6d0d130d6"} Jul 09 16:54:54.189898 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:54.189873 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8" Jul 09 16:54:54.355583 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:54.355544 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f795a6f-b10f-4ccc-b420-4d06fd8d3a95-util\") pod \"8f795a6f-b10f-4ccc-b420-4d06fd8d3a95\" (UID: \"8f795a6f-b10f-4ccc-b420-4d06fd8d3a95\") " Jul 09 16:54:54.355750 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:54.355595 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dktb\" (UniqueName: \"kubernetes.io/projected/8f795a6f-b10f-4ccc-b420-4d06fd8d3a95-kube-api-access-8dktb\") pod \"8f795a6f-b10f-4ccc-b420-4d06fd8d3a95\" (UID: \"8f795a6f-b10f-4ccc-b420-4d06fd8d3a95\") " Jul 09 16:54:54.355750 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:54.355645 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f795a6f-b10f-4ccc-b420-4d06fd8d3a95-bundle\") pod \"8f795a6f-b10f-4ccc-b420-4d06fd8d3a95\" (UID: \"8f795a6f-b10f-4ccc-b420-4d06fd8d3a95\") " Jul 09 16:54:54.356408 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:54.356381 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f795a6f-b10f-4ccc-b420-4d06fd8d3a95-bundle" (OuterVolumeSpecName: "bundle") pod "8f795a6f-b10f-4ccc-b420-4d06fd8d3a95" (UID: "8f795a6f-b10f-4ccc-b420-4d06fd8d3a95"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:54:54.358009 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:54.357988 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f795a6f-b10f-4ccc-b420-4d06fd8d3a95-kube-api-access-8dktb" (OuterVolumeSpecName: "kube-api-access-8dktb") pod "8f795a6f-b10f-4ccc-b420-4d06fd8d3a95" (UID: "8f795a6f-b10f-4ccc-b420-4d06fd8d3a95"). InnerVolumeSpecName "kube-api-access-8dktb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:54:54.360577 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:54.360548 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f795a6f-b10f-4ccc-b420-4d06fd8d3a95-util" (OuterVolumeSpecName: "util") pod "8f795a6f-b10f-4ccc-b420-4d06fd8d3a95" (UID: "8f795a6f-b10f-4ccc-b420-4d06fd8d3a95"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:54:54.456320 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:54.456247 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dktb\" (UniqueName: \"kubernetes.io/projected/8f795a6f-b10f-4ccc-b420-4d06fd8d3a95-kube-api-access-8dktb\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:54:54.456320 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:54.456312 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f795a6f-b10f-4ccc-b420-4d06fd8d3a95-bundle\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:54:54.456320 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:54.456322 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f795a6f-b10f-4ccc-b420-4d06fd8d3a95-util\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:54:55.067921 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:55.067884 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8" event={"ID":"8f795a6f-b10f-4ccc-b420-4d06fd8d3a95","Type":"ContainerDied","Data":"12510e5d4a1a31ca26d74e9f0ce5c8385f03fc7a6104502d61bd735b8576b138"} Jul 09 16:54:55.068091 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:55.067931 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ndvx8" Jul 09 16:54:55.068091 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:54:55.067945 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12510e5d4a1a31ca26d74e9f0ce5c8385f03fc7a6104502d61bd735b8576b138" Jul 09 16:55:00.756263 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:00.756230 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fjx5b"] Jul 09 16:55:00.756644 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:00.756550 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f795a6f-b10f-4ccc-b420-4d06fd8d3a95" containerName="pull" Jul 09 16:55:00.756644 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:00.756563 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f795a6f-b10f-4ccc-b420-4d06fd8d3a95" containerName="pull" Jul 09 16:55:00.756644 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:00.756578 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f795a6f-b10f-4ccc-b420-4d06fd8d3a95" containerName="util" Jul 09 16:55:00.756644 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:00.756583 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f795a6f-b10f-4ccc-b420-4d06fd8d3a95" containerName="util" Jul 09 16:55:00.756644 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:00.756591 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f795a6f-b10f-4ccc-b420-4d06fd8d3a95" containerName="extract" Jul 09 16:55:00.756644 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:00.756596 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f795a6f-b10f-4ccc-b420-4d06fd8d3a95" containerName="extract" Jul 09 16:55:00.756644 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:00.756634 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f795a6f-b10f-4ccc-b420-4d06fd8d3a95" containerName="extract" Jul 09 16:55:00.758763 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:00.758746 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fjx5b" Jul 09 16:55:00.761219 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:00.761198 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 09 16:55:00.761335 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:00.761200 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-pgxbn\"" Jul 09 16:55:00.761567 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:00.761548 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 09 16:55:00.775724 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:00.775701 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fjx5b"] Jul 09 16:55:00.897734 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:00.897703 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5528d4d6-073f-4df6-9a15-e31517f26dc8-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fjx5b\" (UID: \"5528d4d6-073f-4df6-9a15-e31517f26dc8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fjx5b" Jul 09 16:55:00.897879 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:00.897758 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcqw4\" (UniqueName: \"kubernetes.io/projected/5528d4d6-073f-4df6-9a15-e31517f26dc8-kube-api-access-zcqw4\") pod \"cert-manager-operator-controller-manager-55c444bf86-fjx5b\" (UID: \"5528d4d6-073f-4df6-9a15-e31517f26dc8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fjx5b" Jul 09 16:55:00.998530 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:00.998498 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcqw4\" (UniqueName: \"kubernetes.io/projected/5528d4d6-073f-4df6-9a15-e31517f26dc8-kube-api-access-zcqw4\") pod \"cert-manager-operator-controller-manager-55c444bf86-fjx5b\" (UID: \"5528d4d6-073f-4df6-9a15-e31517f26dc8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fjx5b" Jul 09 16:55:00.998688 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:00.998571 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5528d4d6-073f-4df6-9a15-e31517f26dc8-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fjx5b\" (UID: \"5528d4d6-073f-4df6-9a15-e31517f26dc8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fjx5b" Jul 09 16:55:00.998936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:00.998915 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5528d4d6-073f-4df6-9a15-e31517f26dc8-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fjx5b\" (UID: \"5528d4d6-073f-4df6-9a15-e31517f26dc8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fjx5b" Jul 09 16:55:01.006053 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:01.006033 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcqw4\" (UniqueName: \"kubernetes.io/projected/5528d4d6-073f-4df6-9a15-e31517f26dc8-kube-api-access-zcqw4\") pod \"cert-manager-operator-controller-manager-55c444bf86-fjx5b\" (UID: \"5528d4d6-073f-4df6-9a15-e31517f26dc8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fjx5b" Jul 09 16:55:01.068473 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:01.068406 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fjx5b" Jul 09 16:55:01.200606 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:01.200577 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fjx5b"] Jul 09 16:55:01.203751 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:55:01.203727 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5528d4d6_073f_4df6_9a15_e31517f26dc8.slice/crio-ec4c9c5494ac70ca9f66978ddc19aedf5117298d1ecfcadac4020b4fbee55226 WatchSource:0}: Error finding container ec4c9c5494ac70ca9f66978ddc19aedf5117298d1ecfcadac4020b4fbee55226: Status 404 returned error can't find the container with id ec4c9c5494ac70ca9f66978ddc19aedf5117298d1ecfcadac4020b4fbee55226 Jul 09 16:55:02.092298 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:02.092244 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fjx5b" event={"ID":"5528d4d6-073f-4df6-9a15-e31517f26dc8","Type":"ContainerStarted","Data":"ec4c9c5494ac70ca9f66978ddc19aedf5117298d1ecfcadac4020b4fbee55226"} Jul 09 16:55:09.119411 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:09.119373 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fjx5b" event={"ID":"5528d4d6-073f-4df6-9a15-e31517f26dc8","Type":"ContainerStarted","Data":"dc442d8a96e6fb281d1660cf630bc1955ad9ef3b1c6c077238844a36160e20e2"} Jul 09 16:55:09.138834 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:09.138778 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fjx5b" podStartSLOduration=1.7153607979999999 podStartE2EDuration="9.138758822s" totalImagesPullingTime="7.423398024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:55:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:55:09.136999403 +0000 UTC m=+247.501751318" watchObservedRunningTime="2026-07-09 16:55:09.138758822 +0000 UTC m=+247.503510741" Jul 09 16:55:09.696800 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:09.696759 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xkcxh"] Jul 09 16:55:09.699748 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:09.699728 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xkcxh" Jul 09 16:55:09.702454 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:09.702430 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 09 16:55:09.702618 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:09.702600 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 09 16:55:09.717669 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:09.717644 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xkcxh"] Jul 09 16:55:09.867884 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:09.867843 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqxlq\" (UniqueName: \"kubernetes.io/projected/a0f5384f-9765-4958-ae78-07e4c11549fc-kube-api-access-vqxlq\") pod \"cert-manager-webhook-6486ffd997-xkcxh\" (UID: \"a0f5384f-9765-4958-ae78-07e4c11549fc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xkcxh" Jul 09 16:55:09.868045 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:09.867929 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0f5384f-9765-4958-ae78-07e4c11549fc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xkcxh\" (UID: \"a0f5384f-9765-4958-ae78-07e4c11549fc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xkcxh" Jul 09 16:55:09.969224 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:09.969139 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0f5384f-9765-4958-ae78-07e4c11549fc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xkcxh\" (UID: \"a0f5384f-9765-4958-ae78-07e4c11549fc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xkcxh" Jul 09 16:55:09.969224 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:09.969199 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqxlq\" (UniqueName: \"kubernetes.io/projected/a0f5384f-9765-4958-ae78-07e4c11549fc-kube-api-access-vqxlq\") pod \"cert-manager-webhook-6486ffd997-xkcxh\" (UID: \"a0f5384f-9765-4958-ae78-07e4c11549fc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xkcxh" Jul 09 16:55:09.976984 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:09.976953 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a0f5384f-9765-4958-ae78-07e4c11549fc-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xkcxh\" (UID: \"a0f5384f-9765-4958-ae78-07e4c11549fc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xkcxh" Jul 09 16:55:09.977258 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:09.977235 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqxlq\" (UniqueName: \"kubernetes.io/projected/a0f5384f-9765-4958-ae78-07e4c11549fc-kube-api-access-vqxlq\") pod \"cert-manager-webhook-6486ffd997-xkcxh\" (UID: \"a0f5384f-9765-4958-ae78-07e4c11549fc\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xkcxh" Jul 09 16:55:10.029426 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:10.029393 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xkcxh" Jul 09 16:55:10.158521 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:10.158487 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xkcxh"] Jul 09 16:55:10.161429 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:55:10.161391 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0f5384f_9765_4958_ae78_07e4c11549fc.slice/crio-41d5958ec5c2948695bf1fb0592d5aa99ad2288aace3288ac060665cf43a4192 WatchSource:0}: Error finding container 41d5958ec5c2948695bf1fb0592d5aa99ad2288aace3288ac060665cf43a4192: Status 404 returned error can't find the container with id 41d5958ec5c2948695bf1fb0592d5aa99ad2288aace3288ac060665cf43a4192 Jul 09 16:55:11.130543 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:11.130498 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xkcxh" event={"ID":"a0f5384f-9765-4958-ae78-07e4c11549fc","Type":"ContainerStarted","Data":"41d5958ec5c2948695bf1fb0592d5aa99ad2288aace3288ac060665cf43a4192"} Jul 09 16:55:11.234463 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:11.234416 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct"] Jul 09 16:55:11.237610 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:11.237585 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct" Jul 09 16:55:11.239768 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:11.239733 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2z4jg\"" Jul 09 16:55:11.239895 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:11.239787 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 16:55:11.240397 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:11.240370 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 16:55:11.245251 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:11.245126 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct"] Jul 09 16:55:11.380009 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:11.379977 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab37db5f-d6d2-4d47-8ad3-33856af1092c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct\" (UID: \"ab37db5f-d6d2-4d47-8ad3-33856af1092c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct" Jul 09 16:55:11.380189 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:11.380068 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2psgr\" (UniqueName: \"kubernetes.io/projected/ab37db5f-d6d2-4d47-8ad3-33856af1092c-kube-api-access-2psgr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct\" (UID: \"ab37db5f-d6d2-4d47-8ad3-33856af1092c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct" Jul 09 16:55:11.380189 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:11.380094 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab37db5f-d6d2-4d47-8ad3-33856af1092c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct\" (UID: \"ab37db5f-d6d2-4d47-8ad3-33856af1092c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct" Jul 09 16:55:11.481501 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:11.481415 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2psgr\" (UniqueName: \"kubernetes.io/projected/ab37db5f-d6d2-4d47-8ad3-33856af1092c-kube-api-access-2psgr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct\" (UID: \"ab37db5f-d6d2-4d47-8ad3-33856af1092c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct" Jul 09 16:55:11.481501 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:11.481462 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab37db5f-d6d2-4d47-8ad3-33856af1092c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct\" (UID: \"ab37db5f-d6d2-4d47-8ad3-33856af1092c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct" Jul 09 16:55:11.481729 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:11.481505 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab37db5f-d6d2-4d47-8ad3-33856af1092c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct\" (UID: \"ab37db5f-d6d2-4d47-8ad3-33856af1092c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct" Jul 09 16:55:11.482041 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:11.482007 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab37db5f-d6d2-4d47-8ad3-33856af1092c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct\" (UID: \"ab37db5f-d6d2-4d47-8ad3-33856af1092c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct" Jul 09 16:55:11.482175 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:11.482054 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab37db5f-d6d2-4d47-8ad3-33856af1092c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct\" (UID: \"ab37db5f-d6d2-4d47-8ad3-33856af1092c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct" Jul 09 16:55:11.489967 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:11.489941 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2psgr\" (UniqueName: \"kubernetes.io/projected/ab37db5f-d6d2-4d47-8ad3-33856af1092c-kube-api-access-2psgr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct\" (UID: \"ab37db5f-d6d2-4d47-8ad3-33856af1092c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct" Jul 09 16:55:11.549775 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:11.549738 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct" Jul 09 16:55:11.697495 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:11.697459 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct"] Jul 09 16:55:11.700860 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:55:11.700828 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab37db5f_d6d2_4d47_8ad3_33856af1092c.slice/crio-273d1ce5c6eed8a60297dfb0d012eeee4b0570a1d1176ce6551fe7ce8a178261 WatchSource:0}: Error finding container 273d1ce5c6eed8a60297dfb0d012eeee4b0570a1d1176ce6551fe7ce8a178261: Status 404 returned error can't find the container with id 273d1ce5c6eed8a60297dfb0d012eeee4b0570a1d1176ce6551fe7ce8a178261 Jul 09 16:55:12.136234 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:12.136184 2580 generic.go:356] "Generic (PLEG): container finished" podID="ab37db5f-d6d2-4d47-8ad3-33856af1092c" containerID="804685d4d7059b5aa5a8b936d4265034159a0c46c1691725e0be1498ccc9c5b4" exitCode=0 Jul 09 16:55:12.136441 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:12.136244 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct" event={"ID":"ab37db5f-d6d2-4d47-8ad3-33856af1092c","Type":"ContainerDied","Data":"804685d4d7059b5aa5a8b936d4265034159a0c46c1691725e0be1498ccc9c5b4"} Jul 09 16:55:12.136441 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:12.136324 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct" event={"ID":"ab37db5f-d6d2-4d47-8ad3-33856af1092c","Type":"ContainerStarted","Data":"273d1ce5c6eed8a60297dfb0d012eeee4b0570a1d1176ce6551fe7ce8a178261"} Jul 09 16:55:12.993128 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:12.993095 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-d2lgw"] Jul 09 16:55:12.996106 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:12.996086 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d2lgw" Jul 09 16:55:12.998266 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:12.998246 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-2gzpv\"" Jul 09 16:55:13.002863 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:13.002792 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-d2lgw"] Jul 09 16:55:13.094151 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:13.094111 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xppvw\" (UniqueName: \"kubernetes.io/projected/cad8b184-33e0-48e2-914e-5a880435687a-kube-api-access-xppvw\") pod \"cert-manager-cainjector-559cdd8c87-d2lgw\" (UID: \"cad8b184-33e0-48e2-914e-5a880435687a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d2lgw" Jul 09 16:55:13.094319 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:13.094161 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cad8b184-33e0-48e2-914e-5a880435687a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-d2lgw\" (UID: \"cad8b184-33e0-48e2-914e-5a880435687a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d2lgw" Jul 09 16:55:13.142688 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:13.142613 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xkcxh" event={"ID":"a0f5384f-9765-4958-ae78-07e4c11549fc","Type":"ContainerStarted","Data":"025431f40f3823f744105158ebe264684dbcf53ae7ceb8dc9105af3cb89c1a69"} Jul 09 16:55:13.142688 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:13.142679 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xkcxh" Jul 09 16:55:13.161107 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:13.161065 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-xkcxh" podStartSLOduration=1.438668507 podStartE2EDuration="4.161049926s" totalImagesPullingTime="2.722381419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:55:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:55:13.160097799 +0000 UTC m=+251.524849716" watchObservedRunningTime="2026-07-09 16:55:13.161049926 +0000 UTC m=+251.525801842" Jul 09 16:55:13.194898 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:13.194863 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cad8b184-33e0-48e2-914e-5a880435687a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-d2lgw\" (UID: \"cad8b184-33e0-48e2-914e-5a880435687a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d2lgw" Jul 09 16:55:13.195056 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:13.194966 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xppvw\" (UniqueName: \"kubernetes.io/projected/cad8b184-33e0-48e2-914e-5a880435687a-kube-api-access-xppvw\") pod \"cert-manager-cainjector-559cdd8c87-d2lgw\" (UID: \"cad8b184-33e0-48e2-914e-5a880435687a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d2lgw" Jul 09 16:55:13.204749 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:13.204719 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xppvw\" (UniqueName: \"kubernetes.io/projected/cad8b184-33e0-48e2-914e-5a880435687a-kube-api-access-xppvw\") pod \"cert-manager-cainjector-559cdd8c87-d2lgw\" (UID: \"cad8b184-33e0-48e2-914e-5a880435687a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d2lgw" Jul 09 16:55:13.205380 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:13.205362 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cad8b184-33e0-48e2-914e-5a880435687a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-d2lgw\" (UID: \"cad8b184-33e0-48e2-914e-5a880435687a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d2lgw" Jul 09 16:55:13.304919 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:13.304888 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d2lgw" Jul 09 16:55:13.454011 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:13.453977 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-d2lgw"] Jul 09 16:55:13.458805 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:55:13.458770 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcad8b184_33e0_48e2_914e_5a880435687a.slice/crio-6a28c7fe3d2ee223066daffbb537998ff53027ec69870c298d11d891ddbc824a WatchSource:0}: Error finding container 6a28c7fe3d2ee223066daffbb537998ff53027ec69870c298d11d891ddbc824a: Status 404 returned error can't find the container with id 6a28c7fe3d2ee223066daffbb537998ff53027ec69870c298d11d891ddbc824a Jul 09 16:55:14.149256 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:14.149209 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d2lgw" event={"ID":"cad8b184-33e0-48e2-914e-5a880435687a","Type":"ContainerStarted","Data":"e0a3b15874c1144b768f84d5beca7426ce9351746972ae9b289e1586862d487a"} Jul 09 16:55:14.149727 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:14.149264 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d2lgw" event={"ID":"cad8b184-33e0-48e2-914e-5a880435687a","Type":"ContainerStarted","Data":"6a28c7fe3d2ee223066daffbb537998ff53027ec69870c298d11d891ddbc824a"} Jul 09 16:55:14.185898 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:14.185843 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d2lgw" podStartSLOduration=2.185827806 podStartE2EDuration="2.185827806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:55:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:55:14.185151595 +0000 UTC m=+252.549903513" watchObservedRunningTime="2026-07-09 16:55:14.185827806 +0000 UTC m=+252.550579721" Jul 09 16:55:15.155896 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:15.155863 2580 generic.go:356] "Generic (PLEG): container finished" podID="ab37db5f-d6d2-4d47-8ad3-33856af1092c" containerID="df21b8ee8d39a951c845b967bdcb2641110c075d6b001e23fffd98cca2ec9a49" exitCode=0 Jul 09 16:55:15.156313 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:15.155957 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct" event={"ID":"ab37db5f-d6d2-4d47-8ad3-33856af1092c","Type":"ContainerDied","Data":"df21b8ee8d39a951c845b967bdcb2641110c075d6b001e23fffd98cca2ec9a49"} Jul 09 16:55:16.162809 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:16.162770 2580 generic.go:356] "Generic (PLEG): container finished" podID="ab37db5f-d6d2-4d47-8ad3-33856af1092c" containerID="c796c4a8bdc26a527c29732be9a32d29b759d0763d98f9e6be8f630efc681335" exitCode=0 Jul 09 16:55:16.163248 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:16.162822 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct" event={"ID":"ab37db5f-d6d2-4d47-8ad3-33856af1092c","Type":"ContainerDied","Data":"c796c4a8bdc26a527c29732be9a32d29b759d0763d98f9e6be8f630efc681335"} Jul 09 16:55:17.293044 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:17.293021 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct" Jul 09 16:55:17.327324 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:17.327266 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab37db5f-d6d2-4d47-8ad3-33856af1092c-util\") pod \"ab37db5f-d6d2-4d47-8ad3-33856af1092c\" (UID: \"ab37db5f-d6d2-4d47-8ad3-33856af1092c\") " Jul 09 16:55:17.327489 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:17.327362 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2psgr\" (UniqueName: \"kubernetes.io/projected/ab37db5f-d6d2-4d47-8ad3-33856af1092c-kube-api-access-2psgr\") pod \"ab37db5f-d6d2-4d47-8ad3-33856af1092c\" (UID: \"ab37db5f-d6d2-4d47-8ad3-33856af1092c\") " Jul 09 16:55:17.327489 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:17.327411 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab37db5f-d6d2-4d47-8ad3-33856af1092c-bundle\") pod \"ab37db5f-d6d2-4d47-8ad3-33856af1092c\" (UID: \"ab37db5f-d6d2-4d47-8ad3-33856af1092c\") " Jul 09 16:55:17.327857 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:17.327826 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab37db5f-d6d2-4d47-8ad3-33856af1092c-bundle" (OuterVolumeSpecName: "bundle") pod "ab37db5f-d6d2-4d47-8ad3-33856af1092c" (UID: "ab37db5f-d6d2-4d47-8ad3-33856af1092c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:55:17.329601 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:17.329575 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab37db5f-d6d2-4d47-8ad3-33856af1092c-kube-api-access-2psgr" (OuterVolumeSpecName: "kube-api-access-2psgr") pod "ab37db5f-d6d2-4d47-8ad3-33856af1092c" (UID: "ab37db5f-d6d2-4d47-8ad3-33856af1092c"). InnerVolumeSpecName "kube-api-access-2psgr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:55:17.332108 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:17.332088 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab37db5f-d6d2-4d47-8ad3-33856af1092c-util" (OuterVolumeSpecName: "util") pod "ab37db5f-d6d2-4d47-8ad3-33856af1092c" (UID: "ab37db5f-d6d2-4d47-8ad3-33856af1092c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:55:17.428534 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:17.428463 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab37db5f-d6d2-4d47-8ad3-33856af1092c-bundle\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:55:17.428534 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:17.428487 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab37db5f-d6d2-4d47-8ad3-33856af1092c-util\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:55:17.428534 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:17.428497 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2psgr\" (UniqueName: \"kubernetes.io/projected/ab37db5f-d6d2-4d47-8ad3-33856af1092c-kube-api-access-2psgr\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:55:18.172947 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:18.172920 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct" Jul 09 16:55:18.176827 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:18.176798 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqfqct" event={"ID":"ab37db5f-d6d2-4d47-8ad3-33856af1092c","Type":"ContainerDied","Data":"273d1ce5c6eed8a60297dfb0d012eeee4b0570a1d1176ce6551fe7ce8a178261"} Jul 09 16:55:18.176946 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:18.176842 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="273d1ce5c6eed8a60297dfb0d012eeee4b0570a1d1176ce6551fe7ce8a178261" Jul 09 16:55:19.151528 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:19.151492 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xkcxh" Jul 09 16:55:24.740098 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:24.740015 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpswv"] Jul 09 16:55:24.740571 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:24.740315 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab37db5f-d6d2-4d47-8ad3-33856af1092c" containerName="util" Jul 09 16:55:24.740571 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:24.740328 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab37db5f-d6d2-4d47-8ad3-33856af1092c" containerName="util" Jul 09 16:55:24.740571 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:24.740354 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab37db5f-d6d2-4d47-8ad3-33856af1092c" containerName="extract" Jul 09 16:55:24.740571 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:24.740361 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab37db5f-d6d2-4d47-8ad3-33856af1092c" containerName="extract" Jul 09 16:55:24.740571 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:24.740380 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab37db5f-d6d2-4d47-8ad3-33856af1092c" containerName="pull" Jul 09 16:55:24.740571 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:24.740388 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab37db5f-d6d2-4d47-8ad3-33856af1092c" containerName="pull" Jul 09 16:55:24.740571 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:24.740436 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab37db5f-d6d2-4d47-8ad3-33856af1092c" containerName="extract" Jul 09 16:55:24.764404 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:24.764376 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpswv" Jul 09 16:55:24.767325 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:24.767305 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-5zrxw\"" Jul 09 16:55:24.767888 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:24.767873 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 16:55:24.767971 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:24.767925 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 16:55:24.776655 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:24.776633 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpswv"] Jul 09 16:55:24.781846 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:24.781813 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf8333df-d5d5-4e2a-bb14-933b739502d5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lpswv\" (UID: \"cf8333df-d5d5-4e2a-bb14-933b739502d5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpswv" Jul 09 16:55:24.781949 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:24.781898 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7smq8\" (UniqueName: \"kubernetes.io/projected/cf8333df-d5d5-4e2a-bb14-933b739502d5-kube-api-access-7smq8\") pod \"openshift-lws-operator-fd8ccff4c-lpswv\" (UID: \"cf8333df-d5d5-4e2a-bb14-933b739502d5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpswv" Jul 09 16:55:24.882718 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:24.882682 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf8333df-d5d5-4e2a-bb14-933b739502d5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lpswv\" (UID: \"cf8333df-d5d5-4e2a-bb14-933b739502d5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpswv" Jul 09 16:55:24.882872 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:24.882728 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7smq8\" (UniqueName: \"kubernetes.io/projected/cf8333df-d5d5-4e2a-bb14-933b739502d5-kube-api-access-7smq8\") pod \"openshift-lws-operator-fd8ccff4c-lpswv\" (UID: \"cf8333df-d5d5-4e2a-bb14-933b739502d5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpswv" Jul 09 16:55:24.883059 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:24.883038 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf8333df-d5d5-4e2a-bb14-933b739502d5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lpswv\" (UID: \"cf8333df-d5d5-4e2a-bb14-933b739502d5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpswv" Jul 09 16:55:24.903300 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:24.903252 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7smq8\" (UniqueName: \"kubernetes.io/projected/cf8333df-d5d5-4e2a-bb14-933b739502d5-kube-api-access-7smq8\") pod \"openshift-lws-operator-fd8ccff4c-lpswv\" (UID: \"cf8333df-d5d5-4e2a-bb14-933b739502d5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpswv" Jul 09 16:55:25.073722 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:25.073642 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpswv" Jul 09 16:55:25.216891 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:25.216869 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpswv"] Jul 09 16:55:25.219520 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:55:25.219492 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf8333df_d5d5_4e2a_bb14_933b739502d5.slice/crio-b8deababe32f2847db2924e4dd12f1045693ab9019bc4a3a33d90ea5652ee88a WatchSource:0}: Error finding container b8deababe32f2847db2924e4dd12f1045693ab9019bc4a3a33d90ea5652ee88a: Status 404 returned error can't find the container with id b8deababe32f2847db2924e4dd12f1045693ab9019bc4a3a33d90ea5652ee88a Jul 09 16:55:26.208915 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:26.208880 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpswv" event={"ID":"cf8333df-d5d5-4e2a-bb14-933b739502d5","Type":"ContainerStarted","Data":"b8deababe32f2847db2924e4dd12f1045693ab9019bc4a3a33d90ea5652ee88a"} Jul 09 16:55:42.274692 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:42.274655 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpswv" event={"ID":"cf8333df-d5d5-4e2a-bb14-933b739502d5","Type":"ContainerStarted","Data":"43b79e8318648a1f05a2d791c579d8e5b4d402b761ace476a1b4ab4b0219056c"} Jul 09 16:55:42.290491 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:42.290443 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpswv" podStartSLOduration=2.246948029 podStartE2EDuration="18.290429578s" totalImagesPullingTime="16.043481549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:55:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:55:42.288353682 +0000 UTC m=+280.653105575" watchObservedRunningTime="2026-07-09 16:55:42.290429578 +0000 UTC m=+280.655181493" Jul 09 16:55:43.762325 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:43.762263 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6"] Jul 09 16:55:43.765725 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:43.765702 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6" Jul 09 16:55:43.767357 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:43.767333 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6"] Jul 09 16:55:43.767863 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:43.767844 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 16:55:43.768640 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:43.768617 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 16:55:43.768731 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:43.768662 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2z4jg\"" Jul 09 16:55:43.828821 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:43.828792 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ac0e917-6dcb-4770-af7c-5ad9215377ba-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6\" (UID: \"8ac0e917-6dcb-4770-af7c-5ad9215377ba\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6" Jul 09 16:55:43.828821 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:43.828822 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ac0e917-6dcb-4770-af7c-5ad9215377ba-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6\" (UID: \"8ac0e917-6dcb-4770-af7c-5ad9215377ba\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6" Jul 09 16:55:43.828966 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:43.828854 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlbjf\" (UniqueName: \"kubernetes.io/projected/8ac0e917-6dcb-4770-af7c-5ad9215377ba-kube-api-access-jlbjf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6\" (UID: \"8ac0e917-6dcb-4770-af7c-5ad9215377ba\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6" Jul 09 16:55:43.929836 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:43.929809 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ac0e917-6dcb-4770-af7c-5ad9215377ba-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6\" (UID: \"8ac0e917-6dcb-4770-af7c-5ad9215377ba\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6" Jul 09 16:55:43.929836 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:43.929840 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ac0e917-6dcb-4770-af7c-5ad9215377ba-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6\" (UID: \"8ac0e917-6dcb-4770-af7c-5ad9215377ba\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6" Jul 09 16:55:43.930012 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:43.929868 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlbjf\" (UniqueName: \"kubernetes.io/projected/8ac0e917-6dcb-4770-af7c-5ad9215377ba-kube-api-access-jlbjf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6\" (UID: \"8ac0e917-6dcb-4770-af7c-5ad9215377ba\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6" Jul 09 16:55:43.930295 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:43.930252 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ac0e917-6dcb-4770-af7c-5ad9215377ba-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6\" (UID: \"8ac0e917-6dcb-4770-af7c-5ad9215377ba\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6" Jul 09 16:55:43.930342 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:43.930262 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ac0e917-6dcb-4770-af7c-5ad9215377ba-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6\" (UID: \"8ac0e917-6dcb-4770-af7c-5ad9215377ba\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6" Jul 09 16:55:43.940025 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:43.939997 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlbjf\" (UniqueName: \"kubernetes.io/projected/8ac0e917-6dcb-4770-af7c-5ad9215377ba-kube-api-access-jlbjf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6\" (UID: \"8ac0e917-6dcb-4770-af7c-5ad9215377ba\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6" Jul 09 16:55:44.075536 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:44.075462 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6" Jul 09 16:55:44.204489 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:44.204457 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6"] Jul 09 16:55:44.207195 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:55:44.207164 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ac0e917_6dcb_4770_af7c_5ad9215377ba.slice/crio-3a2bcc8245337b4af0bba918899b9caee7c2a63711113e4eebf6f14a91801c4b WatchSource:0}: Error finding container 3a2bcc8245337b4af0bba918899b9caee7c2a63711113e4eebf6f14a91801c4b: Status 404 returned error can't find the container with id 3a2bcc8245337b4af0bba918899b9caee7c2a63711113e4eebf6f14a91801c4b Jul 09 16:55:44.284598 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:44.284555 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6" event={"ID":"8ac0e917-6dcb-4770-af7c-5ad9215377ba","Type":"ContainerStarted","Data":"a1649bfda4c27a06cf64f2ebc53c448056c166d7b4d9ae9707675f087795815f"} Jul 09 16:55:44.284739 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:44.284619 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6" event={"ID":"8ac0e917-6dcb-4770-af7c-5ad9215377ba","Type":"ContainerStarted","Data":"3a2bcc8245337b4af0bba918899b9caee7c2a63711113e4eebf6f14a91801c4b"} Jul 09 16:55:45.290936 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:45.290838 2580 generic.go:356] "Generic (PLEG): container finished" podID="8ac0e917-6dcb-4770-af7c-5ad9215377ba" containerID="a1649bfda4c27a06cf64f2ebc53c448056c166d7b4d9ae9707675f087795815f" exitCode=0 Jul 09 16:55:45.291315 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:45.290926 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6" event={"ID":"8ac0e917-6dcb-4770-af7c-5ad9215377ba","Type":"ContainerDied","Data":"a1649bfda4c27a06cf64f2ebc53c448056c166d7b4d9ae9707675f087795815f"} Jul 09 16:55:47.300545 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:47.300503 2580 generic.go:356] "Generic (PLEG): container finished" podID="8ac0e917-6dcb-4770-af7c-5ad9215377ba" containerID="f6b3e301023c83020448afe44b13a6d2656f98f9f6e3529e7cbc79d423b1240d" exitCode=0 Jul 09 16:55:47.300956 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:47.300598 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6" event={"ID":"8ac0e917-6dcb-4770-af7c-5ad9215377ba","Type":"ContainerDied","Data":"f6b3e301023c83020448afe44b13a6d2656f98f9f6e3529e7cbc79d423b1240d"} Jul 09 16:55:48.307117 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:48.307049 2580 generic.go:356] "Generic (PLEG): container finished" podID="8ac0e917-6dcb-4770-af7c-5ad9215377ba" containerID="3d008d6c34d953097676b17c716b1d807675dc804727afb84d26ef02be21ac86" exitCode=0 Jul 09 16:55:48.307515 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:48.307131 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6" event={"ID":"8ac0e917-6dcb-4770-af7c-5ad9215377ba","Type":"ContainerDied","Data":"3d008d6c34d953097676b17c716b1d807675dc804727afb84d26ef02be21ac86"} Jul 09 16:55:49.449350 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.449320 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6" Jul 09 16:55:49.468721 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.468693 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-db6444945-x6h6c"] Jul 09 16:55:49.468986 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.468972 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ac0e917-6dcb-4770-af7c-5ad9215377ba" containerName="extract" Jul 09 16:55:49.469028 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.468988 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ac0e917-6dcb-4770-af7c-5ad9215377ba" containerName="extract" Jul 09 16:55:49.469028 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.469004 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ac0e917-6dcb-4770-af7c-5ad9215377ba" containerName="pull" Jul 09 16:55:49.469028 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.469011 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ac0e917-6dcb-4770-af7c-5ad9215377ba" containerName="pull" Jul 09 16:55:49.469028 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.469022 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ac0e917-6dcb-4770-af7c-5ad9215377ba" containerName="util" Jul 09 16:55:49.469028 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.469027 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ac0e917-6dcb-4770-af7c-5ad9215377ba" containerName="util" Jul 09 16:55:49.469172 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.469069 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ac0e917-6dcb-4770-af7c-5ad9215377ba" containerName="extract" Jul 09 16:55:49.470697 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.470682 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-db6444945-x6h6c" Jul 09 16:55:49.472890 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.472875 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 09 16:55:49.473334 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.473311 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-clfzh\"" Jul 09 16:55:49.473486 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.473460 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 09 16:55:49.473538 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.473527 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 09 16:55:49.500165 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.500138 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-db6444945-x6h6c"] Jul 09 16:55:49.574844 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.574761 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlbjf\" (UniqueName: \"kubernetes.io/projected/8ac0e917-6dcb-4770-af7c-5ad9215377ba-kube-api-access-jlbjf\") pod \"8ac0e917-6dcb-4770-af7c-5ad9215377ba\" (UID: \"8ac0e917-6dcb-4770-af7c-5ad9215377ba\") " Jul 09 16:55:49.574844 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.574812 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ac0e917-6dcb-4770-af7c-5ad9215377ba-bundle\") pod \"8ac0e917-6dcb-4770-af7c-5ad9215377ba\" (UID: \"8ac0e917-6dcb-4770-af7c-5ad9215377ba\") " Jul 09 16:55:49.575062 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.574869 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ac0e917-6dcb-4770-af7c-5ad9215377ba-util\") pod \"8ac0e917-6dcb-4770-af7c-5ad9215377ba\" (UID: \"8ac0e917-6dcb-4770-af7c-5ad9215377ba\") " Jul 09 16:55:49.575062 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.575003 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8a2fdfa5-9fe9-402a-9d2a-79857d6da7e1-metrics-cert\") pod \"lws-controller-manager-db6444945-x6h6c\" (UID: \"8a2fdfa5-9fe9-402a-9d2a-79857d6da7e1\") " pod="openshift-lws-operator/lws-controller-manager-db6444945-x6h6c" Jul 09 16:55:49.575162 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.575075 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjs44\" (UniqueName: \"kubernetes.io/projected/8a2fdfa5-9fe9-402a-9d2a-79857d6da7e1-kube-api-access-vjs44\") pod \"lws-controller-manager-db6444945-x6h6c\" (UID: \"8a2fdfa5-9fe9-402a-9d2a-79857d6da7e1\") " pod="openshift-lws-operator/lws-controller-manager-db6444945-x6h6c" Jul 09 16:55:49.575162 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.575119 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8a2fdfa5-9fe9-402a-9d2a-79857d6da7e1-manager-config\") pod \"lws-controller-manager-db6444945-x6h6c\" (UID: \"8a2fdfa5-9fe9-402a-9d2a-79857d6da7e1\") " pod="openshift-lws-operator/lws-controller-manager-db6444945-x6h6c" Jul 09 16:55:49.575258 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.575173 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a2fdfa5-9fe9-402a-9d2a-79857d6da7e1-cert\") pod \"lws-controller-manager-db6444945-x6h6c\" (UID: \"8a2fdfa5-9fe9-402a-9d2a-79857d6da7e1\") " pod="openshift-lws-operator/lws-controller-manager-db6444945-x6h6c" Jul 09 16:55:49.575595 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.575570 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ac0e917-6dcb-4770-af7c-5ad9215377ba-bundle" (OuterVolumeSpecName: "bundle") pod "8ac0e917-6dcb-4770-af7c-5ad9215377ba" (UID: "8ac0e917-6dcb-4770-af7c-5ad9215377ba"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:55:49.577074 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.577053 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ac0e917-6dcb-4770-af7c-5ad9215377ba-kube-api-access-jlbjf" (OuterVolumeSpecName: "kube-api-access-jlbjf") pod "8ac0e917-6dcb-4770-af7c-5ad9215377ba" (UID: "8ac0e917-6dcb-4770-af7c-5ad9215377ba"). InnerVolumeSpecName "kube-api-access-jlbjf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:55:49.671408 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.671368 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ac0e917-6dcb-4770-af7c-5ad9215377ba-util" (OuterVolumeSpecName: "util") pod "8ac0e917-6dcb-4770-af7c-5ad9215377ba" (UID: "8ac0e917-6dcb-4770-af7c-5ad9215377ba"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:55:49.676561 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.676539 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8a2fdfa5-9fe9-402a-9d2a-79857d6da7e1-manager-config\") pod \"lws-controller-manager-db6444945-x6h6c\" (UID: \"8a2fdfa5-9fe9-402a-9d2a-79857d6da7e1\") " pod="openshift-lws-operator/lws-controller-manager-db6444945-x6h6c" Jul 09 16:55:49.676619 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.676583 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a2fdfa5-9fe9-402a-9d2a-79857d6da7e1-cert\") pod \"lws-controller-manager-db6444945-x6h6c\" (UID: \"8a2fdfa5-9fe9-402a-9d2a-79857d6da7e1\") " pod="openshift-lws-operator/lws-controller-manager-db6444945-x6h6c" Jul 09 16:55:49.676654 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.676616 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8a2fdfa5-9fe9-402a-9d2a-79857d6da7e1-metrics-cert\") pod \"lws-controller-manager-db6444945-x6h6c\" (UID: \"8a2fdfa5-9fe9-402a-9d2a-79857d6da7e1\") " pod="openshift-lws-operator/lws-controller-manager-db6444945-x6h6c" Jul 09 16:55:49.676687 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.676652 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjs44\" (UniqueName: \"kubernetes.io/projected/8a2fdfa5-9fe9-402a-9d2a-79857d6da7e1-kube-api-access-vjs44\") pod \"lws-controller-manager-db6444945-x6h6c\" (UID: \"8a2fdfa5-9fe9-402a-9d2a-79857d6da7e1\") " pod="openshift-lws-operator/lws-controller-manager-db6444945-x6h6c" Jul 09 16:55:49.676731 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.676693 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlbjf\" (UniqueName: \"kubernetes.io/projected/8ac0e917-6dcb-4770-af7c-5ad9215377ba-kube-api-access-jlbjf\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:55:49.676731 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.676708 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ac0e917-6dcb-4770-af7c-5ad9215377ba-bundle\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:55:49.676731 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.676720 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ac0e917-6dcb-4770-af7c-5ad9215377ba-util\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:55:49.677352 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.677310 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8a2fdfa5-9fe9-402a-9d2a-79857d6da7e1-manager-config\") pod \"lws-controller-manager-db6444945-x6h6c\" (UID: \"8a2fdfa5-9fe9-402a-9d2a-79857d6da7e1\") " pod="openshift-lws-operator/lws-controller-manager-db6444945-x6h6c" Jul 09 16:55:49.679331 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.679309 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8a2fdfa5-9fe9-402a-9d2a-79857d6da7e1-metrics-cert\") pod \"lws-controller-manager-db6444945-x6h6c\" (UID: \"8a2fdfa5-9fe9-402a-9d2a-79857d6da7e1\") " pod="openshift-lws-operator/lws-controller-manager-db6444945-x6h6c" Jul 09 16:55:49.679403 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.679352 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a2fdfa5-9fe9-402a-9d2a-79857d6da7e1-cert\") pod \"lws-controller-manager-db6444945-x6h6c\" (UID: \"8a2fdfa5-9fe9-402a-9d2a-79857d6da7e1\") " pod="openshift-lws-operator/lws-controller-manager-db6444945-x6h6c" Jul 09 16:55:49.685474 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.685447 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjs44\" (UniqueName: \"kubernetes.io/projected/8a2fdfa5-9fe9-402a-9d2a-79857d6da7e1-kube-api-access-vjs44\") pod \"lws-controller-manager-db6444945-x6h6c\" (UID: \"8a2fdfa5-9fe9-402a-9d2a-79857d6da7e1\") " pod="openshift-lws-operator/lws-controller-manager-db6444945-x6h6c" Jul 09 16:55:49.781443 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.781409 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-db6444945-x6h6c" Jul 09 16:55:49.928417 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:49.928384 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-db6444945-x6h6c"] Jul 09 16:55:49.931258 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:55:49.931231 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a2fdfa5_9fe9_402a_9d2a_79857d6da7e1.slice/crio-3cdea405c16030cd49725bc0a4caf9bf367ffe7e920a1d7e8ce1da2356a2cb59 WatchSource:0}: Error finding container 3cdea405c16030cd49725bc0a4caf9bf367ffe7e920a1d7e8ce1da2356a2cb59: Status 404 returned error can't find the container with id 3cdea405c16030cd49725bc0a4caf9bf367ffe7e920a1d7e8ce1da2356a2cb59 Jul 09 16:55:50.318330 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:50.318302 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6" Jul 09 16:55:50.318496 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:50.318297 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aft7xg6" event={"ID":"8ac0e917-6dcb-4770-af7c-5ad9215377ba","Type":"ContainerDied","Data":"3a2bcc8245337b4af0bba918899b9caee7c2a63711113e4eebf6f14a91801c4b"} Jul 09 16:55:50.318496 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:50.318460 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a2bcc8245337b4af0bba918899b9caee7c2a63711113e4eebf6f14a91801c4b" Jul 09 16:55:50.319629 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:50.319601 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-db6444945-x6h6c" event={"ID":"8a2fdfa5-9fe9-402a-9d2a-79857d6da7e1","Type":"ContainerStarted","Data":"3cdea405c16030cd49725bc0a4caf9bf367ffe7e920a1d7e8ce1da2356a2cb59"} Jul 09 16:55:52.329968 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:52.329933 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-db6444945-x6h6c" event={"ID":"8a2fdfa5-9fe9-402a-9d2a-79857d6da7e1","Type":"ContainerStarted","Data":"8d61d3c4ae5fe5e454def42693d8e67638010883cbfd8a91b0f22db0dee0d3a3"} Jul 09 16:55:52.330387 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:52.330069 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-db6444945-x6h6c" Jul 09 16:55:52.346035 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:55:52.345980 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-db6444945-x6h6c" podStartSLOduration=1.919999263 podStartE2EDuration="3.345962902s" totalImagesPullingTime="1.425963639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:55:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:55:52.344254828 +0000 UTC m=+290.709006738" watchObservedRunningTime="2026-07-09 16:55:52.345962902 +0000 UTC m=+290.710714817" Jul 09 16:56:00.559036 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:00.559005 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-789dddf866-78kgp"] Jul 09 16:56:00.562492 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:00.562470 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-78kgp" Jul 09 16:56:00.564945 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:00.564920 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 16:56:00.564945 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:00.564931 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 16:56:00.565127 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:00.564932 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sh896\"" Jul 09 16:56:00.565127 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:00.564939 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 16:56:00.565127 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:00.564933 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 16:56:00.577531 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:00.577507 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-789dddf866-78kgp"] Jul 09 16:56:00.663437 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:00.663404 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4671492-257e-4f92-b557-b9f0dd51256b-webhook-cert\") pod \"opendatahub-operator-controller-manager-789dddf866-78kgp\" (UID: \"d4671492-257e-4f92-b557-b9f0dd51256b\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-78kgp" Jul 09 16:56:00.663613 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:00.663455 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdmj6\" (UniqueName: \"kubernetes.io/projected/d4671492-257e-4f92-b557-b9f0dd51256b-kube-api-access-xdmj6\") pod \"opendatahub-operator-controller-manager-789dddf866-78kgp\" (UID: \"d4671492-257e-4f92-b557-b9f0dd51256b\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-78kgp" Jul 09 16:56:00.663613 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:00.663483 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d4671492-257e-4f92-b557-b9f0dd51256b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-789dddf866-78kgp\" (UID: \"d4671492-257e-4f92-b557-b9f0dd51256b\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-78kgp" Jul 09 16:56:00.663613 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:00.663536 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d4671492-257e-4f92-b557-b9f0dd51256b-manifests\") pod \"opendatahub-operator-controller-manager-789dddf866-78kgp\" (UID: \"d4671492-257e-4f92-b557-b9f0dd51256b\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-78kgp" Jul 09 16:56:00.663613 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:00.663599 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4671492-257e-4f92-b557-b9f0dd51256b-tmp\") pod \"opendatahub-operator-controller-manager-789dddf866-78kgp\" (UID: \"d4671492-257e-4f92-b557-b9f0dd51256b\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-78kgp" Jul 09 16:56:00.764583 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:00.764551 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdmj6\" (UniqueName: \"kubernetes.io/projected/d4671492-257e-4f92-b557-b9f0dd51256b-kube-api-access-xdmj6\") pod \"opendatahub-operator-controller-manager-789dddf866-78kgp\" (UID: \"d4671492-257e-4f92-b557-b9f0dd51256b\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-78kgp" Jul 09 16:56:00.764743 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:00.764592 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d4671492-257e-4f92-b557-b9f0dd51256b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-789dddf866-78kgp\" (UID: \"d4671492-257e-4f92-b557-b9f0dd51256b\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-78kgp" Jul 09 16:56:00.764743 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:00.764615 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d4671492-257e-4f92-b557-b9f0dd51256b-manifests\") pod \"opendatahub-operator-controller-manager-789dddf866-78kgp\" (UID: \"d4671492-257e-4f92-b557-b9f0dd51256b\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-78kgp" Jul 09 16:56:00.764743 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:00.764644 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4671492-257e-4f92-b557-b9f0dd51256b-tmp\") pod \"opendatahub-operator-controller-manager-789dddf866-78kgp\" (UID: \"d4671492-257e-4f92-b557-b9f0dd51256b\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-78kgp" Jul 09 16:56:00.764743 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:00.764673 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4671492-257e-4f92-b557-b9f0dd51256b-webhook-cert\") pod \"opendatahub-operator-controller-manager-789dddf866-78kgp\" (UID: \"d4671492-257e-4f92-b557-b9f0dd51256b\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-78kgp" Jul 09 16:56:00.765100 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:00.765076 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d4671492-257e-4f92-b557-b9f0dd51256b-manifests\") pod \"opendatahub-operator-controller-manager-789dddf866-78kgp\" (UID: \"d4671492-257e-4f92-b557-b9f0dd51256b\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-78kgp" Jul 09 16:56:00.767097 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:00.767075 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4671492-257e-4f92-b557-b9f0dd51256b-tmp\") pod \"opendatahub-operator-controller-manager-789dddf866-78kgp\" (UID: \"d4671492-257e-4f92-b557-b9f0dd51256b\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-78kgp" Jul 09 16:56:00.767349 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:00.767324 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d4671492-257e-4f92-b557-b9f0dd51256b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-789dddf866-78kgp\" (UID: \"d4671492-257e-4f92-b557-b9f0dd51256b\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-78kgp" Jul 09 16:56:00.767413 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:00.767397 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4671492-257e-4f92-b557-b9f0dd51256b-webhook-cert\") pod \"opendatahub-operator-controller-manager-789dddf866-78kgp\" (UID: \"d4671492-257e-4f92-b557-b9f0dd51256b\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-78kgp" Jul 09 16:56:00.773570 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:00.773546 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdmj6\" (UniqueName: \"kubernetes.io/projected/d4671492-257e-4f92-b557-b9f0dd51256b-kube-api-access-xdmj6\") pod \"opendatahub-operator-controller-manager-789dddf866-78kgp\" (UID: \"d4671492-257e-4f92-b557-b9f0dd51256b\") " pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-78kgp" Jul 09 16:56:00.873120 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:00.873088 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-78kgp" Jul 09 16:56:01.014884 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:01.014850 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-789dddf866-78kgp"] Jul 09 16:56:01.017039 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:56:01.017013 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4671492_257e_4f92_b557_b9f0dd51256b.slice/crio-4e5875dd920c1ef187eedd0a896f0110b10ae2543dac8c7cc79bdbabcb4f91ed WatchSource:0}: Error finding container 4e5875dd920c1ef187eedd0a896f0110b10ae2543dac8c7cc79bdbabcb4f91ed: Status 404 returned error can't find the container with id 4e5875dd920c1ef187eedd0a896f0110b10ae2543dac8c7cc79bdbabcb4f91ed Jul 09 16:56:01.372633 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:01.372596 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-78kgp" event={"ID":"d4671492-257e-4f92-b557-b9f0dd51256b","Type":"ContainerStarted","Data":"4e5875dd920c1ef187eedd0a896f0110b10ae2543dac8c7cc79bdbabcb4f91ed"} Jul 09 16:56:02.052366 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:02.052320 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pcwtl_12995bc0-2245-4f06-aad5-b496fd24f0b1/ovn-acl-logging/0.log" Jul 09 16:56:02.056150 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:02.056125 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pcwtl_12995bc0-2245-4f06-aad5-b496fd24f0b1/ovn-acl-logging/0.log" Jul 09 16:56:02.059020 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:02.058990 2580 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 16:56:03.339995 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:03.339956 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-db6444945-x6h6c" Jul 09 16:56:04.389268 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:04.389221 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-78kgp" event={"ID":"d4671492-257e-4f92-b557-b9f0dd51256b","Type":"ContainerStarted","Data":"e31f1dfde0015b204485320cd7b8b8fee8badef6f0d1427dc341c5c3058666f5"} Jul 09 16:56:06.399444 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:06.399410 2580 generic.go:356] "Generic (PLEG): container finished" podID="d4671492-257e-4f92-b557-b9f0dd51256b" containerID="e31f1dfde0015b204485320cd7b8b8fee8badef6f0d1427dc341c5c3058666f5" exitCode=0 Jul 09 16:56:06.399855 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:06.399471 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-78kgp" event={"ID":"d4671492-257e-4f92-b557-b9f0dd51256b","Type":"ContainerDied","Data":"e31f1dfde0015b204485320cd7b8b8fee8badef6f0d1427dc341c5c3058666f5"} Jul 09 16:56:06.400060 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:06.400045 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 16:56:07.406533 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:07.406442 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-78kgp" event={"ID":"d4671492-257e-4f92-b557-b9f0dd51256b","Type":"ContainerStarted","Data":"794b439d768b2d1e888553d4464f4cd2aa8ec14739e796f9566ef90257306795"} Jul 09 16:56:07.406896 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:07.406662 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-78kgp" Jul 09 16:56:07.430701 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:07.430646 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-78kgp" podStartSLOduration=2.381695199 podStartE2EDuration="7.430629781s" totalImagesPullingTime="3.973497122s" totalInitContainerRuntime="1.07543746s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:56:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:56:07.428495304 +0000 UTC m=+305.793247231" watchObservedRunningTime="2026-07-09 16:56:07.430629781 +0000 UTC m=+305.795381697" Jul 09 16:56:18.415476 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:18.415408 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-789dddf866-78kgp" Jul 09 16:56:21.969879 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:21.969830 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6xpmg"] Jul 09 16:56:21.972293 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:21.972252 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-6xpmg" Jul 09 16:56:21.975632 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:21.975612 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 09 16:56:21.989011 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:21.988987 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6xpmg"] Jul 09 16:56:22.052274 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:22.052235 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3b9012f-6a41-4e2f-9082-c31001625aad-tls-certs\") pod \"model-serving-api-54d89bd5fc-6xpmg\" (UID: \"f3b9012f-6a41-4e2f-9082-c31001625aad\") " pod="opendatahub/model-serving-api-54d89bd5fc-6xpmg" Jul 09 16:56:22.052472 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:22.052369 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbf62\" (UniqueName: \"kubernetes.io/projected/f3b9012f-6a41-4e2f-9082-c31001625aad-kube-api-access-nbf62\") pod \"model-serving-api-54d89bd5fc-6xpmg\" (UID: \"f3b9012f-6a41-4e2f-9082-c31001625aad\") " pod="opendatahub/model-serving-api-54d89bd5fc-6xpmg" Jul 09 16:56:22.152801 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:22.152768 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbf62\" (UniqueName: \"kubernetes.io/projected/f3b9012f-6a41-4e2f-9082-c31001625aad-kube-api-access-nbf62\") pod \"model-serving-api-54d89bd5fc-6xpmg\" (UID: \"f3b9012f-6a41-4e2f-9082-c31001625aad\") " pod="opendatahub/model-serving-api-54d89bd5fc-6xpmg" Jul 09 16:56:22.152989 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:22.152838 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3b9012f-6a41-4e2f-9082-c31001625aad-tls-certs\") pod \"model-serving-api-54d89bd5fc-6xpmg\" (UID: \"f3b9012f-6a41-4e2f-9082-c31001625aad\") " pod="opendatahub/model-serving-api-54d89bd5fc-6xpmg" Jul 09 16:56:22.152989 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:56:22.152952 2580 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 09 16:56:22.153113 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:56:22.153017 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3b9012f-6a41-4e2f-9082-c31001625aad-tls-certs podName:f3b9012f-6a41-4e2f-9082-c31001625aad nodeName:}" failed. No retries permitted until 2026-07-09 16:56:22.652997811 +0000 UTC m=+321.017749707 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f3b9012f-6a41-4e2f-9082-c31001625aad-tls-certs") pod "model-serving-api-54d89bd5fc-6xpmg" (UID: "f3b9012f-6a41-4e2f-9082-c31001625aad") : secret "model-serving-api-tls" not found Jul 09 16:56:22.163590 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:22.163559 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbf62\" (UniqueName: \"kubernetes.io/projected/f3b9012f-6a41-4e2f-9082-c31001625aad-kube-api-access-nbf62\") pod \"model-serving-api-54d89bd5fc-6xpmg\" (UID: \"f3b9012f-6a41-4e2f-9082-c31001625aad\") " pod="opendatahub/model-serving-api-54d89bd5fc-6xpmg" Jul 09 16:56:22.657883 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:22.657839 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3b9012f-6a41-4e2f-9082-c31001625aad-tls-certs\") pod \"model-serving-api-54d89bd5fc-6xpmg\" (UID: \"f3b9012f-6a41-4e2f-9082-c31001625aad\") " pod="opendatahub/model-serving-api-54d89bd5fc-6xpmg" Jul 09 16:56:22.660442 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:22.660421 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3b9012f-6a41-4e2f-9082-c31001625aad-tls-certs\") pod \"model-serving-api-54d89bd5fc-6xpmg\" (UID: \"f3b9012f-6a41-4e2f-9082-c31001625aad\") " pod="opendatahub/model-serving-api-54d89bd5fc-6xpmg" Jul 09 16:56:22.882303 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:22.882250 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-6xpmg" Jul 09 16:56:23.011945 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:23.011917 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6xpmg"] Jul 09 16:56:23.014354 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:56:23.014327 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3b9012f_6a41_4e2f_9082_c31001625aad.slice/crio-31054c67ffc86ab90b9d38bc2830527a97f256864e01a920560ea1e5f4b934b9 WatchSource:0}: Error finding container 31054c67ffc86ab90b9d38bc2830527a97f256864e01a920560ea1e5f4b934b9: Status 404 returned error can't find the container with id 31054c67ffc86ab90b9d38bc2830527a97f256864e01a920560ea1e5f4b934b9 Jul 09 16:56:23.479695 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:23.479648 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-6xpmg" event={"ID":"f3b9012f-6a41-4e2f-9082-c31001625aad","Type":"ContainerStarted","Data":"31054c67ffc86ab90b9d38bc2830527a97f256864e01a920560ea1e5f4b934b9"} Jul 09 16:56:25.498325 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:25.498268 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-6xpmg" event={"ID":"f3b9012f-6a41-4e2f-9082-c31001625aad","Type":"ContainerStarted","Data":"9d7d41f2a2137fe293af2a72cee9eebfdb21f461bdbbaeec5427da7ea01d51c3"} Jul 09 16:56:25.498806 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:25.498362 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-6xpmg" Jul 09 16:56:25.516212 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:25.516163 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-6xpmg" podStartSLOduration=2.473326585 podStartE2EDuration="4.516149247s" totalImagesPullingTime="2.042822662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:56:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:56:25.514563131 +0000 UTC m=+323.879315046" watchObservedRunningTime="2026-07-09 16:56:25.516149247 +0000 UTC m=+323.880901199" Jul 09 16:56:28.661427 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.661389 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh"] Jul 09 16:56:28.664737 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.664720 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:28.666992 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.666972 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 16:56:28.667087 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.667029 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 16:56:28.667312 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.667297 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-fkzln\"" Jul 09 16:56:28.667543 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.667530 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 16:56:28.682886 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.682858 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh"] Jul 09 16:56:28.714190 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.714153 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ff7nh\" (UID: \"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:28.714364 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.714273 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ff7nh\" (UID: \"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:28.714418 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.714365 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ff7nh\" (UID: \"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:28.714418 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.714405 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ff7nh\" (UID: \"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:28.714506 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.714459 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzrxg\" (UniqueName: \"kubernetes.io/projected/9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f-kube-api-access-mzrxg\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ff7nh\" (UID: \"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:28.714545 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.714512 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ff7nh\" (UID: \"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:28.714545 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.714533 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ff7nh\" (UID: \"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:28.714619 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.714551 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ff7nh\" (UID: \"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:28.714619 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.714578 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ff7nh\" (UID: \"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:28.815906 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.815869 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ff7nh\" (UID: \"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:28.815906 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.815910 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ff7nh\" (UID: \"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:28.816142 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.815943 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ff7nh\" (UID: \"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:28.816142 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.815974 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ff7nh\" (UID: \"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:28.816142 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.816006 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzrxg\" (UniqueName: \"kubernetes.io/projected/9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f-kube-api-access-mzrxg\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ff7nh\" (UID: \"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:28.816319 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.816147 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ff7nh\" (UID: \"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:28.816319 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.816207 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ff7nh\" (UID: \"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:28.816319 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.816237 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ff7nh\" (UID: \"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:28.816319 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.816300 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ff7nh\" (UID: \"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:28.816529 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.816452 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ff7nh\" (UID: \"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:28.816565 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.816521 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ff7nh\" (UID: \"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:28.816661 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.816637 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ff7nh\" (UID: \"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:28.816780 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.816756 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ff7nh\" (UID: \"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:28.816902 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.816759 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ff7nh\" (UID: \"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:28.818822 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.818798 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ff7nh\" (UID: \"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:28.818911 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.818851 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ff7nh\" (UID: \"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:28.829615 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.829595 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ff7nh\" (UID: \"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:28.846676 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.846644 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzrxg\" (UniqueName: \"kubernetes.io/projected/9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f-kube-api-access-mzrxg\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4ff7nh\" (UID: \"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:28.975183 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:28.975090 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:29.120195 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:29.115998 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh"] Jul 09 16:56:29.516603 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:29.516561 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" event={"ID":"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f","Type":"ContainerStarted","Data":"f9c5aada6b729b1de4d52bcab8857a2f141e525a97d9677b566d1bf31385b212"} Jul 09 16:56:31.618905 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.618869 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h"] Jul 09 16:56:31.626245 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.626212 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h" Jul 09 16:56:31.629046 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.629014 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 09 16:56:31.629181 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.629061 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-pnpqz\"" Jul 09 16:56:31.629181 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.629152 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 09 16:56:31.629326 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.629178 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 09 16:56:31.638536 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.638511 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h"] Jul 09 16:56:31.743218 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.743174 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ffe67e28-e944-4410-b8b4-f5c316e4e383-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-xgk9h\" (UID: \"ffe67e28-e944-4410-b8b4-f5c316e4e383\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h" Jul 09 16:56:31.743419 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.743233 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxdgs\" (UniqueName: \"kubernetes.io/projected/ffe67e28-e944-4410-b8b4-f5c316e4e383-kube-api-access-vxdgs\") pod \"istiod-openshift-gateway-94bb8fbfd-xgk9h\" (UID: \"ffe67e28-e944-4410-b8b4-f5c316e4e383\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h" Jul 09 16:56:31.743419 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.743308 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ffe67e28-e944-4410-b8b4-f5c316e4e383-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-xgk9h\" (UID: \"ffe67e28-e944-4410-b8b4-f5c316e4e383\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h" Jul 09 16:56:31.743419 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.743362 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ffe67e28-e944-4410-b8b4-f5c316e4e383-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-xgk9h\" (UID: \"ffe67e28-e944-4410-b8b4-f5c316e4e383\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h" Jul 09 16:56:31.743419 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.743398 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ffe67e28-e944-4410-b8b4-f5c316e4e383-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-xgk9h\" (UID: \"ffe67e28-e944-4410-b8b4-f5c316e4e383\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h" Jul 09 16:56:31.743631 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.743443 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ffe67e28-e944-4410-b8b4-f5c316e4e383-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-xgk9h\" (UID: \"ffe67e28-e944-4410-b8b4-f5c316e4e383\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h" Jul 09 16:56:31.743631 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.743488 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffe67e28-e944-4410-b8b4-f5c316e4e383-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-xgk9h\" (UID: \"ffe67e28-e944-4410-b8b4-f5c316e4e383\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h" Jul 09 16:56:31.844176 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.844131 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ffe67e28-e944-4410-b8b4-f5c316e4e383-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-xgk9h\" (UID: \"ffe67e28-e944-4410-b8b4-f5c316e4e383\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h" Jul 09 16:56:31.844390 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.844183 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxdgs\" (UniqueName: \"kubernetes.io/projected/ffe67e28-e944-4410-b8b4-f5c316e4e383-kube-api-access-vxdgs\") pod \"istiod-openshift-gateway-94bb8fbfd-xgk9h\" (UID: \"ffe67e28-e944-4410-b8b4-f5c316e4e383\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h" Jul 09 16:56:31.844390 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.844252 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ffe67e28-e944-4410-b8b4-f5c316e4e383-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-xgk9h\" (UID: \"ffe67e28-e944-4410-b8b4-f5c316e4e383\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h" Jul 09 16:56:31.844390 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.844327 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ffe67e28-e944-4410-b8b4-f5c316e4e383-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-xgk9h\" (UID: \"ffe67e28-e944-4410-b8b4-f5c316e4e383\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h" Jul 09 16:56:31.844390 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.844375 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ffe67e28-e944-4410-b8b4-f5c316e4e383-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-xgk9h\" (UID: \"ffe67e28-e944-4410-b8b4-f5c316e4e383\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h" Jul 09 16:56:31.844627 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.844404 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ffe67e28-e944-4410-b8b4-f5c316e4e383-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-xgk9h\" (UID: \"ffe67e28-e944-4410-b8b4-f5c316e4e383\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h" Jul 09 16:56:31.844627 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.844432 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffe67e28-e944-4410-b8b4-f5c316e4e383-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-xgk9h\" (UID: \"ffe67e28-e944-4410-b8b4-f5c316e4e383\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h" Jul 09 16:56:31.845603 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.845561 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ffe67e28-e944-4410-b8b4-f5c316e4e383-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-xgk9h\" (UID: \"ffe67e28-e944-4410-b8b4-f5c316e4e383\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h" Jul 09 16:56:31.847671 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.847269 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ffe67e28-e944-4410-b8b4-f5c316e4e383-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-xgk9h\" (UID: \"ffe67e28-e944-4410-b8b4-f5c316e4e383\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h" Jul 09 16:56:31.847671 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.847593 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffe67e28-e944-4410-b8b4-f5c316e4e383-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-xgk9h\" (UID: \"ffe67e28-e944-4410-b8b4-f5c316e4e383\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h" Jul 09 16:56:31.847671 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.847615 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ffe67e28-e944-4410-b8b4-f5c316e4e383-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-xgk9h\" (UID: \"ffe67e28-e944-4410-b8b4-f5c316e4e383\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h" Jul 09 16:56:31.847930 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.847904 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ffe67e28-e944-4410-b8b4-f5c316e4e383-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-xgk9h\" (UID: \"ffe67e28-e944-4410-b8b4-f5c316e4e383\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h" Jul 09 16:56:31.852881 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.852861 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ffe67e28-e944-4410-b8b4-f5c316e4e383-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-xgk9h\" (UID: \"ffe67e28-e944-4410-b8b4-f5c316e4e383\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h" Jul 09 16:56:31.853319 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.853298 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxdgs\" (UniqueName: \"kubernetes.io/projected/ffe67e28-e944-4410-b8b4-f5c316e4e383-kube-api-access-vxdgs\") pod \"istiod-openshift-gateway-94bb8fbfd-xgk9h\" (UID: \"ffe67e28-e944-4410-b8b4-f5c316e4e383\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h" Jul 09 16:56:31.937657 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:31.937580 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h" Jul 09 16:56:32.097183 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:32.097130 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 16:56:32.097269 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:32.097245 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 16:56:32.097339 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:32.097319 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 16:56:32.166230 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:32.166205 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h"] Jul 09 16:56:32.168495 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:56:32.168472 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffe67e28_e944_4410_b8b4_f5c316e4e383.slice/crio-d8d57b7cd071fa6f3b699e86226b641214760a0fe5b95d192fe1722e778aff6a WatchSource:0}: Error finding container d8d57b7cd071fa6f3b699e86226b641214760a0fe5b95d192fe1722e778aff6a: Status 404 returned error can't find the container with id d8d57b7cd071fa6f3b699e86226b641214760a0fe5b95d192fe1722e778aff6a Jul 09 16:56:32.539696 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:32.539651 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" event={"ID":"9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f","Type":"ContainerStarted","Data":"4bdae04c7ce8214c7e001831c4f9f599fc1444e00d7ef85d97413e989dddb214"} Jul 09 16:56:32.540893 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:32.540855 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h" event={"ID":"ffe67e28-e944-4410-b8b4-f5c316e4e383","Type":"ContainerStarted","Data":"d8d57b7cd071fa6f3b699e86226b641214760a0fe5b95d192fe1722e778aff6a"} Jul 09 16:56:32.566485 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:32.566439 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" podStartSLOduration=1.5907285629999999 podStartE2EDuration="4.566422885s" totalImagesPullingTime="2.975694322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:56:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:56:32.564802259 +0000 UTC m=+330.929554175" watchObservedRunningTime="2026-07-09 16:56:32.566422885 +0000 UTC m=+330.931174800" Jul 09 16:56:32.975295 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:32.975238 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:33.980912 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:33.980866 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:34.550540 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:34.550498 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:34.551588 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:34.551562 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4ff7nh" Jul 09 16:56:34.586410 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:34.586373 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 16:56:34.586512 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:34.586438 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 16:56:35.555465 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:35.555420 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h" event={"ID":"ffe67e28-e944-4410-b8b4-f5c316e4e383","Type":"ContainerStarted","Data":"a16fd679517d0ca050b8f8277488fda399d66205b1a4546f1024be28f0b383bd"} Jul 09 16:56:35.576567 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:35.576522 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h" podStartSLOduration=2.160829747 podStartE2EDuration="4.576505176s" totalImagesPullingTime="2.415675429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:56:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:56:35.574680196 +0000 UTC m=+333.939432112" watchObservedRunningTime="2026-07-09 16:56:35.576505176 +0000 UTC m=+333.941257092" Jul 09 16:56:36.506845 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:36.506810 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-6xpmg" Jul 09 16:56:36.560649 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:36.560617 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h" Jul 09 16:56:36.562036 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:56:36.562013 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgk9h" Jul 09 16:57:30.573784 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:30.573744 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d945d484-6xmdl"] Jul 09 16:57:35.200610 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.200577 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g"] Jul 09 16:57:35.203206 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.203188 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g" Jul 09 16:57:35.205529 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.205501 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 16:57:35.205639 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.205554 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 16:57:35.206182 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.206167 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7ms9p\"" Jul 09 16:57:35.212574 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.212553 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g"] Jul 09 16:57:35.292257 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.292226 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm77b\" (UniqueName: \"kubernetes.io/projected/75cde8ba-f7f6-4bf1-b234-b6ff4c27b591-kube-api-access-zm77b\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g\" (UID: \"75cde8ba-f7f6-4bf1-b234-b6ff4c27b591\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g" Jul 09 16:57:35.292448 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.292264 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75cde8ba-f7f6-4bf1-b234-b6ff4c27b591-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g\" (UID: \"75cde8ba-f7f6-4bf1-b234-b6ff4c27b591\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g" Jul 09 16:57:35.292448 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.292389 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75cde8ba-f7f6-4bf1-b234-b6ff4c27b591-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g\" (UID: \"75cde8ba-f7f6-4bf1-b234-b6ff4c27b591\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g" Jul 09 16:57:35.393671 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.393634 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75cde8ba-f7f6-4bf1-b234-b6ff4c27b591-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g\" (UID: \"75cde8ba-f7f6-4bf1-b234-b6ff4c27b591\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g" Jul 09 16:57:35.393844 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.393756 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75cde8ba-f7f6-4bf1-b234-b6ff4c27b591-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g\" (UID: \"75cde8ba-f7f6-4bf1-b234-b6ff4c27b591\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g" Jul 09 16:57:35.393844 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.393806 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm77b\" (UniqueName: \"kubernetes.io/projected/75cde8ba-f7f6-4bf1-b234-b6ff4c27b591-kube-api-access-zm77b\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g\" (UID: \"75cde8ba-f7f6-4bf1-b234-b6ff4c27b591\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g" Jul 09 16:57:35.394031 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.394011 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75cde8ba-f7f6-4bf1-b234-b6ff4c27b591-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g\" (UID: \"75cde8ba-f7f6-4bf1-b234-b6ff4c27b591\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g" Jul 09 16:57:35.394092 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.394063 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75cde8ba-f7f6-4bf1-b234-b6ff4c27b591-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g\" (UID: \"75cde8ba-f7f6-4bf1-b234-b6ff4c27b591\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g" Jul 09 16:57:35.403037 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.403003 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm77b\" (UniqueName: \"kubernetes.io/projected/75cde8ba-f7f6-4bf1-b234-b6ff4c27b591-kube-api-access-zm77b\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g\" (UID: \"75cde8ba-f7f6-4bf1-b234-b6ff4c27b591\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g" Jul 09 16:57:35.513180 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.513079 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g" Jul 09 16:57:35.601255 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.601220 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh"] Jul 09 16:57:35.604547 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.604519 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh" Jul 09 16:57:35.624025 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.623982 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh"] Jul 09 16:57:35.649674 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.649641 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g"] Jul 09 16:57:35.652525 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:57:35.652494 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75cde8ba_f7f6_4bf1_b234_b6ff4c27b591.slice/crio-cedc4745caaeb0d2ba48c510602d87ba959d0d0a12b40b323371ab5384f707d9 WatchSource:0}: Error finding container cedc4745caaeb0d2ba48c510602d87ba959d0d0a12b40b323371ab5384f707d9: Status 404 returned error can't find the container with id cedc4745caaeb0d2ba48c510602d87ba959d0d0a12b40b323371ab5384f707d9 Jul 09 16:57:35.696772 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.696745 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt7b9\" (UniqueName: \"kubernetes.io/projected/647a5691-436d-4c26-9d21-2cc0ae114e26-kube-api-access-dt7b9\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh\" (UID: \"647a5691-436d-4c26-9d21-2cc0ae114e26\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh" Jul 09 16:57:35.696885 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.696787 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/647a5691-436d-4c26-9d21-2cc0ae114e26-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh\" (UID: \"647a5691-436d-4c26-9d21-2cc0ae114e26\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh" Jul 09 16:57:35.696929 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.696890 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/647a5691-436d-4c26-9d21-2cc0ae114e26-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh\" (UID: \"647a5691-436d-4c26-9d21-2cc0ae114e26\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh" Jul 09 16:57:35.797840 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.797805 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt7b9\" (UniqueName: \"kubernetes.io/projected/647a5691-436d-4c26-9d21-2cc0ae114e26-kube-api-access-dt7b9\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh\" (UID: \"647a5691-436d-4c26-9d21-2cc0ae114e26\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh" Jul 09 16:57:35.797840 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.797853 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/647a5691-436d-4c26-9d21-2cc0ae114e26-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh\" (UID: \"647a5691-436d-4c26-9d21-2cc0ae114e26\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh" Jul 09 16:57:35.798049 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.797901 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/647a5691-436d-4c26-9d21-2cc0ae114e26-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh\" (UID: \"647a5691-436d-4c26-9d21-2cc0ae114e26\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh" Jul 09 16:57:35.798233 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.798218 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/647a5691-436d-4c26-9d21-2cc0ae114e26-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh\" (UID: \"647a5691-436d-4c26-9d21-2cc0ae114e26\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh" Jul 09 16:57:35.798273 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.798259 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/647a5691-436d-4c26-9d21-2cc0ae114e26-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh\" (UID: \"647a5691-436d-4c26-9d21-2cc0ae114e26\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh" Jul 09 16:57:35.806145 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.806119 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt7b9\" (UniqueName: \"kubernetes.io/projected/647a5691-436d-4c26-9d21-2cc0ae114e26-kube-api-access-dt7b9\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh\" (UID: \"647a5691-436d-4c26-9d21-2cc0ae114e26\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh" Jul 09 16:57:35.824773 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.824744 2580 generic.go:356] "Generic (PLEG): container finished" podID="75cde8ba-f7f6-4bf1-b234-b6ff4c27b591" containerID="0ed174efe27ad69f02377a9010583236161804f726ae2689b01ae122341a8857" exitCode=0 Jul 09 16:57:35.824899 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.824837 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g" event={"ID":"75cde8ba-f7f6-4bf1-b234-b6ff4c27b591","Type":"ContainerDied","Data":"0ed174efe27ad69f02377a9010583236161804f726ae2689b01ae122341a8857"} Jul 09 16:57:35.824899 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.824891 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g" event={"ID":"75cde8ba-f7f6-4bf1-b234-b6ff4c27b591","Type":"ContainerStarted","Data":"cedc4745caaeb0d2ba48c510602d87ba959d0d0a12b40b323371ab5384f707d9"} Jul 09 16:57:35.925328 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.925270 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh" Jul 09 16:57:35.998958 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:35.998897 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz"] Jul 09 16:57:36.001613 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.001590 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz" Jul 09 16:57:36.011764 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.011737 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz"] Jul 09 16:57:36.061791 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.061766 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh"] Jul 09 16:57:36.063656 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:57:36.063628 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod647a5691_436d_4c26_9d21_2cc0ae114e26.slice/crio-b770c838cf10480a0f23e25488b4e8235a43a2c906fe72926fb79c52cab564a0 WatchSource:0}: Error finding container b770c838cf10480a0f23e25488b4e8235a43a2c906fe72926fb79c52cab564a0: Status 404 returned error can't find the container with id b770c838cf10480a0f23e25488b4e8235a43a2c906fe72926fb79c52cab564a0 Jul 09 16:57:36.100340 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.100313 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d1838b-c229-4ee1-8bc5-6ede85fcef61-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz\" (UID: \"09d1838b-c229-4ee1-8bc5-6ede85fcef61\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz" Jul 09 16:57:36.100492 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.100370 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bdqg\" (UniqueName: \"kubernetes.io/projected/09d1838b-c229-4ee1-8bc5-6ede85fcef61-kube-api-access-5bdqg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz\" (UID: \"09d1838b-c229-4ee1-8bc5-6ede85fcef61\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz" Jul 09 16:57:36.100492 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.100427 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d1838b-c229-4ee1-8bc5-6ede85fcef61-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz\" (UID: \"09d1838b-c229-4ee1-8bc5-6ede85fcef61\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz" Jul 09 16:57:36.201124 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.201096 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bdqg\" (UniqueName: \"kubernetes.io/projected/09d1838b-c229-4ee1-8bc5-6ede85fcef61-kube-api-access-5bdqg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz\" (UID: \"09d1838b-c229-4ee1-8bc5-6ede85fcef61\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz" Jul 09 16:57:36.201507 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.201146 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d1838b-c229-4ee1-8bc5-6ede85fcef61-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz\" (UID: \"09d1838b-c229-4ee1-8bc5-6ede85fcef61\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz" Jul 09 16:57:36.201507 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.201197 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d1838b-c229-4ee1-8bc5-6ede85fcef61-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz\" (UID: \"09d1838b-c229-4ee1-8bc5-6ede85fcef61\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz" Jul 09 16:57:36.201583 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.201540 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d1838b-c229-4ee1-8bc5-6ede85fcef61-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz\" (UID: \"09d1838b-c229-4ee1-8bc5-6ede85fcef61\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz" Jul 09 16:57:36.201619 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.201597 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d1838b-c229-4ee1-8bc5-6ede85fcef61-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz\" (UID: \"09d1838b-c229-4ee1-8bc5-6ede85fcef61\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz" Jul 09 16:57:36.209469 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.209445 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bdqg\" (UniqueName: \"kubernetes.io/projected/09d1838b-c229-4ee1-8bc5-6ede85fcef61-kube-api-access-5bdqg\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz\" (UID: \"09d1838b-c229-4ee1-8bc5-6ede85fcef61\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz" Jul 09 16:57:36.315890 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.315805 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz" Jul 09 16:57:36.401867 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.401833 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd"] Jul 09 16:57:36.405139 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.405116 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd" Jul 09 16:57:36.414069 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.413967 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd"] Jul 09 16:57:36.450792 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.450747 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz"] Jul 09 16:57:36.453262 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:57:36.453227 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09d1838b_c229_4ee1_8bc5_6ede85fcef61.slice/crio-1cad559559a7e86784762a66347da94ca53a48a9aece6b9ed3ab16d0525f4a78 WatchSource:0}: Error finding container 1cad559559a7e86784762a66347da94ca53a48a9aece6b9ed3ab16d0525f4a78: Status 404 returned error can't find the container with id 1cad559559a7e86784762a66347da94ca53a48a9aece6b9ed3ab16d0525f4a78 Jul 09 16:57:36.503569 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.503544 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ce381b8-479d-403d-9130-2bdbd9883d23-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd\" (UID: \"1ce381b8-479d-403d-9130-2bdbd9883d23\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd" Jul 09 16:57:36.503686 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.503614 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ce381b8-479d-403d-9130-2bdbd9883d23-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd\" (UID: \"1ce381b8-479d-403d-9130-2bdbd9883d23\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd" Jul 09 16:57:36.503748 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.503690 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zmht\" (UniqueName: \"kubernetes.io/projected/1ce381b8-479d-403d-9130-2bdbd9883d23-kube-api-access-2zmht\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd\" (UID: \"1ce381b8-479d-403d-9130-2bdbd9883d23\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd" Jul 09 16:57:36.605161 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.605137 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ce381b8-479d-403d-9130-2bdbd9883d23-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd\" (UID: \"1ce381b8-479d-403d-9130-2bdbd9883d23\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd" Jul 09 16:57:36.605314 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.605194 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zmht\" (UniqueName: \"kubernetes.io/projected/1ce381b8-479d-403d-9130-2bdbd9883d23-kube-api-access-2zmht\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd\" (UID: \"1ce381b8-479d-403d-9130-2bdbd9883d23\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd" Jul 09 16:57:36.605314 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.605230 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ce381b8-479d-403d-9130-2bdbd9883d23-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd\" (UID: \"1ce381b8-479d-403d-9130-2bdbd9883d23\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd" Jul 09 16:57:36.605521 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.605499 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ce381b8-479d-403d-9130-2bdbd9883d23-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd\" (UID: \"1ce381b8-479d-403d-9130-2bdbd9883d23\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd" Jul 09 16:57:36.605594 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.605534 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ce381b8-479d-403d-9130-2bdbd9883d23-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd\" (UID: \"1ce381b8-479d-403d-9130-2bdbd9883d23\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd" Jul 09 16:57:36.613572 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.613548 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zmht\" (UniqueName: \"kubernetes.io/projected/1ce381b8-479d-403d-9130-2bdbd9883d23-kube-api-access-2zmht\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd\" (UID: \"1ce381b8-479d-403d-9130-2bdbd9883d23\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd" Jul 09 16:57:36.728381 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.728348 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd" Jul 09 16:57:36.832478 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.832440 2580 generic.go:356] "Generic (PLEG): container finished" podID="09d1838b-c229-4ee1-8bc5-6ede85fcef61" containerID="d4e201126822cfbf97fa5bbb0a9300013d0610108b8336d0d209cd7e31c62699" exitCode=0 Jul 09 16:57:36.832668 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.832533 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz" event={"ID":"09d1838b-c229-4ee1-8bc5-6ede85fcef61","Type":"ContainerDied","Data":"d4e201126822cfbf97fa5bbb0a9300013d0610108b8336d0d209cd7e31c62699"} Jul 09 16:57:36.832668 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.832587 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz" event={"ID":"09d1838b-c229-4ee1-8bc5-6ede85fcef61","Type":"ContainerStarted","Data":"1cad559559a7e86784762a66347da94ca53a48a9aece6b9ed3ab16d0525f4a78"} Jul 09 16:57:36.835398 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.835182 2580 generic.go:356] "Generic (PLEG): container finished" podID="75cde8ba-f7f6-4bf1-b234-b6ff4c27b591" containerID="b2f80ab182061e1d1426b8cebe82b51b85e09bf124c2e2c51b02a60ae496b173" exitCode=0 Jul 09 16:57:36.835398 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.835343 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g" event={"ID":"75cde8ba-f7f6-4bf1-b234-b6ff4c27b591","Type":"ContainerDied","Data":"b2f80ab182061e1d1426b8cebe82b51b85e09bf124c2e2c51b02a60ae496b173"} Jul 09 16:57:36.838364 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.838337 2580 generic.go:356] "Generic (PLEG): container finished" podID="647a5691-436d-4c26-9d21-2cc0ae114e26" containerID="c12be98238947ac790e8399fe73b6daae142786f558e9ba318f4dc948d8686bf" exitCode=0 Jul 09 16:57:36.838457 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.838394 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh" event={"ID":"647a5691-436d-4c26-9d21-2cc0ae114e26","Type":"ContainerDied","Data":"c12be98238947ac790e8399fe73b6daae142786f558e9ba318f4dc948d8686bf"} Jul 09 16:57:36.838457 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.838433 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh" event={"ID":"647a5691-436d-4c26-9d21-2cc0ae114e26","Type":"ContainerStarted","Data":"b770c838cf10480a0f23e25488b4e8235a43a2c906fe72926fb79c52cab564a0"} Jul 09 16:57:36.887052 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:36.887027 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd"] Jul 09 16:57:36.889237 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:57:36.889216 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ce381b8_479d_403d_9130_2bdbd9883d23.slice/crio-bd8551d70b7c554fcd50ef3d7c2417d814fc234a39c0dfd39ae52a4edd55b099 WatchSource:0}: Error finding container bd8551d70b7c554fcd50ef3d7c2417d814fc234a39c0dfd39ae52a4edd55b099: Status 404 returned error can't find the container with id bd8551d70b7c554fcd50ef3d7c2417d814fc234a39c0dfd39ae52a4edd55b099 Jul 09 16:57:37.844727 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:37.844697 2580 generic.go:356] "Generic (PLEG): container finished" podID="1ce381b8-479d-403d-9130-2bdbd9883d23" containerID="589728af0ffd3f2564be5049624a1bd21c67302768f2144e035905d9ec8385de" exitCode=0 Jul 09 16:57:37.845064 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:37.844789 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd" event={"ID":"1ce381b8-479d-403d-9130-2bdbd9883d23","Type":"ContainerDied","Data":"589728af0ffd3f2564be5049624a1bd21c67302768f2144e035905d9ec8385de"} Jul 09 16:57:37.845064 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:37.844844 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd" event={"ID":"1ce381b8-479d-403d-9130-2bdbd9883d23","Type":"ContainerStarted","Data":"bd8551d70b7c554fcd50ef3d7c2417d814fc234a39c0dfd39ae52a4edd55b099"} Jul 09 16:57:37.847354 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:37.847251 2580 generic.go:356] "Generic (PLEG): container finished" podID="75cde8ba-f7f6-4bf1-b234-b6ff4c27b591" containerID="cfdfa356a1c3000842364cf92c674700b58f607827b1bcb78a8ac0dc8a6d4a45" exitCode=0 Jul 09 16:57:37.847354 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:37.847322 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g" event={"ID":"75cde8ba-f7f6-4bf1-b234-b6ff4c27b591","Type":"ContainerDied","Data":"cfdfa356a1c3000842364cf92c674700b58f607827b1bcb78a8ac0dc8a6d4a45"} Jul 09 16:57:38.854156 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:38.854119 2580 generic.go:356] "Generic (PLEG): container finished" podID="647a5691-436d-4c26-9d21-2cc0ae114e26" containerID="1cb495ebff3f40dea1d35fdb08aeb20354be33451a62a5c9bb549e2a33c02e27" exitCode=0 Jul 09 16:57:38.854590 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:38.854207 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh" event={"ID":"647a5691-436d-4c26-9d21-2cc0ae114e26","Type":"ContainerDied","Data":"1cb495ebff3f40dea1d35fdb08aeb20354be33451a62a5c9bb549e2a33c02e27"} Jul 09 16:57:38.856193 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:38.856170 2580 generic.go:356] "Generic (PLEG): container finished" podID="1ce381b8-479d-403d-9130-2bdbd9883d23" containerID="98647da2de347dc98834b932b08ad0f25da378cc18fd8357723a31282e7b3ede" exitCode=0 Jul 09 16:57:38.856317 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:38.856254 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd" event={"ID":"1ce381b8-479d-403d-9130-2bdbd9883d23","Type":"ContainerDied","Data":"98647da2de347dc98834b932b08ad0f25da378cc18fd8357723a31282e7b3ede"} Jul 09 16:57:38.858588 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:38.858569 2580 generic.go:356] "Generic (PLEG): container finished" podID="09d1838b-c229-4ee1-8bc5-6ede85fcef61" containerID="0aa7ed903d1ea1a62460f688b880be67c3fc9b87165aa561d5d2f0d31fa1f137" exitCode=0 Jul 09 16:57:38.858687 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:38.858661 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz" event={"ID":"09d1838b-c229-4ee1-8bc5-6ede85fcef61","Type":"ContainerDied","Data":"0aa7ed903d1ea1a62460f688b880be67c3fc9b87165aa561d5d2f0d31fa1f137"} Jul 09 16:57:38.996032 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:38.995997 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g" Jul 09 16:57:39.127247 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:39.127224 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75cde8ba-f7f6-4bf1-b234-b6ff4c27b591-util\") pod \"75cde8ba-f7f6-4bf1-b234-b6ff4c27b591\" (UID: \"75cde8ba-f7f6-4bf1-b234-b6ff4c27b591\") " Jul 09 16:57:39.127370 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:39.127264 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75cde8ba-f7f6-4bf1-b234-b6ff4c27b591-bundle\") pod \"75cde8ba-f7f6-4bf1-b234-b6ff4c27b591\" (UID: \"75cde8ba-f7f6-4bf1-b234-b6ff4c27b591\") " Jul 09 16:57:39.127370 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:39.127329 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zm77b\" (UniqueName: \"kubernetes.io/projected/75cde8ba-f7f6-4bf1-b234-b6ff4c27b591-kube-api-access-zm77b\") pod \"75cde8ba-f7f6-4bf1-b234-b6ff4c27b591\" (UID: \"75cde8ba-f7f6-4bf1-b234-b6ff4c27b591\") " Jul 09 16:57:39.127858 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:39.127829 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75cde8ba-f7f6-4bf1-b234-b6ff4c27b591-bundle" (OuterVolumeSpecName: "bundle") pod "75cde8ba-f7f6-4bf1-b234-b6ff4c27b591" (UID: "75cde8ba-f7f6-4bf1-b234-b6ff4c27b591"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:57:39.129753 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:39.129729 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75cde8ba-f7f6-4bf1-b234-b6ff4c27b591-kube-api-access-zm77b" (OuterVolumeSpecName: "kube-api-access-zm77b") pod "75cde8ba-f7f6-4bf1-b234-b6ff4c27b591" (UID: "75cde8ba-f7f6-4bf1-b234-b6ff4c27b591"). InnerVolumeSpecName "kube-api-access-zm77b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:57:39.132559 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:39.132538 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75cde8ba-f7f6-4bf1-b234-b6ff4c27b591-util" (OuterVolumeSpecName: "util") pod "75cde8ba-f7f6-4bf1-b234-b6ff4c27b591" (UID: "75cde8ba-f7f6-4bf1-b234-b6ff4c27b591"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:57:39.228077 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:39.228035 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75cde8ba-f7f6-4bf1-b234-b6ff4c27b591-util\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:57:39.228077 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:39.228071 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75cde8ba-f7f6-4bf1-b234-b6ff4c27b591-bundle\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:57:39.228077 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:39.228081 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zm77b\" (UniqueName: \"kubernetes.io/projected/75cde8ba-f7f6-4bf1-b234-b6ff4c27b591-kube-api-access-zm77b\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:57:39.866094 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:39.866053 2580 generic.go:356] "Generic (PLEG): container finished" podID="647a5691-436d-4c26-9d21-2cc0ae114e26" containerID="b19aff77fed8bce78a1080807281b27804083c618f59ce2101c2efe36e0f416d" exitCode=0 Jul 09 16:57:39.866549 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:39.866138 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh" event={"ID":"647a5691-436d-4c26-9d21-2cc0ae114e26","Type":"ContainerDied","Data":"b19aff77fed8bce78a1080807281b27804083c618f59ce2101c2efe36e0f416d"} Jul 09 16:57:39.868182 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:39.868157 2580 generic.go:356] "Generic (PLEG): container finished" podID="1ce381b8-479d-403d-9130-2bdbd9883d23" containerID="335c39734a0f69d6a204feac1acdde9efd383ef17efccb171f2a533542d26afa" exitCode=0 Jul 09 16:57:39.868308 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:39.868243 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd" event={"ID":"1ce381b8-479d-403d-9130-2bdbd9883d23","Type":"ContainerDied","Data":"335c39734a0f69d6a204feac1acdde9efd383ef17efccb171f2a533542d26afa"} Jul 09 16:57:39.870341 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:39.870320 2580 generic.go:356] "Generic (PLEG): container finished" podID="09d1838b-c229-4ee1-8bc5-6ede85fcef61" containerID="69f79088f42406a188d020603564eb92bee882870b1d1b6cb75a0e43d8aadbe4" exitCode=0 Jul 09 16:57:39.870424 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:39.870406 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz" event={"ID":"09d1838b-c229-4ee1-8bc5-6ede85fcef61","Type":"ContainerDied","Data":"69f79088f42406a188d020603564eb92bee882870b1d1b6cb75a0e43d8aadbe4"} Jul 09 16:57:39.872093 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:39.872077 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g" event={"ID":"75cde8ba-f7f6-4bf1-b234-b6ff4c27b591","Type":"ContainerDied","Data":"cedc4745caaeb0d2ba48c510602d87ba959d0d0a12b40b323371ab5384f707d9"} Jul 09 16:57:39.872176 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:39.872106 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cedc4745caaeb0d2ba48c510602d87ba959d0d0a12b40b323371ab5384f707d9" Jul 09 16:57:39.872176 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:39.872107 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g" Jul 09 16:57:41.037405 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.037382 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd" Jul 09 16:57:41.038460 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.038439 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz" Jul 09 16:57:41.070477 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.070438 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh" Jul 09 16:57:41.146779 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.146686 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d1838b-c229-4ee1-8bc5-6ede85fcef61-bundle\") pod \"09d1838b-c229-4ee1-8bc5-6ede85fcef61\" (UID: \"09d1838b-c229-4ee1-8bc5-6ede85fcef61\") " Jul 09 16:57:41.146779 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.146720 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ce381b8-479d-403d-9130-2bdbd9883d23-util\") pod \"1ce381b8-479d-403d-9130-2bdbd9883d23\" (UID: \"1ce381b8-479d-403d-9130-2bdbd9883d23\") " Jul 09 16:57:41.146779 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.146775 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zmht\" (UniqueName: \"kubernetes.io/projected/1ce381b8-479d-403d-9130-2bdbd9883d23-kube-api-access-2zmht\") pod \"1ce381b8-479d-403d-9130-2bdbd9883d23\" (UID: \"1ce381b8-479d-403d-9130-2bdbd9883d23\") " Jul 09 16:57:41.147039 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.146821 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d1838b-c229-4ee1-8bc5-6ede85fcef61-util\") pod \"09d1838b-c229-4ee1-8bc5-6ede85fcef61\" (UID: \"09d1838b-c229-4ee1-8bc5-6ede85fcef61\") " Jul 09 16:57:41.147039 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.146868 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bdqg\" (UniqueName: \"kubernetes.io/projected/09d1838b-c229-4ee1-8bc5-6ede85fcef61-kube-api-access-5bdqg\") pod \"09d1838b-c229-4ee1-8bc5-6ede85fcef61\" (UID: \"09d1838b-c229-4ee1-8bc5-6ede85fcef61\") " Jul 09 16:57:41.147039 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.146914 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ce381b8-479d-403d-9130-2bdbd9883d23-bundle\") pod \"1ce381b8-479d-403d-9130-2bdbd9883d23\" (UID: \"1ce381b8-479d-403d-9130-2bdbd9883d23\") " Jul 09 16:57:41.147535 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.147487 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ce381b8-479d-403d-9130-2bdbd9883d23-bundle" (OuterVolumeSpecName: "bundle") pod "1ce381b8-479d-403d-9130-2bdbd9883d23" (UID: "1ce381b8-479d-403d-9130-2bdbd9883d23"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:57:41.147535 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.147524 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09d1838b-c229-4ee1-8bc5-6ede85fcef61-bundle" (OuterVolumeSpecName: "bundle") pod "09d1838b-c229-4ee1-8bc5-6ede85fcef61" (UID: "09d1838b-c229-4ee1-8bc5-6ede85fcef61"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:57:41.149181 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.149155 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ce381b8-479d-403d-9130-2bdbd9883d23-kube-api-access-2zmht" (OuterVolumeSpecName: "kube-api-access-2zmht") pod "1ce381b8-479d-403d-9130-2bdbd9883d23" (UID: "1ce381b8-479d-403d-9130-2bdbd9883d23"). InnerVolumeSpecName "kube-api-access-2zmht". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:57:41.149271 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.149230 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09d1838b-c229-4ee1-8bc5-6ede85fcef61-kube-api-access-5bdqg" (OuterVolumeSpecName: "kube-api-access-5bdqg") pod "09d1838b-c229-4ee1-8bc5-6ede85fcef61" (UID: "09d1838b-c229-4ee1-8bc5-6ede85fcef61"). InnerVolumeSpecName "kube-api-access-5bdqg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:57:41.152612 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.152594 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ce381b8-479d-403d-9130-2bdbd9883d23-util" (OuterVolumeSpecName: "util") pod "1ce381b8-479d-403d-9130-2bdbd9883d23" (UID: "1ce381b8-479d-403d-9130-2bdbd9883d23"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:57:41.152953 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.152934 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09d1838b-c229-4ee1-8bc5-6ede85fcef61-util" (OuterVolumeSpecName: "util") pod "09d1838b-c229-4ee1-8bc5-6ede85fcef61" (UID: "09d1838b-c229-4ee1-8bc5-6ede85fcef61"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:57:41.247848 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.247817 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/647a5691-436d-4c26-9d21-2cc0ae114e26-bundle\") pod \"647a5691-436d-4c26-9d21-2cc0ae114e26\" (UID: \"647a5691-436d-4c26-9d21-2cc0ae114e26\") " Jul 09 16:57:41.248024 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.247857 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dt7b9\" (UniqueName: \"kubernetes.io/projected/647a5691-436d-4c26-9d21-2cc0ae114e26-kube-api-access-dt7b9\") pod \"647a5691-436d-4c26-9d21-2cc0ae114e26\" (UID: \"647a5691-436d-4c26-9d21-2cc0ae114e26\") " Jul 09 16:57:41.248024 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.247939 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/647a5691-436d-4c26-9d21-2cc0ae114e26-util\") pod \"647a5691-436d-4c26-9d21-2cc0ae114e26\" (UID: \"647a5691-436d-4c26-9d21-2cc0ae114e26\") " Jul 09 16:57:41.248151 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.248134 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09d1838b-c229-4ee1-8bc5-6ede85fcef61-bundle\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:57:41.248184 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.248158 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ce381b8-479d-403d-9130-2bdbd9883d23-util\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:57:41.248184 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.248174 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zmht\" (UniqueName: \"kubernetes.io/projected/1ce381b8-479d-403d-9130-2bdbd9883d23-kube-api-access-2zmht\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:57:41.248248 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.248189 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09d1838b-c229-4ee1-8bc5-6ede85fcef61-util\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:57:41.248248 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.248202 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bdqg\" (UniqueName: \"kubernetes.io/projected/09d1838b-c229-4ee1-8bc5-6ede85fcef61-kube-api-access-5bdqg\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:57:41.248248 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.248214 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ce381b8-479d-403d-9130-2bdbd9883d23-bundle\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:57:41.248508 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.248463 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/647a5691-436d-4c26-9d21-2cc0ae114e26-bundle" (OuterVolumeSpecName: "bundle") pod "647a5691-436d-4c26-9d21-2cc0ae114e26" (UID: "647a5691-436d-4c26-9d21-2cc0ae114e26"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:57:41.250105 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.250076 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/647a5691-436d-4c26-9d21-2cc0ae114e26-kube-api-access-dt7b9" (OuterVolumeSpecName: "kube-api-access-dt7b9") pod "647a5691-436d-4c26-9d21-2cc0ae114e26" (UID: "647a5691-436d-4c26-9d21-2cc0ae114e26"). InnerVolumeSpecName "kube-api-access-dt7b9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:57:41.252764 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.252744 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/647a5691-436d-4c26-9d21-2cc0ae114e26-util" (OuterVolumeSpecName: "util") pod "647a5691-436d-4c26-9d21-2cc0ae114e26" (UID: "647a5691-436d-4c26-9d21-2cc0ae114e26"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:57:41.349145 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.349107 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/647a5691-436d-4c26-9d21-2cc0ae114e26-util\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:57:41.349421 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.349398 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/647a5691-436d-4c26-9d21-2cc0ae114e26-bundle\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:57:41.349494 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.349425 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dt7b9\" (UniqueName: \"kubernetes.io/projected/647a5691-436d-4c26-9d21-2cc0ae114e26-kube-api-access-dt7b9\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:57:41.884700 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.884671 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh" Jul 09 16:57:41.884856 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.884665 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh" event={"ID":"647a5691-436d-4c26-9d21-2cc0ae114e26","Type":"ContainerDied","Data":"b770c838cf10480a0f23e25488b4e8235a43a2c906fe72926fb79c52cab564a0"} Jul 09 16:57:41.884856 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.884838 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b770c838cf10480a0f23e25488b4e8235a43a2c906fe72926fb79c52cab564a0" Jul 09 16:57:41.886511 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.886488 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd" Jul 09 16:57:41.886640 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.886508 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd" event={"ID":"1ce381b8-479d-403d-9130-2bdbd9883d23","Type":"ContainerDied","Data":"bd8551d70b7c554fcd50ef3d7c2417d814fc234a39c0dfd39ae52a4edd55b099"} Jul 09 16:57:41.886640 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.886552 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd8551d70b7c554fcd50ef3d7c2417d814fc234a39c0dfd39ae52a4edd55b099" Jul 09 16:57:41.888444 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.888422 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz" event={"ID":"09d1838b-c229-4ee1-8bc5-6ede85fcef61","Type":"ContainerDied","Data":"1cad559559a7e86784762a66347da94ca53a48a9aece6b9ed3ab16d0525f4a78"} Jul 09 16:57:41.888540 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.888459 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1cad559559a7e86784762a66347da94ca53a48a9aece6b9ed3ab16d0525f4a78" Jul 09 16:57:41.888540 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:41.888432 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz" Jul 09 16:57:55.594715 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.594668 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d945d484-6xmdl" podUID="841337e2-6846-4efb-b4d1-7f19bbf815f7" containerName="console" containerID="cri-o://29dbb3496b4ffa0307d81675187b4c7639477944d1baabe8d41d41b3ff553b69" gracePeriod=15 Jul 09 16:57:55.835320 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.835296 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:57:55.877489 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.877461 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/841337e2-6846-4efb-b4d1-7f19bbf815f7-service-ca\") pod \"841337e2-6846-4efb-b4d1-7f19bbf815f7\" (UID: \"841337e2-6846-4efb-b4d1-7f19bbf815f7\") " Jul 09 16:57:55.877489 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.877490 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/841337e2-6846-4efb-b4d1-7f19bbf815f7-console-config\") pod \"841337e2-6846-4efb-b4d1-7f19bbf815f7\" (UID: \"841337e2-6846-4efb-b4d1-7f19bbf815f7\") " Jul 09 16:57:55.877684 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.877515 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/841337e2-6846-4efb-b4d1-7f19bbf815f7-console-serving-cert\") pod \"841337e2-6846-4efb-b4d1-7f19bbf815f7\" (UID: \"841337e2-6846-4efb-b4d1-7f19bbf815f7\") " Jul 09 16:57:55.877684 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.877556 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/841337e2-6846-4efb-b4d1-7f19bbf815f7-console-oauth-config\") pod \"841337e2-6846-4efb-b4d1-7f19bbf815f7\" (UID: \"841337e2-6846-4efb-b4d1-7f19bbf815f7\") " Jul 09 16:57:55.877684 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.877588 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/841337e2-6846-4efb-b4d1-7f19bbf815f7-oauth-serving-cert\") pod \"841337e2-6846-4efb-b4d1-7f19bbf815f7\" (UID: \"841337e2-6846-4efb-b4d1-7f19bbf815f7\") " Jul 09 16:57:55.877684 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.877639 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjd8t\" (UniqueName: \"kubernetes.io/projected/841337e2-6846-4efb-b4d1-7f19bbf815f7-kube-api-access-qjd8t\") pod \"841337e2-6846-4efb-b4d1-7f19bbf815f7\" (UID: \"841337e2-6846-4efb-b4d1-7f19bbf815f7\") " Jul 09 16:57:55.877684 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.877678 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/841337e2-6846-4efb-b4d1-7f19bbf815f7-trusted-ca-bundle\") pod \"841337e2-6846-4efb-b4d1-7f19bbf815f7\" (UID: \"841337e2-6846-4efb-b4d1-7f19bbf815f7\") " Jul 09 16:57:55.877983 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.877954 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/841337e2-6846-4efb-b4d1-7f19bbf815f7-console-config" (OuterVolumeSpecName: "console-config") pod "841337e2-6846-4efb-b4d1-7f19bbf815f7" (UID: "841337e2-6846-4efb-b4d1-7f19bbf815f7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:57:55.878101 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.877925 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/841337e2-6846-4efb-b4d1-7f19bbf815f7-service-ca" (OuterVolumeSpecName: "service-ca") pod "841337e2-6846-4efb-b4d1-7f19bbf815f7" (UID: "841337e2-6846-4efb-b4d1-7f19bbf815f7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:57:55.878236 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.878116 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/841337e2-6846-4efb-b4d1-7f19bbf815f7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "841337e2-6846-4efb-b4d1-7f19bbf815f7" (UID: "841337e2-6846-4efb-b4d1-7f19bbf815f7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:57:55.878496 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.878451 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/841337e2-6846-4efb-b4d1-7f19bbf815f7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "841337e2-6846-4efb-b4d1-7f19bbf815f7" (UID: "841337e2-6846-4efb-b4d1-7f19bbf815f7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:57:55.879886 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.879860 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/841337e2-6846-4efb-b4d1-7f19bbf815f7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "841337e2-6846-4efb-b4d1-7f19bbf815f7" (UID: "841337e2-6846-4efb-b4d1-7f19bbf815f7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:57:55.880160 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.880136 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/841337e2-6846-4efb-b4d1-7f19bbf815f7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "841337e2-6846-4efb-b4d1-7f19bbf815f7" (UID: "841337e2-6846-4efb-b4d1-7f19bbf815f7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:57:55.880221 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.880192 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/841337e2-6846-4efb-b4d1-7f19bbf815f7-kube-api-access-qjd8t" (OuterVolumeSpecName: "kube-api-access-qjd8t") pod "841337e2-6846-4efb-b4d1-7f19bbf815f7" (UID: "841337e2-6846-4efb-b4d1-7f19bbf815f7"). InnerVolumeSpecName "kube-api-access-qjd8t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:57:55.957028 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.956994 2580 generic.go:356] "Generic (PLEG): container finished" podID="841337e2-6846-4efb-b4d1-7f19bbf815f7" containerID="29dbb3496b4ffa0307d81675187b4c7639477944d1baabe8d41d41b3ff553b69" exitCode=0 Jul 09 16:57:55.957144 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.957043 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d945d484-6xmdl" Jul 09 16:57:55.957144 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.957085 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d945d484-6xmdl" event={"ID":"841337e2-6846-4efb-b4d1-7f19bbf815f7","Type":"ContainerDied","Data":"29dbb3496b4ffa0307d81675187b4c7639477944d1baabe8d41d41b3ff553b69"} Jul 09 16:57:55.957144 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.957141 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d945d484-6xmdl" event={"ID":"841337e2-6846-4efb-b4d1-7f19bbf815f7","Type":"ContainerDied","Data":"9fbe87094b0121c40e560fab5315c9a7e16fefcf954ad11db72c2cd7bd66ebac"} Jul 09 16:57:55.957237 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.957162 2580 scope.go:117] "RemoveContainer" containerID="29dbb3496b4ffa0307d81675187b4c7639477944d1baabe8d41d41b3ff553b69" Jul 09 16:57:55.966796 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.966781 2580 scope.go:117] "RemoveContainer" containerID="29dbb3496b4ffa0307d81675187b4c7639477944d1baabe8d41d41b3ff553b69" Jul 09 16:57:55.967068 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:57:55.967047 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29dbb3496b4ffa0307d81675187b4c7639477944d1baabe8d41d41b3ff553b69\": container with ID starting with 29dbb3496b4ffa0307d81675187b4c7639477944d1baabe8d41d41b3ff553b69 not found: ID does not exist" containerID="29dbb3496b4ffa0307d81675187b4c7639477944d1baabe8d41d41b3ff553b69" Jul 09 16:57:55.967131 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.967079 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29dbb3496b4ffa0307d81675187b4c7639477944d1baabe8d41d41b3ff553b69"} err="failed to get container status \"29dbb3496b4ffa0307d81675187b4c7639477944d1baabe8d41d41b3ff553b69\": rpc error: code = NotFound desc = could not find container \"29dbb3496b4ffa0307d81675187b4c7639477944d1baabe8d41d41b3ff553b69\": container with ID starting with 29dbb3496b4ffa0307d81675187b4c7639477944d1baabe8d41d41b3ff553b69 not found: ID does not exist" Jul 09 16:57:55.977751 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.977726 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d945d484-6xmdl"] Jul 09 16:57:55.978768 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.978742 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/841337e2-6846-4efb-b4d1-7f19bbf815f7-service-ca\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:57:55.978768 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.978763 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/841337e2-6846-4efb-b4d1-7f19bbf815f7-console-config\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:57:55.978840 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.978772 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/841337e2-6846-4efb-b4d1-7f19bbf815f7-console-serving-cert\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:57:55.978840 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.978780 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/841337e2-6846-4efb-b4d1-7f19bbf815f7-console-oauth-config\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:57:55.978840 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.978790 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/841337e2-6846-4efb-b4d1-7f19bbf815f7-oauth-serving-cert\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:57:55.978840 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.978799 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjd8t\" (UniqueName: \"kubernetes.io/projected/841337e2-6846-4efb-b4d1-7f19bbf815f7-kube-api-access-qjd8t\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:57:55.978840 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.978807 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/841337e2-6846-4efb-b4d1-7f19bbf815f7-trusted-ca-bundle\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:57:55.981847 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:55.981825 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d945d484-6xmdl"] Jul 09 16:57:56.177610 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:57:56.177535 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="841337e2-6846-4efb-b4d1-7f19bbf815f7" path="/var/lib/kubelet/pods/841337e2-6846-4efb-b4d1-7f19bbf815f7/volumes" Jul 09 16:58:48.225055 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225021 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg"] Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225332 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09d1838b-c229-4ee1-8bc5-6ede85fcef61" containerName="util" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225344 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="09d1838b-c229-4ee1-8bc5-6ede85fcef61" containerName="util" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225355 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="647a5691-436d-4c26-9d21-2cc0ae114e26" containerName="util" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225361 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="647a5691-436d-4c26-9d21-2cc0ae114e26" containerName="util" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225373 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ce381b8-479d-403d-9130-2bdbd9883d23" containerName="util" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225378 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ce381b8-479d-403d-9130-2bdbd9883d23" containerName="util" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225385 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="647a5691-436d-4c26-9d21-2cc0ae114e26" containerName="pull" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225390 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="647a5691-436d-4c26-9d21-2cc0ae114e26" containerName="pull" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225398 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75cde8ba-f7f6-4bf1-b234-b6ff4c27b591" containerName="extract" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225403 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="75cde8ba-f7f6-4bf1-b234-b6ff4c27b591" containerName="extract" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225409 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75cde8ba-f7f6-4bf1-b234-b6ff4c27b591" containerName="pull" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225414 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="75cde8ba-f7f6-4bf1-b234-b6ff4c27b591" containerName="pull" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225420 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09d1838b-c229-4ee1-8bc5-6ede85fcef61" containerName="extract" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225425 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="09d1838b-c229-4ee1-8bc5-6ede85fcef61" containerName="extract" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225434 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09d1838b-c229-4ee1-8bc5-6ede85fcef61" containerName="pull" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225439 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="09d1838b-c229-4ee1-8bc5-6ede85fcef61" containerName="pull" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225444 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ce381b8-479d-403d-9130-2bdbd9883d23" containerName="pull" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225449 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ce381b8-479d-403d-9130-2bdbd9883d23" containerName="pull" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225455 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ce381b8-479d-403d-9130-2bdbd9883d23" containerName="extract" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225460 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ce381b8-479d-403d-9130-2bdbd9883d23" containerName="extract" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225465 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="841337e2-6846-4efb-b4d1-7f19bbf815f7" containerName="console" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225470 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="841337e2-6846-4efb-b4d1-7f19bbf815f7" containerName="console" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225476 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="647a5691-436d-4c26-9d21-2cc0ae114e26" containerName="extract" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225481 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="647a5691-436d-4c26-9d21-2cc0ae114e26" containerName="extract" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225490 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75cde8ba-f7f6-4bf1-b234-b6ff4c27b591" containerName="util" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225495 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="75cde8ba-f7f6-4bf1-b234-b6ff4c27b591" containerName="util" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225543 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="75cde8ba-f7f6-4bf1-b234-b6ff4c27b591" containerName="extract" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225551 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="647a5691-436d-4c26-9d21-2cc0ae114e26" containerName="extract" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225558 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="841337e2-6846-4efb-b4d1-7f19bbf815f7" containerName="console" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225563 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ce381b8-479d-403d-9130-2bdbd9883d23" containerName="extract" Jul 09 16:58:48.225597 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.225568 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="09d1838b-c229-4ee1-8bc5-6ede85fcef61" containerName="extract" Jul 09 16:58:48.228525 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.228508 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.230583 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.230562 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9skxm\"" Jul 09 16:58:48.239166 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.239145 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg"] Jul 09 16:58:48.310969 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.310933 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/121993ca-d4de-4580-ba70-1c090b685455-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-pgtzg\" (UID: \"121993ca-d4de-4580-ba70-1c090b685455\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.310969 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.310971 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kwdk\" (UniqueName: \"kubernetes.io/projected/121993ca-d4de-4580-ba70-1c090b685455-kube-api-access-8kwdk\") pod \"maas-default-gateway-openshift-default-56654dcf7-pgtzg\" (UID: \"121993ca-d4de-4580-ba70-1c090b685455\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.311173 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.311003 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/121993ca-d4de-4580-ba70-1c090b685455-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-pgtzg\" (UID: \"121993ca-d4de-4580-ba70-1c090b685455\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.311173 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.311030 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/121993ca-d4de-4580-ba70-1c090b685455-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-pgtzg\" (UID: \"121993ca-d4de-4580-ba70-1c090b685455\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.311173 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.311065 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/121993ca-d4de-4580-ba70-1c090b685455-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pgtzg\" (UID: \"121993ca-d4de-4580-ba70-1c090b685455\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.311173 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.311094 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/121993ca-d4de-4580-ba70-1c090b685455-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-pgtzg\" (UID: \"121993ca-d4de-4580-ba70-1c090b685455\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.311332 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.311180 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/121993ca-d4de-4580-ba70-1c090b685455-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-pgtzg\" (UID: \"121993ca-d4de-4580-ba70-1c090b685455\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.311332 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.311241 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/121993ca-d4de-4580-ba70-1c090b685455-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-pgtzg\" (UID: \"121993ca-d4de-4580-ba70-1c090b685455\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.311332 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.311261 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/121993ca-d4de-4580-ba70-1c090b685455-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pgtzg\" (UID: \"121993ca-d4de-4580-ba70-1c090b685455\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.411745 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.411715 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/121993ca-d4de-4580-ba70-1c090b685455-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-pgtzg\" (UID: \"121993ca-d4de-4580-ba70-1c090b685455\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.411745 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.411747 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kwdk\" (UniqueName: \"kubernetes.io/projected/121993ca-d4de-4580-ba70-1c090b685455-kube-api-access-8kwdk\") pod \"maas-default-gateway-openshift-default-56654dcf7-pgtzg\" (UID: \"121993ca-d4de-4580-ba70-1c090b685455\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.411996 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.411767 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/121993ca-d4de-4580-ba70-1c090b685455-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-pgtzg\" (UID: \"121993ca-d4de-4580-ba70-1c090b685455\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.411996 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.411907 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/121993ca-d4de-4580-ba70-1c090b685455-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-pgtzg\" (UID: \"121993ca-d4de-4580-ba70-1c090b685455\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.411996 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.411977 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/121993ca-d4de-4580-ba70-1c090b685455-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pgtzg\" (UID: \"121993ca-d4de-4580-ba70-1c090b685455\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.412197 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.412035 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/121993ca-d4de-4580-ba70-1c090b685455-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-pgtzg\" (UID: \"121993ca-d4de-4580-ba70-1c090b685455\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.412197 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.412104 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/121993ca-d4de-4580-ba70-1c090b685455-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-pgtzg\" (UID: \"121993ca-d4de-4580-ba70-1c090b685455\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.412197 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.412116 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/121993ca-d4de-4580-ba70-1c090b685455-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-pgtzg\" (UID: \"121993ca-d4de-4580-ba70-1c090b685455\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.412197 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.412191 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/121993ca-d4de-4580-ba70-1c090b685455-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-pgtzg\" (UID: \"121993ca-d4de-4580-ba70-1c090b685455\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.412441 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.412223 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/121993ca-d4de-4580-ba70-1c090b685455-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pgtzg\" (UID: \"121993ca-d4de-4580-ba70-1c090b685455\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.412441 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.412258 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/121993ca-d4de-4580-ba70-1c090b685455-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pgtzg\" (UID: \"121993ca-d4de-4580-ba70-1c090b685455\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.412441 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.412397 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/121993ca-d4de-4580-ba70-1c090b685455-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-pgtzg\" (UID: \"121993ca-d4de-4580-ba70-1c090b685455\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.412762 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.412545 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/121993ca-d4de-4580-ba70-1c090b685455-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pgtzg\" (UID: \"121993ca-d4de-4580-ba70-1c090b685455\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.412816 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.412772 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/121993ca-d4de-4580-ba70-1c090b685455-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-pgtzg\" (UID: \"121993ca-d4de-4580-ba70-1c090b685455\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.414377 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.414350 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/121993ca-d4de-4580-ba70-1c090b685455-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-pgtzg\" (UID: \"121993ca-d4de-4580-ba70-1c090b685455\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.414468 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.414406 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/121993ca-d4de-4580-ba70-1c090b685455-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-pgtzg\" (UID: \"121993ca-d4de-4580-ba70-1c090b685455\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.419870 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.419848 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kwdk\" (UniqueName: \"kubernetes.io/projected/121993ca-d4de-4580-ba70-1c090b685455-kube-api-access-8kwdk\") pod \"maas-default-gateway-openshift-default-56654dcf7-pgtzg\" (UID: \"121993ca-d4de-4580-ba70-1c090b685455\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.419999 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.419977 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/121993ca-d4de-4580-ba70-1c090b685455-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-pgtzg\" (UID: \"121993ca-d4de-4580-ba70-1c090b685455\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.538817 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.538739 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:48.674275 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.674247 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg"] Jul 09 16:58:48.676133 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:58:48.676107 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod121993ca_d4de_4580_ba70_1c090b685455.slice/crio-9ad7c30ae4790f8d3cd6527df500d424d8d6fe6568bee4f5ce9786059b486878 WatchSource:0}: Error finding container 9ad7c30ae4790f8d3cd6527df500d424d8d6fe6568bee4f5ce9786059b486878: Status 404 returned error can't find the container with id 9ad7c30ae4790f8d3cd6527df500d424d8d6fe6568bee4f5ce9786059b486878 Jul 09 16:58:48.678609 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.678577 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 16:58:48.678680 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.678647 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 16:58:48.678680 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:48.678674 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 16:58:49.219675 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:49.219638 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" event={"ID":"121993ca-d4de-4580-ba70-1c090b685455","Type":"ContainerStarted","Data":"a9a973588bdbbc1db61f19fd5c93a36f875eb8a7a6a61c30d2881a4dfaada42a"} Jul 09 16:58:49.219887 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:49.219702 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" event={"ID":"121993ca-d4de-4580-ba70-1c090b685455","Type":"ContainerStarted","Data":"9ad7c30ae4790f8d3cd6527df500d424d8d6fe6568bee4f5ce9786059b486878"} Jul 09 16:58:49.241461 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:49.241259 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" podStartSLOduration=1.241239025 podStartE2EDuration="1.241239025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:58:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:58:49.239848715 +0000 UTC m=+467.604600647" watchObservedRunningTime="2026-07-09 16:58:49.241239025 +0000 UTC m=+467.605990942" Jul 09 16:58:49.539611 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:49.539512 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:49.544398 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:49.544369 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:50.224542 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:50.224503 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:50.225364 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:50.225342 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 16:58:51.104440 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:51.104398 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-8kn42"] Jul 09 16:58:51.107781 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:51.107755 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8kn42" Jul 09 16:58:51.109905 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:51.109882 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 16:58:51.110540 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:51.110494 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nt42k\"" Jul 09 16:58:51.110634 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:51.110515 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 16:58:51.113326 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:51.113308 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-8kn42"] Jul 09 16:58:51.135320 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:51.135267 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcn2x\" (UniqueName: \"kubernetes.io/projected/a4035adb-2e7b-4960-afa6-292e4330ba8d-kube-api-access-xcn2x\") pod \"authorino-58cd955675-8kn42\" (UID: \"a4035adb-2e7b-4960-afa6-292e4330ba8d\") " pod="kuadrant-system/authorino-58cd955675-8kn42" Jul 09 16:58:51.236425 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:51.236391 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcn2x\" (UniqueName: \"kubernetes.io/projected/a4035adb-2e7b-4960-afa6-292e4330ba8d-kube-api-access-xcn2x\") pod \"authorino-58cd955675-8kn42\" (UID: \"a4035adb-2e7b-4960-afa6-292e4330ba8d\") " pod="kuadrant-system/authorino-58cd955675-8kn42" Jul 09 16:58:51.244808 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:51.244785 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcn2x\" (UniqueName: \"kubernetes.io/projected/a4035adb-2e7b-4960-afa6-292e4330ba8d-kube-api-access-xcn2x\") pod \"authorino-58cd955675-8kn42\" (UID: \"a4035adb-2e7b-4960-afa6-292e4330ba8d\") " pod="kuadrant-system/authorino-58cd955675-8kn42" Jul 09 16:58:51.418502 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:51.418407 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8kn42" Jul 09 16:58:51.548624 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:51.548600 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-8kn42"] Jul 09 16:58:51.550813 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:58:51.550786 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4035adb_2e7b_4960_afa6_292e4330ba8d.slice/crio-d9e8f4b776e31377adcb35d6f3f066aeefca1aae6652c9214ff0f59c6e4821f0 WatchSource:0}: Error finding container d9e8f4b776e31377adcb35d6f3f066aeefca1aae6652c9214ff0f59c6e4821f0: Status 404 returned error can't find the container with id d9e8f4b776e31377adcb35d6f3f066aeefca1aae6652c9214ff0f59c6e4821f0 Jul 09 16:58:52.235665 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:52.235624 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8kn42" event={"ID":"a4035adb-2e7b-4960-afa6-292e4330ba8d","Type":"ContainerStarted","Data":"d9e8f4b776e31377adcb35d6f3f066aeefca1aae6652c9214ff0f59c6e4821f0"} Jul 09 16:58:55.255147 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:55.255063 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8kn42" event={"ID":"a4035adb-2e7b-4960-afa6-292e4330ba8d","Type":"ContainerStarted","Data":"de3b925f38c9ef0a54fec04ab401f7cdd3f0124c4b8743abb4cac0e41bf566ff"} Jul 09 16:58:55.270958 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:55.270908 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-8kn42" podStartSLOduration=0.892901848 podStartE2EDuration="4.270892876s" totalImagesPullingTime="3.377991028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:58:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:58:55.268980883 +0000 UTC m=+473.633732801" watchObservedRunningTime="2026-07-09 16:58:55.270892876 +0000 UTC m=+473.635644792" Jul 09 16:58:55.966830 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:55.966793 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-8kn42"] Jul 09 16:58:57.264441 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:57.264402 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-8kn42" podUID="a4035adb-2e7b-4960-afa6-292e4330ba8d" containerName="authorino" containerID="cri-o://de3b925f38c9ef0a54fec04ab401f7cdd3f0124c4b8743abb4cac0e41bf566ff" gracePeriod=30 Jul 09 16:58:57.516666 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:57.516609 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8kn42" Jul 09 16:58:57.595529 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:57.595496 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcn2x\" (UniqueName: \"kubernetes.io/projected/a4035adb-2e7b-4960-afa6-292e4330ba8d-kube-api-access-xcn2x\") pod \"a4035adb-2e7b-4960-afa6-292e4330ba8d\" (UID: \"a4035adb-2e7b-4960-afa6-292e4330ba8d\") " Jul 09 16:58:57.597664 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:57.597627 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4035adb-2e7b-4960-afa6-292e4330ba8d-kube-api-access-xcn2x" (OuterVolumeSpecName: "kube-api-access-xcn2x") pod "a4035adb-2e7b-4960-afa6-292e4330ba8d" (UID: "a4035adb-2e7b-4960-afa6-292e4330ba8d"). InnerVolumeSpecName "kube-api-access-xcn2x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:58:57.696454 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:57.696420 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcn2x\" (UniqueName: \"kubernetes.io/projected/a4035adb-2e7b-4960-afa6-292e4330ba8d-kube-api-access-xcn2x\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:58:58.270448 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:58.270412 2580 generic.go:356] "Generic (PLEG): container finished" podID="a4035adb-2e7b-4960-afa6-292e4330ba8d" containerID="de3b925f38c9ef0a54fec04ab401f7cdd3f0124c4b8743abb4cac0e41bf566ff" exitCode=0 Jul 09 16:58:58.270870 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:58.270475 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8kn42" Jul 09 16:58:58.270870 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:58.270494 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8kn42" event={"ID":"a4035adb-2e7b-4960-afa6-292e4330ba8d","Type":"ContainerDied","Data":"de3b925f38c9ef0a54fec04ab401f7cdd3f0124c4b8743abb4cac0e41bf566ff"} Jul 09 16:58:58.270870 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:58.270536 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8kn42" event={"ID":"a4035adb-2e7b-4960-afa6-292e4330ba8d","Type":"ContainerDied","Data":"d9e8f4b776e31377adcb35d6f3f066aeefca1aae6652c9214ff0f59c6e4821f0"} Jul 09 16:58:58.270870 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:58.270553 2580 scope.go:117] "RemoveContainer" containerID="de3b925f38c9ef0a54fec04ab401f7cdd3f0124c4b8743abb4cac0e41bf566ff" Jul 09 16:58:58.279186 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:58.279169 2580 scope.go:117] "RemoveContainer" containerID="de3b925f38c9ef0a54fec04ab401f7cdd3f0124c4b8743abb4cac0e41bf566ff" Jul 09 16:58:58.279482 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:58:58.279464 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de3b925f38c9ef0a54fec04ab401f7cdd3f0124c4b8743abb4cac0e41bf566ff\": container with ID starting with de3b925f38c9ef0a54fec04ab401f7cdd3f0124c4b8743abb4cac0e41bf566ff not found: ID does not exist" containerID="de3b925f38c9ef0a54fec04ab401f7cdd3f0124c4b8743abb4cac0e41bf566ff" Jul 09 16:58:58.279583 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:58.279488 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de3b925f38c9ef0a54fec04ab401f7cdd3f0124c4b8743abb4cac0e41bf566ff"} err="failed to get container status \"de3b925f38c9ef0a54fec04ab401f7cdd3f0124c4b8743abb4cac0e41bf566ff\": rpc error: code = NotFound desc = could not find container \"de3b925f38c9ef0a54fec04ab401f7cdd3f0124c4b8743abb4cac0e41bf566ff\": container with ID starting with de3b925f38c9ef0a54fec04ab401f7cdd3f0124c4b8743abb4cac0e41bf566ff not found: ID does not exist" Jul 09 16:58:58.286449 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:58.286426 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-8kn42"] Jul 09 16:58:58.290207 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:58:58.290184 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-8kn42"] Jul 09 16:59:00.177675 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:00.177636 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4035adb-2e7b-4960-afa6-292e4330ba8d" path="/var/lib/kubelet/pods/a4035adb-2e7b-4960-afa6-292e4330ba8d/volumes" Jul 09 16:59:24.630912 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:24.630875 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9ggm2"] Jul 09 16:59:24.631438 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:24.631190 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4035adb-2e7b-4960-afa6-292e4330ba8d" containerName="authorino" Jul 09 16:59:24.631438 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:24.631201 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4035adb-2e7b-4960-afa6-292e4330ba8d" containerName="authorino" Jul 09 16:59:24.631438 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:24.631255 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4035adb-2e7b-4960-afa6-292e4330ba8d" containerName="authorino" Jul 09 16:59:24.636905 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:24.636883 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9ggm2" Jul 09 16:59:24.639178 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:24.639151 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 16:59:24.639778 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:24.639753 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nt42k\"" Jul 09 16:59:24.639948 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:24.639775 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 16:59:24.640529 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:24.640508 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9ggm2"] Jul 09 16:59:24.730501 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:24.730468 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9jl9\" (UniqueName: \"kubernetes.io/projected/76000b55-a233-4177-bb4b-0139cd92d079-kube-api-access-g9jl9\") pod \"authorino-5d4b67c446-9ggm2\" (UID: \"76000b55-a233-4177-bb4b-0139cd92d079\") " pod="kuadrant-system/authorino-5d4b67c446-9ggm2" Jul 09 16:59:24.831439 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:24.831399 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9jl9\" (UniqueName: \"kubernetes.io/projected/76000b55-a233-4177-bb4b-0139cd92d079-kube-api-access-g9jl9\") pod \"authorino-5d4b67c446-9ggm2\" (UID: \"76000b55-a233-4177-bb4b-0139cd92d079\") " pod="kuadrant-system/authorino-5d4b67c446-9ggm2" Jul 09 16:59:24.839546 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:24.839516 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9jl9\" (UniqueName: \"kubernetes.io/projected/76000b55-a233-4177-bb4b-0139cd92d079-kube-api-access-g9jl9\") pod \"authorino-5d4b67c446-9ggm2\" (UID: \"76000b55-a233-4177-bb4b-0139cd92d079\") " pod="kuadrant-system/authorino-5d4b67c446-9ggm2" Jul 09 16:59:24.868403 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:24.868373 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9ggm2"] Jul 09 16:59:24.868628 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:24.868615 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9ggm2" Jul 09 16:59:25.005516 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:25.005492 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9ggm2"] Jul 09 16:59:25.007689 ip-10-0-128-34 kubenswrapper[2580]: W0709 16:59:25.007656 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76000b55_a233_4177_bb4b_0139cd92d079.slice/crio-5ebb813959b4fa9b1de76e28008fac35e9d9d563f26e05fa468b012959c95b79 WatchSource:0}: Error finding container 5ebb813959b4fa9b1de76e28008fac35e9d9d563f26e05fa468b012959c95b79: Status 404 returned error can't find the container with id 5ebb813959b4fa9b1de76e28008fac35e9d9d563f26e05fa468b012959c95b79 Jul 09 16:59:25.404567 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:25.404524 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-9ggm2" event={"ID":"76000b55-a233-4177-bb4b-0139cd92d079","Type":"ContainerStarted","Data":"5ebb813959b4fa9b1de76e28008fac35e9d9d563f26e05fa468b012959c95b79"} Jul 09 16:59:26.410669 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:26.410629 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-9ggm2" event={"ID":"76000b55-a233-4177-bb4b-0139cd92d079","Type":"ContainerStarted","Data":"703c7c5e96dd4ab41c3002d382a71fe3a03a0145a26592f7f2f990e3b8dd751c"} Jul 09 16:59:26.410669 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:26.410640 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-9ggm2" podUID="76000b55-a233-4177-bb4b-0139cd92d079" containerName="authorino" containerID="cri-o://703c7c5e96dd4ab41c3002d382a71fe3a03a0145a26592f7f2f990e3b8dd751c" gracePeriod=30 Jul 09 16:59:26.424633 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:26.424584 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-9ggm2" podStartSLOduration=1.787541356 podStartE2EDuration="2.424567625s" totalImagesPullingTime="637.026269ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:59:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:59:26.424142086 +0000 UTC m=+504.788894002" watchObservedRunningTime="2026-07-09 16:59:26.424567625 +0000 UTC m=+504.789319540" Jul 09 16:59:26.655300 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:26.655247 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9ggm2" Jul 09 16:59:26.746522 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:26.746429 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9jl9\" (UniqueName: \"kubernetes.io/projected/76000b55-a233-4177-bb4b-0139cd92d079-kube-api-access-g9jl9\") pod \"76000b55-a233-4177-bb4b-0139cd92d079\" (UID: \"76000b55-a233-4177-bb4b-0139cd92d079\") " Jul 09 16:59:26.748813 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:26.748779 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76000b55-a233-4177-bb4b-0139cd92d079-kube-api-access-g9jl9" (OuterVolumeSpecName: "kube-api-access-g9jl9") pod "76000b55-a233-4177-bb4b-0139cd92d079" (UID: "76000b55-a233-4177-bb4b-0139cd92d079"). InnerVolumeSpecName "kube-api-access-g9jl9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:59:26.847646 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:26.847608 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9jl9\" (UniqueName: \"kubernetes.io/projected/76000b55-a233-4177-bb4b-0139cd92d079-kube-api-access-g9jl9\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 16:59:27.416786 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:27.416747 2580 generic.go:356] "Generic (PLEG): container finished" podID="76000b55-a233-4177-bb4b-0139cd92d079" containerID="703c7c5e96dd4ab41c3002d382a71fe3a03a0145a26592f7f2f990e3b8dd751c" exitCode=0 Jul 09 16:59:27.417226 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:27.416791 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-9ggm2" Jul 09 16:59:27.417226 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:27.416833 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-9ggm2" event={"ID":"76000b55-a233-4177-bb4b-0139cd92d079","Type":"ContainerDied","Data":"703c7c5e96dd4ab41c3002d382a71fe3a03a0145a26592f7f2f990e3b8dd751c"} Jul 09 16:59:27.417226 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:27.416877 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-9ggm2" event={"ID":"76000b55-a233-4177-bb4b-0139cd92d079","Type":"ContainerDied","Data":"5ebb813959b4fa9b1de76e28008fac35e9d9d563f26e05fa468b012959c95b79"} Jul 09 16:59:27.417226 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:27.416896 2580 scope.go:117] "RemoveContainer" containerID="703c7c5e96dd4ab41c3002d382a71fe3a03a0145a26592f7f2f990e3b8dd751c" Jul 09 16:59:27.426100 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:27.426083 2580 scope.go:117] "RemoveContainer" containerID="703c7c5e96dd4ab41c3002d382a71fe3a03a0145a26592f7f2f990e3b8dd751c" Jul 09 16:59:27.426356 ip-10-0-128-34 kubenswrapper[2580]: E0709 16:59:27.426337 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"703c7c5e96dd4ab41c3002d382a71fe3a03a0145a26592f7f2f990e3b8dd751c\": container with ID starting with 703c7c5e96dd4ab41c3002d382a71fe3a03a0145a26592f7f2f990e3b8dd751c not found: ID does not exist" containerID="703c7c5e96dd4ab41c3002d382a71fe3a03a0145a26592f7f2f990e3b8dd751c" Jul 09 16:59:27.426416 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:27.426367 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"703c7c5e96dd4ab41c3002d382a71fe3a03a0145a26592f7f2f990e3b8dd751c"} err="failed to get container status \"703c7c5e96dd4ab41c3002d382a71fe3a03a0145a26592f7f2f990e3b8dd751c\": rpc error: code = NotFound desc = could not find container \"703c7c5e96dd4ab41c3002d382a71fe3a03a0145a26592f7f2f990e3b8dd751c\": container with ID starting with 703c7c5e96dd4ab41c3002d382a71fe3a03a0145a26592f7f2f990e3b8dd751c not found: ID does not exist" Jul 09 16:59:27.437848 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:27.437827 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9ggm2"] Jul 09 16:59:27.441436 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:27.441416 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-9ggm2"] Jul 09 16:59:28.177128 ip-10-0-128-34 kubenswrapper[2580]: I0709 16:59:28.177085 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76000b55-a233-4177-bb4b-0139cd92d079" path="/var/lib/kubelet/pods/76000b55-a233-4177-bb4b-0139cd92d079/volumes" Jul 09 17:00:07.359412 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:07.359376 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zndwp"] Jul 09 17:00:07.359854 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:07.359672 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76000b55-a233-4177-bb4b-0139cd92d079" containerName="authorino" Jul 09 17:00:07.359854 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:07.359682 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="76000b55-a233-4177-bb4b-0139cd92d079" containerName="authorino" Jul 09 17:00:07.359854 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:07.359746 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="76000b55-a233-4177-bb4b-0139cd92d079" containerName="authorino" Jul 09 17:00:07.362120 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:07.362103 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-zndwp" Jul 09 17:00:07.364438 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:07.364413 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-l6sqb\"" Jul 09 17:00:07.364560 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:07.364451 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 09 17:00:07.372964 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:07.372939 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zndwp"] Jul 09 17:00:07.399036 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:07.399001 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jjx8\" (UniqueName: \"kubernetes.io/projected/93485444-b733-447c-8fc9-9b89a1894724-kube-api-access-8jjx8\") pod \"payload-processing-58f86c7798-zndwp\" (UID: \"93485444-b733-447c-8fc9-9b89a1894724\") " pod="openshift-ingress/payload-processing-58f86c7798-zndwp" Jul 09 17:00:07.399167 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:07.399051 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93485444-b733-447c-8fc9-9b89a1894724-plugins-config-volume\") pod \"payload-processing-58f86c7798-zndwp\" (UID: \"93485444-b733-447c-8fc9-9b89a1894724\") " pod="openshift-ingress/payload-processing-58f86c7798-zndwp" Jul 09 17:00:07.499643 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:07.499602 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93485444-b733-447c-8fc9-9b89a1894724-plugins-config-volume\") pod \"payload-processing-58f86c7798-zndwp\" (UID: \"93485444-b733-447c-8fc9-9b89a1894724\") " pod="openshift-ingress/payload-processing-58f86c7798-zndwp" Jul 09 17:00:07.499809 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:07.499726 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jjx8\" (UniqueName: \"kubernetes.io/projected/93485444-b733-447c-8fc9-9b89a1894724-kube-api-access-8jjx8\") pod \"payload-processing-58f86c7798-zndwp\" (UID: \"93485444-b733-447c-8fc9-9b89a1894724\") " pod="openshift-ingress/payload-processing-58f86c7798-zndwp" Jul 09 17:00:07.500292 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:07.500255 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93485444-b733-447c-8fc9-9b89a1894724-plugins-config-volume\") pod \"payload-processing-58f86c7798-zndwp\" (UID: \"93485444-b733-447c-8fc9-9b89a1894724\") " pod="openshift-ingress/payload-processing-58f86c7798-zndwp" Jul 09 17:00:07.508455 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:07.508425 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jjx8\" (UniqueName: \"kubernetes.io/projected/93485444-b733-447c-8fc9-9b89a1894724-kube-api-access-8jjx8\") pod \"payload-processing-58f86c7798-zndwp\" (UID: \"93485444-b733-447c-8fc9-9b89a1894724\") " pod="openshift-ingress/payload-processing-58f86c7798-zndwp" Jul 09 17:00:07.673379 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:07.673255 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-zndwp" Jul 09 17:00:07.807690 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:07.807665 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zndwp"] Jul 09 17:00:07.809818 ip-10-0-128-34 kubenswrapper[2580]: W0709 17:00:07.809786 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93485444_b733_447c_8fc9_9b89a1894724.slice/crio-94a751937d6461d90141feaf77ac0665b5daf970f07ec3790c5909e1bfa2226d WatchSource:0}: Error finding container 94a751937d6461d90141feaf77ac0665b5daf970f07ec3790c5909e1bfa2226d: Status 404 returned error can't find the container with id 94a751937d6461d90141feaf77ac0665b5daf970f07ec3790c5909e1bfa2226d Jul 09 17:00:08.619825 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:08.619785 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-zndwp" event={"ID":"93485444-b733-447c-8fc9-9b89a1894724","Type":"ContainerStarted","Data":"94a751937d6461d90141feaf77ac0665b5daf970f07ec3790c5909e1bfa2226d"} Jul 09 17:00:10.633452 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:10.633411 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-zndwp" event={"ID":"93485444-b733-447c-8fc9-9b89a1894724","Type":"ContainerStarted","Data":"76d8ebdb56b99cb72f24f779317bdcd5bc3a90f4be66a3afc13672fe4569661b"} Jul 09 17:00:10.633865 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:10.633510 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-zndwp" Jul 09 17:00:10.649081 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:10.649027 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-zndwp" podStartSLOduration=1.2218337240000001 podStartE2EDuration="3.649009459s" totalImagesPullingTime="2.427175735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:00:10.647388383 +0000 UTC m=+549.012140311" watchObservedRunningTime="2026-07-09 17:00:10.649009459 +0000 UTC m=+549.013761376" Jul 09 17:00:15.660932 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:15.660899 2580 generic.go:356] "Generic (PLEG): container finished" podID="121993ca-d4de-4580-ba70-1c090b685455" containerID="a9a973588bdbbc1db61f19fd5c93a36f875eb8a7a6a61c30d2881a4dfaada42a" exitCode=0 Jul 09 17:00:15.661396 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:15.660975 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" event={"ID":"121993ca-d4de-4580-ba70-1c090b685455","Type":"ContainerDied","Data":"a9a973588bdbbc1db61f19fd5c93a36f875eb8a7a6a61c30d2881a4dfaada42a"} Jul 09 17:00:15.661469 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:15.661451 2580 scope.go:117] "RemoveContainer" containerID="a9a973588bdbbc1db61f19fd5c93a36f875eb8a7a6a61c30d2881a4dfaada42a" Jul 09 17:00:15.662418 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:15.662388 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:00:15.662522 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:15.662472 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:00:15.662584 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:15.662523 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:00:16.668234 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:16.668194 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" event={"ID":"121993ca-d4de-4580-ba70-1c090b685455","Type":"ContainerStarted","Data":"7fbbdd0a6e0f8b4363aaf1d7218a721bfbe9c00dfe00a106ae930209bc0916b0"} Jul 09 17:00:17.539401 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:17.539357 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 17:00:17.540596 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:17.540564 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-pgtzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 09 17:00:17.540716 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:17.540622 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" podUID="121993ca-d4de-4580-ba70-1c090b685455" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 09 17:00:18.540134 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:18.540089 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-pgtzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 09 17:00:18.540664 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:18.540167 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" podUID="121993ca-d4de-4580-ba70-1c090b685455" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 09 17:00:19.539338 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:19.539262 2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-pgtzg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 09 17:00:19.539529 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:19.539358 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" podUID="121993ca-d4de-4580-ba70-1c090b685455" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 09 17:00:20.225322 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:20.225263 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 17:00:20.543510 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:20.543425 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 17:00:20.687643 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:20.687615 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pgtzg" Jul 09 17:00:21.642054 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:21.642026 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-zndwp" Jul 09 17:00:29.339934 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:29.339896 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt"] Jul 09 17:00:29.343494 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:29.343470 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt" Jul 09 17:00:29.346642 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:29.346619 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 17:00:29.346765 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:29.346645 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 17:00:29.346765 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:29.346619 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 09 17:00:29.346765 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:29.346699 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sl724\"" Jul 09 17:00:29.353608 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:29.353582 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt"] Jul 09 17:00:29.402209 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:29.402177 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sh4dt\" (UID: \"0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt" Jul 09 17:00:29.402394 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:29.402218 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8zwp\" (UniqueName: \"kubernetes.io/projected/0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a-kube-api-access-f8zwp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sh4dt\" (UID: \"0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt" Jul 09 17:00:29.402394 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:29.402244 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sh4dt\" (UID: \"0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt" Jul 09 17:00:29.402394 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:29.402308 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sh4dt\" (UID: \"0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt" Jul 09 17:00:29.402505 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:29.402422 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sh4dt\" (UID: \"0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt" Jul 09 17:00:29.402505 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:29.402444 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sh4dt\" (UID: \"0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt" Jul 09 17:00:29.503972 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:29.503921 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sh4dt\" (UID: \"0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt" Jul 09 17:00:29.504150 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:29.503982 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8zwp\" (UniqueName: \"kubernetes.io/projected/0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a-kube-api-access-f8zwp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sh4dt\" (UID: \"0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt" Jul 09 17:00:29.504150 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:29.504019 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sh4dt\" (UID: \"0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt" Jul 09 17:00:29.504150 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:29.504044 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sh4dt\" (UID: \"0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt" Jul 09 17:00:29.504150 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:29.504139 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sh4dt\" (UID: \"0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt" Jul 09 17:00:29.504379 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:29.504170 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sh4dt\" (UID: \"0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt" Jul 09 17:00:29.504532 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:29.504502 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sh4dt\" (UID: \"0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt" Jul 09 17:00:29.504658 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:29.504546 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sh4dt\" (UID: \"0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt" Jul 09 17:00:29.504731 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:29.504706 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sh4dt\" (UID: \"0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt" Jul 09 17:00:29.506926 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:29.506898 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sh4dt\" (UID: \"0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt" Jul 09 17:00:29.507319 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:29.507274 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sh4dt\" (UID: \"0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt" Jul 09 17:00:29.511220 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:29.511189 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8zwp\" (UniqueName: \"kubernetes.io/projected/0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a-kube-api-access-f8zwp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-sh4dt\" (UID: \"0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt" Jul 09 17:00:29.656476 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:29.656427 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt" Jul 09 17:00:29.794392 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:29.794365 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt"] Jul 09 17:00:29.795920 ip-10-0-128-34 kubenswrapper[2580]: W0709 17:00:29.795890 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ab8cb1b_bf79_4c57_bc21_8c2db4f7402a.slice/crio-2f0bea0d4bf9f26572d09bc5b23f2ab7723f961a817377f3fdc62aea6ddc55ff WatchSource:0}: Error finding container 2f0bea0d4bf9f26572d09bc5b23f2ab7723f961a817377f3fdc62aea6ddc55ff: Status 404 returned error can't find the container with id 2f0bea0d4bf9f26572d09bc5b23f2ab7723f961a817377f3fdc62aea6ddc55ff Jul 09 17:00:30.744165 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:30.744124 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt" event={"ID":"0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a","Type":"ContainerStarted","Data":"2f0bea0d4bf9f26572d09bc5b23f2ab7723f961a817377f3fdc62aea6ddc55ff"} Jul 09 17:00:33.761098 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:33.761059 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt" event={"ID":"0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a","Type":"ContainerStarted","Data":"da9f16e069f41146a63e084ba9b71747b29603120a461f3b48501134dcc2fbd0"} Jul 09 17:00:33.782299 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:33.782219 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt" podStartSLOduration=1.5397349660000001 podStartE2EDuration="4.7821989s" totalImagesPullingTime="3.242463934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:00:33.778863553 +0000 UTC m=+572.143615466" watchObservedRunningTime="2026-07-09 17:00:33.7821989 +0000 UTC m=+572.146950820" Jul 09 17:00:38.832741 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:38.832705 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9"] Jul 09 17:00:38.835787 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:38.835768 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9" Jul 09 17:00:38.839200 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:38.839176 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 09 17:00:38.847112 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:38.847084 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9"] Jul 09 17:00:38.985684 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:38.985649 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d78255-3fa1-47e1-bd61-b3a97ff59c9e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vvv9\" (UID: \"56d78255-3fa1-47e1-bd61-b3a97ff59c9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9" Jul 09 17:00:38.985684 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:38.985686 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d78255-3fa1-47e1-bd61-b3a97ff59c9e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vvv9\" (UID: \"56d78255-3fa1-47e1-bd61-b3a97ff59c9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9" Jul 09 17:00:38.985899 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:38.985720 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d78255-3fa1-47e1-bd61-b3a97ff59c9e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vvv9\" (UID: \"56d78255-3fa1-47e1-bd61-b3a97ff59c9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9" Jul 09 17:00:38.985899 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:38.985788 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbzcr\" (UniqueName: \"kubernetes.io/projected/56d78255-3fa1-47e1-bd61-b3a97ff59c9e-kube-api-access-xbzcr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vvv9\" (UID: \"56d78255-3fa1-47e1-bd61-b3a97ff59c9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9" Jul 09 17:00:38.985969 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:38.985910 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d78255-3fa1-47e1-bd61-b3a97ff59c9e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vvv9\" (UID: \"56d78255-3fa1-47e1-bd61-b3a97ff59c9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9" Jul 09 17:00:38.985969 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:38.985953 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d78255-3fa1-47e1-bd61-b3a97ff59c9e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vvv9\" (UID: \"56d78255-3fa1-47e1-bd61-b3a97ff59c9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9" Jul 09 17:00:39.086676 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:39.086589 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d78255-3fa1-47e1-bd61-b3a97ff59c9e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vvv9\" (UID: \"56d78255-3fa1-47e1-bd61-b3a97ff59c9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9" Jul 09 17:00:39.086676 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:39.086641 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d78255-3fa1-47e1-bd61-b3a97ff59c9e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vvv9\" (UID: \"56d78255-3fa1-47e1-bd61-b3a97ff59c9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9" Jul 09 17:00:39.086676 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:39.086670 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d78255-3fa1-47e1-bd61-b3a97ff59c9e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vvv9\" (UID: \"56d78255-3fa1-47e1-bd61-b3a97ff59c9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9" Jul 09 17:00:39.086907 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:39.086687 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d78255-3fa1-47e1-bd61-b3a97ff59c9e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vvv9\" (UID: \"56d78255-3fa1-47e1-bd61-b3a97ff59c9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9" Jul 09 17:00:39.086907 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:39.086718 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d78255-3fa1-47e1-bd61-b3a97ff59c9e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vvv9\" (UID: \"56d78255-3fa1-47e1-bd61-b3a97ff59c9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9" Jul 09 17:00:39.086907 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:39.086733 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbzcr\" (UniqueName: \"kubernetes.io/projected/56d78255-3fa1-47e1-bd61-b3a97ff59c9e-kube-api-access-xbzcr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vvv9\" (UID: \"56d78255-3fa1-47e1-bd61-b3a97ff59c9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9" Jul 09 17:00:39.087050 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:39.087016 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56d78255-3fa1-47e1-bd61-b3a97ff59c9e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vvv9\" (UID: \"56d78255-3fa1-47e1-bd61-b3a97ff59c9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9" Jul 09 17:00:39.087128 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:39.087061 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56d78255-3fa1-47e1-bd61-b3a97ff59c9e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vvv9\" (UID: \"56d78255-3fa1-47e1-bd61-b3a97ff59c9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9" Jul 09 17:00:39.087216 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:39.087195 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56d78255-3fa1-47e1-bd61-b3a97ff59c9e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vvv9\" (UID: \"56d78255-3fa1-47e1-bd61-b3a97ff59c9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9" Jul 09 17:00:39.089216 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:39.089199 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56d78255-3fa1-47e1-bd61-b3a97ff59c9e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vvv9\" (UID: \"56d78255-3fa1-47e1-bd61-b3a97ff59c9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9" Jul 09 17:00:39.089355 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:39.089337 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56d78255-3fa1-47e1-bd61-b3a97ff59c9e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vvv9\" (UID: \"56d78255-3fa1-47e1-bd61-b3a97ff59c9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9" Jul 09 17:00:39.095274 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:39.095248 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbzcr\" (UniqueName: \"kubernetes.io/projected/56d78255-3fa1-47e1-bd61-b3a97ff59c9e-kube-api-access-xbzcr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4vvv9\" (UID: \"56d78255-3fa1-47e1-bd61-b3a97ff59c9e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9" Jul 09 17:00:39.148304 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:39.148246 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9" Jul 09 17:00:39.283469 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:39.283438 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9"] Jul 09 17:00:39.285738 ip-10-0-128-34 kubenswrapper[2580]: W0709 17:00:39.285706 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d78255_3fa1_47e1_bd61_b3a97ff59c9e.slice/crio-0330afe0ec05a7da99379d2c6c70d4b094d6c3df03019e4eb201f6064f5c8814 WatchSource:0}: Error finding container 0330afe0ec05a7da99379d2c6c70d4b094d6c3df03019e4eb201f6064f5c8814: Status 404 returned error can't find the container with id 0330afe0ec05a7da99379d2c6c70d4b094d6c3df03019e4eb201f6064f5c8814 Jul 09 17:00:39.657169 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:39.657127 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt" Jul 09 17:00:39.657350 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:39.657202 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt" Jul 09 17:00:39.669877 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:39.669850 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt" Jul 09 17:00:39.790179 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:39.790141 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9" event={"ID":"56d78255-3fa1-47e1-bd61-b3a97ff59c9e","Type":"ContainerStarted","Data":"0330afe0ec05a7da99379d2c6c70d4b094d6c3df03019e4eb201f6064f5c8814"} Jul 09 17:00:39.801445 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:39.801418 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-sh4dt" Jul 09 17:00:40.796783 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:40.796746 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9" event={"ID":"56d78255-3fa1-47e1-bd61-b3a97ff59c9e","Type":"ContainerStarted","Data":"b293a46c763d83cf557e2e01084526be768a7702568048546a063ec051f29a5c"} Jul 09 17:00:40.814782 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:40.814730 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9" podStartSLOduration=1.9465960089999998 podStartE2EDuration="2.814711733s" totalImagesPullingTime="868.115724ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:00:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:00:40.813512241 +0000 UTC m=+579.178264171" watchObservedRunningTime="2026-07-09 17:00:40.814711733 +0000 UTC m=+579.179463706" Jul 09 17:00:49.148964 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:49.148913 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9" Jul 09 17:00:49.149451 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:49.148999 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9" Jul 09 17:00:49.161411 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:49.161385 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9" Jul 09 17:00:49.858327 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:00:49.858269 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4vvv9" Jul 09 17:01:02.089182 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:01:02.089152 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pcwtl_12995bc0-2245-4f06-aad5-b496fd24f0b1/ovn-acl-logging/0.log" Jul 09 17:01:02.089648 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:01:02.089373 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pcwtl_12995bc0-2245-4f06-aad5-b496fd24f0b1/ovn-acl-logging/0.log" Jul 09 17:06:02.122326 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:06:02.122275 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pcwtl_12995bc0-2245-4f06-aad5-b496fd24f0b1/ovn-acl-logging/0.log" Jul 09 17:06:02.122991 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:06:02.122973 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pcwtl_12995bc0-2245-4f06-aad5-b496fd24f0b1/ovn-acl-logging/0.log" Jul 09 17:11:02.159727 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:11:02.159697 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pcwtl_12995bc0-2245-4f06-aad5-b496fd24f0b1/ovn-acl-logging/0.log" Jul 09 17:11:02.161316 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:11:02.160871 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pcwtl_12995bc0-2245-4f06-aad5-b496fd24f0b1/ovn-acl-logging/0.log" Jul 09 17:15:00.137832 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:00.137753 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726955-wzkdc"] Jul 09 17:15:00.140016 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:00.139994 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726955-wzkdc" Jul 09 17:15:00.142426 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:00.142403 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 09 17:15:00.142879 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:00.142852 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-whstr\"" Jul 09 17:15:00.142969 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:00.142877 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 09 17:15:00.159172 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:00.159144 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zhtp\" (UniqueName: \"kubernetes.io/projected/04cfd7fa-b808-4f11-ab40-940b741ec962-kube-api-access-7zhtp\") pod \"maas-api-key-cleanup-29726955-wzkdc\" (UID: \"04cfd7fa-b808-4f11-ab40-940b741ec962\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726955-wzkdc" Jul 09 17:15:00.159414 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:00.159395 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726955-wzkdc"] Jul 09 17:15:00.260267 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:00.260223 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zhtp\" (UniqueName: \"kubernetes.io/projected/04cfd7fa-b808-4f11-ab40-940b741ec962-kube-api-access-7zhtp\") pod \"maas-api-key-cleanup-29726955-wzkdc\" (UID: \"04cfd7fa-b808-4f11-ab40-940b741ec962\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726955-wzkdc" Jul 09 17:15:00.268009 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:00.267978 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zhtp\" (UniqueName: \"kubernetes.io/projected/04cfd7fa-b808-4f11-ab40-940b741ec962-kube-api-access-7zhtp\") pod \"maas-api-key-cleanup-29726955-wzkdc\" (UID: \"04cfd7fa-b808-4f11-ab40-940b741ec962\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726955-wzkdc" Jul 09 17:15:00.449445 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:00.449350 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726955-wzkdc" Jul 09 17:15:00.582366 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:00.582342 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726955-wzkdc"] Jul 09 17:15:00.584107 ip-10-0-128-34 kubenswrapper[2580]: W0709 17:15:00.584078 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04cfd7fa_b808_4f11_ab40_940b741ec962.slice/crio-ed771c478e0c3c64f4ff0e7a48551a0e699644c5a1f56704837da162076e8c52 WatchSource:0}: Error finding container ed771c478e0c3c64f4ff0e7a48551a0e699644c5a1f56704837da162076e8c52: Status 404 returned error can't find the container with id ed771c478e0c3c64f4ff0e7a48551a0e699644c5a1f56704837da162076e8c52 Jul 09 17:15:00.586438 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:00.586422 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 17:15:01.017225 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:01.017190 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726955-wzkdc" event={"ID":"04cfd7fa-b808-4f11-ab40-940b741ec962","Type":"ContainerStarted","Data":"ed771c478e0c3c64f4ff0e7a48551a0e699644c5a1f56704837da162076e8c52"} Jul 09 17:15:05.048509 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:05.048469 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726955-wzkdc" event={"ID":"04cfd7fa-b808-4f11-ab40-940b741ec962","Type":"ContainerStarted","Data":"cd920df36012bc85e0c5fe4238395026c870c9192590809aa6bf17812fd7d935"} Jul 09 17:15:05.063993 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:05.063945 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726955-wzkdc" podStartSLOduration=1.537155717 podStartE2EDuration="5.063928328s" totalImagesPullingTime="3.526772611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:15:05.06218295 +0000 UTC m=+1443.426934890" watchObservedRunningTime="2026-07-09 17:15:05.063928328 +0000 UTC m=+1443.428680295" Jul 09 17:15:32.458900 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.458852 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb"] Jul 09 17:15:32.461700 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.461677 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.463963 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.463938 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-720e00d5-openshift-default-dockercfg-tmtkb\"" Jul 09 17:15:32.473511 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.473471 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb"] Jul 09 17:15:32.532801 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.532761 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-credential-socket\") pod \"e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.532801 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.532801 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istio-podinfo\") pod \"e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.533041 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.532819 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfk98\" (UniqueName: \"kubernetes.io/projected/36bdee3b-ff1d-42f4-b803-67d64f911e3a-kube-api-access-cfk98\") pod \"e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.533041 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.532922 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-workload-socket\") pod \"e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.533041 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.532948 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istio-envoy\") pod \"e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.533041 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.532980 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istio-data\") pod \"e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.533041 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.533005 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istiod-ca-cert\") pod \"e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.533222 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.533043 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-workload-certs\") pod \"e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.533222 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.533061 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istio-token\") pod \"e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.634224 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.634180 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-credential-socket\") pod \"e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.634224 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.634223 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istio-podinfo\") pod \"e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.634468 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.634241 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfk98\" (UniqueName: \"kubernetes.io/projected/36bdee3b-ff1d-42f4-b803-67d64f911e3a-kube-api-access-cfk98\") pod \"e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.634468 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.634275 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-workload-socket\") pod \"e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.634468 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.634336 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istio-envoy\") pod \"e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.634468 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.634373 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istio-data\") pod \"e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.634739 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.634526 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istiod-ca-cert\") pod \"e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.634739 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.634610 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-workload-certs\") pod \"e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.634739 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.634640 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istio-token\") pod \"e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.634739 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.634727 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-credential-socket\") pod \"e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.634935 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.634765 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-workload-socket\") pod \"e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.634935 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.634810 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istio-data\") pod \"e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.635025 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.634984 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-workload-certs\") pod \"e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.635231 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.635213 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istiod-ca-cert\") pod \"e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.636733 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.636702 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istio-envoy\") pod \"e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.636982 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.636962 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istio-podinfo\") pod \"e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.645735 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.645711 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istio-token\") pod \"e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.646917 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.646893 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfk98\" (UniqueName: \"kubernetes.io/projected/36bdee3b-ff1d-42f4-b803-67d64f911e3a-kube-api-access-cfk98\") pod \"e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.776210 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.776135 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:32.913214 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.913188 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb"] Jul 09 17:15:32.915048 ip-10-0-128-34 kubenswrapper[2580]: W0709 17:15:32.915024 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36bdee3b_ff1d_42f4_b803_67d64f911e3a.slice/crio-3d18c59621ed8fa3e115e7ed6922ac4c2a846d75ed97e9e026952285bb31a6cf WatchSource:0}: Error finding container 3d18c59621ed8fa3e115e7ed6922ac4c2a846d75ed97e9e026952285bb31a6cf: Status 404 returned error can't find the container with id 3d18c59621ed8fa3e115e7ed6922ac4c2a846d75ed97e9e026952285bb31a6cf Jul 09 17:15:32.917119 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.917087 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:15:32.917171 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.917154 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:15:32.917206 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:32.917181 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:15:33.200933 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:33.200894 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" event={"ID":"36bdee3b-ff1d-42f4-b803-67d64f911e3a","Type":"ContainerStarted","Data":"409cdd97e680a18efe1f66012b889cb1fdf9c3107272cbfed6fab90157c837fe"} Jul 09 17:15:33.201108 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:33.200958 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" event={"ID":"36bdee3b-ff1d-42f4-b803-67d64f911e3a","Type":"ContainerStarted","Data":"3d18c59621ed8fa3e115e7ed6922ac4c2a846d75ed97e9e026952285bb31a6cf"} Jul 09 17:15:33.225844 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:33.225791 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" podStartSLOduration=1.225775013 podStartE2EDuration="1.225775013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:15:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:15:33.223992439 +0000 UTC m=+1471.588744355" watchObservedRunningTime="2026-07-09 17:15:33.225775013 +0000 UTC m=+1471.590526929" Jul 09 17:15:33.776342 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:33.776305 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:33.781275 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:33.781249 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:34.205827 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:34.205799 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:34.206763 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:34.206741 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:38.894569 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:38.894536 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb"] Jul 09 17:15:38.894986 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:38.894719 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" podUID="36bdee3b-ff1d-42f4-b803-67d64f911e3a" containerName="istio-proxy" containerID="cri-o://409cdd97e680a18efe1f66012b889cb1fdf9c3107272cbfed6fab90157c837fe" gracePeriod=30 Jul 09 17:15:44.147395 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.147368 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:44.231778 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.231682 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-workload-socket\") pod \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " Jul 09 17:15:44.231778 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.231741 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfk98\" (UniqueName: \"kubernetes.io/projected/36bdee3b-ff1d-42f4-b803-67d64f911e3a-kube-api-access-cfk98\") pod \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " Jul 09 17:15:44.232011 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.231798 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istio-data\") pod \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " Jul 09 17:15:44.232011 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.231826 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istio-podinfo\") pod \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " Jul 09 17:15:44.232011 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.231883 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istio-token\") pod \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " Jul 09 17:15:44.232011 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.231908 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-workload-certs\") pod \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " Jul 09 17:15:44.232011 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.231935 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-credential-socket\") pod \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " Jul 09 17:15:44.232011 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.231932 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "36bdee3b-ff1d-42f4-b803-67d64f911e3a" (UID: "36bdee3b-ff1d-42f4-b803-67d64f911e3a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:15:44.232011 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.231990 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istiod-ca-cert\") pod \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " Jul 09 17:15:44.232428 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.232033 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istio-envoy\") pod \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\" (UID: \"36bdee3b-ff1d-42f4-b803-67d64f911e3a\") " Jul 09 17:15:44.232428 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.232124 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istio-data" (OuterVolumeSpecName: "istio-data") pod "36bdee3b-ff1d-42f4-b803-67d64f911e3a" (UID: "36bdee3b-ff1d-42f4-b803-67d64f911e3a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:15:44.232428 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.232242 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "36bdee3b-ff1d-42f4-b803-67d64f911e3a" (UID: "36bdee3b-ff1d-42f4-b803-67d64f911e3a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:15:44.232428 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.232405 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-workload-socket\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:15:44.232428 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.232426 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istio-data\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:15:44.232680 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.232440 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-credential-socket\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:15:44.232680 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.232528 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "36bdee3b-ff1d-42f4-b803-67d64f911e3a" (UID: "36bdee3b-ff1d-42f4-b803-67d64f911e3a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:15:44.232783 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.232605 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "36bdee3b-ff1d-42f4-b803-67d64f911e3a" (UID: "36bdee3b-ff1d-42f4-b803-67d64f911e3a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:15:44.234360 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.234326 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36bdee3b-ff1d-42f4-b803-67d64f911e3a-kube-api-access-cfk98" (OuterVolumeSpecName: "kube-api-access-cfk98") pod "36bdee3b-ff1d-42f4-b803-67d64f911e3a" (UID: "36bdee3b-ff1d-42f4-b803-67d64f911e3a"). InnerVolumeSpecName "kube-api-access-cfk98". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:15:44.234360 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.234343 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istio-token" (OuterVolumeSpecName: "istio-token") pod "36bdee3b-ff1d-42f4-b803-67d64f911e3a" (UID: "36bdee3b-ff1d-42f4-b803-67d64f911e3a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:15:44.234508 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.234357 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "36bdee3b-ff1d-42f4-b803-67d64f911e3a" (UID: "36bdee3b-ff1d-42f4-b803-67d64f911e3a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 17:15:44.234508 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.234435 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "36bdee3b-ff1d-42f4-b803-67d64f911e3a" (UID: "36bdee3b-ff1d-42f4-b803-67d64f911e3a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:15:44.254140 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.254113 2580 generic.go:356] "Generic (PLEG): container finished" podID="36bdee3b-ff1d-42f4-b803-67d64f911e3a" containerID="409cdd97e680a18efe1f66012b889cb1fdf9c3107272cbfed6fab90157c837fe" exitCode=0 Jul 09 17:15:44.254256 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.254154 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" Jul 09 17:15:44.254256 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.254150 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" event={"ID":"36bdee3b-ff1d-42f4-b803-67d64f911e3a","Type":"ContainerDied","Data":"409cdd97e680a18efe1f66012b889cb1fdf9c3107272cbfed6fab90157c837fe"} Jul 09 17:15:44.254397 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.254268 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb" event={"ID":"36bdee3b-ff1d-42f4-b803-67d64f911e3a","Type":"ContainerDied","Data":"3d18c59621ed8fa3e115e7ed6922ac4c2a846d75ed97e9e026952285bb31a6cf"} Jul 09 17:15:44.254397 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.254324 2580 scope.go:117] "RemoveContainer" containerID="409cdd97e680a18efe1f66012b889cb1fdf9c3107272cbfed6fab90157c837fe" Jul 09 17:15:44.263770 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.263752 2580 scope.go:117] "RemoveContainer" containerID="409cdd97e680a18efe1f66012b889cb1fdf9c3107272cbfed6fab90157c837fe" Jul 09 17:15:44.264035 ip-10-0-128-34 kubenswrapper[2580]: E0709 17:15:44.264017 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"409cdd97e680a18efe1f66012b889cb1fdf9c3107272cbfed6fab90157c837fe\": container with ID starting with 409cdd97e680a18efe1f66012b889cb1fdf9c3107272cbfed6fab90157c837fe not found: ID does not exist" containerID="409cdd97e680a18efe1f66012b889cb1fdf9c3107272cbfed6fab90157c837fe" Jul 09 17:15:44.264087 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.264044 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"409cdd97e680a18efe1f66012b889cb1fdf9c3107272cbfed6fab90157c837fe"} err="failed to get container status \"409cdd97e680a18efe1f66012b889cb1fdf9c3107272cbfed6fab90157c837fe\": rpc error: code = NotFound desc = could not find container \"409cdd97e680a18efe1f66012b889cb1fdf9c3107272cbfed6fab90157c837fe\": container with ID starting with 409cdd97e680a18efe1f66012b889cb1fdf9c3107272cbfed6fab90157c837fe not found: ID does not exist" Jul 09 17:15:44.275669 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.275648 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb"] Jul 09 17:15:44.279681 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.279656 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-720e00d5-openshift-default-696dbdf657-lsknb"] Jul 09 17:15:44.333809 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.333778 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istio-envoy\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:15:44.333809 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.333804 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfk98\" (UniqueName: \"kubernetes.io/projected/36bdee3b-ff1d-42f4-b803-67d64f911e3a-kube-api-access-cfk98\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:15:44.333809 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.333814 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istio-podinfo\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:15:44.334036 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.333826 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istio-token\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:15:44.334036 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.333834 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36bdee3b-ff1d-42f4-b803-67d64f911e3a-workload-certs\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:15:44.334036 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.333843 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36bdee3b-ff1d-42f4-b803-67d64f911e3a-istiod-ca-cert\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:15:44.817148 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.817103 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng"] Jul 09 17:15:44.817525 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.817509 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36bdee3b-ff1d-42f4-b803-67d64f911e3a" containerName="istio-proxy" Jul 09 17:15:44.817575 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.817527 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="36bdee3b-ff1d-42f4-b803-67d64f911e3a" containerName="istio-proxy" Jul 09 17:15:44.817618 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.817598 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="36bdee3b-ff1d-42f4-b803-67d64f911e3a" containerName="istio-proxy" Jul 09 17:15:44.821011 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.820992 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:44.823246 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.823227 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a6f26a7e-openshift-default-dockercfg-8s7d7\"" Jul 09 17:15:44.833560 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.833536 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng"] Jul 09 17:15:44.939064 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.939020 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-workload-socket\") pod \"e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:44.939064 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.939066 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/886c51eb-f540-4f88-ab91-2b3688b531a1-istiod-ca-cert\") pod \"e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:44.939332 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.939167 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/886c51eb-f540-4f88-ab91-2b3688b531a1-istio-token\") pod \"e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:44.939332 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.939224 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/886c51eb-f540-4f88-ab91-2b3688b531a1-istio-podinfo\") pod \"e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:44.939332 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.939258 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbqhv\" (UniqueName: \"kubernetes.io/projected/886c51eb-f540-4f88-ab91-2b3688b531a1-kube-api-access-pbqhv\") pod \"e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:44.939332 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.939318 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-istio-data\") pod \"e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:44.939496 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.939370 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-credential-socket\") pod \"e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:44.939496 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.939453 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-workload-certs\") pod \"e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:44.939496 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:44.939481 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-istio-envoy\") pod \"e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:45.040534 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:45.040499 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-credential-socket\") pod \"e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:45.040724 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:45.040568 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-workload-certs\") pod \"e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:45.040724 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:45.040600 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-istio-envoy\") pod \"e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:45.040724 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:45.040654 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-workload-socket\") pod \"e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:45.040724 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:45.040679 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/886c51eb-f540-4f88-ab91-2b3688b531a1-istiod-ca-cert\") pod \"e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:45.040930 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:45.040736 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/886c51eb-f540-4f88-ab91-2b3688b531a1-istio-token\") pod \"e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:45.040930 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:45.040772 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/886c51eb-f540-4f88-ab91-2b3688b531a1-istio-podinfo\") pod \"e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:45.041023 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:45.040998 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-workload-certs\") pod \"e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:45.041138 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:45.041113 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbqhv\" (UniqueName: \"kubernetes.io/projected/886c51eb-f540-4f88-ab91-2b3688b531a1-kube-api-access-pbqhv\") pod \"e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:45.041201 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:45.041170 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-istio-data\") pod \"e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:45.041201 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:45.041168 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-workload-socket\") pod \"e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:45.041331 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:45.041273 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-credential-socket\") pod \"e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:45.041396 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:45.041385 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/886c51eb-f540-4f88-ab91-2b3688b531a1-istiod-ca-cert\") pod \"e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:45.041533 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:45.041514 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-istio-data\") pod \"e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:45.043009 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:45.042985 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-istio-envoy\") pod \"e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:45.043313 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:45.043275 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/886c51eb-f540-4f88-ab91-2b3688b531a1-istio-podinfo\") pod \"e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:45.048229 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:45.048197 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbqhv\" (UniqueName: \"kubernetes.io/projected/886c51eb-f540-4f88-ab91-2b3688b531a1-kube-api-access-pbqhv\") pod \"e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:45.048365 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:45.048275 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/886c51eb-f540-4f88-ab91-2b3688b531a1-istio-token\") pod \"e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:45.132036 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:45.132007 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:45.272328 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:45.272292 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng"] Jul 09 17:15:45.273744 ip-10-0-128-34 kubenswrapper[2580]: W0709 17:15:45.273713 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod886c51eb_f540_4f88_ab91_2b3688b531a1.slice/crio-2b515811d476cd0743822a8b5201a0666fc64b67ea7116def7a8584f161ff89b WatchSource:0}: Error finding container 2b515811d476cd0743822a8b5201a0666fc64b67ea7116def7a8584f161ff89b: Status 404 returned error can't find the container with id 2b515811d476cd0743822a8b5201a0666fc64b67ea7116def7a8584f161ff89b Jul 09 17:15:45.276100 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:45.276062 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:15:45.276164 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:45.276138 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:15:45.276243 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:45.276176 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:15:46.178125 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:46.178085 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36bdee3b-ff1d-42f4-b803-67d64f911e3a" path="/var/lib/kubelet/pods/36bdee3b-ff1d-42f4-b803-67d64f911e3a/volumes" Jul 09 17:15:46.266338 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:46.266297 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" event={"ID":"886c51eb-f540-4f88-ab91-2b3688b531a1","Type":"ContainerStarted","Data":"a15d42444a255efe4cd6d77769b29b194691279d4acc69f56f28084ff2189f71"} Jul 09 17:15:46.266508 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:46.266364 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" event={"ID":"886c51eb-f540-4f88-ab91-2b3688b531a1","Type":"ContainerStarted","Data":"2b515811d476cd0743822a8b5201a0666fc64b67ea7116def7a8584f161ff89b"} Jul 09 17:15:46.286648 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:46.286589 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" podStartSLOduration=2.286571391 podStartE2EDuration="2.286571391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:15:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:15:46.285450487 +0000 UTC m=+1484.650202418" watchObservedRunningTime="2026-07-09 17:15:46.286571391 +0000 UTC m=+1484.651323307" Jul 09 17:15:47.132199 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:47.132158 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:47.137542 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:47.137516 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:47.271300 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:47.271256 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:47.272384 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:47.272360 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:15:57.328362 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:57.328326 2580 generic.go:356] "Generic (PLEG): container finished" podID="886c51eb-f540-4f88-ab91-2b3688b531a1" containerID="a15d42444a255efe4cd6d77769b29b194691279d4acc69f56f28084ff2189f71" exitCode=0 Jul 09 17:15:57.328772 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:57.328398 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" event={"ID":"886c51eb-f540-4f88-ab91-2b3688b531a1","Type":"ContainerDied","Data":"a15d42444a255efe4cd6d77769b29b194691279d4acc69f56f28084ff2189f71"} Jul 09 17:15:57.328815 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:57.328781 2580 scope.go:117] "RemoveContainer" containerID="a15d42444a255efe4cd6d77769b29b194691279d4acc69f56f28084ff2189f71" Jul 09 17:15:57.329826 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:57.329795 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:15:57.329928 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:57.329877 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:15:57.329987 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:57.329925 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:15:57.368012 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:57.367910 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng"] Jul 09 17:15:58.335122 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:58.335086 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" event={"ID":"886c51eb-f540-4f88-ab91-2b3688b531a1","Type":"ContainerStarted","Data":"89cdd396c21786ee3b1fcf16c5f745d7069b797277e394ffa06ef0a845dc5675"} Jul 09 17:15:58.335576 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:15:58.335181 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" podUID="886c51eb-f540-4f88-ab91-2b3688b531a1" containerName="istio-proxy" containerID="cri-o://89cdd396c21786ee3b1fcf16c5f745d7069b797277e394ffa06ef0a845dc5675" gracePeriod=30 Jul 09 17:16:00.010095 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:00.010050 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726955-wzkdc"] Jul 09 17:16:00.010579 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:00.010312 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726955-wzkdc" podUID="04cfd7fa-b808-4f11-ab40-940b741ec962" containerName="cleanup" containerID="cri-o://cd920df36012bc85e0c5fe4238395026c870c9192590809aa6bf17812fd7d935" gracePeriod=30 Jul 09 17:16:02.196591 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:02.196560 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pcwtl_12995bc0-2245-4f06-aad5-b496fd24f0b1/ovn-acl-logging/0.log" Jul 09 17:16:02.197007 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:02.196786 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pcwtl_12995bc0-2245-4f06-aad5-b496fd24f0b1/ovn-acl-logging/0.log" Jul 09 17:16:02.271431 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:02.271403 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:16:03.460692 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.460658 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8"] Jul 09 17:16:03.464623 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.464596 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.467146 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.467126 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-8631fde9-openshift-default-dockercfg-gtng9\"" Jul 09 17:16:03.482425 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.482398 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8"] Jul 09 17:16:03.507086 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.507057 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fa07cc3-2339-4003-9150-42a51bf29ad1-istio-podinfo\") pod \"e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.507208 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.507093 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-istio-data\") pod \"e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.507208 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.507116 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fa07cc3-2339-4003-9150-42a51bf29ad1-istiod-ca-cert\") pod \"e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.507208 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.507135 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bddvk\" (UniqueName: \"kubernetes.io/projected/7fa07cc3-2339-4003-9150-42a51bf29ad1-kube-api-access-bddvk\") pod \"e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.507334 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.507224 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-workload-socket\") pod \"e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.507334 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.507318 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-workload-certs\") pod \"e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.507396 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.507368 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fa07cc3-2339-4003-9150-42a51bf29ad1-istio-token\") pod \"e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.507446 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.507430 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-credential-socket\") pod \"e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.507481 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.507463 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-istio-envoy\") pod \"e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.594695 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.594630 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:16:03.607921 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.607894 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fa07cc3-2339-4003-9150-42a51bf29ad1-istio-podinfo\") pod \"e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.608037 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.607930 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-istio-data\") pod \"e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.608037 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.607961 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fa07cc3-2339-4003-9150-42a51bf29ad1-istiod-ca-cert\") pod \"e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.608037 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.607991 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bddvk\" (UniqueName: \"kubernetes.io/projected/7fa07cc3-2339-4003-9150-42a51bf29ad1-kube-api-access-bddvk\") pod \"e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.608194 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.608042 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-workload-socket\") pod \"e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.608194 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.608111 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-workload-certs\") pod \"e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.608194 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.608155 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fa07cc3-2339-4003-9150-42a51bf29ad1-istio-token\") pod \"e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.608390 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.608328 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-istio-data\") pod \"e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.608451 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.608419 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-workload-socket\") pod \"e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.608512 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.608492 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-workload-certs\") pod \"e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.608575 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.608527 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-credential-socket\") pod \"e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.608627 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.608570 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-istio-envoy\") pod \"e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.608683 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.608630 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-credential-socket\") pod \"e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.608763 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.608743 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fa07cc3-2339-4003-9150-42a51bf29ad1-istiod-ca-cert\") pod \"e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.610715 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.610683 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fa07cc3-2339-4003-9150-42a51bf29ad1-istio-podinfo\") pod \"e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.610865 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.610850 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-istio-envoy\") pod \"e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.619683 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.619661 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bddvk\" (UniqueName: \"kubernetes.io/projected/7fa07cc3-2339-4003-9150-42a51bf29ad1-kube-api-access-bddvk\") pod \"e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.619842 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.619784 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fa07cc3-2339-4003-9150-42a51bf29ad1-istio-token\") pod \"e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.709765 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.709737 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/886c51eb-f540-4f88-ab91-2b3688b531a1-istio-podinfo\") pod \"886c51eb-f540-4f88-ab91-2b3688b531a1\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " Jul 09 17:16:03.709879 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.709774 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-credential-socket\") pod \"886c51eb-f540-4f88-ab91-2b3688b531a1\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " Jul 09 17:16:03.709879 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.709796 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-istio-envoy\") pod \"886c51eb-f540-4f88-ab91-2b3688b531a1\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " Jul 09 17:16:03.709879 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.709851 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbqhv\" (UniqueName: \"kubernetes.io/projected/886c51eb-f540-4f88-ab91-2b3688b531a1-kube-api-access-pbqhv\") pod \"886c51eb-f540-4f88-ab91-2b3688b531a1\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " Jul 09 17:16:03.710045 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.709900 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-istio-data\") pod \"886c51eb-f540-4f88-ab91-2b3688b531a1\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " Jul 09 17:16:03.710045 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.709933 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-workload-socket\") pod \"886c51eb-f540-4f88-ab91-2b3688b531a1\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " Jul 09 17:16:03.710045 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.709983 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-workload-certs\") pod \"886c51eb-f540-4f88-ab91-2b3688b531a1\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " Jul 09 17:16:03.710045 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.709999 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "886c51eb-f540-4f88-ab91-2b3688b531a1" (UID: "886c51eb-f540-4f88-ab91-2b3688b531a1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:16:03.710045 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.710013 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/886c51eb-f540-4f88-ab91-2b3688b531a1-istio-token\") pod \"886c51eb-f540-4f88-ab91-2b3688b531a1\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " Jul 09 17:16:03.710310 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.710068 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/886c51eb-f540-4f88-ab91-2b3688b531a1-istiod-ca-cert\") pod \"886c51eb-f540-4f88-ab91-2b3688b531a1\" (UID: \"886c51eb-f540-4f88-ab91-2b3688b531a1\") " Jul 09 17:16:03.710310 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.710215 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "886c51eb-f540-4f88-ab91-2b3688b531a1" (UID: "886c51eb-f540-4f88-ab91-2b3688b531a1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:16:03.710421 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.710389 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-workload-certs\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:16:03.710478 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.710439 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-credential-socket\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:16:03.710532 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.710500 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "886c51eb-f540-4f88-ab91-2b3688b531a1" (UID: "886c51eb-f540-4f88-ab91-2b3688b531a1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:16:03.710590 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.710574 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/886c51eb-f540-4f88-ab91-2b3688b531a1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "886c51eb-f540-4f88-ab91-2b3688b531a1" (UID: "886c51eb-f540-4f88-ab91-2b3688b531a1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:16:03.711039 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.711012 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-istio-data" (OuterVolumeSpecName: "istio-data") pod "886c51eb-f540-4f88-ab91-2b3688b531a1" (UID: "886c51eb-f540-4f88-ab91-2b3688b531a1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:16:03.712158 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.712130 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "886c51eb-f540-4f88-ab91-2b3688b531a1" (UID: "886c51eb-f540-4f88-ab91-2b3688b531a1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:16:03.712312 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.712270 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/886c51eb-f540-4f88-ab91-2b3688b531a1-istio-token" (OuterVolumeSpecName: "istio-token") pod "886c51eb-f540-4f88-ab91-2b3688b531a1" (UID: "886c51eb-f540-4f88-ab91-2b3688b531a1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:16:03.712413 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.712309 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/886c51eb-f540-4f88-ab91-2b3688b531a1-kube-api-access-pbqhv" (OuterVolumeSpecName: "kube-api-access-pbqhv") pod "886c51eb-f540-4f88-ab91-2b3688b531a1" (UID: "886c51eb-f540-4f88-ab91-2b3688b531a1"). InnerVolumeSpecName "kube-api-access-pbqhv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:16:03.712413 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.712317 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/886c51eb-f540-4f88-ab91-2b3688b531a1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "886c51eb-f540-4f88-ab91-2b3688b531a1" (UID: "886c51eb-f540-4f88-ab91-2b3688b531a1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 17:16:03.779096 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.779073 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:03.811646 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.811610 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/886c51eb-f540-4f88-ab91-2b3688b531a1-istio-token\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:16:03.811646 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.811650 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/886c51eb-f540-4f88-ab91-2b3688b531a1-istiod-ca-cert\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:16:03.811831 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.811666 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/886c51eb-f540-4f88-ab91-2b3688b531a1-istio-podinfo\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:16:03.811831 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.811679 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-istio-envoy\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:16:03.811831 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.811691 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbqhv\" (UniqueName: \"kubernetes.io/projected/886c51eb-f540-4f88-ab91-2b3688b531a1-kube-api-access-pbqhv\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:16:03.811831 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.811706 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-istio-data\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:16:03.811831 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.811718 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/886c51eb-f540-4f88-ab91-2b3688b531a1-workload-socket\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:16:03.922171 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.922143 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8"] Jul 09 17:16:03.923473 ip-10-0-128-34 kubenswrapper[2580]: W0709 17:16:03.923443 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fa07cc3_2339_4003_9150_42a51bf29ad1.slice/crio-cab5c6aca402086d1e9738da0e38de51c89b4a918a7ba21726a3d6267a4941f4 WatchSource:0}: Error finding container cab5c6aca402086d1e9738da0e38de51c89b4a918a7ba21726a3d6267a4941f4: Status 404 returned error can't find the container with id cab5c6aca402086d1e9738da0e38de51c89b4a918a7ba21726a3d6267a4941f4 Jul 09 17:16:03.925741 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.925708 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:16:03.925803 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.925772 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:16:03.925839 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:03.925801 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:16:04.366522 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:04.366484 2580 generic.go:356] "Generic (PLEG): container finished" podID="886c51eb-f540-4f88-ab91-2b3688b531a1" containerID="89cdd396c21786ee3b1fcf16c5f745d7069b797277e394ffa06ef0a845dc5675" exitCode=0 Jul 09 17:16:04.366683 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:04.366528 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" Jul 09 17:16:04.366683 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:04.366565 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" event={"ID":"886c51eb-f540-4f88-ab91-2b3688b531a1","Type":"ContainerDied","Data":"89cdd396c21786ee3b1fcf16c5f745d7069b797277e394ffa06ef0a845dc5675"} Jul 09 17:16:04.366683 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:04.366618 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng" event={"ID":"886c51eb-f540-4f88-ab91-2b3688b531a1","Type":"ContainerDied","Data":"2b515811d476cd0743822a8b5201a0666fc64b67ea7116def7a8584f161ff89b"} Jul 09 17:16:04.366683 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:04.366647 2580 scope.go:117] "RemoveContainer" containerID="89cdd396c21786ee3b1fcf16c5f745d7069b797277e394ffa06ef0a845dc5675" Jul 09 17:16:04.368431 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:04.368404 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" event={"ID":"7fa07cc3-2339-4003-9150-42a51bf29ad1","Type":"ContainerStarted","Data":"ba931ffebda2d99018658532b91e3f13806c30615790d6d8099fd8cc4b82122d"} Jul 09 17:16:04.368617 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:04.368462 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" event={"ID":"7fa07cc3-2339-4003-9150-42a51bf29ad1","Type":"ContainerStarted","Data":"cab5c6aca402086d1e9738da0e38de51c89b4a918a7ba21726a3d6267a4941f4"} Jul 09 17:16:04.375593 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:04.375574 2580 scope.go:117] "RemoveContainer" containerID="a15d42444a255efe4cd6d77769b29b194691279d4acc69f56f28084ff2189f71" Jul 09 17:16:04.387714 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:04.386762 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng"] Jul 09 17:16:04.387714 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:04.387696 2580 scope.go:117] "RemoveContainer" containerID="89cdd396c21786ee3b1fcf16c5f745d7069b797277e394ffa06ef0a845dc5675" Jul 09 17:16:04.391403 ip-10-0-128-34 kubenswrapper[2580]: E0709 17:16:04.388544 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89cdd396c21786ee3b1fcf16c5f745d7069b797277e394ffa06ef0a845dc5675\": container with ID starting with 89cdd396c21786ee3b1fcf16c5f745d7069b797277e394ffa06ef0a845dc5675 not found: ID does not exist" containerID="89cdd396c21786ee3b1fcf16c5f745d7069b797277e394ffa06ef0a845dc5675" Jul 09 17:16:04.391403 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:04.388588 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89cdd396c21786ee3b1fcf16c5f745d7069b797277e394ffa06ef0a845dc5675"} err="failed to get container status \"89cdd396c21786ee3b1fcf16c5f745d7069b797277e394ffa06ef0a845dc5675\": rpc error: code = NotFound desc = could not find container \"89cdd396c21786ee3b1fcf16c5f745d7069b797277e394ffa06ef0a845dc5675\": container with ID starting with 89cdd396c21786ee3b1fcf16c5f745d7069b797277e394ffa06ef0a845dc5675 not found: ID does not exist" Jul 09 17:16:04.391403 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:04.388615 2580 scope.go:117] "RemoveContainer" containerID="a15d42444a255efe4cd6d77769b29b194691279d4acc69f56f28084ff2189f71" Jul 09 17:16:04.391403 ip-10-0-128-34 kubenswrapper[2580]: E0709 17:16:04.389826 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a15d42444a255efe4cd6d77769b29b194691279d4acc69f56f28084ff2189f71\": container with ID starting with a15d42444a255efe4cd6d77769b29b194691279d4acc69f56f28084ff2189f71 not found: ID does not exist" containerID="a15d42444a255efe4cd6d77769b29b194691279d4acc69f56f28084ff2189f71" Jul 09 17:16:04.391403 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:04.389860 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a15d42444a255efe4cd6d77769b29b194691279d4acc69f56f28084ff2189f71"} err="failed to get container status \"a15d42444a255efe4cd6d77769b29b194691279d4acc69f56f28084ff2189f71\": rpc error: code = NotFound desc = could not find container \"a15d42444a255efe4cd6d77769b29b194691279d4acc69f56f28084ff2189f71\": container with ID starting with a15d42444a255efe4cd6d77769b29b194691279d4acc69f56f28084ff2189f71 not found: ID does not exist" Jul 09 17:16:04.392528 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:04.392466 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a6f26a7e-openshift-default-c68d64cc9-fmgng"] Jul 09 17:16:04.413875 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:04.413808 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" podStartSLOduration=1.4137904780000001 podStartE2EDuration="1.413790478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:16:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:16:04.411672211 +0000 UTC m=+1502.776424170" watchObservedRunningTime="2026-07-09 17:16:04.413790478 +0000 UTC m=+1502.778542395" Jul 09 17:16:04.779376 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:04.779341 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:04.784144 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:04.784117 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:05.374957 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:05.374929 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:05.375842 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:05.375826 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:06.177448 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:06.177418 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="886c51eb-f540-4f88-ab91-2b3688b531a1" path="/var/lib/kubelet/pods/886c51eb-f540-4f88-ab91-2b3688b531a1/volumes" Jul 09 17:16:09.218302 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:09.218250 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8"] Jul 09 17:16:09.218762 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:09.218461 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" podUID="7fa07cc3-2339-4003-9150-42a51bf29ad1" containerName="istio-proxy" containerID="cri-o://ba931ffebda2d99018658532b91e3f13806c30615790d6d8099fd8cc4b82122d" gracePeriod=30 Jul 09 17:16:14.967359 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:14.967335 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:15.113717 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.113686 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bddvk\" (UniqueName: \"kubernetes.io/projected/7fa07cc3-2339-4003-9150-42a51bf29ad1-kube-api-access-bddvk\") pod \"7fa07cc3-2339-4003-9150-42a51bf29ad1\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " Jul 09 17:16:15.113885 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.113729 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fa07cc3-2339-4003-9150-42a51bf29ad1-istiod-ca-cert\") pod \"7fa07cc3-2339-4003-9150-42a51bf29ad1\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " Jul 09 17:16:15.113885 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.113763 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fa07cc3-2339-4003-9150-42a51bf29ad1-istio-podinfo\") pod \"7fa07cc3-2339-4003-9150-42a51bf29ad1\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " Jul 09 17:16:15.113885 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.113785 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-workload-socket\") pod \"7fa07cc3-2339-4003-9150-42a51bf29ad1\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " Jul 09 17:16:15.113885 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.113804 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fa07cc3-2339-4003-9150-42a51bf29ad1-istio-token\") pod \"7fa07cc3-2339-4003-9150-42a51bf29ad1\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " Jul 09 17:16:15.113885 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.113842 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-istio-envoy\") pod \"7fa07cc3-2339-4003-9150-42a51bf29ad1\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " Jul 09 17:16:15.113885 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.113877 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-istio-data\") pod \"7fa07cc3-2339-4003-9150-42a51bf29ad1\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " Jul 09 17:16:15.114197 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.113948 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-workload-certs\") pod \"7fa07cc3-2339-4003-9150-42a51bf29ad1\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " Jul 09 17:16:15.114197 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.113983 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-credential-socket\") pod \"7fa07cc3-2339-4003-9150-42a51bf29ad1\" (UID: \"7fa07cc3-2339-4003-9150-42a51bf29ad1\") " Jul 09 17:16:15.114321 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.114187 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fa07cc3-2339-4003-9150-42a51bf29ad1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7fa07cc3-2339-4003-9150-42a51bf29ad1" (UID: "7fa07cc3-2339-4003-9150-42a51bf29ad1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:16:15.114321 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.114195 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7fa07cc3-2339-4003-9150-42a51bf29ad1" (UID: "7fa07cc3-2339-4003-9150-42a51bf29ad1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:16:15.114497 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.114437 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7fa07cc3-2339-4003-9150-42a51bf29ad1" (UID: "7fa07cc3-2339-4003-9150-42a51bf29ad1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:16:15.114497 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.114504 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7fa07cc3-2339-4003-9150-42a51bf29ad1" (UID: "7fa07cc3-2339-4003-9150-42a51bf29ad1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:16:15.114941 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.114920 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-istio-data" (OuterVolumeSpecName: "istio-data") pod "7fa07cc3-2339-4003-9150-42a51bf29ad1" (UID: "7fa07cc3-2339-4003-9150-42a51bf29ad1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:16:15.116062 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.116037 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fa07cc3-2339-4003-9150-42a51bf29ad1-kube-api-access-bddvk" (OuterVolumeSpecName: "kube-api-access-bddvk") pod "7fa07cc3-2339-4003-9150-42a51bf29ad1" (UID: "7fa07cc3-2339-4003-9150-42a51bf29ad1"). InnerVolumeSpecName "kube-api-access-bddvk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:16:15.116204 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.116187 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fa07cc3-2339-4003-9150-42a51bf29ad1-istio-token" (OuterVolumeSpecName: "istio-token") pod "7fa07cc3-2339-4003-9150-42a51bf29ad1" (UID: "7fa07cc3-2339-4003-9150-42a51bf29ad1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:16:15.116579 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.116550 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7fa07cc3-2339-4003-9150-42a51bf29ad1" (UID: "7fa07cc3-2339-4003-9150-42a51bf29ad1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:16:15.116579 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.116557 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7fa07cc3-2339-4003-9150-42a51bf29ad1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7fa07cc3-2339-4003-9150-42a51bf29ad1" (UID: "7fa07cc3-2339-4003-9150-42a51bf29ad1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 17:16:15.214949 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.214926 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-workload-certs\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:16:15.214949 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.214947 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-credential-socket\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:16:15.215080 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.214957 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bddvk\" (UniqueName: \"kubernetes.io/projected/7fa07cc3-2339-4003-9150-42a51bf29ad1-kube-api-access-bddvk\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:16:15.215080 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.214966 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fa07cc3-2339-4003-9150-42a51bf29ad1-istiod-ca-cert\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:16:15.215080 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.214975 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fa07cc3-2339-4003-9150-42a51bf29ad1-istio-podinfo\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:16:15.215080 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.214982 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-workload-socket\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:16:15.215080 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.214989 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fa07cc3-2339-4003-9150-42a51bf29ad1-istio-token\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:16:15.215080 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.214997 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-istio-envoy\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:16:15.215080 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.215004 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fa07cc3-2339-4003-9150-42a51bf29ad1-istio-data\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:16:15.440868 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.440798 2580 generic.go:356] "Generic (PLEG): container finished" podID="7fa07cc3-2339-4003-9150-42a51bf29ad1" containerID="ba931ffebda2d99018658532b91e3f13806c30615790d6d8099fd8cc4b82122d" exitCode=0 Jul 09 17:16:15.440868 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.440846 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" Jul 09 17:16:15.441022 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.440882 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" event={"ID":"7fa07cc3-2339-4003-9150-42a51bf29ad1","Type":"ContainerDied","Data":"ba931ffebda2d99018658532b91e3f13806c30615790d6d8099fd8cc4b82122d"} Jul 09 17:16:15.441022 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.440934 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8" event={"ID":"7fa07cc3-2339-4003-9150-42a51bf29ad1","Type":"ContainerDied","Data":"cab5c6aca402086d1e9738da0e38de51c89b4a918a7ba21726a3d6267a4941f4"} Jul 09 17:16:15.441022 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.440957 2580 scope.go:117] "RemoveContainer" containerID="ba931ffebda2d99018658532b91e3f13806c30615790d6d8099fd8cc4b82122d" Jul 09 17:16:15.450998 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.450982 2580 scope.go:117] "RemoveContainer" containerID="ba931ffebda2d99018658532b91e3f13806c30615790d6d8099fd8cc4b82122d" Jul 09 17:16:15.451316 ip-10-0-128-34 kubenswrapper[2580]: E0709 17:16:15.451212 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba931ffebda2d99018658532b91e3f13806c30615790d6d8099fd8cc4b82122d\": container with ID starting with ba931ffebda2d99018658532b91e3f13806c30615790d6d8099fd8cc4b82122d not found: ID does not exist" containerID="ba931ffebda2d99018658532b91e3f13806c30615790d6d8099fd8cc4b82122d" Jul 09 17:16:15.451316 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.451239 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba931ffebda2d99018658532b91e3f13806c30615790d6d8099fd8cc4b82122d"} err="failed to get container status \"ba931ffebda2d99018658532b91e3f13806c30615790d6d8099fd8cc4b82122d\": rpc error: code = NotFound desc = could not find container \"ba931ffebda2d99018658532b91e3f13806c30615790d6d8099fd8cc4b82122d\": container with ID starting with ba931ffebda2d99018658532b91e3f13806c30615790d6d8099fd8cc4b82122d not found: ID does not exist" Jul 09 17:16:15.464688 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.464662 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8"] Jul 09 17:16:15.473302 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:15.470638 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-8631fde9-openshift-default-7fd6fb89f5-mhsm8"] Jul 09 17:16:16.178715 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:16.178680 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fa07cc3-2339-4003-9150-42a51bf29ad1" path="/var/lib/kubelet/pods/7fa07cc3-2339-4003-9150-42a51bf29ad1/volumes" Jul 09 17:16:30.196635 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:30.196609 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726955-wzkdc" Jul 09 17:16:30.360765 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:30.360739 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zhtp\" (UniqueName: \"kubernetes.io/projected/04cfd7fa-b808-4f11-ab40-940b741ec962-kube-api-access-7zhtp\") pod \"04cfd7fa-b808-4f11-ab40-940b741ec962\" (UID: \"04cfd7fa-b808-4f11-ab40-940b741ec962\") " Jul 09 17:16:30.362653 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:30.362626 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04cfd7fa-b808-4f11-ab40-940b741ec962-kube-api-access-7zhtp" (OuterVolumeSpecName: "kube-api-access-7zhtp") pod "04cfd7fa-b808-4f11-ab40-940b741ec962" (UID: "04cfd7fa-b808-4f11-ab40-940b741ec962"). InnerVolumeSpecName "kube-api-access-7zhtp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:16:30.461263 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:30.461237 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zhtp\" (UniqueName: \"kubernetes.io/projected/04cfd7fa-b808-4f11-ab40-940b741ec962-kube-api-access-7zhtp\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:16:30.520368 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:30.520341 2580 generic.go:356] "Generic (PLEG): container finished" podID="04cfd7fa-b808-4f11-ab40-940b741ec962" containerID="cd920df36012bc85e0c5fe4238395026c870c9192590809aa6bf17812fd7d935" exitCode=137 Jul 09 17:16:30.520489 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:30.520403 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726955-wzkdc" Jul 09 17:16:30.520489 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:30.520435 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726955-wzkdc" event={"ID":"04cfd7fa-b808-4f11-ab40-940b741ec962","Type":"ContainerDied","Data":"cd920df36012bc85e0c5fe4238395026c870c9192590809aa6bf17812fd7d935"} Jul 09 17:16:30.520562 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:30.520518 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726955-wzkdc" event={"ID":"04cfd7fa-b808-4f11-ab40-940b741ec962","Type":"ContainerDied","Data":"ed771c478e0c3c64f4ff0e7a48551a0e699644c5a1f56704837da162076e8c52"} Jul 09 17:16:30.520562 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:30.520542 2580 scope.go:117] "RemoveContainer" containerID="cd920df36012bc85e0c5fe4238395026c870c9192590809aa6bf17812fd7d935" Jul 09 17:16:30.529010 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:30.528981 2580 scope.go:117] "RemoveContainer" containerID="cd920df36012bc85e0c5fe4238395026c870c9192590809aa6bf17812fd7d935" Jul 09 17:16:30.529244 ip-10-0-128-34 kubenswrapper[2580]: E0709 17:16:30.529224 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd920df36012bc85e0c5fe4238395026c870c9192590809aa6bf17812fd7d935\": container with ID starting with cd920df36012bc85e0c5fe4238395026c870c9192590809aa6bf17812fd7d935 not found: ID does not exist" containerID="cd920df36012bc85e0c5fe4238395026c870c9192590809aa6bf17812fd7d935" Jul 09 17:16:30.529331 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:30.529256 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd920df36012bc85e0c5fe4238395026c870c9192590809aa6bf17812fd7d935"} err="failed to get container status \"cd920df36012bc85e0c5fe4238395026c870c9192590809aa6bf17812fd7d935\": rpc error: code = NotFound desc = could not find container \"cd920df36012bc85e0c5fe4238395026c870c9192590809aa6bf17812fd7d935\": container with ID starting with cd920df36012bc85e0c5fe4238395026c870c9192590809aa6bf17812fd7d935 not found: ID does not exist" Jul 09 17:16:30.543501 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:30.543473 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726955-wzkdc"] Jul 09 17:16:30.547898 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:30.547877 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726955-wzkdc"] Jul 09 17:16:32.177160 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:16:32.177123 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04cfd7fa-b808-4f11-ab40-940b741ec962" path="/var/lib/kubelet/pods/04cfd7fa-b808-4f11-ab40-940b741ec962/volumes" Jul 09 17:17:51.026658 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.026626 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf"] Jul 09 17:17:51.027111 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.026948 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04cfd7fa-b808-4f11-ab40-940b741ec962" containerName="cleanup" Jul 09 17:17:51.027111 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.026958 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="04cfd7fa-b808-4f11-ab40-940b741ec962" containerName="cleanup" Jul 09 17:17:51.027111 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.026971 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fa07cc3-2339-4003-9150-42a51bf29ad1" containerName="istio-proxy" Jul 09 17:17:51.027111 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.026976 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fa07cc3-2339-4003-9150-42a51bf29ad1" containerName="istio-proxy" Jul 09 17:17:51.027111 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.026996 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="886c51eb-f540-4f88-ab91-2b3688b531a1" containerName="istio-proxy" Jul 09 17:17:51.027111 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.027001 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="886c51eb-f540-4f88-ab91-2b3688b531a1" containerName="istio-proxy" Jul 09 17:17:51.027111 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.027010 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="886c51eb-f540-4f88-ab91-2b3688b531a1" containerName="istio-proxy" Jul 09 17:17:51.027111 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.027015 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="886c51eb-f540-4f88-ab91-2b3688b531a1" containerName="istio-proxy" Jul 09 17:17:51.027111 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.027065 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="04cfd7fa-b808-4f11-ab40-940b741ec962" containerName="cleanup" Jul 09 17:17:51.027111 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.027071 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fa07cc3-2339-4003-9150-42a51bf29ad1" containerName="istio-proxy" Jul 09 17:17:51.027111 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.027076 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="886c51eb-f540-4f88-ab91-2b3688b531a1" containerName="istio-proxy" Jul 09 17:17:51.027111 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.027082 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="886c51eb-f540-4f88-ab91-2b3688b531a1" containerName="istio-proxy" Jul 09 17:17:51.029205 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.029189 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.031511 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.031488 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-add69b2a-openshift-default-dockercfg-xvhx7\"" Jul 09 17:17:51.042732 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.042710 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf"] Jul 09 17:17:51.153257 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.153215 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d09a3b6-123d-433c-b739-624f9bf2b587-istio-token\") pod \"e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.153472 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.153260 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-workload-socket\") pod \"e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.153472 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.153319 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-workload-certs\") pod \"e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.153472 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.153361 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-istio-data\") pod \"e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.153472 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.153402 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptqbf\" (UniqueName: \"kubernetes.io/projected/9d09a3b6-123d-433c-b739-624f9bf2b587-kube-api-access-ptqbf\") pod \"e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.153472 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.153437 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d09a3b6-123d-433c-b739-624f9bf2b587-istiod-ca-cert\") pod \"e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.153735 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.153497 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-istio-envoy\") pod \"e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.153735 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.153552 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-credential-socket\") pod \"e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.153735 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.153620 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d09a3b6-123d-433c-b739-624f9bf2b587-istio-podinfo\") pod \"e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.254164 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.254131 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-workload-socket\") pod \"e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.254349 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.254185 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-workload-certs\") pod \"e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.254349 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.254213 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-istio-data\") pod \"e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.254349 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.254243 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptqbf\" (UniqueName: \"kubernetes.io/projected/9d09a3b6-123d-433c-b739-624f9bf2b587-kube-api-access-ptqbf\") pod \"e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.254349 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.254303 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d09a3b6-123d-433c-b739-624f9bf2b587-istiod-ca-cert\") pod \"e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.254349 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.254346 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-istio-envoy\") pod \"e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.254635 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.254378 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-credential-socket\") pod \"e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.254635 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.254444 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d09a3b6-123d-433c-b739-624f9bf2b587-istio-podinfo\") pod \"e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.254635 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.254523 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d09a3b6-123d-433c-b739-624f9bf2b587-istio-token\") pod \"e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.254635 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.254575 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-workload-socket\") pod \"e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.254635 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.254612 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-istio-data\") pod \"e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.254870 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.254642 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-workload-certs\") pod \"e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.254870 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.254810 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-credential-socket\") pod \"e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.255041 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.255020 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d09a3b6-123d-433c-b739-624f9bf2b587-istiod-ca-cert\") pod \"e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.256802 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.256780 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-istio-envoy\") pod \"e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.256974 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.256957 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d09a3b6-123d-433c-b739-624f9bf2b587-istio-podinfo\") pod \"e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.262045 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.262012 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d09a3b6-123d-433c-b739-624f9bf2b587-istio-token\") pod \"e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.262238 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.262221 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptqbf\" (UniqueName: \"kubernetes.io/projected/9d09a3b6-123d-433c-b739-624f9bf2b587-kube-api-access-ptqbf\") pod \"e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.339837 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.339778 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:51.492109 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.492083 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf"] Jul 09 17:17:51.494055 ip-10-0-128-34 kubenswrapper[2580]: W0709 17:17:51.494026 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d09a3b6_123d_433c_b739_624f9bf2b587.slice/crio-2eed4260931ce1b36a168db63bd31068dfd8172f90d0d8ba3434f72b0f1fe08c WatchSource:0}: Error finding container 2eed4260931ce1b36a168db63bd31068dfd8172f90d0d8ba3434f72b0f1fe08c: Status 404 returned error can't find the container with id 2eed4260931ce1b36a168db63bd31068dfd8172f90d0d8ba3434f72b0f1fe08c Jul 09 17:17:51.496213 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.496179 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:17:51.496297 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.496247 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:17:51.496360 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.496345 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:17:51.940256 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.940221 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" event={"ID":"9d09a3b6-123d-433c-b739-624f9bf2b587","Type":"ContainerStarted","Data":"ecc88af7e089f0ef5716514d13b86cb889efbf2c6157033db70169745d7ab18b"} Jul 09 17:17:51.940498 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.940309 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" event={"ID":"9d09a3b6-123d-433c-b739-624f9bf2b587","Type":"ContainerStarted","Data":"2eed4260931ce1b36a168db63bd31068dfd8172f90d0d8ba3434f72b0f1fe08c"} Jul 09 17:17:51.961406 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:51.961358 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" podStartSLOduration=1.961341273 podStartE2EDuration="1.961341273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:17:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:17:51.958576954 +0000 UTC m=+1610.323328872" watchObservedRunningTime="2026-07-09 17:17:51.961341273 +0000 UTC m=+1610.326093189" Jul 09 17:17:52.340829 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:52.340721 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:52.345541 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:52.345518 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:52.945432 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:52.945397 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:17:52.946490 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:17:52.946467 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:18:08.238959 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:08.238923 2580 patch_prober.go:28] interesting pod/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": read tcp 10.134.0.2:35988->10.134.0.41:15021: read: connection reset by peer" start-of-body= Jul 09 17:18:08.239435 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:08.239008 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" podUID="9d09a3b6-123d-433c-b739-624f9bf2b587" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": read tcp 10.134.0.2:35988->10.134.0.41:15021: read: connection reset by peer" Jul 09 17:18:09.033087 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:09.033051 2580 generic.go:356] "Generic (PLEG): container finished" podID="9d09a3b6-123d-433c-b739-624f9bf2b587" containerID="ecc88af7e089f0ef5716514d13b86cb889efbf2c6157033db70169745d7ab18b" exitCode=0 Jul 09 17:18:09.033248 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:09.033124 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" event={"ID":"9d09a3b6-123d-433c-b739-624f9bf2b587","Type":"ContainerDied","Data":"ecc88af7e089f0ef5716514d13b86cb889efbf2c6157033db70169745d7ab18b"} Jul 09 17:18:09.033583 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:09.033564 2580 scope.go:117] "RemoveContainer" containerID="ecc88af7e089f0ef5716514d13b86cb889efbf2c6157033db70169745d7ab18b" Jul 09 17:18:09.034626 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:09.034589 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:18:09.034692 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:09.034673 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:18:09.034727 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:09.034706 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:18:10.040124 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:10.040092 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" event={"ID":"9d09a3b6-123d-433c-b739-624f9bf2b587","Type":"ContainerStarted","Data":"70f8706dc799bcecec6d49b909b87f2893a40dad130d1aef590b13d07f7f8183"} Jul 09 17:18:10.340481 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:10.340407 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:18:10.343838 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:10.343817 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:18:11.049947 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:11.047752 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:18:11.050799 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:11.050775 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:18:12.565322 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:12.565275 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf"] Jul 09 17:18:13.056797 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:13.056760 2580 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" secret="" err="secret \"e2e-mt-add69b2a-openshift-default-dockercfg-xvhx7\" not found" Jul 09 17:18:14.061844 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:14.061801 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" podUID="9d09a3b6-123d-433c-b739-624f9bf2b587" containerName="istio-proxy" containerID="cri-o://70f8706dc799bcecec6d49b909b87f2893a40dad130d1aef590b13d07f7f8183" gracePeriod=30 Jul 09 17:18:19.313908 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:19.313874 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:18:19.391018 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:19.390990 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d09a3b6-123d-433c-b739-624f9bf2b587-istiod-ca-cert\") pod \"9d09a3b6-123d-433c-b739-624f9bf2b587\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " Jul 09 17:18:19.391163 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:19.391036 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptqbf\" (UniqueName: \"kubernetes.io/projected/9d09a3b6-123d-433c-b739-624f9bf2b587-kube-api-access-ptqbf\") pod \"9d09a3b6-123d-433c-b739-624f9bf2b587\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " Jul 09 17:18:19.391163 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:19.391074 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-istio-data\") pod \"9d09a3b6-123d-433c-b739-624f9bf2b587\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " Jul 09 17:18:19.391163 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:19.391102 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-workload-socket\") pod \"9d09a3b6-123d-433c-b739-624f9bf2b587\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " Jul 09 17:18:19.391163 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:19.391152 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d09a3b6-123d-433c-b739-624f9bf2b587-istio-podinfo\") pod \"9d09a3b6-123d-433c-b739-624f9bf2b587\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " Jul 09 17:18:19.391418 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:19.391182 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-workload-certs\") pod \"9d09a3b6-123d-433c-b739-624f9bf2b587\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " Jul 09 17:18:19.391418 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:19.391264 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d09a3b6-123d-433c-b739-624f9bf2b587-istio-token\") pod \"9d09a3b6-123d-433c-b739-624f9bf2b587\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " Jul 09 17:18:19.391418 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:19.391322 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-istio-envoy\") pod \"9d09a3b6-123d-433c-b739-624f9bf2b587\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " Jul 09 17:18:19.391418 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:19.391356 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-credential-socket\") pod \"9d09a3b6-123d-433c-b739-624f9bf2b587\" (UID: \"9d09a3b6-123d-433c-b739-624f9bf2b587\") " Jul 09 17:18:19.391418 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:19.391405 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9d09a3b6-123d-433c-b739-624f9bf2b587" (UID: "9d09a3b6-123d-433c-b739-624f9bf2b587"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:18:19.391665 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:19.391479 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d09a3b6-123d-433c-b739-624f9bf2b587-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9d09a3b6-123d-433c-b739-624f9bf2b587" (UID: "9d09a3b6-123d-433c-b739-624f9bf2b587"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:18:19.391723 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:19.391626 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d09a3b6-123d-433c-b739-624f9bf2b587-istiod-ca-cert\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:18:19.391723 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:19.391682 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-workload-socket\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:18:19.391723 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:19.391709 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9d09a3b6-123d-433c-b739-624f9bf2b587" (UID: "9d09a3b6-123d-433c-b739-624f9bf2b587"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:18:19.391842 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:19.391809 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9d09a3b6-123d-433c-b739-624f9bf2b587" (UID: "9d09a3b6-123d-433c-b739-624f9bf2b587"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:18:19.392326 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:19.392240 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-istio-data" (OuterVolumeSpecName: "istio-data") pod "9d09a3b6-123d-433c-b739-624f9bf2b587" (UID: "9d09a3b6-123d-433c-b739-624f9bf2b587"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:18:19.393573 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:19.393543 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9d09a3b6-123d-433c-b739-624f9bf2b587-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9d09a3b6-123d-433c-b739-624f9bf2b587" (UID: "9d09a3b6-123d-433c-b739-624f9bf2b587"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 17:18:19.393671 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:19.393596 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d09a3b6-123d-433c-b739-624f9bf2b587-kube-api-access-ptqbf" (OuterVolumeSpecName: "kube-api-access-ptqbf") pod "9d09a3b6-123d-433c-b739-624f9bf2b587" (UID: "9d09a3b6-123d-433c-b739-624f9bf2b587"). InnerVolumeSpecName "kube-api-access-ptqbf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:18:19.393671 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:19.393598 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9d09a3b6-123d-433c-b739-624f9bf2b587" (UID: "9d09a3b6-123d-433c-b739-624f9bf2b587"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:18:19.393771 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:19.393702 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d09a3b6-123d-433c-b739-624f9bf2b587-istio-token" (OuterVolumeSpecName: "istio-token") pod "9d09a3b6-123d-433c-b739-624f9bf2b587" (UID: "9d09a3b6-123d-433c-b739-624f9bf2b587"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:18:19.492118 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:19.492094 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d09a3b6-123d-433c-b739-624f9bf2b587-istio-token\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:18:19.492118 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:19.492118 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-istio-envoy\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:18:19.492250 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:19.492128 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-credential-socket\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:18:19.492250 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:19.492137 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptqbf\" (UniqueName: \"kubernetes.io/projected/9d09a3b6-123d-433c-b739-624f9bf2b587-kube-api-access-ptqbf\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:18:19.492250 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:19.492147 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-istio-data\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:18:19.492250 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:19.492154 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d09a3b6-123d-433c-b739-624f9bf2b587-istio-podinfo\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:18:19.492250 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:19.492162 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d09a3b6-123d-433c-b739-624f9bf2b587-workload-certs\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:18:20.094107 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:20.094070 2580 generic.go:356] "Generic (PLEG): container finished" podID="9d09a3b6-123d-433c-b739-624f9bf2b587" containerID="70f8706dc799bcecec6d49b909b87f2893a40dad130d1aef590b13d07f7f8183" exitCode=0 Jul 09 17:18:20.094296 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:20.094121 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" Jul 09 17:18:20.094296 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:20.094141 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" event={"ID":"9d09a3b6-123d-433c-b739-624f9bf2b587","Type":"ContainerDied","Data":"70f8706dc799bcecec6d49b909b87f2893a40dad130d1aef590b13d07f7f8183"} Jul 09 17:18:20.094296 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:20.094186 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf" event={"ID":"9d09a3b6-123d-433c-b739-624f9bf2b587","Type":"ContainerDied","Data":"2eed4260931ce1b36a168db63bd31068dfd8172f90d0d8ba3434f72b0f1fe08c"} Jul 09 17:18:20.094296 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:20.094212 2580 scope.go:117] "RemoveContainer" containerID="70f8706dc799bcecec6d49b909b87f2893a40dad130d1aef590b13d07f7f8183" Jul 09 17:18:20.103706 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:20.103685 2580 scope.go:117] "RemoveContainer" containerID="ecc88af7e089f0ef5716514d13b86cb889efbf2c6157033db70169745d7ab18b" Jul 09 17:18:20.111700 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:20.111681 2580 scope.go:117] "RemoveContainer" containerID="70f8706dc799bcecec6d49b909b87f2893a40dad130d1aef590b13d07f7f8183" Jul 09 17:18:20.111954 ip-10-0-128-34 kubenswrapper[2580]: E0709 17:18:20.111933 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70f8706dc799bcecec6d49b909b87f2893a40dad130d1aef590b13d07f7f8183\": container with ID starting with 70f8706dc799bcecec6d49b909b87f2893a40dad130d1aef590b13d07f7f8183 not found: ID does not exist" containerID="70f8706dc799bcecec6d49b909b87f2893a40dad130d1aef590b13d07f7f8183" Jul 09 17:18:20.112001 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:20.111967 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f8706dc799bcecec6d49b909b87f2893a40dad130d1aef590b13d07f7f8183"} err="failed to get container status \"70f8706dc799bcecec6d49b909b87f2893a40dad130d1aef590b13d07f7f8183\": rpc error: code = NotFound desc = could not find container \"70f8706dc799bcecec6d49b909b87f2893a40dad130d1aef590b13d07f7f8183\": container with ID starting with 70f8706dc799bcecec6d49b909b87f2893a40dad130d1aef590b13d07f7f8183 not found: ID does not exist" Jul 09 17:18:20.112001 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:20.111990 2580 scope.go:117] "RemoveContainer" containerID="ecc88af7e089f0ef5716514d13b86cb889efbf2c6157033db70169745d7ab18b" Jul 09 17:18:20.112239 ip-10-0-128-34 kubenswrapper[2580]: E0709 17:18:20.112217 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecc88af7e089f0ef5716514d13b86cb889efbf2c6157033db70169745d7ab18b\": container with ID starting with ecc88af7e089f0ef5716514d13b86cb889efbf2c6157033db70169745d7ab18b not found: ID does not exist" containerID="ecc88af7e089f0ef5716514d13b86cb889efbf2c6157033db70169745d7ab18b" Jul 09 17:18:20.112311 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:20.112247 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecc88af7e089f0ef5716514d13b86cb889efbf2c6157033db70169745d7ab18b"} err="failed to get container status \"ecc88af7e089f0ef5716514d13b86cb889efbf2c6157033db70169745d7ab18b\": rpc error: code = NotFound desc = could not find container \"ecc88af7e089f0ef5716514d13b86cb889efbf2c6157033db70169745d7ab18b\": container with ID starting with ecc88af7e089f0ef5716514d13b86cb889efbf2c6157033db70169745d7ab18b not found: ID does not exist" Jul 09 17:18:20.116484 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:20.116459 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf"] Jul 09 17:18:20.122479 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:20.122454 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-add69b2a-openshift-default-677c6bb5f9-glmgf"] Jul 09 17:18:20.177676 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:20.177652 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d09a3b6-123d-433c-b739-624f9bf2b587" path="/var/lib/kubelet/pods/9d09a3b6-123d-433c-b739-624f9bf2b587/volumes" Jul 09 17:18:31.977172 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:31.977137 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb"] Jul 09 17:18:31.977606 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:31.977483 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d09a3b6-123d-433c-b739-624f9bf2b587" containerName="istio-proxy" Jul 09 17:18:31.977606 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:31.977495 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d09a3b6-123d-433c-b739-624f9bf2b587" containerName="istio-proxy" Jul 09 17:18:31.977606 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:31.977511 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d09a3b6-123d-433c-b739-624f9bf2b587" containerName="istio-proxy" Jul 09 17:18:31.977606 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:31.977518 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d09a3b6-123d-433c-b739-624f9bf2b587" containerName="istio-proxy" Jul 09 17:18:31.977606 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:31.977578 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d09a3b6-123d-433c-b739-624f9bf2b587" containerName="istio-proxy" Jul 09 17:18:31.977606 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:31.977588 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d09a3b6-123d-433c-b739-624f9bf2b587" containerName="istio-proxy" Jul 09 17:18:31.979938 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:31.979921 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:31.982143 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:31.982122 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-8384063d-openshift-default-dockercfg-wdrq2\"" Jul 09 17:18:31.991589 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:31.991564 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb"] Jul 09 17:18:32.100734 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.100698 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-workload-certs\") pod \"e2e-mt-8384063d-openshift-default-79f49895-6bsqb\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:32.100734 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.100737 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istiod-ca-cert\") pod \"e2e-mt-8384063d-openshift-default-79f49895-6bsqb\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:32.100982 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.100767 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istio-podinfo\") pod \"e2e-mt-8384063d-openshift-default-79f49895-6bsqb\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:32.100982 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.100850 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istio-envoy\") pod \"e2e-mt-8384063d-openshift-default-79f49895-6bsqb\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:32.100982 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.100883 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2cdb\" (UniqueName: \"kubernetes.io/projected/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-kube-api-access-p2cdb\") pod \"e2e-mt-8384063d-openshift-default-79f49895-6bsqb\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:32.100982 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.100904 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istio-token\") pod \"e2e-mt-8384063d-openshift-default-79f49895-6bsqb\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:32.101181 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.100984 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istio-data\") pod \"e2e-mt-8384063d-openshift-default-79f49895-6bsqb\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:32.101181 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.101035 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-workload-socket\") pod \"e2e-mt-8384063d-openshift-default-79f49895-6bsqb\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:32.101181 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.101056 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-credential-socket\") pod \"e2e-mt-8384063d-openshift-default-79f49895-6bsqb\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:32.202082 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.202051 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istiod-ca-cert\") pod \"e2e-mt-8384063d-openshift-default-79f49895-6bsqb\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:32.202082 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.202085 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istio-podinfo\") pod \"e2e-mt-8384063d-openshift-default-79f49895-6bsqb\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:32.202376 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.202119 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istio-envoy\") pod \"e2e-mt-8384063d-openshift-default-79f49895-6bsqb\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:32.202376 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.202141 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2cdb\" (UniqueName: \"kubernetes.io/projected/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-kube-api-access-p2cdb\") pod \"e2e-mt-8384063d-openshift-default-79f49895-6bsqb\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:32.202376 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.202158 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istio-token\") pod \"e2e-mt-8384063d-openshift-default-79f49895-6bsqb\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:32.202376 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.202196 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istio-data\") pod \"e2e-mt-8384063d-openshift-default-79f49895-6bsqb\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:32.202376 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.202230 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-workload-socket\") pod \"e2e-mt-8384063d-openshift-default-79f49895-6bsqb\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:32.202376 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.202254 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-credential-socket\") pod \"e2e-mt-8384063d-openshift-default-79f49895-6bsqb\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:32.202376 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.202311 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-workload-certs\") pod \"e2e-mt-8384063d-openshift-default-79f49895-6bsqb\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:32.202719 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.202657 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istio-data\") pod \"e2e-mt-8384063d-openshift-default-79f49895-6bsqb\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:32.202719 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.202700 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-workload-socket\") pod \"e2e-mt-8384063d-openshift-default-79f49895-6bsqb\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:32.202816 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.202761 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-credential-socket\") pod \"e2e-mt-8384063d-openshift-default-79f49895-6bsqb\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:32.202816 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.202808 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-workload-certs\") pod \"e2e-mt-8384063d-openshift-default-79f49895-6bsqb\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:32.202883 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.202830 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istiod-ca-cert\") pod \"e2e-mt-8384063d-openshift-default-79f49895-6bsqb\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:32.204772 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.204751 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istio-envoy\") pod \"e2e-mt-8384063d-openshift-default-79f49895-6bsqb\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:32.205010 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.204996 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istio-podinfo\") pod \"e2e-mt-8384063d-openshift-default-79f49895-6bsqb\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:32.211158 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.211133 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istio-token\") pod \"e2e-mt-8384063d-openshift-default-79f49895-6bsqb\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:32.211332 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.211249 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2cdb\" (UniqueName: \"kubernetes.io/projected/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-kube-api-access-p2cdb\") pod \"e2e-mt-8384063d-openshift-default-79f49895-6bsqb\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:32.290549 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.290486 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:32.426091 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.426065 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb"] Jul 09 17:18:32.427548 ip-10-0-128-34 kubenswrapper[2580]: W0709 17:18:32.427524 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50389d4d_af65_4b17_9ffd_e3a8c79d0eb6.slice/crio-6177e7fa12efeaed96b0771e7bcf7b1aa57c2f975225ffc3b878a25861e73b8f WatchSource:0}: Error finding container 6177e7fa12efeaed96b0771e7bcf7b1aa57c2f975225ffc3b878a25861e73b8f: Status 404 returned error can't find the container with id 6177e7fa12efeaed96b0771e7bcf7b1aa57c2f975225ffc3b878a25861e73b8f Jul 09 17:18:32.429667 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.429635 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:18:32.429733 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.429703 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:18:32.429770 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:32.429734 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:18:33.158678 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:33.158643 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" event={"ID":"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6","Type":"ContainerStarted","Data":"183f76bfb28c36055912450e582c7739bc55948107131f564a9756abe9e37771"} Jul 09 17:18:33.159067 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:33.158700 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" event={"ID":"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6","Type":"ContainerStarted","Data":"6177e7fa12efeaed96b0771e7bcf7b1aa57c2f975225ffc3b878a25861e73b8f"} Jul 09 17:18:33.177784 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:33.177725 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" podStartSLOduration=2.177704189 podStartE2EDuration="2.177704189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:18:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:18:33.176601699 +0000 UTC m=+1651.541353615" watchObservedRunningTime="2026-07-09 17:18:33.177704189 +0000 UTC m=+1651.542456106" Jul 09 17:18:33.291359 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:33.291328 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:33.297990 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:33.297955 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:34.164231 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:34.164202 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:34.165088 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:34.165070 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:49.165684 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:49.165596 2580 patch_prober.go:28] interesting pod/e2e-mt-8384063d-openshift-default-79f49895-6bsqb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 09 17:18:49.165684 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:49.165656 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" podUID="50389d4d-af65-4b17-9ffd-e3a8c79d0eb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 09 17:18:49.250832 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:49.250796 2580 generic.go:356] "Generic (PLEG): container finished" podID="50389d4d-af65-4b17-9ffd-e3a8c79d0eb6" containerID="183f76bfb28c36055912450e582c7739bc55948107131f564a9756abe9e37771" exitCode=0 Jul 09 17:18:49.251001 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:49.250872 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" event={"ID":"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6","Type":"ContainerDied","Data":"183f76bfb28c36055912450e582c7739bc55948107131f564a9756abe9e37771"} Jul 09 17:18:49.251326 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:49.251309 2580 scope.go:117] "RemoveContainer" containerID="183f76bfb28c36055912450e582c7739bc55948107131f564a9756abe9e37771" Jul 09 17:18:49.252336 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:49.252298 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:18:49.252397 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:49.252370 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:18:49.252435 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:49.252400 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:18:50.257345 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:50.257308 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" event={"ID":"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6","Type":"ContainerStarted","Data":"c45e66151a677f22d5e0fa525d94f7f11e14c07beafe254c876b127b57e50782"} Jul 09 17:18:50.291047 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:50.291017 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:50.291394 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:50.291367 2580 patch_prober.go:28] interesting pod/e2e-mt-8384063d-openshift-default-79f49895-6bsqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 09 17:18:50.291490 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:50.291416 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" podUID="50389d4d-af65-4b17-9ffd-e3a8c79d0eb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 09 17:18:51.291771 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:51.291734 2580 patch_prober.go:28] interesting pod/e2e-mt-8384063d-openshift-default-79f49895-6bsqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 09 17:18:51.292382 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:51.292343 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" podUID="50389d4d-af65-4b17-9ffd-e3a8c79d0eb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 09 17:18:52.291748 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:52.291706 2580 patch_prober.go:28] interesting pod/e2e-mt-8384063d-openshift-default-79f49895-6bsqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 09 17:18:52.291952 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:52.291788 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" podUID="50389d4d-af65-4b17-9ffd-e3a8c79d0eb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 09 17:18:53.291810 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:53.291773 2580 patch_prober.go:28] interesting pod/e2e-mt-8384063d-openshift-default-79f49895-6bsqb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 09 17:18:53.292360 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:53.292322 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" podUID="50389d4d-af65-4b17-9ffd-e3a8c79d0eb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 09 17:18:54.295016 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:54.294983 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:54.295477 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:54.295274 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:18:54.295991 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:18:54.295972 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:20:20.884790 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:20.884756 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb"] Jul 09 17:20:20.885266 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:20.884970 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" podUID="50389d4d-af65-4b17-9ffd-e3a8c79d0eb6" containerName="istio-proxy" containerID="cri-o://c45e66151a677f22d5e0fa525d94f7f11e14c07beafe254c876b127b57e50782" gracePeriod=30 Jul 09 17:20:24.298005 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:24.297968 2580 patch_prober.go:28] interesting pod/e2e-mt-8384063d-openshift-default-79f49895-6bsqb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 17:20:24.298391 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:24.298034 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" podUID="50389d4d-af65-4b17-9ffd-e3a8c79d0eb6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 17:20:26.137831 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.137807 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:20:26.292916 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.292825 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istiod-ca-cert\") pod \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " Jul 09 17:20:26.292916 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.292873 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istio-envoy\") pod \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " Jul 09 17:20:26.292916 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.292902 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istio-token\") pod \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " Jul 09 17:20:26.293210 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.292925 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-workload-certs\") pod \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " Jul 09 17:20:26.293210 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.292943 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-workload-socket\") pod \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " Jul 09 17:20:26.293210 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.292992 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istio-data\") pod \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " Jul 09 17:20:26.293210 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.293023 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2cdb\" (UniqueName: \"kubernetes.io/projected/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-kube-api-access-p2cdb\") pod \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " Jul 09 17:20:26.293210 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.293049 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-credential-socket\") pod \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " Jul 09 17:20:26.293210 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.293094 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istio-podinfo\") pod \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\" (UID: \"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6\") " Jul 09 17:20:26.293509 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.293246 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "50389d4d-af65-4b17-9ffd-e3a8c79d0eb6" (UID: "50389d4d-af65-4b17-9ffd-e3a8c79d0eb6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:20:26.293509 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.293399 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "50389d4d-af65-4b17-9ffd-e3a8c79d0eb6" (UID: "50389d4d-af65-4b17-9ffd-e3a8c79d0eb6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:20:26.293509 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.293414 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-workload-certs\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:20:26.293509 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.293428 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "50389d4d-af65-4b17-9ffd-e3a8c79d0eb6" (UID: "50389d4d-af65-4b17-9ffd-e3a8c79d0eb6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:20:26.293692 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.293673 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "50389d4d-af65-4b17-9ffd-e3a8c79d0eb6" (UID: "50389d4d-af65-4b17-9ffd-e3a8c79d0eb6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:20:26.294299 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.294252 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istio-data" (OuterVolumeSpecName: "istio-data") pod "50389d4d-af65-4b17-9ffd-e3a8c79d0eb6" (UID: "50389d4d-af65-4b17-9ffd-e3a8c79d0eb6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:20:26.295265 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.295243 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "50389d4d-af65-4b17-9ffd-e3a8c79d0eb6" (UID: "50389d4d-af65-4b17-9ffd-e3a8c79d0eb6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:20:26.295265 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.295251 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istio-token" (OuterVolumeSpecName: "istio-token") pod "50389d4d-af65-4b17-9ffd-e3a8c79d0eb6" (UID: "50389d4d-af65-4b17-9ffd-e3a8c79d0eb6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:20:26.295427 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.295408 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "50389d4d-af65-4b17-9ffd-e3a8c79d0eb6" (UID: "50389d4d-af65-4b17-9ffd-e3a8c79d0eb6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 17:20:26.295632 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.295607 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-kube-api-access-p2cdb" (OuterVolumeSpecName: "kube-api-access-p2cdb") pod "50389d4d-af65-4b17-9ffd-e3a8c79d0eb6" (UID: "50389d4d-af65-4b17-9ffd-e3a8c79d0eb6"). InnerVolumeSpecName "kube-api-access-p2cdb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:20:26.394002 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.393964 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istio-token\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:20:26.394002 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.393998 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-workload-socket\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:20:26.394226 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.394013 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istio-data\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:20:26.394226 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.394026 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2cdb\" (UniqueName: \"kubernetes.io/projected/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-kube-api-access-p2cdb\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:20:26.394226 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.394042 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-credential-socket\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:20:26.394226 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.394055 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istio-podinfo\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:20:26.394226 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.394067 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istiod-ca-cert\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:20:26.394226 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.394079 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6-istio-envoy\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:20:26.742926 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.742887 2580 generic.go:356] "Generic (PLEG): container finished" podID="50389d4d-af65-4b17-9ffd-e3a8c79d0eb6" containerID="c45e66151a677f22d5e0fa525d94f7f11e14c07beafe254c876b127b57e50782" exitCode=0 Jul 09 17:20:26.743117 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.742957 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" Jul 09 17:20:26.743117 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.742978 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" event={"ID":"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6","Type":"ContainerDied","Data":"c45e66151a677f22d5e0fa525d94f7f11e14c07beafe254c876b127b57e50782"} Jul 09 17:20:26.743117 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.743070 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb" event={"ID":"50389d4d-af65-4b17-9ffd-e3a8c79d0eb6","Type":"ContainerDied","Data":"6177e7fa12efeaed96b0771e7bcf7b1aa57c2f975225ffc3b878a25861e73b8f"} Jul 09 17:20:26.743117 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.743101 2580 scope.go:117] "RemoveContainer" containerID="c45e66151a677f22d5e0fa525d94f7f11e14c07beafe254c876b127b57e50782" Jul 09 17:20:26.752205 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.752187 2580 scope.go:117] "RemoveContainer" containerID="183f76bfb28c36055912450e582c7739bc55948107131f564a9756abe9e37771" Jul 09 17:20:26.760257 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.760238 2580 scope.go:117] "RemoveContainer" containerID="c45e66151a677f22d5e0fa525d94f7f11e14c07beafe254c876b127b57e50782" Jul 09 17:20:26.760643 ip-10-0-128-34 kubenswrapper[2580]: E0709 17:20:26.760514 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c45e66151a677f22d5e0fa525d94f7f11e14c07beafe254c876b127b57e50782\": container with ID starting with c45e66151a677f22d5e0fa525d94f7f11e14c07beafe254c876b127b57e50782 not found: ID does not exist" containerID="c45e66151a677f22d5e0fa525d94f7f11e14c07beafe254c876b127b57e50782" Jul 09 17:20:26.760643 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.760551 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c45e66151a677f22d5e0fa525d94f7f11e14c07beafe254c876b127b57e50782"} err="failed to get container status \"c45e66151a677f22d5e0fa525d94f7f11e14c07beafe254c876b127b57e50782\": rpc error: code = NotFound desc = could not find container \"c45e66151a677f22d5e0fa525d94f7f11e14c07beafe254c876b127b57e50782\": container with ID starting with c45e66151a677f22d5e0fa525d94f7f11e14c07beafe254c876b127b57e50782 not found: ID does not exist" Jul 09 17:20:26.760643 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.760573 2580 scope.go:117] "RemoveContainer" containerID="183f76bfb28c36055912450e582c7739bc55948107131f564a9756abe9e37771" Jul 09 17:20:26.760829 ip-10-0-128-34 kubenswrapper[2580]: E0709 17:20:26.760811 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"183f76bfb28c36055912450e582c7739bc55948107131f564a9756abe9e37771\": container with ID starting with 183f76bfb28c36055912450e582c7739bc55948107131f564a9756abe9e37771 not found: ID does not exist" containerID="183f76bfb28c36055912450e582c7739bc55948107131f564a9756abe9e37771" Jul 09 17:20:26.760867 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.760836 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"183f76bfb28c36055912450e582c7739bc55948107131f564a9756abe9e37771"} err="failed to get container status \"183f76bfb28c36055912450e582c7739bc55948107131f564a9756abe9e37771\": rpc error: code = NotFound desc = could not find container \"183f76bfb28c36055912450e582c7739bc55948107131f564a9756abe9e37771\": container with ID starting with 183f76bfb28c36055912450e582c7739bc55948107131f564a9756abe9e37771 not found: ID does not exist" Jul 09 17:20:26.766133 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.766113 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb"] Jul 09 17:20:26.769995 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:26.769976 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-8384063d-openshift-default-79f49895-6bsqb"] Jul 09 17:20:28.176933 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:20:28.176896 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50389d4d-af65-4b17-9ffd-e3a8c79d0eb6" path="/var/lib/kubelet/pods/50389d4d-af65-4b17-9ffd-e3a8c79d0eb6/volumes" Jul 09 17:21:02.228907 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:02.228876 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pcwtl_12995bc0-2245-4f06-aad5-b496fd24f0b1/ovn-acl-logging/0.log" Jul 09 17:21:02.229778 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:02.229762 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pcwtl_12995bc0-2245-4f06-aad5-b496fd24f0b1/ovn-acl-logging/0.log" Jul 09 17:21:15.184780 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.184748 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw"] Jul 09 17:21:15.185171 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.185062 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50389d4d-af65-4b17-9ffd-e3a8c79d0eb6" containerName="istio-proxy" Jul 09 17:21:15.185171 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.185072 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="50389d4d-af65-4b17-9ffd-e3a8c79d0eb6" containerName="istio-proxy" Jul 09 17:21:15.185171 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.185087 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50389d4d-af65-4b17-9ffd-e3a8c79d0eb6" containerName="istio-proxy" Jul 09 17:21:15.185171 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.185094 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="50389d4d-af65-4b17-9ffd-e3a8c79d0eb6" containerName="istio-proxy" Jul 09 17:21:15.185171 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.185143 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="50389d4d-af65-4b17-9ffd-e3a8c79d0eb6" containerName="istio-proxy" Jul 09 17:21:15.185171 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.185152 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="50389d4d-af65-4b17-9ffd-e3a8c79d0eb6" containerName="istio-proxy" Jul 09 17:21:15.187522 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.187504 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.189986 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.189958 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-88cd44-openshift-default-dockercfg-d44wr\"" Jul 09 17:21:15.205738 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.205711 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw"] Jul 09 17:21:15.292933 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.292892 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-workload-socket\") pod \"e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.292933 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.292938 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-workload-certs\") pod \"e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.293195 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.292978 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-credential-socket\") pod \"e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.293195 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.293044 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istio-token\") pod \"e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.293195 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.293100 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istio-envoy\") pod \"e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.293195 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.293148 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istio-podinfo\") pod \"e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.293394 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.293221 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istio-data\") pod \"e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.293394 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.293241 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rgb8\" (UniqueName: \"kubernetes.io/projected/da112a3d-a6ee-4b28-ada8-e10ace9f4924-kube-api-access-7rgb8\") pod \"e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.293394 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.293260 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istiod-ca-cert\") pod \"e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.393909 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.393870 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istio-envoy\") pod \"e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.394082 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.393922 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istio-podinfo\") pod \"e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.394082 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.394050 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istio-data\") pod \"e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.394159 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.394088 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rgb8\" (UniqueName: \"kubernetes.io/projected/da112a3d-a6ee-4b28-ada8-e10ace9f4924-kube-api-access-7rgb8\") pod \"e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.394226 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.394205 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istiod-ca-cert\") pod \"e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.394272 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.394245 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-workload-socket\") pod \"e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.394272 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.394267 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-workload-certs\") pod \"e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.394400 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.394333 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-credential-socket\") pod \"e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.394400 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.394374 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istio-token\") pod \"e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.394503 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.394429 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istio-data\") pod \"e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.394631 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.394605 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-workload-socket\") pod \"e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.394701 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.394643 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-workload-certs\") pod \"e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.394759 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.394712 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-credential-socket\") pod \"e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.394984 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.394961 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istiod-ca-cert\") pod \"e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.396495 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.396475 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istio-envoy\") pod \"e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.397089 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.397069 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istio-podinfo\") pod \"e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.402017 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.401989 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istio-token\") pod \"e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.402305 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.402266 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rgb8\" (UniqueName: \"kubernetes.io/projected/da112a3d-a6ee-4b28-ada8-e10ace9f4924-kube-api-access-7rgb8\") pod \"e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.497360 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.497263 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:15.633534 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.633510 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw"] Jul 09 17:21:15.634772 ip-10-0-128-34 kubenswrapper[2580]: W0709 17:21:15.634745 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda112a3d_a6ee_4b28_ada8_e10ace9f4924.slice/crio-50e212e31beec99544340afcde7f85d13622f5828c19627f311e680e9dfa4cbc WatchSource:0}: Error finding container 50e212e31beec99544340afcde7f85d13622f5828c19627f311e680e9dfa4cbc: Status 404 returned error can't find the container with id 50e212e31beec99544340afcde7f85d13622f5828c19627f311e680e9dfa4cbc Jul 09 17:21:15.636770 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.636735 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:21:15.636855 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.636799 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:21:15.636855 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.636830 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:21:15.986932 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.986892 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" event={"ID":"da112a3d-a6ee-4b28-ada8-e10ace9f4924","Type":"ContainerStarted","Data":"bb158a338a6967afc37d0aec53c85d5d04c845af43869d5eac67725b828b9860"} Jul 09 17:21:15.987097 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:15.986956 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" event={"ID":"da112a3d-a6ee-4b28-ada8-e10ace9f4924","Type":"ContainerStarted","Data":"50e212e31beec99544340afcde7f85d13622f5828c19627f311e680e9dfa4cbc"} Jul 09 17:21:16.006463 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:16.006411 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" podStartSLOduration=1.006396053 podStartE2EDuration="1.006396053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:21:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:21:16.003914193 +0000 UTC m=+1814.368666110" watchObservedRunningTime="2026-07-09 17:21:16.006396053 +0000 UTC m=+1814.371147968" Jul 09 17:21:16.497816 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:16.497783 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:16.502602 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:16.502575 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:16.992051 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:16.992021 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:16.992888 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:16.992867 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:23.099619 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.099587 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq"] Jul 09 17:21:23.102261 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.102239 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.104733 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.104712 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-33cf76-openshift-default-dockercfg-zpfmc\"" Jul 09 17:21:23.115335 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.115314 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq"] Jul 09 17:21:23.269138 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.269103 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-workload-certs\") pod \"e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.269138 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.269145 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istio-envoy\") pod \"e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.269407 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.269177 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-credential-socket\") pod \"e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.269407 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.269228 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfldx\" (UniqueName: \"kubernetes.io/projected/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-kube-api-access-sfldx\") pod \"e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.269407 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.269303 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istio-podinfo\") pod \"e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.269407 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.269375 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istiod-ca-cert\") pod \"e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.269609 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.269467 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istio-data\") pod \"e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.269609 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.269522 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istio-token\") pod \"e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.269609 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.269590 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-workload-socket\") pod \"e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.370253 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.370189 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istio-data\") pod \"e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.370253 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.370222 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istio-token\") pod \"e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.370253 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.370253 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-workload-socket\") pod \"e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.370518 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.370275 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-workload-certs\") pod \"e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.370518 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.370414 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istio-envoy\") pod \"e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.370518 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.370468 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-credential-socket\") pod \"e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.370518 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.370496 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfldx\" (UniqueName: \"kubernetes.io/projected/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-kube-api-access-sfldx\") pod \"e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.370718 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.370536 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istio-podinfo\") pod \"e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.370718 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.370579 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istiod-ca-cert\") pod \"e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.370718 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.370613 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istio-data\") pod \"e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.370870 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.370737 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-workload-certs\") pod \"e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.370870 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.370779 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-workload-socket\") pod \"e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.370980 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.370874 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-credential-socket\") pod \"e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.371255 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.371232 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istiod-ca-cert\") pod \"e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.372964 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.372944 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istio-envoy\") pod \"e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.373036 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.373021 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istio-podinfo\") pod \"e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.378960 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.378931 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istio-token\") pod \"e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.380005 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.379978 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfldx\" (UniqueName: \"kubernetes.io/projected/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-kube-api-access-sfldx\") pod \"e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.413777 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.413754 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:23.547653 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.547623 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq"] Jul 09 17:21:23.549045 ip-10-0-128-34 kubenswrapper[2580]: W0709 17:21:23.549015 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb26f6032_5ee9_43c6_98c4_5b1541da4fe5.slice/crio-cd2a2391b976da923f6418c9a5cc31b65fb47ba46d2f91d38d085c6bba55b9b1 WatchSource:0}: Error finding container cd2a2391b976da923f6418c9a5cc31b65fb47ba46d2f91d38d085c6bba55b9b1: Status 404 returned error can't find the container with id cd2a2391b976da923f6418c9a5cc31b65fb47ba46d2f91d38d085c6bba55b9b1 Jul 09 17:21:23.551025 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.550991 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:21:23.551099 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.551059 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:21:23.551099 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:23.551089 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:21:24.027608 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:24.027572 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" event={"ID":"b26f6032-5ee9-43c6-98c4-5b1541da4fe5","Type":"ContainerStarted","Data":"ee679c1eca8ff105467100f48e93ee32edb9a2539b3c9dbfbef61ef6abf97ed7"} Jul 09 17:21:24.027754 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:24.027636 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" event={"ID":"b26f6032-5ee9-43c6-98c4-5b1541da4fe5","Type":"ContainerStarted","Data":"cd2a2391b976da923f6418c9a5cc31b65fb47ba46d2f91d38d085c6bba55b9b1"} Jul 09 17:21:24.045058 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:24.045004 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" podStartSLOduration=1.044990419 podStartE2EDuration="1.044990419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:21:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:21:24.043672943 +0000 UTC m=+1822.408424907" watchObservedRunningTime="2026-07-09 17:21:24.044990419 +0000 UTC m=+1822.409742335" Jul 09 17:21:24.414256 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:24.414226 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:24.419631 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:24.419608 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:25.033227 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:25.033197 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:25.034256 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:25.034233 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:33.034487 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:33.034443 2580 patch_prober.go:28] interesting pod/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 09 17:21:33.034912 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:33.034525 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" podUID="da112a3d-a6ee-4b28-ada8-e10ace9f4924" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 09 17:21:35.082156 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:35.082118 2580 generic.go:356] "Generic (PLEG): container finished" podID="da112a3d-a6ee-4b28-ada8-e10ace9f4924" containerID="bb158a338a6967afc37d0aec53c85d5d04c845af43869d5eac67725b828b9860" exitCode=0 Jul 09 17:21:35.082701 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:35.082194 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" event={"ID":"da112a3d-a6ee-4b28-ada8-e10ace9f4924","Type":"ContainerDied","Data":"bb158a338a6967afc37d0aec53c85d5d04c845af43869d5eac67725b828b9860"} Jul 09 17:21:35.082775 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:35.082735 2580 scope.go:117] "RemoveContainer" containerID="bb158a338a6967afc37d0aec53c85d5d04c845af43869d5eac67725b828b9860" Jul 09 17:21:35.083759 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:35.083729 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:21:35.083862 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:35.083810 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:21:35.083924 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:35.083857 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:21:36.089570 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:36.089534 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" event={"ID":"da112a3d-a6ee-4b28-ada8-e10ace9f4924","Type":"ContainerStarted","Data":"388124d1f39918a989603a0c33dd193644374d81e2538912ee921194c907fbd7"} Jul 09 17:21:36.497634 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:36.497598 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:36.498006 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:36.497915 2580 patch_prober.go:28] interesting pod/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 09 17:21:36.498186 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:36.498162 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" podUID="da112a3d-a6ee-4b28-ada8-e10ace9f4924" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 09 17:21:37.498706 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:37.498662 2580 patch_prober.go:28] interesting pod/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 09 17:21:37.499373 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:37.499332 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" podUID="da112a3d-a6ee-4b28-ada8-e10ace9f4924" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 09 17:21:38.497747 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:38.497704 2580 patch_prober.go:28] interesting pod/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 09 17:21:38.497948 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:38.497771 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" podUID="da112a3d-a6ee-4b28-ada8-e10ace9f4924" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 09 17:21:39.498305 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:39.497845 2580 patch_prober.go:28] interesting pod/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 09 17:21:39.498305 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:39.497906 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" podUID="da112a3d-a6ee-4b28-ada8-e10ace9f4924" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 09 17:21:40.501741 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:40.501706 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:40.502215 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:40.501977 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:40.502773 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:40.502751 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:21:40.964168 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:40.964121 2580 patch_prober.go:28] interesting pod/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": read tcp 10.134.0.2:51192->10.134.0.44:15021: read: connection reset by peer" start-of-body= Jul 09 17:21:40.964401 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:40.964188 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" podUID="b26f6032-5ee9-43c6-98c4-5b1541da4fe5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": read tcp 10.134.0.2:51192->10.134.0.44:15021: read: connection reset by peer" Jul 09 17:21:41.125939 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:41.123749 2580 generic.go:356] "Generic (PLEG): container finished" podID="b26f6032-5ee9-43c6-98c4-5b1541da4fe5" containerID="ee679c1eca8ff105467100f48e93ee32edb9a2539b3c9dbfbef61ef6abf97ed7" exitCode=0 Jul 09 17:21:41.125939 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:41.123933 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" event={"ID":"b26f6032-5ee9-43c6-98c4-5b1541da4fe5","Type":"ContainerDied","Data":"ee679c1eca8ff105467100f48e93ee32edb9a2539b3c9dbfbef61ef6abf97ed7"} Jul 09 17:21:41.125939 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:41.125055 2580 scope.go:117] "RemoveContainer" containerID="ee679c1eca8ff105467100f48e93ee32edb9a2539b3c9dbfbef61ef6abf97ed7" Jul 09 17:21:41.130421 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:41.130388 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:21:41.130502 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:41.130472 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:21:41.130540 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:41.130529 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:21:42.131037 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:42.130995 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" event={"ID":"b26f6032-5ee9-43c6-98c4-5b1541da4fe5","Type":"ContainerStarted","Data":"fe1370b658ac4530b021f2ff1e32ccb0f7f4b4ea2df7e05843d485762b5316a3"} Jul 09 17:21:42.414580 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:42.414475 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:42.415154 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:42.414814 2580 patch_prober.go:28] interesting pod/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 09 17:21:42.415154 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:42.414881 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" podUID="b26f6032-5ee9-43c6-98c4-5b1541da4fe5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 09 17:21:43.414561 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:43.414509 2580 patch_prober.go:28] interesting pod/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 09 17:21:43.415084 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:43.414583 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" podUID="b26f6032-5ee9-43c6-98c4-5b1541da4fe5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 09 17:21:44.414306 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:44.414239 2580 patch_prober.go:28] interesting pod/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 09 17:21:44.414513 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:44.414336 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" podUID="b26f6032-5ee9-43c6-98c4-5b1541da4fe5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 09 17:21:45.415091 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:45.415044 2580 patch_prober.go:28] interesting pod/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 09 17:21:45.415598 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:45.415111 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" podUID="b26f6032-5ee9-43c6-98c4-5b1541da4fe5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 09 17:21:46.418128 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:46.418091 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:46.418617 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:46.418409 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:21:46.419199 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:21:46.419178 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:23:12.704579 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:12.704544 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw"] Jul 09 17:23:12.705083 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:12.704809 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" podUID="da112a3d-a6ee-4b28-ada8-e10ace9f4924" containerName="istio-proxy" containerID="cri-o://388124d1f39918a989603a0c33dd193644374d81e2538912ee921194c907fbd7" gracePeriod=30 Jul 09 17:23:17.962051 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:17.962024 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:23:17.974544 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:17.974487 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istio-podinfo\") pod \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " Jul 09 17:23:17.974661 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:17.974542 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istio-token\") pod \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " Jul 09 17:23:17.974661 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:17.974575 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istio-envoy\") pod \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " Jul 09 17:23:17.974661 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:17.974610 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istio-data\") pod \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " Jul 09 17:23:17.974661 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:17.974633 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istiod-ca-cert\") pod \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " Jul 09 17:23:17.974878 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:17.974669 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-workload-socket\") pod \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " Jul 09 17:23:17.974878 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:17.974695 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-workload-certs\") pod \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " Jul 09 17:23:17.974878 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:17.974751 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-credential-socket\") pod \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " Jul 09 17:23:17.974878 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:17.974850 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rgb8\" (UniqueName: \"kubernetes.io/projected/da112a3d-a6ee-4b28-ada8-e10ace9f4924-kube-api-access-7rgb8\") pod \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\" (UID: \"da112a3d-a6ee-4b28-ada8-e10ace9f4924\") " Jul 09 17:23:17.975076 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:17.974996 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "da112a3d-a6ee-4b28-ada8-e10ace9f4924" (UID: "da112a3d-a6ee-4b28-ada8-e10ace9f4924"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:23:17.975306 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:17.975210 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istiod-ca-cert\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:23:17.975704 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:17.975483 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "da112a3d-a6ee-4b28-ada8-e10ace9f4924" (UID: "da112a3d-a6ee-4b28-ada8-e10ace9f4924"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:23:17.975704 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:17.975562 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "da112a3d-a6ee-4b28-ada8-e10ace9f4924" (UID: "da112a3d-a6ee-4b28-ada8-e10ace9f4924"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:23:17.975704 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:17.975671 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istio-data" (OuterVolumeSpecName: "istio-data") pod "da112a3d-a6ee-4b28-ada8-e10ace9f4924" (UID: "da112a3d-a6ee-4b28-ada8-e10ace9f4924"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:23:17.975704 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:17.975681 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "da112a3d-a6ee-4b28-ada8-e10ace9f4924" (UID: "da112a3d-a6ee-4b28-ada8-e10ace9f4924"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:23:17.976891 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:17.976869 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "da112a3d-a6ee-4b28-ada8-e10ace9f4924" (UID: "da112a3d-a6ee-4b28-ada8-e10ace9f4924"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:23:17.977030 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:17.977015 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istio-token" (OuterVolumeSpecName: "istio-token") pod "da112a3d-a6ee-4b28-ada8-e10ace9f4924" (UID: "da112a3d-a6ee-4b28-ada8-e10ace9f4924"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:23:17.977217 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:17.977199 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "da112a3d-a6ee-4b28-ada8-e10ace9f4924" (UID: "da112a3d-a6ee-4b28-ada8-e10ace9f4924"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 17:23:17.977577 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:17.977559 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da112a3d-a6ee-4b28-ada8-e10ace9f4924-kube-api-access-7rgb8" (OuterVolumeSpecName: "kube-api-access-7rgb8") pod "da112a3d-a6ee-4b28-ada8-e10ace9f4924" (UID: "da112a3d-a6ee-4b28-ada8-e10ace9f4924"). InnerVolumeSpecName "kube-api-access-7rgb8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:23:18.076419 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:18.076389 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istio-token\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:23:18.076419 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:18.076416 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istio-envoy\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:23:18.076584 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:18.076428 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istio-data\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:23:18.076584 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:18.076440 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-workload-socket\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:23:18.076584 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:18.076453 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-workload-certs\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:23:18.076584 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:18.076465 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/da112a3d-a6ee-4b28-ada8-e10ace9f4924-credential-socket\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:23:18.076584 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:18.076477 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rgb8\" (UniqueName: \"kubernetes.io/projected/da112a3d-a6ee-4b28-ada8-e10ace9f4924-kube-api-access-7rgb8\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:23:18.076584 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:18.076490 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/da112a3d-a6ee-4b28-ada8-e10ace9f4924-istio-podinfo\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:23:18.618733 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:18.618687 2580 generic.go:356] "Generic (PLEG): container finished" podID="da112a3d-a6ee-4b28-ada8-e10ace9f4924" containerID="388124d1f39918a989603a0c33dd193644374d81e2538912ee921194c907fbd7" exitCode=0 Jul 09 17:23:18.618895 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:18.618759 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" Jul 09 17:23:18.618895 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:18.618769 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" event={"ID":"da112a3d-a6ee-4b28-ada8-e10ace9f4924","Type":"ContainerDied","Data":"388124d1f39918a989603a0c33dd193644374d81e2538912ee921194c907fbd7"} Jul 09 17:23:18.618895 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:18.618854 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw" event={"ID":"da112a3d-a6ee-4b28-ada8-e10ace9f4924","Type":"ContainerDied","Data":"50e212e31beec99544340afcde7f85d13622f5828c19627f311e680e9dfa4cbc"} Jul 09 17:23:18.618895 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:18.618877 2580 scope.go:117] "RemoveContainer" containerID="388124d1f39918a989603a0c33dd193644374d81e2538912ee921194c907fbd7" Jul 09 17:23:18.627820 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:18.627789 2580 scope.go:117] "RemoveContainer" containerID="bb158a338a6967afc37d0aec53c85d5d04c845af43869d5eac67725b828b9860" Jul 09 17:23:18.635969 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:18.635951 2580 scope.go:117] "RemoveContainer" containerID="388124d1f39918a989603a0c33dd193644374d81e2538912ee921194c907fbd7" Jul 09 17:23:18.636209 ip-10-0-128-34 kubenswrapper[2580]: E0709 17:23:18.636191 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"388124d1f39918a989603a0c33dd193644374d81e2538912ee921194c907fbd7\": container with ID starting with 388124d1f39918a989603a0c33dd193644374d81e2538912ee921194c907fbd7 not found: ID does not exist" containerID="388124d1f39918a989603a0c33dd193644374d81e2538912ee921194c907fbd7" Jul 09 17:23:18.636264 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:18.636218 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"388124d1f39918a989603a0c33dd193644374d81e2538912ee921194c907fbd7"} err="failed to get container status \"388124d1f39918a989603a0c33dd193644374d81e2538912ee921194c907fbd7\": rpc error: code = NotFound desc = could not find container \"388124d1f39918a989603a0c33dd193644374d81e2538912ee921194c907fbd7\": container with ID starting with 388124d1f39918a989603a0c33dd193644374d81e2538912ee921194c907fbd7 not found: ID does not exist" Jul 09 17:23:18.636264 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:18.636252 2580 scope.go:117] "RemoveContainer" containerID="bb158a338a6967afc37d0aec53c85d5d04c845af43869d5eac67725b828b9860" Jul 09 17:23:18.636505 ip-10-0-128-34 kubenswrapper[2580]: E0709 17:23:18.636484 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb158a338a6967afc37d0aec53c85d5d04c845af43869d5eac67725b828b9860\": container with ID starting with bb158a338a6967afc37d0aec53c85d5d04c845af43869d5eac67725b828b9860 not found: ID does not exist" containerID="bb158a338a6967afc37d0aec53c85d5d04c845af43869d5eac67725b828b9860" Jul 09 17:23:18.636547 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:18.636516 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb158a338a6967afc37d0aec53c85d5d04c845af43869d5eac67725b828b9860"} err="failed to get container status \"bb158a338a6967afc37d0aec53c85d5d04c845af43869d5eac67725b828b9860\": rpc error: code = NotFound desc = could not find container \"bb158a338a6967afc37d0aec53c85d5d04c845af43869d5eac67725b828b9860\": container with ID starting with bb158a338a6967afc37d0aec53c85d5d04c845af43869d5eac67725b828b9860 not found: ID does not exist" Jul 09 17:23:18.637215 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:18.637197 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw"] Jul 09 17:23:18.645150 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:18.645130 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-88cd44-openshift-default-cc647864c-prxnw"] Jul 09 17:23:19.771040 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:19.771004 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq"] Jul 09 17:23:19.771464 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:19.771216 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" podUID="b26f6032-5ee9-43c6-98c4-5b1541da4fe5" containerName="istio-proxy" containerID="cri-o://fe1370b658ac4530b021f2ff1e32ccb0f7f4b4ea2df7e05843d485762b5316a3" gracePeriod=30 Jul 09 17:23:20.177943 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.177908 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da112a3d-a6ee-4b28-ada8-e10ace9f4924" path="/var/lib/kubelet/pods/da112a3d-a6ee-4b28-ada8-e10ace9f4924/volumes" Jul 09 17:23:20.612504 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.612469 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz"] Jul 09 17:23:20.612801 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.612789 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da112a3d-a6ee-4b28-ada8-e10ace9f4924" containerName="istio-proxy" Jul 09 17:23:20.612847 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.612803 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="da112a3d-a6ee-4b28-ada8-e10ace9f4924" containerName="istio-proxy" Jul 09 17:23:20.612882 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.612868 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="da112a3d-a6ee-4b28-ada8-e10ace9f4924" containerName="istio-proxy" Jul 09 17:23:20.612882 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.612877 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="da112a3d-a6ee-4b28-ada8-e10ace9f4924" containerName="istio-proxy" Jul 09 17:23:20.615806 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.615782 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:20.617821 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.617797 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-fd442b-openshift-default-dockercfg-5hf5k\"" Jul 09 17:23:20.626348 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.626325 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz"] Jul 09 17:23:20.703340 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.703309 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-istio-data\") pod \"e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:20.703508 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.703387 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-workload-socket\") pod \"e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:20.703508 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.703418 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a69751a6-b0e8-4271-92bd-bcb2b5319762-istio-podinfo\") pod \"e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:20.703508 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.703450 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfpz7\" (UniqueName: \"kubernetes.io/projected/a69751a6-b0e8-4271-92bd-bcb2b5319762-kube-api-access-gfpz7\") pod \"e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:20.703689 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.703514 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a69751a6-b0e8-4271-92bd-bcb2b5319762-istiod-ca-cert\") pod \"e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:20.703689 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.703562 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-workload-certs\") pod \"e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:20.703689 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.703612 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-istio-envoy\") pod \"e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:20.703689 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.703661 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a69751a6-b0e8-4271-92bd-bcb2b5319762-istio-token\") pod \"e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:20.703881 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.703695 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-credential-socket\") pod \"e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:20.804756 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.804721 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-istio-data\") pod \"e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:20.805234 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.804774 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-workload-socket\") pod \"e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:20.805234 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.804796 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a69751a6-b0e8-4271-92bd-bcb2b5319762-istio-podinfo\") pod \"e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:20.805234 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.804824 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfpz7\" (UniqueName: \"kubernetes.io/projected/a69751a6-b0e8-4271-92bd-bcb2b5319762-kube-api-access-gfpz7\") pod \"e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:20.805234 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.804845 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a69751a6-b0e8-4271-92bd-bcb2b5319762-istiod-ca-cert\") pod \"e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:20.805234 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.804863 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-workload-certs\") pod \"e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:20.805234 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.804880 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-istio-envoy\") pod \"e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:20.805234 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.804911 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a69751a6-b0e8-4271-92bd-bcb2b5319762-istio-token\") pod \"e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:20.805234 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.804944 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-credential-socket\") pod \"e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:20.805234 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.805217 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-workload-socket\") pod \"e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:20.805234 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.805237 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-istio-data\") pod \"e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:20.805689 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.805332 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-workload-certs\") pod \"e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:20.805689 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.805511 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-credential-socket\") pod \"e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:20.805784 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.805737 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a69751a6-b0e8-4271-92bd-bcb2b5319762-istiod-ca-cert\") pod \"e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:20.807427 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.807405 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-istio-envoy\") pod \"e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:20.807565 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.807547 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a69751a6-b0e8-4271-92bd-bcb2b5319762-istio-podinfo\") pod \"e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:20.812922 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.812897 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a69751a6-b0e8-4271-92bd-bcb2b5319762-istio-token\") pod \"e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:20.813129 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.813110 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfpz7\" (UniqueName: \"kubernetes.io/projected/a69751a6-b0e8-4271-92bd-bcb2b5319762-kube-api-access-gfpz7\") pod \"e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:20.926482 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:20.926390 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:21.059055 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:21.059032 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz"] Jul 09 17:23:21.060496 ip-10-0-128-34 kubenswrapper[2580]: W0709 17:23:21.060471 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda69751a6_b0e8_4271_92bd_bcb2b5319762.slice/crio-e4cb752f54404e2bc51a841ecd769afdeb94edcc713d97f38e0ecef8485a3d80 WatchSource:0}: Error finding container e4cb752f54404e2bc51a841ecd769afdeb94edcc713d97f38e0ecef8485a3d80: Status 404 returned error can't find the container with id e4cb752f54404e2bc51a841ecd769afdeb94edcc713d97f38e0ecef8485a3d80 Jul 09 17:23:21.062553 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:21.062522 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:23:21.062637 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:21.062613 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:23:21.062677 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:21.062643 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:23:21.636419 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:21.636385 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" event={"ID":"a69751a6-b0e8-4271-92bd-bcb2b5319762","Type":"ContainerStarted","Data":"c84cac99c20a2be536aaf1ecb304f6de9b650c120430cc534603f38ab6d5aa77"} Jul 09 17:23:21.636590 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:21.636441 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" event={"ID":"a69751a6-b0e8-4271-92bd-bcb2b5319762","Type":"ContainerStarted","Data":"e4cb752f54404e2bc51a841ecd769afdeb94edcc713d97f38e0ecef8485a3d80"} Jul 09 17:23:21.658142 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:21.658090 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" podStartSLOduration=1.658075732 podStartE2EDuration="1.658075732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:23:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:23:21.655577871 +0000 UTC m=+1940.020329787" watchObservedRunningTime="2026-07-09 17:23:21.658075732 +0000 UTC m=+1940.022827647" Jul 09 17:23:21.927209 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:21.927122 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:22.931506 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:22.931473 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:23.647429 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:23.647395 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:23.648355 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:23.648334 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:25.017653 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.017630 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:23:25.141456 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.141420 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istio-podinfo\") pod \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " Jul 09 17:23:25.141608 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.141473 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istio-token\") pod \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " Jul 09 17:23:25.141608 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.141504 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-credential-socket\") pod \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " Jul 09 17:23:25.141608 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.141529 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istio-envoy\") pod \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " Jul 09 17:23:25.141608 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.141549 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istiod-ca-cert\") pod \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " Jul 09 17:23:25.141608 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.141565 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-workload-socket\") pod \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " Jul 09 17:23:25.141608 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.141602 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istio-data\") pod \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " Jul 09 17:23:25.141926 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.141656 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-workload-certs\") pod \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " Jul 09 17:23:25.141926 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.141690 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfldx\" (UniqueName: \"kubernetes.io/projected/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-kube-api-access-sfldx\") pod \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\" (UID: \"b26f6032-5ee9-43c6-98c4-5b1541da4fe5\") " Jul 09 17:23:25.142021 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.141917 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b26f6032-5ee9-43c6-98c4-5b1541da4fe5" (UID: "b26f6032-5ee9-43c6-98c4-5b1541da4fe5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:23:25.142021 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.141930 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b26f6032-5ee9-43c6-98c4-5b1541da4fe5" (UID: "b26f6032-5ee9-43c6-98c4-5b1541da4fe5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:23:25.142129 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.142104 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b26f6032-5ee9-43c6-98c4-5b1541da4fe5" (UID: "b26f6032-5ee9-43c6-98c4-5b1541da4fe5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:23:25.142176 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.142156 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b26f6032-5ee9-43c6-98c4-5b1541da4fe5" (UID: "b26f6032-5ee9-43c6-98c4-5b1541da4fe5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:23:25.142812 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.142775 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istio-data" (OuterVolumeSpecName: "istio-data") pod "b26f6032-5ee9-43c6-98c4-5b1541da4fe5" (UID: "b26f6032-5ee9-43c6-98c4-5b1541da4fe5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:23:25.143902 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.143875 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b26f6032-5ee9-43c6-98c4-5b1541da4fe5" (UID: "b26f6032-5ee9-43c6-98c4-5b1541da4fe5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 17:23:25.143902 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.143881 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istio-token" (OuterVolumeSpecName: "istio-token") pod "b26f6032-5ee9-43c6-98c4-5b1541da4fe5" (UID: "b26f6032-5ee9-43c6-98c4-5b1541da4fe5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:23:25.144051 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.143984 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-kube-api-access-sfldx" (OuterVolumeSpecName: "kube-api-access-sfldx") pod "b26f6032-5ee9-43c6-98c4-5b1541da4fe5" (UID: "b26f6032-5ee9-43c6-98c4-5b1541da4fe5"). InnerVolumeSpecName "kube-api-access-sfldx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:23:25.144547 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.144524 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b26f6032-5ee9-43c6-98c4-5b1541da4fe5" (UID: "b26f6032-5ee9-43c6-98c4-5b1541da4fe5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:23:25.242433 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.242395 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istio-envoy\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:23:25.242433 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.242427 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istiod-ca-cert\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:23:25.242433 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.242435 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-workload-socket\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:23:25.242433 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.242443 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istio-data\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:23:25.242726 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.242452 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-workload-certs\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:23:25.242726 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.242459 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfldx\" (UniqueName: \"kubernetes.io/projected/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-kube-api-access-sfldx\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:23:25.242726 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.242468 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istio-podinfo\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:23:25.242726 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.242475 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-istio-token\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:23:25.242726 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.242483 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b26f6032-5ee9-43c6-98c4-5b1541da4fe5-credential-socket\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:23:25.660745 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.660707 2580 generic.go:356] "Generic (PLEG): container finished" podID="b26f6032-5ee9-43c6-98c4-5b1541da4fe5" containerID="fe1370b658ac4530b021f2ff1e32ccb0f7f4b4ea2df7e05843d485762b5316a3" exitCode=0 Jul 09 17:23:25.660920 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.660759 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" Jul 09 17:23:25.660920 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.660787 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" event={"ID":"b26f6032-5ee9-43c6-98c4-5b1541da4fe5","Type":"ContainerDied","Data":"fe1370b658ac4530b021f2ff1e32ccb0f7f4b4ea2df7e05843d485762b5316a3"} Jul 09 17:23:25.660920 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.660843 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq" event={"ID":"b26f6032-5ee9-43c6-98c4-5b1541da4fe5","Type":"ContainerDied","Data":"cd2a2391b976da923f6418c9a5cc31b65fb47ba46d2f91d38d085c6bba55b9b1"} Jul 09 17:23:25.660920 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.660865 2580 scope.go:117] "RemoveContainer" containerID="fe1370b658ac4530b021f2ff1e32ccb0f7f4b4ea2df7e05843d485762b5316a3" Jul 09 17:23:25.670174 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.670146 2580 scope.go:117] "RemoveContainer" containerID="ee679c1eca8ff105467100f48e93ee32edb9a2539b3c9dbfbef61ef6abf97ed7" Jul 09 17:23:25.678132 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.678111 2580 scope.go:117] "RemoveContainer" containerID="fe1370b658ac4530b021f2ff1e32ccb0f7f4b4ea2df7e05843d485762b5316a3" Jul 09 17:23:25.678389 ip-10-0-128-34 kubenswrapper[2580]: E0709 17:23:25.678371 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe1370b658ac4530b021f2ff1e32ccb0f7f4b4ea2df7e05843d485762b5316a3\": container with ID starting with fe1370b658ac4530b021f2ff1e32ccb0f7f4b4ea2df7e05843d485762b5316a3 not found: ID does not exist" containerID="fe1370b658ac4530b021f2ff1e32ccb0f7f4b4ea2df7e05843d485762b5316a3" Jul 09 17:23:25.678445 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.678396 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe1370b658ac4530b021f2ff1e32ccb0f7f4b4ea2df7e05843d485762b5316a3"} err="failed to get container status \"fe1370b658ac4530b021f2ff1e32ccb0f7f4b4ea2df7e05843d485762b5316a3\": rpc error: code = NotFound desc = could not find container \"fe1370b658ac4530b021f2ff1e32ccb0f7f4b4ea2df7e05843d485762b5316a3\": container with ID starting with fe1370b658ac4530b021f2ff1e32ccb0f7f4b4ea2df7e05843d485762b5316a3 not found: ID does not exist" Jul 09 17:23:25.678445 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.678412 2580 scope.go:117] "RemoveContainer" containerID="ee679c1eca8ff105467100f48e93ee32edb9a2539b3c9dbfbef61ef6abf97ed7" Jul 09 17:23:25.678653 ip-10-0-128-34 kubenswrapper[2580]: E0709 17:23:25.678634 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee679c1eca8ff105467100f48e93ee32edb9a2539b3c9dbfbef61ef6abf97ed7\": container with ID starting with ee679c1eca8ff105467100f48e93ee32edb9a2539b3c9dbfbef61ef6abf97ed7 not found: ID does not exist" containerID="ee679c1eca8ff105467100f48e93ee32edb9a2539b3c9dbfbef61ef6abf97ed7" Jul 09 17:23:25.678708 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.678663 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee679c1eca8ff105467100f48e93ee32edb9a2539b3c9dbfbef61ef6abf97ed7"} err="failed to get container status \"ee679c1eca8ff105467100f48e93ee32edb9a2539b3c9dbfbef61ef6abf97ed7\": rpc error: code = NotFound desc = could not find container \"ee679c1eca8ff105467100f48e93ee32edb9a2539b3c9dbfbef61ef6abf97ed7\": container with ID starting with ee679c1eca8ff105467100f48e93ee32edb9a2539b3c9dbfbef61ef6abf97ed7 not found: ID does not exist" Jul 09 17:23:25.683579 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.683559 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq"] Jul 09 17:23:25.687531 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:25.687511 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-33cf76-openshift-default-5bd76cd4f9-fcjkq"] Jul 09 17:23:26.178048 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:26.178016 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b26f6032-5ee9-43c6-98c4-5b1541da4fe5" path="/var/lib/kubelet/pods/b26f6032-5ee9-43c6-98c4-5b1541da4fe5/volumes" Jul 09 17:23:28.862428 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:28.862393 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw"] Jul 09 17:23:28.862904 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:28.862884 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b26f6032-5ee9-43c6-98c4-5b1541da4fe5" containerName="istio-proxy" Jul 09 17:23:28.862991 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:28.862908 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b26f6032-5ee9-43c6-98c4-5b1541da4fe5" containerName="istio-proxy" Jul 09 17:23:28.862991 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:28.862933 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da112a3d-a6ee-4b28-ada8-e10ace9f4924" containerName="istio-proxy" Jul 09 17:23:28.862991 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:28.862941 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="da112a3d-a6ee-4b28-ada8-e10ace9f4924" containerName="istio-proxy" Jul 09 17:23:28.863141 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:28.863032 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b26f6032-5ee9-43c6-98c4-5b1541da4fe5" containerName="istio-proxy" Jul 09 17:23:28.865863 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:28.865842 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:28.868066 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:28.868046 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-890eaa-openshift-default-dockercfg-7rjsp\"" Jul 09 17:23:28.875943 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:28.875911 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw"] Jul 09 17:23:28.980940 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:28.980898 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istio-data\") pod \"e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:28.980940 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:28.980942 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istio-podinfo\") pod \"e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:28.981168 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:28.980967 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istiod-ca-cert\") pod \"e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:28.981168 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:28.981039 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rvzn\" (UniqueName: \"kubernetes.io/projected/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-kube-api-access-7rvzn\") pod \"e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:28.981168 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:28.981095 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istio-envoy\") pod \"e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:28.981168 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:28.981129 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istio-token\") pod \"e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:28.981168 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:28.981154 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-workload-certs\") pod \"e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:28.981392 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:28.981201 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-credential-socket\") pod \"e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:28.981392 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:28.981234 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-workload-socket\") pod \"e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:29.082134 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:29.082097 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istio-data\") pod \"e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:29.082134 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:29.082135 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istio-podinfo\") pod \"e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:29.082444 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:29.082156 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istiod-ca-cert\") pod \"e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:29.082444 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:29.082173 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rvzn\" (UniqueName: \"kubernetes.io/projected/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-kube-api-access-7rvzn\") pod \"e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:29.082444 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:29.082205 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istio-envoy\") pod \"e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:29.082444 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:29.082246 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istio-token\") pod \"e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:29.082444 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:29.082274 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-workload-certs\") pod \"e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:29.082444 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:29.082362 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-credential-socket\") pod \"e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:29.082444 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:29.082398 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-workload-socket\") pod \"e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:29.082767 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:29.082603 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istio-data\") pod \"e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:29.082767 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:29.082697 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-workload-certs\") pod \"e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:29.082837 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:29.082787 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-credential-socket\") pod \"e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:29.082876 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:29.082846 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-workload-socket\") pod \"e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:29.083017 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:29.082993 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istiod-ca-cert\") pod \"e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:29.084673 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:29.084646 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istio-envoy\") pod \"e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:29.085018 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:29.085002 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istio-podinfo\") pod \"e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:29.090106 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:29.090080 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rvzn\" (UniqueName: \"kubernetes.io/projected/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-kube-api-access-7rvzn\") pod \"e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:29.090251 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:29.090232 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istio-token\") pod \"e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:29.177619 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:29.177558 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:29.318970 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:29.318946 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw"] Jul 09 17:23:29.320852 ip-10-0-128-34 kubenswrapper[2580]: W0709 17:23:29.320825 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b4b5eb0_8e9a_4452_92e3_5cfbb2f01f1e.slice/crio-d33f9a2e4e4dba1f8b4d746c6ab5fef52268f527b2c8e45459294e1bed6f83df WatchSource:0}: Error finding container d33f9a2e4e4dba1f8b4d746c6ab5fef52268f527b2c8e45459294e1bed6f83df: Status 404 returned error can't find the container with id d33f9a2e4e4dba1f8b4d746c6ab5fef52268f527b2c8e45459294e1bed6f83df Jul 09 17:23:29.323042 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:29.323006 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:23:29.323112 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:29.323095 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:23:29.323154 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:29.323139 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:23:29.682414 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:29.682381 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" event={"ID":"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e","Type":"ContainerStarted","Data":"65656e1d77b113a5f70a26cbb92acd55f54f082305a0be5ea81477ddf5953ea7"} Jul 09 17:23:29.682605 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:29.682441 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" event={"ID":"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e","Type":"ContainerStarted","Data":"d33f9a2e4e4dba1f8b4d746c6ab5fef52268f527b2c8e45459294e1bed6f83df"} Jul 09 17:23:29.701312 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:29.701229 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" podStartSLOduration=1.701212296 podStartE2EDuration="1.701212296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:23:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:23:29.699119076 +0000 UTC m=+1948.063870993" watchObservedRunningTime="2026-07-09 17:23:29.701212296 +0000 UTC m=+1948.065964210" Jul 09 17:23:30.177694 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:30.177666 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:30.182516 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:30.182494 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:30.687391 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:30.687356 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:30.688380 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:30.688361 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:39.689426 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:39.689386 2580 patch_prober.go:28] interesting pod/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 09 17:23:39.689801 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:39.689466 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" podUID="a69751a6-b0e8-4271-92bd-bcb2b5319762" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 09 17:23:40.749553 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:40.749520 2580 generic.go:356] "Generic (PLEG): container finished" podID="a69751a6-b0e8-4271-92bd-bcb2b5319762" containerID="c84cac99c20a2be536aaf1ecb304f6de9b650c120430cc534603f38ab6d5aa77" exitCode=0 Jul 09 17:23:40.750139 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:40.749589 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" event={"ID":"a69751a6-b0e8-4271-92bd-bcb2b5319762","Type":"ContainerDied","Data":"c84cac99c20a2be536aaf1ecb304f6de9b650c120430cc534603f38ab6d5aa77"} Jul 09 17:23:40.750139 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:40.750075 2580 scope.go:117] "RemoveContainer" containerID="c84cac99c20a2be536aaf1ecb304f6de9b650c120430cc534603f38ab6d5aa77" Jul 09 17:23:40.751127 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:40.751098 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:23:40.751205 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:40.751166 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:23:40.751205 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:40.751197 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:23:41.760028 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:41.759994 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" event={"ID":"a69751a6-b0e8-4271-92bd-bcb2b5319762","Type":"ContainerStarted","Data":"81ce97fa4845b4696fae72b68f29a89c251cb2e0d5427eaa14240fa54aff266f"} Jul 09 17:23:41.926619 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:41.926579 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:41.927036 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:41.927005 2580 patch_prober.go:28] interesting pod/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 09 17:23:41.927146 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:41.927078 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" podUID="a69751a6-b0e8-4271-92bd-bcb2b5319762" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 09 17:23:42.927235 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:42.927186 2580 patch_prober.go:28] interesting pod/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 09 17:23:42.927776 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:42.927257 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" podUID="a69751a6-b0e8-4271-92bd-bcb2b5319762" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 09 17:23:43.927839 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:43.927350 2580 patch_prober.go:28] interesting pod/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 09 17:23:43.927839 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:43.927421 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" podUID="a69751a6-b0e8-4271-92bd-bcb2b5319762" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 09 17:23:44.927541 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:44.927505 2580 patch_prober.go:28] interesting pod/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 09 17:23:44.927709 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:44.927567 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" podUID="a69751a6-b0e8-4271-92bd-bcb2b5319762" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 09 17:23:45.930309 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:45.930250 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:45.930813 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:45.930586 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:45.931214 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:45.931191 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:46.729448 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:46.729406 2580 patch_prober.go:28] interesting pod/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 09 17:23:46.729624 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:46.729463 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" podUID="5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 09 17:23:47.792159 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:47.792130 2580 generic.go:356] "Generic (PLEG): container finished" podID="5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e" containerID="65656e1d77b113a5f70a26cbb92acd55f54f082305a0be5ea81477ddf5953ea7" exitCode=0 Jul 09 17:23:47.792704 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:47.792203 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" event={"ID":"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e","Type":"ContainerDied","Data":"65656e1d77b113a5f70a26cbb92acd55f54f082305a0be5ea81477ddf5953ea7"} Jul 09 17:23:47.792781 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:47.792735 2580 scope.go:117] "RemoveContainer" containerID="65656e1d77b113a5f70a26cbb92acd55f54f082305a0be5ea81477ddf5953ea7" Jul 09 17:23:47.793664 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:47.793639 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:23:47.793714 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:47.793705 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:23:47.793749 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:47.793738 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:23:48.804452 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:48.804406 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" event={"ID":"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e","Type":"ContainerStarted","Data":"6c9ff1a3f1278347aa85d7279eadd524115544021391170ea361dac9bfbde0f1"} Jul 09 17:23:49.177995 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:49.177961 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:49.178203 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:49.178183 2580 patch_prober.go:28] interesting pod/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 09 17:23:49.178253 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:49.178231 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" podUID="5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 09 17:23:50.178271 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:50.178236 2580 patch_prober.go:28] interesting pod/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 09 17:23:50.178728 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:50.178314 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" podUID="5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 09 17:23:50.969033 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:50.968995 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz"] Jul 09 17:23:50.969243 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:50.969223 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" podUID="a69751a6-b0e8-4271-92bd-bcb2b5319762" containerName="istio-proxy" containerID="cri-o://81ce97fa4845b4696fae72b68f29a89c251cb2e0d5427eaa14240fa54aff266f" gracePeriod=30 Jul 09 17:23:51.178125 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:51.178088 2580 patch_prober.go:28] interesting pod/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 09 17:23:51.178300 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:51.178145 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" podUID="5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 09 17:23:52.177925 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:52.177844 2580 patch_prober.go:28] interesting pod/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 09 17:23:52.177925 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:52.177905 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" podUID="5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 09 17:23:53.181126 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:53.181099 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:53.181510 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:53.181401 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:53.182164 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:53.182144 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:23:56.218451 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.218419 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:56.269910 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.269841 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfpz7\" (UniqueName: \"kubernetes.io/projected/a69751a6-b0e8-4271-92bd-bcb2b5319762-kube-api-access-gfpz7\") pod \"a69751a6-b0e8-4271-92bd-bcb2b5319762\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " Jul 09 17:23:56.269910 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.269878 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-istio-envoy\") pod \"a69751a6-b0e8-4271-92bd-bcb2b5319762\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " Jul 09 17:23:56.270083 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.269920 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a69751a6-b0e8-4271-92bd-bcb2b5319762-istiod-ca-cert\") pod \"a69751a6-b0e8-4271-92bd-bcb2b5319762\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " Jul 09 17:23:56.270083 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.269936 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a69751a6-b0e8-4271-92bd-bcb2b5319762-istio-token\") pod \"a69751a6-b0e8-4271-92bd-bcb2b5319762\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " Jul 09 17:23:56.270083 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.269973 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-workload-certs\") pod \"a69751a6-b0e8-4271-92bd-bcb2b5319762\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " Jul 09 17:23:56.270083 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.270001 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-credential-socket\") pod \"a69751a6-b0e8-4271-92bd-bcb2b5319762\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " Jul 09 17:23:56.270312 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.270161 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-istio-data\") pod \"a69751a6-b0e8-4271-92bd-bcb2b5319762\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " Jul 09 17:23:56.270312 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.270219 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-workload-socket\") pod \"a69751a6-b0e8-4271-92bd-bcb2b5319762\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " Jul 09 17:23:56.270312 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.270253 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a69751a6-b0e8-4271-92bd-bcb2b5319762-istio-podinfo\") pod \"a69751a6-b0e8-4271-92bd-bcb2b5319762\" (UID: \"a69751a6-b0e8-4271-92bd-bcb2b5319762\") " Jul 09 17:23:56.270492 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.270309 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a69751a6-b0e8-4271-92bd-bcb2b5319762" (UID: "a69751a6-b0e8-4271-92bd-bcb2b5319762"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:23:56.270492 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.270357 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a69751a6-b0e8-4271-92bd-bcb2b5319762-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a69751a6-b0e8-4271-92bd-bcb2b5319762" (UID: "a69751a6-b0e8-4271-92bd-bcb2b5319762"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:23:56.270597 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.270538 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a69751a6-b0e8-4271-92bd-bcb2b5319762" (UID: "a69751a6-b0e8-4271-92bd-bcb2b5319762"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:23:56.270732 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.270699 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a69751a6-b0e8-4271-92bd-bcb2b5319762" (UID: "a69751a6-b0e8-4271-92bd-bcb2b5319762"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:23:56.270911 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.270878 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-workload-socket\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:23:56.270911 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.270900 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a69751a6-b0e8-4271-92bd-bcb2b5319762-istiod-ca-cert\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:23:56.271217 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.270914 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-workload-certs\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:23:56.271217 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.270929 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-credential-socket\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:23:56.271217 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.271082 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-istio-data" (OuterVolumeSpecName: "istio-data") pod "a69751a6-b0e8-4271-92bd-bcb2b5319762" (UID: "a69751a6-b0e8-4271-92bd-bcb2b5319762"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:23:56.272301 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.272256 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a69751a6-b0e8-4271-92bd-bcb2b5319762" (UID: "a69751a6-b0e8-4271-92bd-bcb2b5319762"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:23:56.272580 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.272565 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a69751a6-b0e8-4271-92bd-bcb2b5319762-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a69751a6-b0e8-4271-92bd-bcb2b5319762" (UID: "a69751a6-b0e8-4271-92bd-bcb2b5319762"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 17:23:56.272769 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.272751 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a69751a6-b0e8-4271-92bd-bcb2b5319762-istio-token" (OuterVolumeSpecName: "istio-token") pod "a69751a6-b0e8-4271-92bd-bcb2b5319762" (UID: "a69751a6-b0e8-4271-92bd-bcb2b5319762"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:23:56.272834 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.272772 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a69751a6-b0e8-4271-92bd-bcb2b5319762-kube-api-access-gfpz7" (OuterVolumeSpecName: "kube-api-access-gfpz7") pod "a69751a6-b0e8-4271-92bd-bcb2b5319762" (UID: "a69751a6-b0e8-4271-92bd-bcb2b5319762"). InnerVolumeSpecName "kube-api-access-gfpz7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:23:56.372038 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.372011 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a69751a6-b0e8-4271-92bd-bcb2b5319762-istio-token\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:23:56.372038 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.372036 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-istio-data\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:23:56.372182 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.372050 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a69751a6-b0e8-4271-92bd-bcb2b5319762-istio-podinfo\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:23:56.372182 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.372063 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfpz7\" (UniqueName: \"kubernetes.io/projected/a69751a6-b0e8-4271-92bd-bcb2b5319762-kube-api-access-gfpz7\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:23:56.372182 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.372077 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a69751a6-b0e8-4271-92bd-bcb2b5319762-istio-envoy\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:23:56.851878 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.851839 2580 generic.go:356] "Generic (PLEG): container finished" podID="a69751a6-b0e8-4271-92bd-bcb2b5319762" containerID="81ce97fa4845b4696fae72b68f29a89c251cb2e0d5427eaa14240fa54aff266f" exitCode=0 Jul 09 17:23:56.852089 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.851956 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" Jul 09 17:23:56.852089 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.851970 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" event={"ID":"a69751a6-b0e8-4271-92bd-bcb2b5319762","Type":"ContainerDied","Data":"81ce97fa4845b4696fae72b68f29a89c251cb2e0d5427eaa14240fa54aff266f"} Jul 09 17:23:56.852089 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.852028 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz" event={"ID":"a69751a6-b0e8-4271-92bd-bcb2b5319762","Type":"ContainerDied","Data":"e4cb752f54404e2bc51a841ecd769afdeb94edcc713d97f38e0ecef8485a3d80"} Jul 09 17:23:56.852089 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.852051 2580 scope.go:117] "RemoveContainer" containerID="81ce97fa4845b4696fae72b68f29a89c251cb2e0d5427eaa14240fa54aff266f" Jul 09 17:23:56.861913 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.861899 2580 scope.go:117] "RemoveContainer" containerID="c84cac99c20a2be536aaf1ecb304f6de9b650c120430cc534603f38ab6d5aa77" Jul 09 17:23:56.869752 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.869736 2580 scope.go:117] "RemoveContainer" containerID="81ce97fa4845b4696fae72b68f29a89c251cb2e0d5427eaa14240fa54aff266f" Jul 09 17:23:56.870002 ip-10-0-128-34 kubenswrapper[2580]: E0709 17:23:56.869985 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81ce97fa4845b4696fae72b68f29a89c251cb2e0d5427eaa14240fa54aff266f\": container with ID starting with 81ce97fa4845b4696fae72b68f29a89c251cb2e0d5427eaa14240fa54aff266f not found: ID does not exist" containerID="81ce97fa4845b4696fae72b68f29a89c251cb2e0d5427eaa14240fa54aff266f" Jul 09 17:23:56.870050 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.870011 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81ce97fa4845b4696fae72b68f29a89c251cb2e0d5427eaa14240fa54aff266f"} err="failed to get container status \"81ce97fa4845b4696fae72b68f29a89c251cb2e0d5427eaa14240fa54aff266f\": rpc error: code = NotFound desc = could not find container \"81ce97fa4845b4696fae72b68f29a89c251cb2e0d5427eaa14240fa54aff266f\": container with ID starting with 81ce97fa4845b4696fae72b68f29a89c251cb2e0d5427eaa14240fa54aff266f not found: ID does not exist" Jul 09 17:23:56.870050 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.870028 2580 scope.go:117] "RemoveContainer" containerID="c84cac99c20a2be536aaf1ecb304f6de9b650c120430cc534603f38ab6d5aa77" Jul 09 17:23:56.870350 ip-10-0-128-34 kubenswrapper[2580]: E0709 17:23:56.870331 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c84cac99c20a2be536aaf1ecb304f6de9b650c120430cc534603f38ab6d5aa77\": container with ID starting with c84cac99c20a2be536aaf1ecb304f6de9b650c120430cc534603f38ab6d5aa77 not found: ID does not exist" containerID="c84cac99c20a2be536aaf1ecb304f6de9b650c120430cc534603f38ab6d5aa77" Jul 09 17:23:56.870440 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.870357 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c84cac99c20a2be536aaf1ecb304f6de9b650c120430cc534603f38ab6d5aa77"} err="failed to get container status \"c84cac99c20a2be536aaf1ecb304f6de9b650c120430cc534603f38ab6d5aa77\": rpc error: code = NotFound desc = could not find container \"c84cac99c20a2be536aaf1ecb304f6de9b650c120430cc534603f38ab6d5aa77\": container with ID starting with c84cac99c20a2be536aaf1ecb304f6de9b650c120430cc534603f38ab6d5aa77 not found: ID does not exist" Jul 09 17:23:56.873252 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.873230 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz"] Jul 09 17:23:56.876383 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:56.876364 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-fd442b-openshift-default-58c6868d75-hxsnz"] Jul 09 17:23:57.912111 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:57.912077 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw"] Jul 09 17:23:57.912563 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:57.912268 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" podUID="5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e" containerName="istio-proxy" containerID="cri-o://6c9ff1a3f1278347aa85d7279eadd524115544021391170ea361dac9bfbde0f1" gracePeriod=30 Jul 09 17:23:58.177915 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:58.177832 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a69751a6-b0e8-4271-92bd-bcb2b5319762" path="/var/lib/kubelet/pods/a69751a6-b0e8-4271-92bd-bcb2b5319762/volumes" Jul 09 17:23:58.818586 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:58.818554 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w"] Jul 09 17:23:58.818907 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:58.818895 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a69751a6-b0e8-4271-92bd-bcb2b5319762" containerName="istio-proxy" Jul 09 17:23:58.818954 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:58.818909 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a69751a6-b0e8-4271-92bd-bcb2b5319762" containerName="istio-proxy" Jul 09 17:23:58.818954 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:58.818918 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b26f6032-5ee9-43c6-98c4-5b1541da4fe5" containerName="istio-proxy" Jul 09 17:23:58.818954 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:58.818924 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b26f6032-5ee9-43c6-98c4-5b1541da4fe5" containerName="istio-proxy" Jul 09 17:23:58.819059 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:58.818991 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b26f6032-5ee9-43c6-98c4-5b1541da4fe5" containerName="istio-proxy" Jul 09 17:23:58.819059 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:58.818998 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a69751a6-b0e8-4271-92bd-bcb2b5319762" containerName="istio-proxy" Jul 09 17:23:58.819059 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:58.819006 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a69751a6-b0e8-4271-92bd-bcb2b5319762" containerName="istio-proxy" Jul 09 17:23:58.821791 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:58.821771 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:58.824077 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:58.824053 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-0abbe5-openshift-default-dockercfg-m2cks\"" Jul 09 17:23:58.835257 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:58.835235 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w"] Jul 09 17:23:58.901343 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:58.900851 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/768d2e9f-3e04-4c17-bb68-199c100411b3-istio-podinfo\") pod \"e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:58.901343 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:58.900933 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/768d2e9f-3e04-4c17-bb68-199c100411b3-istio-token\") pod \"e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:58.901343 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:58.900967 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-istio-data\") pod \"e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:58.901343 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:58.900993 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-workload-socket\") pod \"e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:58.901343 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:58.901055 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-workload-certs\") pod \"e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:58.901343 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:58.901083 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-istio-envoy\") pod \"e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:58.901343 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:58.901135 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62psj\" (UniqueName: \"kubernetes.io/projected/768d2e9f-3e04-4c17-bb68-199c100411b3-kube-api-access-62psj\") pod \"e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:58.901343 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:58.901165 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-credential-socket\") pod \"e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:58.901343 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:58.901189 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/768d2e9f-3e04-4c17-bb68-199c100411b3-istiod-ca-cert\") pod \"e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:59.002342 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:59.002302 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-workload-certs\") pod \"e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:59.002342 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:59.002345 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-istio-envoy\") pod \"e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:59.002842 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:59.002485 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62psj\" (UniqueName: \"kubernetes.io/projected/768d2e9f-3e04-4c17-bb68-199c100411b3-kube-api-access-62psj\") pod \"e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:59.002842 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:59.002531 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-credential-socket\") pod \"e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:59.002842 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:59.002554 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/768d2e9f-3e04-4c17-bb68-199c100411b3-istiod-ca-cert\") pod \"e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:59.002842 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:59.002602 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/768d2e9f-3e04-4c17-bb68-199c100411b3-istio-podinfo\") pod \"e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:59.002842 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:59.002665 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/768d2e9f-3e04-4c17-bb68-199c100411b3-istio-token\") pod \"e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:59.002842 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:59.002698 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-istio-data\") pod \"e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:59.002842 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:59.002726 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-workload-socket\") pod \"e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:59.002842 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:59.002757 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-workload-certs\") pod \"e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:59.003155 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:59.002878 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-credential-socket\") pod \"e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:59.003155 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:59.002996 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-istio-data\") pod \"e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:59.003155 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:59.003100 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-workload-socket\") pod \"e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:59.003643 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:59.003568 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/768d2e9f-3e04-4c17-bb68-199c100411b3-istiod-ca-cert\") pod \"e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:59.004864 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:59.004840 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-istio-envoy\") pod \"e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:59.005399 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:59.005379 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/768d2e9f-3e04-4c17-bb68-199c100411b3-istio-podinfo\") pod \"e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:59.023152 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:59.023124 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/768d2e9f-3e04-4c17-bb68-199c100411b3-istio-token\") pod \"e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:59.023368 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:59.023350 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62psj\" (UniqueName: \"kubernetes.io/projected/768d2e9f-3e04-4c17-bb68-199c100411b3-kube-api-access-62psj\") pod \"e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:59.131276 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:59.131237 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:23:59.265499 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:59.265474 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w"] Jul 09 17:23:59.266695 ip-10-0-128-34 kubenswrapper[2580]: W0709 17:23:59.266672 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod768d2e9f_3e04_4c17_bb68_199c100411b3.slice/crio-0c951e6c84d8246ca1aeaa75c20f41a2fc0447f58f305f1e792a1007dc4827c8 WatchSource:0}: Error finding container 0c951e6c84d8246ca1aeaa75c20f41a2fc0447f58f305f1e792a1007dc4827c8: Status 404 returned error can't find the container with id 0c951e6c84d8246ca1aeaa75c20f41a2fc0447f58f305f1e792a1007dc4827c8 Jul 09 17:23:59.268781 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:59.268752 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:23:59.268849 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:59.268817 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:23:59.268888 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:59.268846 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:23:59.868455 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:59.868422 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" event={"ID":"768d2e9f-3e04-4c17-bb68-199c100411b3","Type":"ContainerStarted","Data":"c80c032a7832b4c6e01f616ecc6161f0470a626ea9276155a46cb22cefd61944"} Jul 09 17:23:59.868672 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:59.868474 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" event={"ID":"768d2e9f-3e04-4c17-bb68-199c100411b3","Type":"ContainerStarted","Data":"0c951e6c84d8246ca1aeaa75c20f41a2fc0447f58f305f1e792a1007dc4827c8"} Jul 09 17:23:59.887103 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:23:59.887049 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" podStartSLOduration=1.887030954 podStartE2EDuration="1.887030954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:23:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:23:59.885664213 +0000 UTC m=+1978.250416142" watchObservedRunningTime="2026-07-09 17:23:59.887030954 +0000 UTC m=+1978.251782872" Jul 09 17:24:00.132091 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:00.132010 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:24:00.136795 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:00.136769 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:24:00.873896 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:00.873860 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:24:00.874623 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:00.874602 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:24:03.165814 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.165789 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:24:03.243211 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.243133 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-workload-socket\") pod \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " Jul 09 17:24:03.243394 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.243220 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istio-podinfo\") pod \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " Jul 09 17:24:03.243394 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.243245 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-workload-certs\") pod \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " Jul 09 17:24:03.243394 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.243270 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-credential-socket\") pod \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " Jul 09 17:24:03.243394 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.243346 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istio-data\") pod \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " Jul 09 17:24:03.243394 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.243388 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istiod-ca-cert\") pod \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " Jul 09 17:24:03.243744 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.243411 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rvzn\" (UniqueName: \"kubernetes.io/projected/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-kube-api-access-7rvzn\") pod \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " Jul 09 17:24:03.243744 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.243436 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istio-envoy\") pod \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " Jul 09 17:24:03.243744 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.243486 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e" (UID: "5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:24:03.243744 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.243502 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istio-token\") pod \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\" (UID: \"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e\") " Jul 09 17:24:03.243744 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.243576 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e" (UID: "5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:24:03.243744 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.243663 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e" (UID: "5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:24:03.244054 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.243822 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e" (UID: "5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:24:03.244054 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.243897 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-workload-certs\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:24:03.244054 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.243917 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-credential-socket\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:24:03.244054 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.243932 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istiod-ca-cert\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:24:03.244054 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.243941 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-workload-socket\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:24:03.244683 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.244661 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istio-data" (OuterVolumeSpecName: "istio-data") pod "5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e" (UID: "5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:24:03.245835 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.245811 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istio-token" (OuterVolumeSpecName: "istio-token") pod "5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e" (UID: "5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:24:03.245938 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.245811 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-kube-api-access-7rvzn" (OuterVolumeSpecName: "kube-api-access-7rvzn") pod "5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e" (UID: "5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e"). InnerVolumeSpecName "kube-api-access-7rvzn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:24:03.246217 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.246191 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e" (UID: "5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 17:24:03.246217 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.246203 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e" (UID: "5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:24:03.344723 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.344696 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istio-podinfo\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:24:03.344723 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.344719 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istio-data\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:24:03.344891 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.344733 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rvzn\" (UniqueName: \"kubernetes.io/projected/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-kube-api-access-7rvzn\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:24:03.344891 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.344746 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istio-envoy\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:24:03.344891 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.344754 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e-istio-token\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:24:03.891313 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.891260 2580 generic.go:356] "Generic (PLEG): container finished" podID="5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e" containerID="6c9ff1a3f1278347aa85d7279eadd524115544021391170ea361dac9bfbde0f1" exitCode=0 Jul 09 17:24:03.891474 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.891325 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" Jul 09 17:24:03.891474 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.891346 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" event={"ID":"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e","Type":"ContainerDied","Data":"6c9ff1a3f1278347aa85d7279eadd524115544021391170ea361dac9bfbde0f1"} Jul 09 17:24:03.891474 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.891429 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw" event={"ID":"5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e","Type":"ContainerDied","Data":"d33f9a2e4e4dba1f8b4d746c6ab5fef52268f527b2c8e45459294e1bed6f83df"} Jul 09 17:24:03.891587 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.891466 2580 scope.go:117] "RemoveContainer" containerID="6c9ff1a3f1278347aa85d7279eadd524115544021391170ea361dac9bfbde0f1" Jul 09 17:24:03.902095 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.902076 2580 scope.go:117] "RemoveContainer" containerID="65656e1d77b113a5f70a26cbb92acd55f54f082305a0be5ea81477ddf5953ea7" Jul 09 17:24:03.910501 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.910484 2580 scope.go:117] "RemoveContainer" containerID="6c9ff1a3f1278347aa85d7279eadd524115544021391170ea361dac9bfbde0f1" Jul 09 17:24:03.910745 ip-10-0-128-34 kubenswrapper[2580]: E0709 17:24:03.910726 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c9ff1a3f1278347aa85d7279eadd524115544021391170ea361dac9bfbde0f1\": container with ID starting with 6c9ff1a3f1278347aa85d7279eadd524115544021391170ea361dac9bfbde0f1 not found: ID does not exist" containerID="6c9ff1a3f1278347aa85d7279eadd524115544021391170ea361dac9bfbde0f1" Jul 09 17:24:03.910801 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.910754 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c9ff1a3f1278347aa85d7279eadd524115544021391170ea361dac9bfbde0f1"} err="failed to get container status \"6c9ff1a3f1278347aa85d7279eadd524115544021391170ea361dac9bfbde0f1\": rpc error: code = NotFound desc = could not find container \"6c9ff1a3f1278347aa85d7279eadd524115544021391170ea361dac9bfbde0f1\": container with ID starting with 6c9ff1a3f1278347aa85d7279eadd524115544021391170ea361dac9bfbde0f1 not found: ID does not exist" Jul 09 17:24:03.910801 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.910773 2580 scope.go:117] "RemoveContainer" containerID="65656e1d77b113a5f70a26cbb92acd55f54f082305a0be5ea81477ddf5953ea7" Jul 09 17:24:03.911012 ip-10-0-128-34 kubenswrapper[2580]: E0709 17:24:03.910994 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65656e1d77b113a5f70a26cbb92acd55f54f082305a0be5ea81477ddf5953ea7\": container with ID starting with 65656e1d77b113a5f70a26cbb92acd55f54f082305a0be5ea81477ddf5953ea7 not found: ID does not exist" containerID="65656e1d77b113a5f70a26cbb92acd55f54f082305a0be5ea81477ddf5953ea7" Jul 09 17:24:03.911052 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.911019 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65656e1d77b113a5f70a26cbb92acd55f54f082305a0be5ea81477ddf5953ea7"} err="failed to get container status \"65656e1d77b113a5f70a26cbb92acd55f54f082305a0be5ea81477ddf5953ea7\": rpc error: code = NotFound desc = could not find container \"65656e1d77b113a5f70a26cbb92acd55f54f082305a0be5ea81477ddf5953ea7\": container with ID starting with 65656e1d77b113a5f70a26cbb92acd55f54f082305a0be5ea81477ddf5953ea7 not found: ID does not exist" Jul 09 17:24:03.914098 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.914076 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw"] Jul 09 17:24:03.918305 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:03.918266 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-890eaa-openshift-default-6b88cf7cdf-hzrnw"] Jul 09 17:24:04.177691 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:04.177615 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e" path="/var/lib/kubelet/pods/5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e/volumes" Jul 09 17:24:06.985385 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:06.985348 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk"] Jul 09 17:24:06.985862 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:06.985837 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e" containerName="istio-proxy" Jul 09 17:24:06.985862 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:06.985856 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e" containerName="istio-proxy" Jul 09 17:24:06.986074 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:06.985872 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a69751a6-b0e8-4271-92bd-bcb2b5319762" containerName="istio-proxy" Jul 09 17:24:06.986074 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:06.985880 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a69751a6-b0e8-4271-92bd-bcb2b5319762" containerName="istio-proxy" Jul 09 17:24:06.986074 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:06.985893 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e" containerName="istio-proxy" Jul 09 17:24:06.986074 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:06.985902 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e" containerName="istio-proxy" Jul 09 17:24:06.986074 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:06.985999 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e" containerName="istio-proxy" Jul 09 17:24:06.989512 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:06.989493 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:06.998114 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:06.998089 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-265f70-openshift-default-dockercfg-r5sr4\"" Jul 09 17:24:07.004913 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.004892 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk"] Jul 09 17:24:07.074328 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.074299 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-workload-certs\") pod \"e2e-shared-b-265f70-openshift-default-7996776775-6f6dk\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:07.074549 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.074524 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istio-token\") pod \"e2e-shared-b-265f70-openshift-default-7996776775-6f6dk\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:07.074712 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.074690 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-workload-socket\") pod \"e2e-shared-b-265f70-openshift-default-7996776775-6f6dk\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:07.074881 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.074864 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istio-envoy\") pod \"e2e-shared-b-265f70-openshift-default-7996776775-6f6dk\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:07.074995 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.074981 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istio-data\") pod \"e2e-shared-b-265f70-openshift-default-7996776775-6f6dk\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:07.075098 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.075084 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istiod-ca-cert\") pod \"e2e-shared-b-265f70-openshift-default-7996776775-6f6dk\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:07.075268 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.075251 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istio-podinfo\") pod \"e2e-shared-b-265f70-openshift-default-7996776775-6f6dk\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:07.075497 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.075465 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgbd5\" (UniqueName: \"kubernetes.io/projected/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-kube-api-access-cgbd5\") pod \"e2e-shared-b-265f70-openshift-default-7996776775-6f6dk\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:07.076251 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.075516 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-credential-socket\") pod \"e2e-shared-b-265f70-openshift-default-7996776775-6f6dk\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:07.176264 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.176223 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istio-envoy\") pod \"e2e-shared-b-265f70-openshift-default-7996776775-6f6dk\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:07.176264 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.176266 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istio-data\") pod \"e2e-shared-b-265f70-openshift-default-7996776775-6f6dk\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:07.176553 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.176302 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istiod-ca-cert\") pod \"e2e-shared-b-265f70-openshift-default-7996776775-6f6dk\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:07.176553 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.176319 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istio-podinfo\") pod \"e2e-shared-b-265f70-openshift-default-7996776775-6f6dk\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:07.176553 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.176367 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgbd5\" (UniqueName: \"kubernetes.io/projected/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-kube-api-access-cgbd5\") pod \"e2e-shared-b-265f70-openshift-default-7996776775-6f6dk\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:07.176553 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.176387 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-credential-socket\") pod \"e2e-shared-b-265f70-openshift-default-7996776775-6f6dk\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:07.176553 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.176405 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-workload-certs\") pod \"e2e-shared-b-265f70-openshift-default-7996776775-6f6dk\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:07.176553 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.176465 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istio-token\") pod \"e2e-shared-b-265f70-openshift-default-7996776775-6f6dk\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:07.176553 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.176509 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-workload-socket\") pod \"e2e-shared-b-265f70-openshift-default-7996776775-6f6dk\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:07.176947 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.176696 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istio-data\") pod \"e2e-shared-b-265f70-openshift-default-7996776775-6f6dk\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:07.176947 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.176810 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-workload-certs\") pod \"e2e-shared-b-265f70-openshift-default-7996776775-6f6dk\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:07.176947 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.176837 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-credential-socket\") pod \"e2e-shared-b-265f70-openshift-default-7996776775-6f6dk\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:07.176947 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.176887 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-workload-socket\") pod \"e2e-shared-b-265f70-openshift-default-7996776775-6f6dk\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:07.177413 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.177389 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istiod-ca-cert\") pod \"e2e-shared-b-265f70-openshift-default-7996776775-6f6dk\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:07.178733 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.178714 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istio-envoy\") pod \"e2e-shared-b-265f70-openshift-default-7996776775-6f6dk\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:07.179113 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.179097 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istio-podinfo\") pod \"e2e-shared-b-265f70-openshift-default-7996776775-6f6dk\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:07.183943 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.183921 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istio-token\") pod \"e2e-shared-b-265f70-openshift-default-7996776775-6f6dk\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:07.184377 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.184361 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgbd5\" (UniqueName: \"kubernetes.io/projected/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-kube-api-access-cgbd5\") pod \"e2e-shared-b-265f70-openshift-default-7996776775-6f6dk\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:07.306600 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.306521 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:07.480836 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.480809 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk"] Jul 09 17:24:07.482815 ip-10-0-128-34 kubenswrapper[2580]: W0709 17:24:07.482786 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03de1eca_1f1a_450b_b42f_a59f37b7a2ff.slice/crio-654b9de8fda1c7ed06ecfbb96c3d1c1a6e05bcec662c9abf50caf5cdca2e0619 WatchSource:0}: Error finding container 654b9de8fda1c7ed06ecfbb96c3d1c1a6e05bcec662c9abf50caf5cdca2e0619: Status 404 returned error can't find the container with id 654b9de8fda1c7ed06ecfbb96c3d1c1a6e05bcec662c9abf50caf5cdca2e0619 Jul 09 17:24:07.485542 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.485504 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:24:07.485629 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.485589 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:24:07.485685 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.485633 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:24:07.913340 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.913301 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" event={"ID":"03de1eca-1f1a-450b-b42f-a59f37b7a2ff","Type":"ContainerStarted","Data":"7cbd6b16dba2802523dbed734656a3dd11f63f189d5d334d339d333f25286cb0"} Jul 09 17:24:07.913563 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.913354 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" event={"ID":"03de1eca-1f1a-450b-b42f-a59f37b7a2ff","Type":"ContainerStarted","Data":"654b9de8fda1c7ed06ecfbb96c3d1c1a6e05bcec662c9abf50caf5cdca2e0619"} Jul 09 17:24:07.932414 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:07.932353 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" podStartSLOduration=1.9323345600000001 podStartE2EDuration="1.93233456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:24:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:24:07.931247972 +0000 UTC m=+1986.295999888" watchObservedRunningTime="2026-07-09 17:24:07.93233456 +0000 UTC m=+1986.297086472" Jul 09 17:24:08.307752 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:08.307659 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:08.312904 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:08.312878 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:08.918397 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:08.918362 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:08.919344 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:08.919325 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:16.915595 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:16.915534 2580 patch_prober.go:28] interesting pod/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 09 17:24:16.916456 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:16.916403 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" podUID="768d2e9f-3e04-4c17-bb68-199c100411b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 09 17:24:17.962711 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:17.962674 2580 generic.go:356] "Generic (PLEG): container finished" podID="768d2e9f-3e04-4c17-bb68-199c100411b3" containerID="c80c032a7832b4c6e01f616ecc6161f0470a626ea9276155a46cb22cefd61944" exitCode=0 Jul 09 17:24:17.963120 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:17.962744 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" event={"ID":"768d2e9f-3e04-4c17-bb68-199c100411b3","Type":"ContainerDied","Data":"c80c032a7832b4c6e01f616ecc6161f0470a626ea9276155a46cb22cefd61944"} Jul 09 17:24:17.963120 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:17.963112 2580 scope.go:117] "RemoveContainer" containerID="c80c032a7832b4c6e01f616ecc6161f0470a626ea9276155a46cb22cefd61944" Jul 09 17:24:17.964099 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:17.964072 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:24:17.964209 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:17.964140 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:24:17.964209 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:17.964171 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:24:18.969973 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:18.969934 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" event={"ID":"768d2e9f-3e04-4c17-bb68-199c100411b3","Type":"ContainerStarted","Data":"2320d57308bbead3d4f1ee1feaedea7d71ef6a3b61a480145237ae2af222004c"} Jul 09 17:24:19.131933 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:19.131849 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:24:19.132305 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:19.132261 2580 patch_prober.go:28] interesting pod/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 09 17:24:19.132495 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:19.132471 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" podUID="768d2e9f-3e04-4c17-bb68-199c100411b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 09 17:24:20.131903 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:20.131862 2580 patch_prober.go:28] interesting pod/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 09 17:24:20.132542 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:20.132506 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" podUID="768d2e9f-3e04-4c17-bb68-199c100411b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 09 17:24:21.132602 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:21.132566 2580 patch_prober.go:28] interesting pod/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 09 17:24:21.132963 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:21.132622 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" podUID="768d2e9f-3e04-4c17-bb68-199c100411b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 09 17:24:22.132430 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:22.132382 2580 patch_prober.go:28] interesting pod/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 09 17:24:22.132615 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:22.132460 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" podUID="768d2e9f-3e04-4c17-bb68-199c100411b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 09 17:24:23.135812 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:23.135777 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:24:23.136305 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:23.136139 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:24:23.136872 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:23.136853 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:24:23.919650 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:23.919623 2580 patch_prober.go:28] interesting pod/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 09 17:24:23.919801 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:23.919673 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" podUID="03de1eca-1f1a-450b-b42f-a59f37b7a2ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 09 17:24:24.000584 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:24.000554 2580 generic.go:356] "Generic (PLEG): container finished" podID="03de1eca-1f1a-450b-b42f-a59f37b7a2ff" containerID="7cbd6b16dba2802523dbed734656a3dd11f63f189d5d334d339d333f25286cb0" exitCode=0 Jul 09 17:24:24.000738 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:24.000628 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" event={"ID":"03de1eca-1f1a-450b-b42f-a59f37b7a2ff","Type":"ContainerDied","Data":"7cbd6b16dba2802523dbed734656a3dd11f63f189d5d334d339d333f25286cb0"} Jul 09 17:24:24.001132 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:24.001114 2580 scope.go:117] "RemoveContainer" containerID="7cbd6b16dba2802523dbed734656a3dd11f63f189d5d334d339d333f25286cb0" Jul 09 17:24:24.002113 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:24.002079 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:24:24.002166 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:24.002153 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:24:24.002202 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:24.002191 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 17:24:25.012104 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:25.012059 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" event={"ID":"03de1eca-1f1a-450b-b42f-a59f37b7a2ff","Type":"ContainerStarted","Data":"cad3809bc12dd7d99c3049603c4a71ebd7db77b3ec2ca41bb6b4b3dd411f3ccd"} Jul 09 17:24:25.307786 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:25.307261 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:25.307786 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:25.307426 2580 patch_prober.go:28] interesting pod/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 09 17:24:25.307786 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:25.307471 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" podUID="03de1eca-1f1a-450b-b42f-a59f37b7a2ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 09 17:24:26.307053 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:26.307010 2580 patch_prober.go:28] interesting pod/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 09 17:24:26.307678 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:26.307642 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" podUID="03de1eca-1f1a-450b-b42f-a59f37b7a2ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 09 17:24:27.307324 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:27.307262 2580 patch_prober.go:28] interesting pod/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 09 17:24:27.307848 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:27.307344 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" podUID="03de1eca-1f1a-450b-b42f-a59f37b7a2ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 09 17:24:28.307611 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:28.307571 2580 patch_prober.go:28] interesting pod/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 09 17:24:28.308204 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:28.308170 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" podUID="03de1eca-1f1a-450b-b42f-a59f37b7a2ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 09 17:24:29.311903 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:29.311870 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:29.312366 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:29.312156 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:24:29.313638 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:24:29.313612 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:26:02.263436 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:26:02.263409 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pcwtl_12995bc0-2245-4f06-aad5-b496fd24f0b1/ovn-acl-logging/0.log" Jul 09 17:26:02.264908 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:26:02.264884 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pcwtl_12995bc0-2245-4f06-aad5-b496fd24f0b1/ovn-acl-logging/0.log" Jul 09 17:30:41.591567 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:41.591535 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w"] Jul 09 17:30:41.592482 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:41.591742 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" podUID="768d2e9f-3e04-4c17-bb68-199c100411b3" containerName="istio-proxy" containerID="cri-o://2320d57308bbead3d4f1ee1feaedea7d71ef6a3b61a480145237ae2af222004c" gracePeriod=30 Jul 09 17:30:46.847110 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.847080 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:30:46.887430 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.887325 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-workload-certs\") pod \"768d2e9f-3e04-4c17-bb68-199c100411b3\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " Jul 09 17:30:46.887430 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.887399 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/768d2e9f-3e04-4c17-bb68-199c100411b3-istio-token\") pod \"768d2e9f-3e04-4c17-bb68-199c100411b3\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " Jul 09 17:30:46.887664 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.887477 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62psj\" (UniqueName: \"kubernetes.io/projected/768d2e9f-3e04-4c17-bb68-199c100411b3-kube-api-access-62psj\") pod \"768d2e9f-3e04-4c17-bb68-199c100411b3\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " Jul 09 17:30:46.887664 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.887527 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-workload-socket\") pod \"768d2e9f-3e04-4c17-bb68-199c100411b3\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " Jul 09 17:30:46.887664 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.887551 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-credential-socket\") pod \"768d2e9f-3e04-4c17-bb68-199c100411b3\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " Jul 09 17:30:46.887664 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.887579 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/768d2e9f-3e04-4c17-bb68-199c100411b3-istiod-ca-cert\") pod \"768d2e9f-3e04-4c17-bb68-199c100411b3\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " Jul 09 17:30:46.887664 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.887604 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/768d2e9f-3e04-4c17-bb68-199c100411b3-istio-podinfo\") pod \"768d2e9f-3e04-4c17-bb68-199c100411b3\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " Jul 09 17:30:46.887664 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.887628 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-istio-envoy\") pod \"768d2e9f-3e04-4c17-bb68-199c100411b3\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " Jul 09 17:30:46.887975 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.887654 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "768d2e9f-3e04-4c17-bb68-199c100411b3" (UID: "768d2e9f-3e04-4c17-bb68-199c100411b3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:30:46.887975 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.887667 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-istio-data\") pod \"768d2e9f-3e04-4c17-bb68-199c100411b3\" (UID: \"768d2e9f-3e04-4c17-bb68-199c100411b3\") " Jul 09 17:30:46.887975 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.887721 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "768d2e9f-3e04-4c17-bb68-199c100411b3" (UID: "768d2e9f-3e04-4c17-bb68-199c100411b3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:30:46.887975 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.887872 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "768d2e9f-3e04-4c17-bb68-199c100411b3" (UID: "768d2e9f-3e04-4c17-bb68-199c100411b3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:30:46.888196 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.888056 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/768d2e9f-3e04-4c17-bb68-199c100411b3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "768d2e9f-3e04-4c17-bb68-199c100411b3" (UID: "768d2e9f-3e04-4c17-bb68-199c100411b3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:30:46.888196 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.888063 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-workload-socket\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:30:46.888196 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.888091 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-credential-socket\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:30:46.888196 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.888107 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-workload-certs\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:30:46.888744 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.888721 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-istio-data" (OuterVolumeSpecName: "istio-data") pod "768d2e9f-3e04-4c17-bb68-199c100411b3" (UID: "768d2e9f-3e04-4c17-bb68-199c100411b3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:30:46.889730 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.889708 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/768d2e9f-3e04-4c17-bb68-199c100411b3-kube-api-access-62psj" (OuterVolumeSpecName: "kube-api-access-62psj") pod "768d2e9f-3e04-4c17-bb68-199c100411b3" (UID: "768d2e9f-3e04-4c17-bb68-199c100411b3"). InnerVolumeSpecName "kube-api-access-62psj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:30:46.889821 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.889807 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/768d2e9f-3e04-4c17-bb68-199c100411b3-istio-token" (OuterVolumeSpecName: "istio-token") pod "768d2e9f-3e04-4c17-bb68-199c100411b3" (UID: "768d2e9f-3e04-4c17-bb68-199c100411b3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:30:46.890579 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.890554 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/768d2e9f-3e04-4c17-bb68-199c100411b3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "768d2e9f-3e04-4c17-bb68-199c100411b3" (UID: "768d2e9f-3e04-4c17-bb68-199c100411b3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 17:30:46.890675 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.890567 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "768d2e9f-3e04-4c17-bb68-199c100411b3" (UID: "768d2e9f-3e04-4c17-bb68-199c100411b3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:30:46.949049 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.949019 2580 generic.go:356] "Generic (PLEG): container finished" podID="768d2e9f-3e04-4c17-bb68-199c100411b3" containerID="2320d57308bbead3d4f1ee1feaedea7d71ef6a3b61a480145237ae2af222004c" exitCode=0 Jul 09 17:30:46.949208 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.949065 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" event={"ID":"768d2e9f-3e04-4c17-bb68-199c100411b3","Type":"ContainerDied","Data":"2320d57308bbead3d4f1ee1feaedea7d71ef6a3b61a480145237ae2af222004c"} Jul 09 17:30:46.949208 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.949070 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" Jul 09 17:30:46.949208 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.949109 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w" event={"ID":"768d2e9f-3e04-4c17-bb68-199c100411b3","Type":"ContainerDied","Data":"0c951e6c84d8246ca1aeaa75c20f41a2fc0447f58f305f1e792a1007dc4827c8"} Jul 09 17:30:46.949208 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.949131 2580 scope.go:117] "RemoveContainer" containerID="2320d57308bbead3d4f1ee1feaedea7d71ef6a3b61a480145237ae2af222004c" Jul 09 17:30:46.960844 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.960817 2580 scope.go:117] "RemoveContainer" containerID="c80c032a7832b4c6e01f616ecc6161f0470a626ea9276155a46cb22cefd61944" Jul 09 17:30:46.969186 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.969163 2580 scope.go:117] "RemoveContainer" containerID="2320d57308bbead3d4f1ee1feaedea7d71ef6a3b61a480145237ae2af222004c" Jul 09 17:30:46.969600 ip-10-0-128-34 kubenswrapper[2580]: E0709 17:30:46.969552 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2320d57308bbead3d4f1ee1feaedea7d71ef6a3b61a480145237ae2af222004c\": container with ID starting with 2320d57308bbead3d4f1ee1feaedea7d71ef6a3b61a480145237ae2af222004c not found: ID does not exist" containerID="2320d57308bbead3d4f1ee1feaedea7d71ef6a3b61a480145237ae2af222004c" Jul 09 17:30:46.969713 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.969610 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2320d57308bbead3d4f1ee1feaedea7d71ef6a3b61a480145237ae2af222004c"} err="failed to get container status \"2320d57308bbead3d4f1ee1feaedea7d71ef6a3b61a480145237ae2af222004c\": rpc error: code = NotFound desc = could not find container \"2320d57308bbead3d4f1ee1feaedea7d71ef6a3b61a480145237ae2af222004c\": container with ID starting with 2320d57308bbead3d4f1ee1feaedea7d71ef6a3b61a480145237ae2af222004c not found: ID does not exist" Jul 09 17:30:46.969713 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.969635 2580 scope.go:117] "RemoveContainer" containerID="c80c032a7832b4c6e01f616ecc6161f0470a626ea9276155a46cb22cefd61944" Jul 09 17:30:46.969983 ip-10-0-128-34 kubenswrapper[2580]: E0709 17:30:46.969964 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c80c032a7832b4c6e01f616ecc6161f0470a626ea9276155a46cb22cefd61944\": container with ID starting with c80c032a7832b4c6e01f616ecc6161f0470a626ea9276155a46cb22cefd61944 not found: ID does not exist" containerID="c80c032a7832b4c6e01f616ecc6161f0470a626ea9276155a46cb22cefd61944" Jul 09 17:30:46.970035 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.969998 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c80c032a7832b4c6e01f616ecc6161f0470a626ea9276155a46cb22cefd61944"} err="failed to get container status \"c80c032a7832b4c6e01f616ecc6161f0470a626ea9276155a46cb22cefd61944\": rpc error: code = NotFound desc = could not find container \"c80c032a7832b4c6e01f616ecc6161f0470a626ea9276155a46cb22cefd61944\": container with ID starting with c80c032a7832b4c6e01f616ecc6161f0470a626ea9276155a46cb22cefd61944 not found: ID does not exist" Jul 09 17:30:46.971630 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.971606 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w"] Jul 09 17:30:46.975051 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.975029 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-0abbe5-openshift-default-69754cbd87-9qx8w"] Jul 09 17:30:46.989403 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.989386 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-istio-data\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:30:46.989403 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.989402 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/768d2e9f-3e04-4c17-bb68-199c100411b3-istio-token\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:30:46.989509 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.989411 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62psj\" (UniqueName: \"kubernetes.io/projected/768d2e9f-3e04-4c17-bb68-199c100411b3-kube-api-access-62psj\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:30:46.989509 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.989420 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/768d2e9f-3e04-4c17-bb68-199c100411b3-istiod-ca-cert\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:30:46.989509 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.989429 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/768d2e9f-3e04-4c17-bb68-199c100411b3-istio-podinfo\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:30:46.989509 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:46.989436 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/768d2e9f-3e04-4c17-bb68-199c100411b3-istio-envoy\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:30:48.177244 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:48.177208 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="768d2e9f-3e04-4c17-bb68-199c100411b3" path="/var/lib/kubelet/pods/768d2e9f-3e04-4c17-bb68-199c100411b3/volumes" Jul 09 17:30:48.623914 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:48.623874 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk"] Jul 09 17:30:48.624102 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:48.624080 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" podUID="03de1eca-1f1a-450b-b42f-a59f37b7a2ff" containerName="istio-proxy" containerID="cri-o://cad3809bc12dd7d99c3049603c4a71ebd7db77b3ec2ca41bb6b4b3dd411f3ccd" gracePeriod=30 Jul 09 17:30:53.874999 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:53.874976 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:30:53.946822 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:53.946721 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istiod-ca-cert\") pod \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " Jul 09 17:30:53.946822 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:53.946775 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-workload-certs\") pod \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " Jul 09 17:30:53.946822 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:53.946798 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istio-podinfo\") pod \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " Jul 09 17:30:53.946822 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:53.946827 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istio-envoy\") pod \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " Jul 09 17:30:53.947146 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:53.946875 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-workload-socket\") pod \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " Jul 09 17:30:53.947146 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:53.946905 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-credential-socket\") pod \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " Jul 09 17:30:53.947146 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:53.946955 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istio-token\") pod \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " Jul 09 17:30:53.947146 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:53.946988 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgbd5\" (UniqueName: \"kubernetes.io/projected/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-kube-api-access-cgbd5\") pod \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " Jul 09 17:30:53.947146 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:53.947033 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istio-data\") pod \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\" (UID: \"03de1eca-1f1a-450b-b42f-a59f37b7a2ff\") " Jul 09 17:30:53.947146 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:53.947052 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "03de1eca-1f1a-450b-b42f-a59f37b7a2ff" (UID: "03de1eca-1f1a-450b-b42f-a59f37b7a2ff"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:30:53.947541 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:53.947247 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "03de1eca-1f1a-450b-b42f-a59f37b7a2ff" (UID: "03de1eca-1f1a-450b-b42f-a59f37b7a2ff"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:30:53.947541 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:53.947270 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "03de1eca-1f1a-450b-b42f-a59f37b7a2ff" (UID: "03de1eca-1f1a-450b-b42f-a59f37b7a2ff"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:30:53.947541 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:53.947376 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-credential-socket\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:30:53.947541 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:53.947395 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istiod-ca-cert\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:30:53.947541 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:53.947434 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-workload-certs\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:30:53.947541 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:53.947469 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "03de1eca-1f1a-450b-b42f-a59f37b7a2ff" (UID: "03de1eca-1f1a-450b-b42f-a59f37b7a2ff"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:30:53.948557 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:53.948532 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istio-data" (OuterVolumeSpecName: "istio-data") pod "03de1eca-1f1a-450b-b42f-a59f37b7a2ff" (UID: "03de1eca-1f1a-450b-b42f-a59f37b7a2ff"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:30:53.949446 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:53.949422 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "03de1eca-1f1a-450b-b42f-a59f37b7a2ff" (UID: "03de1eca-1f1a-450b-b42f-a59f37b7a2ff"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 17:30:53.949783 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:53.949758 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istio-token" (OuterVolumeSpecName: "istio-token") pod "03de1eca-1f1a-450b-b42f-a59f37b7a2ff" (UID: "03de1eca-1f1a-450b-b42f-a59f37b7a2ff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:30:53.950000 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:53.949972 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "03de1eca-1f1a-450b-b42f-a59f37b7a2ff" (UID: "03de1eca-1f1a-450b-b42f-a59f37b7a2ff"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:30:53.950112 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:53.950088 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-kube-api-access-cgbd5" (OuterVolumeSpecName: "kube-api-access-cgbd5") pod "03de1eca-1f1a-450b-b42f-a59f37b7a2ff" (UID: "03de1eca-1f1a-450b-b42f-a59f37b7a2ff"). InnerVolumeSpecName "kube-api-access-cgbd5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:30:53.985405 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:53.985374 2580 generic.go:356] "Generic (PLEG): container finished" podID="03de1eca-1f1a-450b-b42f-a59f37b7a2ff" containerID="cad3809bc12dd7d99c3049603c4a71ebd7db77b3ec2ca41bb6b4b3dd411f3ccd" exitCode=0 Jul 09 17:30:53.985506 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:53.985417 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" Jul 09 17:30:53.985506 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:53.985449 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" event={"ID":"03de1eca-1f1a-450b-b42f-a59f37b7a2ff","Type":"ContainerDied","Data":"cad3809bc12dd7d99c3049603c4a71ebd7db77b3ec2ca41bb6b4b3dd411f3ccd"} Jul 09 17:30:53.985581 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:53.985522 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk" event={"ID":"03de1eca-1f1a-450b-b42f-a59f37b7a2ff","Type":"ContainerDied","Data":"654b9de8fda1c7ed06ecfbb96c3d1c1a6e05bcec662c9abf50caf5cdca2e0619"} Jul 09 17:30:53.985581 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:53.985543 2580 scope.go:117] "RemoveContainer" containerID="cad3809bc12dd7d99c3049603c4a71ebd7db77b3ec2ca41bb6b4b3dd411f3ccd" Jul 09 17:30:53.995193 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:53.995177 2580 scope.go:117] "RemoveContainer" containerID="7cbd6b16dba2802523dbed734656a3dd11f63f189d5d334d339d333f25286cb0" Jul 09 17:30:54.003172 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:54.003154 2580 scope.go:117] "RemoveContainer" containerID="cad3809bc12dd7d99c3049603c4a71ebd7db77b3ec2ca41bb6b4b3dd411f3ccd" Jul 09 17:30:54.003522 ip-10-0-128-34 kubenswrapper[2580]: E0709 17:30:54.003477 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cad3809bc12dd7d99c3049603c4a71ebd7db77b3ec2ca41bb6b4b3dd411f3ccd\": container with ID starting with cad3809bc12dd7d99c3049603c4a71ebd7db77b3ec2ca41bb6b4b3dd411f3ccd not found: ID does not exist" containerID="cad3809bc12dd7d99c3049603c4a71ebd7db77b3ec2ca41bb6b4b3dd411f3ccd" Jul 09 17:30:54.003576 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:54.003539 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cad3809bc12dd7d99c3049603c4a71ebd7db77b3ec2ca41bb6b4b3dd411f3ccd"} err="failed to get container status \"cad3809bc12dd7d99c3049603c4a71ebd7db77b3ec2ca41bb6b4b3dd411f3ccd\": rpc error: code = NotFound desc = could not find container \"cad3809bc12dd7d99c3049603c4a71ebd7db77b3ec2ca41bb6b4b3dd411f3ccd\": container with ID starting with cad3809bc12dd7d99c3049603c4a71ebd7db77b3ec2ca41bb6b4b3dd411f3ccd not found: ID does not exist" Jul 09 17:30:54.003576 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:54.003571 2580 scope.go:117] "RemoveContainer" containerID="7cbd6b16dba2802523dbed734656a3dd11f63f189d5d334d339d333f25286cb0" Jul 09 17:30:54.004074 ip-10-0-128-34 kubenswrapper[2580]: E0709 17:30:54.004046 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cbd6b16dba2802523dbed734656a3dd11f63f189d5d334d339d333f25286cb0\": container with ID starting with 7cbd6b16dba2802523dbed734656a3dd11f63f189d5d334d339d333f25286cb0 not found: ID does not exist" containerID="7cbd6b16dba2802523dbed734656a3dd11f63f189d5d334d339d333f25286cb0" Jul 09 17:30:54.004201 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:54.004081 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cbd6b16dba2802523dbed734656a3dd11f63f189d5d334d339d333f25286cb0"} err="failed to get container status \"7cbd6b16dba2802523dbed734656a3dd11f63f189d5d334d339d333f25286cb0\": rpc error: code = NotFound desc = could not find container \"7cbd6b16dba2802523dbed734656a3dd11f63f189d5d334d339d333f25286cb0\": container with ID starting with 7cbd6b16dba2802523dbed734656a3dd11f63f189d5d334d339d333f25286cb0 not found: ID does not exist" Jul 09 17:30:54.006524 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:54.006504 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk"] Jul 09 17:30:54.012097 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:54.012076 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-265f70-openshift-default-7996776775-6f6dk"] Jul 09 17:30:54.048692 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:54.048667 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-workload-socket\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:30:54.048692 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:54.048688 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istio-token\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:30:54.048813 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:54.048698 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgbd5\" (UniqueName: \"kubernetes.io/projected/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-kube-api-access-cgbd5\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:30:54.048813 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:54.048708 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istio-data\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:30:54.048813 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:54.048717 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istio-podinfo\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:30:54.048813 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:54.048744 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03de1eca-1f1a-450b-b42f-a59f37b7a2ff-istio-envoy\") on node \"ip-10-0-128-34.ec2.internal\" DevicePath \"\"" Jul 09 17:30:54.178051 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:54.178020 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03de1eca-1f1a-450b-b42f-a59f37b7a2ff" path="/var/lib/kubelet/pods/03de1eca-1f1a-450b-b42f-a59f37b7a2ff/volumes" Jul 09 17:30:54.448700 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:54.448670 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6xpmg_f3b9012f-6a41-4e2f-9082-c31001625aad/server/0.log" Jul 09 17:30:54.813960 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:54.813884 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-789dddf866-78kgp_d4671492-257e-4f92-b557-b9f0dd51256b/copy-manifests/0.log" Jul 09 17:30:54.820009 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:54.819987 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-789dddf866-78kgp_d4671492-257e-4f92-b557-b9f0dd51256b/manager/0.log" Jul 09 17:30:56.512952 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:56.512924 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd_1ce381b8-479d-403d-9130-2bdbd9883d23/util/0.log" Jul 09 17:30:56.518636 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:56.518615 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd_1ce381b8-479d-403d-9130-2bdbd9883d23/pull/0.log" Jul 09 17:30:56.524116 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:56.524100 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd_1ce381b8-479d-403d-9130-2bdbd9883d23/extract/0.log" Jul 09 17:30:56.638328 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:56.638297 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g_75cde8ba-f7f6-4bf1-b234-b6ff4c27b591/pull/0.log" Jul 09 17:30:56.644205 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:56.644185 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g_75cde8ba-f7f6-4bf1-b234-b6ff4c27b591/extract/0.log" Jul 09 17:30:56.649919 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:56.649900 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g_75cde8ba-f7f6-4bf1-b234-b6ff4c27b591/util/0.log" Jul 09 17:30:56.764971 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:56.764904 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz_09d1838b-c229-4ee1-8bc5-6ede85fcef61/util/0.log" Jul 09 17:30:56.770548 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:56.770532 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz_09d1838b-c229-4ee1-8bc5-6ede85fcef61/pull/0.log" Jul 09 17:30:56.776098 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:56.776084 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz_09d1838b-c229-4ee1-8bc5-6ede85fcef61/extract/0.log" Jul 09 17:30:56.894442 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:56.894410 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh_647a5691-436d-4c26-9d21-2cc0ae114e26/util/0.log" Jul 09 17:30:56.900052 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:56.900034 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh_647a5691-436d-4c26-9d21-2cc0ae114e26/pull/0.log" Jul 09 17:30:56.905762 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:56.905742 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh_647a5691-436d-4c26-9d21-2cc0ae114e26/extract/0.log" Jul 09 17:30:58.254799 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:58.254767 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4ff7nh_9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f/istio-proxy/0.log" Jul 09 17:30:58.370922 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:58.370888 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xgk9h_ffe67e28-e944-4410-b8b4-f5c316e4e383/discovery/0.log" Jul 09 17:30:58.722732 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:58.722699 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pgtzg_121993ca-d4de-4580-ba70-1c090b685455/istio-proxy/1.log" Jul 09 17:30:58.969859 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:58.969827 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zndwp_93485444-b733-447c-8fc9-9b89a1894724/payload-processing/0.log" Jul 09 17:30:59.550330 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:59.550294 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-sh4dt_0ab8cb1b-bf79-4c57-bc21-8c2db4f7402a/main/0.log" Jul 09 17:30:59.656205 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:30:59.656175 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-4vvv9_56d78255-3fa1-47e1-bd61-b3a97ff59c9e/main/0.log" Jul 09 17:31:02.295226 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:02.295173 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pcwtl_12995bc0-2245-4f06-aad5-b496fd24f0b1/ovn-acl-logging/0.log" Jul 09 17:31:02.298333 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:02.298311 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pcwtl_12995bc0-2245-4f06-aad5-b496fd24f0b1/ovn-acl-logging/0.log" Jul 09 17:31:06.921944 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:06.921904 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6ncs8_b588a7a9-4426-4011-a6e2-e88403477517/global-pull-secret-syncer/0.log" Jul 09 17:31:07.036474 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:07.036440 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-v9qrc_73f90b5e-46be-448d-9429-79bebdd0c83e/konnectivity-agent/0.log" Jul 09 17:31:07.114792 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:07.114766 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-34.ec2.internal_c328db57ded294448d0f09b85263bba6/haproxy/0.log" Jul 09 17:31:12.128531 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:12.128501 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd_1ce381b8-479d-403d-9130-2bdbd9883d23/extract/0.log" Jul 09 17:31:12.166144 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:12.166113 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd_1ce381b8-479d-403d-9130-2bdbd9883d23/util/0.log" Jul 09 17:31:12.196576 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:12.196550 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wq5zd_1ce381b8-479d-403d-9130-2bdbd9883d23/pull/0.log" Jul 09 17:31:12.224240 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:12.224205 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g_75cde8ba-f7f6-4bf1-b234-b6ff4c27b591/extract/0.log" Jul 09 17:31:12.250603 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:12.250576 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g_75cde8ba-f7f6-4bf1-b234-b6ff4c27b591/util/0.log" Jul 09 17:31:12.272102 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:12.272078 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0br65g_75cde8ba-f7f6-4bf1-b234-b6ff4c27b591/pull/0.log" Jul 09 17:31:12.309141 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:12.309116 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz_09d1838b-c229-4ee1-8bc5-6ede85fcef61/extract/0.log" Jul 09 17:31:12.332778 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:12.332749 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz_09d1838b-c229-4ee1-8bc5-6ede85fcef61/util/0.log" Jul 09 17:31:12.360410 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:12.360385 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73d8ghz_09d1838b-c229-4ee1-8bc5-6ede85fcef61/pull/0.log" Jul 09 17:31:12.397108 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:12.397046 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh_647a5691-436d-4c26-9d21-2cc0ae114e26/extract/0.log" Jul 09 17:31:12.422836 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:12.422807 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh_647a5691-436d-4c26-9d21-2cc0ae114e26/util/0.log" Jul 09 17:31:12.448025 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:12.448001 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hlphh_647a5691-436d-4c26-9d21-2cc0ae114e26/pull/0.log" Jul 09 17:31:14.960485 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:14.960456 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_40a0b84f-1bdd-4e29-804a-f0902466512b/alertmanager/0.log" Jul 09 17:31:14.981969 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:14.981938 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_40a0b84f-1bdd-4e29-804a-f0902466512b/config-reloader/0.log" Jul 09 17:31:15.004357 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:15.004332 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_40a0b84f-1bdd-4e29-804a-f0902466512b/kube-rbac-proxy-web/0.log" Jul 09 17:31:15.028431 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:15.028407 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_40a0b84f-1bdd-4e29-804a-f0902466512b/kube-rbac-proxy/0.log" Jul 09 17:31:15.047997 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:15.047976 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_40a0b84f-1bdd-4e29-804a-f0902466512b/kube-rbac-proxy-metric/0.log" Jul 09 17:31:15.073566 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:15.073532 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_40a0b84f-1bdd-4e29-804a-f0902466512b/prom-label-proxy/0.log" Jul 09 17:31:15.095221 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:15.095199 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_40a0b84f-1bdd-4e29-804a-f0902466512b/init-config-reloader/0.log" Jul 09 17:31:15.354970 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:15.354943 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-xpxpq_64a5e6ab-7168-4b12-8925-5e899de8d1e8/monitoring-plugin/0.log" Jul 09 17:31:15.605527 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:15.605441 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zqbv5_c650802e-74d2-474d-8475-68031e8986b5/node-exporter/0.log" Jul 09 17:31:15.625027 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:15.624995 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zqbv5_c650802e-74d2-474d-8475-68031e8986b5/kube-rbac-proxy/0.log" Jul 09 17:31:15.644007 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:15.643983 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zqbv5_c650802e-74d2-474d-8475-68031e8986b5/init-textfile/0.log" Jul 09 17:31:15.985826 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:15.985748 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c87f6d55c-xb9zf_c2c2a29a-d185-4b24-af9d-1784385c0473/telemeter-client/0.log" Jul 09 17:31:16.008637 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:16.008612 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c87f6d55c-xb9zf_c2c2a29a-d185-4b24-af9d-1784385c0473/reload/0.log" Jul 09 17:31:16.027941 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:16.027916 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c87f6d55c-xb9zf_c2c2a29a-d185-4b24-af9d-1784385c0473/kube-rbac-proxy/0.log" Jul 09 17:31:16.779784 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:16.779745 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qjspn/perf-node-gather-daemonset-8gtcp"] Jul 09 17:31:16.780118 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:16.780106 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="768d2e9f-3e04-4c17-bb68-199c100411b3" containerName="istio-proxy" Jul 09 17:31:16.780165 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:16.780120 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="768d2e9f-3e04-4c17-bb68-199c100411b3" containerName="istio-proxy" Jul 09 17:31:16.780165 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:16.780141 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03de1eca-1f1a-450b-b42f-a59f37b7a2ff" containerName="istio-proxy" Jul 09 17:31:16.780165 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:16.780146 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="03de1eca-1f1a-450b-b42f-a59f37b7a2ff" containerName="istio-proxy" Jul 09 17:31:16.780165 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:16.780153 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03de1eca-1f1a-450b-b42f-a59f37b7a2ff" containerName="istio-proxy" Jul 09 17:31:16.780165 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:16.780159 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="03de1eca-1f1a-450b-b42f-a59f37b7a2ff" containerName="istio-proxy" Jul 09 17:31:16.780354 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:16.780202 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="03de1eca-1f1a-450b-b42f-a59f37b7a2ff" containerName="istio-proxy" Jul 09 17:31:16.780354 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:16.780209 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="768d2e9f-3e04-4c17-bb68-199c100411b3" containerName="istio-proxy" Jul 09 17:31:16.780354 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:16.780214 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b4b5eb0-8e9a-4452-92e3-5cfbb2f01f1e" containerName="istio-proxy" Jul 09 17:31:16.783458 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:16.783436 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-8gtcp" Jul 09 17:31:16.785514 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:16.785496 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qjspn\"/\"kube-root-ca.crt\"" Jul 09 17:31:16.786270 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:16.786247 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qjspn\"/\"openshift-service-ca.crt\"" Jul 09 17:31:16.786342 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:16.786318 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qjspn\"/\"default-dockercfg-d452k\"" Jul 09 17:31:16.790578 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:16.790494 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qjspn/perf-node-gather-daemonset-8gtcp"] Jul 09 17:31:16.949601 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:16.949555 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2ddz\" (UniqueName: \"kubernetes.io/projected/f1f641af-fe5d-42a9-9011-5309d1f77398-kube-api-access-p2ddz\") pod \"perf-node-gather-daemonset-8gtcp\" (UID: \"f1f641af-fe5d-42a9-9011-5309d1f77398\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-8gtcp" Jul 09 17:31:16.949783 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:16.949627 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f1f641af-fe5d-42a9-9011-5309d1f77398-podres\") pod \"perf-node-gather-daemonset-8gtcp\" (UID: \"f1f641af-fe5d-42a9-9011-5309d1f77398\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-8gtcp" Jul 09 17:31:16.949783 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:16.949650 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f1f641af-fe5d-42a9-9011-5309d1f77398-lib-modules\") pod \"perf-node-gather-daemonset-8gtcp\" (UID: \"f1f641af-fe5d-42a9-9011-5309d1f77398\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-8gtcp" Jul 09 17:31:16.949783 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:16.949666 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1f641af-fe5d-42a9-9011-5309d1f77398-sys\") pod \"perf-node-gather-daemonset-8gtcp\" (UID: \"f1f641af-fe5d-42a9-9011-5309d1f77398\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-8gtcp" Jul 09 17:31:16.949783 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:16.949687 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f1f641af-fe5d-42a9-9011-5309d1f77398-proc\") pod \"perf-node-gather-daemonset-8gtcp\" (UID: \"f1f641af-fe5d-42a9-9011-5309d1f77398\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-8gtcp" Jul 09 17:31:17.051245 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:17.051148 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2ddz\" (UniqueName: \"kubernetes.io/projected/f1f641af-fe5d-42a9-9011-5309d1f77398-kube-api-access-p2ddz\") pod \"perf-node-gather-daemonset-8gtcp\" (UID: \"f1f641af-fe5d-42a9-9011-5309d1f77398\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-8gtcp" Jul 09 17:31:17.051245 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:17.051245 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f1f641af-fe5d-42a9-9011-5309d1f77398-podres\") pod \"perf-node-gather-daemonset-8gtcp\" (UID: \"f1f641af-fe5d-42a9-9011-5309d1f77398\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-8gtcp" Jul 09 17:31:17.051669 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:17.051308 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f1f641af-fe5d-42a9-9011-5309d1f77398-lib-modules\") pod \"perf-node-gather-daemonset-8gtcp\" (UID: \"f1f641af-fe5d-42a9-9011-5309d1f77398\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-8gtcp" Jul 09 17:31:17.051669 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:17.051335 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1f641af-fe5d-42a9-9011-5309d1f77398-sys\") pod \"perf-node-gather-daemonset-8gtcp\" (UID: \"f1f641af-fe5d-42a9-9011-5309d1f77398\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-8gtcp" Jul 09 17:31:17.051669 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:17.051368 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f1f641af-fe5d-42a9-9011-5309d1f77398-proc\") pod \"perf-node-gather-daemonset-8gtcp\" (UID: \"f1f641af-fe5d-42a9-9011-5309d1f77398\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-8gtcp" Jul 09 17:31:17.051669 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:17.051430 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f1f641af-fe5d-42a9-9011-5309d1f77398-podres\") pod \"perf-node-gather-daemonset-8gtcp\" (UID: \"f1f641af-fe5d-42a9-9011-5309d1f77398\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-8gtcp" Jul 09 17:31:17.051669 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:17.051466 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f1f641af-fe5d-42a9-9011-5309d1f77398-proc\") pod \"perf-node-gather-daemonset-8gtcp\" (UID: \"f1f641af-fe5d-42a9-9011-5309d1f77398\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-8gtcp" Jul 09 17:31:17.051669 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:17.051470 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1f641af-fe5d-42a9-9011-5309d1f77398-sys\") pod \"perf-node-gather-daemonset-8gtcp\" (UID: \"f1f641af-fe5d-42a9-9011-5309d1f77398\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-8gtcp" Jul 09 17:31:17.051669 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:17.051487 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f1f641af-fe5d-42a9-9011-5309d1f77398-lib-modules\") pod \"perf-node-gather-daemonset-8gtcp\" (UID: \"f1f641af-fe5d-42a9-9011-5309d1f77398\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-8gtcp" Jul 09 17:31:17.073257 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:17.073231 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2ddz\" (UniqueName: \"kubernetes.io/projected/f1f641af-fe5d-42a9-9011-5309d1f77398-kube-api-access-p2ddz\") pod \"perf-node-gather-daemonset-8gtcp\" (UID: \"f1f641af-fe5d-42a9-9011-5309d1f77398\") " pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-8gtcp" Jul 09 17:31:17.094257 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:17.094229 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-8gtcp" Jul 09 17:31:17.229192 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:17.229167 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qjspn/perf-node-gather-daemonset-8gtcp"] Jul 09 17:31:17.231102 ip-10-0-128-34 kubenswrapper[2580]: W0709 17:31:17.231073 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf1f641af_fe5d_42a9_9011_5309d1f77398.slice/crio-317af06f75456b7373a30480f65f950e0401eef44739ce75bf5a190374f66047 WatchSource:0}: Error finding container 317af06f75456b7373a30480f65f950e0401eef44739ce75bf5a190374f66047: Status 404 returned error can't find the container with id 317af06f75456b7373a30480f65f950e0401eef44739ce75bf5a190374f66047 Jul 09 17:31:18.106035 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:18.105998 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-8gtcp" event={"ID":"f1f641af-fe5d-42a9-9011-5309d1f77398","Type":"ContainerStarted","Data":"e51fb38cf27e6350c5a7cffea74214d25e50aaf676c2f0e99ce90d5c93f569a8"} Jul 09 17:31:18.106476 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:18.106050 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-8gtcp" event={"ID":"f1f641af-fe5d-42a9-9011-5309d1f77398","Type":"ContainerStarted","Data":"317af06f75456b7373a30480f65f950e0401eef44739ce75bf5a190374f66047"} Jul 09 17:31:18.106476 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:18.106113 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-8gtcp" Jul 09 17:31:18.119792 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:18.119748 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-8gtcp" podStartSLOduration=2.119733632 podStartE2EDuration="2.119733632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:31:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:31:18.11946463 +0000 UTC m=+2416.484216558" watchObservedRunningTime="2026-07-09 17:31:18.119733632 +0000 UTC m=+2416.484485526" Jul 09 17:31:20.117267 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:20.117225 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lsxt4_308c5900-bf1d-46c1-aba0-72ed4234d313/dns/0.log" Jul 09 17:31:20.142193 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:20.142163 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lsxt4_308c5900-bf1d-46c1-aba0-72ed4234d313/kube-rbac-proxy/0.log" Jul 09 17:31:20.197501 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:20.197470 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kgbtw_bbbb42c9-70b4-4367-937d-b8e13c0c10c6/dns-node-resolver/0.log" Jul 09 17:31:20.942856 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:20.942824 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r8p6t_971e1a9a-5666-4e2e-b0bc-c3ea99d4ee9e/node-ca/0.log" Jul 09 17:31:21.931765 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:21.931734 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4ff7nh_9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f/istio-proxy/0.log" Jul 09 17:31:22.045503 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:22.045476 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xgk9h_ffe67e28-e944-4410-b8b4-f5c316e4e383/discovery/0.log" Jul 09 17:31:22.121500 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:22.121390 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pgtzg_121993ca-d4de-4580-ba70-1c090b685455/istio-proxy/0.log" Jul 09 17:31:22.151994 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:22.151966 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pgtzg_121993ca-d4de-4580-ba70-1c090b685455/istio-proxy/1.log" Jul 09 17:31:22.208970 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:22.208894 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zndwp_93485444-b733-447c-8fc9-9b89a1894724/payload-processing/0.log" Jul 09 17:31:22.900982 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:22.900939 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6blm6_4fb615a0-9cfe-4db6-85b6-780fda9a647e/serve-healthcheck-canary/0.log" Jul 09 17:31:23.482731 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:23.482703 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ksjzw_a849d2c0-577a-4acb-b564-88b57b5a9467/kube-rbac-proxy/0.log" Jul 09 17:31:23.505290 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:23.505261 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ksjzw_a849d2c0-577a-4acb-b564-88b57b5a9467/exporter/0.log" Jul 09 17:31:23.528269 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:23.528247 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ksjzw_a849d2c0-577a-4acb-b564-88b57b5a9467/extractor/0.log" Jul 09 17:31:24.122384 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:24.122352 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qjspn/perf-node-gather-daemonset-8gtcp" Jul 09 17:31:26.258158 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:26.258128 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6xpmg_f3b9012f-6a41-4e2f-9082-c31001625aad/server/0.log" Jul 09 17:31:26.435939 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:26.435914 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-789dddf866-78kgp_d4671492-257e-4f92-b557-b9f0dd51256b/manager/0.log" Jul 09 17:31:26.456607 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:26.456579 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-789dddf866-78kgp_d4671492-257e-4f92-b557-b9f0dd51256b/copy-manifests/0.log" Jul 09 17:31:27.698335 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:27.698302 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4ff7nh_9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f/istio-proxy/0.log" Jul 09 17:31:27.801316 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:27.801268 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xgk9h_ffe67e28-e944-4410-b8b4-f5c316e4e383/discovery/0.log" Jul 09 17:31:27.814007 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:27.813980 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-db6444945-x6h6c_8a2fdfa5-9fe9-402a-9d2a-79857d6da7e1/manager/0.log" Jul 09 17:31:27.838608 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:27.838562 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-lpswv_cf8333df-d5d5-4e2a-bb14-933b739502d5/openshift-lws-operator/0.log" Jul 09 17:31:27.841490 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:27.841456 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pgtzg_121993ca-d4de-4580-ba70-1c090b685455/istio-proxy/0.log" Jul 09 17:31:27.872304 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:27.872259 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pgtzg_121993ca-d4de-4580-ba70-1c090b685455/istio-proxy/1.log" Jul 09 17:31:27.918215 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:27.918119 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zndwp_93485444-b733-447c-8fc9-9b89a1894724/payload-processing/0.log" Jul 09 17:31:29.156069 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:29.156036 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4ff7nh_9ff5dbdb-67ed-4726-90e1-82f5da1f8c7f/istio-proxy/0.log" Jul 09 17:31:29.262155 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:29.262126 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xgk9h_ffe67e28-e944-4410-b8b4-f5c316e4e383/discovery/0.log" Jul 09 17:31:29.311397 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:29.311364 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pgtzg_121993ca-d4de-4580-ba70-1c090b685455/istio-proxy/0.log" Jul 09 17:31:29.340672 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:29.340643 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pgtzg_121993ca-d4de-4580-ba70-1c090b685455/istio-proxy/1.log" Jul 09 17:31:29.381206 ip-10-0-128-34 kubenswrapper[2580]: I0709 17:31:29.381171 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zndwp_93485444-b733-447c-8fc9-9b89a1894724/payload-processing/0.log"