Jul 10 13:25:45.335258 ip-10-0-128-57 systemd[1]: Starting Kubernetes Kubelet... Jul 10 13:25:45.809523 ip-10-0-128-57 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 13:25:45.809523 ip-10-0-128-57 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 10 13:25:45.809523 ip-10-0-128-57 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 13:25:45.809523 ip-10-0-128-57 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 10 13:25:45.809523 ip-10-0-128-57 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 13:25:45.809523 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.804773 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 10 13:25:45.811722 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809631 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 13:25:45.811722 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809647 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 13:25:45.811722 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809652 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 13:25:45.811722 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809656 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 13:25:45.811722 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809660 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 13:25:45.811722 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809666 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 13:25:45.811722 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809671 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 13:25:45.811722 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809675 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 13:25:45.811722 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809680 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 13:25:45.811722 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809684 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 13:25:45.811722 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809687 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 13:25:45.811722 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809691 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 13:25:45.811722 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809694 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 13:25:45.811722 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809699 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 13:25:45.811722 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809702 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 13:25:45.811722 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809706 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 13:25:45.811722 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809709 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 13:25:45.811722 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809713 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 13:25:45.811722 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809727 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 13:25:45.811722 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809732 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 13:25:45.816840 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809735 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 13:25:45.816840 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809739 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 13:25:45.816840 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809743 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 13:25:45.816840 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809746 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 13:25:45.816840 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809750 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 13:25:45.816840 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809754 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 13:25:45.816840 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809758 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 13:25:45.816840 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809764 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 13:25:45.816840 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809768 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 13:25:45.816840 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809772 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 13:25:45.816840 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809776 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 13:25:45.816840 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809779 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 13:25:45.816840 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809787 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 13:25:45.816840 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809792 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 13:25:45.816840 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809796 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 13:25:45.816840 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809799 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 13:25:45.816840 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809803 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 13:25:45.816840 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809807 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 13:25:45.816840 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809813 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 13:25:45.816840 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809817 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 13:25:45.844731 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809821 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 13:25:45.844731 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809825 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 13:25:45.844731 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809828 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 13:25:45.844731 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809833 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 13:25:45.844731 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809836 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 13:25:45.844731 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809840 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 13:25:45.844731 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809844 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 13:25:45.844731 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809848 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 13:25:45.844731 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809852 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 13:25:45.844731 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809855 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 13:25:45.844731 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809859 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 13:25:45.844731 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809863 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 13:25:45.844731 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809866 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 13:25:45.844731 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809871 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 13:25:45.844731 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809875 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 13:25:45.844731 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809879 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 13:25:45.844731 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809883 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 13:25:45.844731 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809887 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 13:25:45.844731 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809894 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 10 13:25:45.844731 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809898 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 13:25:45.846858 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809902 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 13:25:45.846858 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809906 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 13:25:45.846858 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809911 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 13:25:45.846858 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809915 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 13:25:45.846858 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809919 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 13:25:45.846858 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809924 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 13:25:45.846858 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809928 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 13:25:45.846858 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809932 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 13:25:45.846858 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809936 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 13:25:45.846858 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809941 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 13:25:45.846858 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809945 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 13:25:45.846858 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809951 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 13:25:45.846858 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809955 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 13:25:45.846858 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809960 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 13:25:45.846858 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809964 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 13:25:45.846858 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809986 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 13:25:45.846858 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809993 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 13:25:45.846858 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.809997 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 13:25:45.846858 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.810002 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 13:25:45.849082 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.810006 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 13:25:45.849082 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.810010 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 13:25:45.849082 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.810015 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 13:25:45.849082 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.810018 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 13:25:45.849082 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.810022 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 13:25:45.849082 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.810026 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 13:25:45.849082 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.810030 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 13:25:45.849082 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.810035 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 13:25:45.849082 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.810039 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 13:25:45.849082 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.810046 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 13:25:45.849082 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.810052 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 13:25:45.849082 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.810057 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 13:25:45.849082 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.810061 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 13:25:45.849082 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.810066 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 13:25:45.849082 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.810070 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 13:25:45.849082 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.810075 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 13:25:45.849082 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.810079 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 13:25:45.849082 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.810083 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 13:25:45.849082 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.810087 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 13:25:45.849082 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.810092 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 13:25:45.855834 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811065 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 13:25:45.855834 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811075 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 13:25:45.855834 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811078 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 13:25:45.855834 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811080 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 13:25:45.855834 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811083 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 13:25:45.855834 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811086 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 13:25:45.855834 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811089 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 13:25:45.855834 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811091 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 13:25:45.855834 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811094 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 13:25:45.855834 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811097 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 13:25:45.855834 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811099 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 13:25:45.855834 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811102 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 13:25:45.855834 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811105 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 13:25:45.855834 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811107 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 13:25:45.855834 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811111 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 13:25:45.855834 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811113 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 13:25:45.855834 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811116 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 13:25:45.855834 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811118 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 13:25:45.855834 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811121 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 13:25:45.855834 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811123 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 13:25:45.858499 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811126 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 13:25:45.858499 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811128 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 13:25:45.858499 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811132 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 13:25:45.858499 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811134 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 13:25:45.858499 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811137 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 13:25:45.858499 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811140 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 13:25:45.858499 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811142 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 13:25:45.858499 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811145 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 13:25:45.858499 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811147 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 13:25:45.858499 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811149 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 13:25:45.858499 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811152 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 13:25:45.858499 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811155 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 13:25:45.858499 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811157 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 13:25:45.858499 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811160 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 13:25:45.858499 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811164 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 13:25:45.858499 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811166 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 13:25:45.858499 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811169 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 13:25:45.858499 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811171 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 13:25:45.858499 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811174 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 13:25:45.858499 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811177 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 13:25:45.860749 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811182 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 13:25:45.860749 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811185 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 13:25:45.860749 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811189 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 13:25:45.860749 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811191 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 13:25:45.860749 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811194 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 13:25:45.860749 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811197 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 13:25:45.860749 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811199 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 13:25:45.860749 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811202 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 13:25:45.860749 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811205 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 13:25:45.860749 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811207 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 13:25:45.860749 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811210 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 13:25:45.860749 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811213 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 13:25:45.860749 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811215 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 13:25:45.860749 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811218 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 13:25:45.860749 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811220 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 13:25:45.860749 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811223 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 13:25:45.860749 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811225 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 13:25:45.860749 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811228 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 13:25:45.860749 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811230 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 13:25:45.876885 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811233 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 13:25:45.876885 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811235 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 13:25:45.876885 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811238 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 13:25:45.876885 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811241 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 13:25:45.876885 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811244 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 13:25:45.876885 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811247 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 13:25:45.876885 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811249 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 13:25:45.876885 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811252 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 13:25:45.876885 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811255 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 13:25:45.876885 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811259 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 13:25:45.876885 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811263 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 13:25:45.876885 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811266 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 13:25:45.876885 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811269 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 13:25:45.876885 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811272 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 13:25:45.876885 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811275 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 13:25:45.876885 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811278 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 13:25:45.876885 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811280 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 13:25:45.876885 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811283 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 13:25:45.876885 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811285 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 13:25:45.880582 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811288 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 13:25:45.880582 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811291 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 13:25:45.880582 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811293 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 13:25:45.880582 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811296 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 13:25:45.880582 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811298 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 13:25:45.880582 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811301 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 13:25:45.880582 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811303 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 13:25:45.880582 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811306 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 13:25:45.880582 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811309 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 13:25:45.880582 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811311 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 13:25:45.880582 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811315 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 13:25:45.880582 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811319 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 13:25:45.880582 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811323 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 13:25:45.880582 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811326 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 13:25:45.880582 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811328 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 13:25:45.880582 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811331 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 13:25:45.880582 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811334 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 13:25:45.880582 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811337 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 13:25:45.880582 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811340 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 13:25:45.880582 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811344 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 10 13:25:45.897597 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811348 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 13:25:45.897597 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811761 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 13:25:45.897597 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811769 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 13:25:45.897597 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811774 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 13:25:45.897597 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811779 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 13:25:45.897597 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811784 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 13:25:45.897597 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811788 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 13:25:45.897597 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811792 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 13:25:45.897597 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811796 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 13:25:45.897597 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811801 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 13:25:45.897597 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811805 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 13:25:45.897597 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811808 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 13:25:45.897597 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811812 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 13:25:45.897597 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811816 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 13:25:45.897597 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811820 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 13:25:45.897597 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811824 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 13:25:45.897597 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811829 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 13:25:45.897597 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811833 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 13:25:45.897597 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811837 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 13:25:45.897597 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811841 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 13:25:45.883717 ip-10-0-128-57 systemd[1]: Started Kubernetes Kubelet. Jul 10 13:25:45.902782 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811845 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 13:25:45.902782 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811850 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 13:25:45.902782 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811854 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 13:25:45.902782 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811858 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 13:25:45.902782 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811862 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 13:25:45.902782 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811866 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 13:25:45.902782 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811873 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 13:25:45.902782 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811879 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 13:25:45.902782 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811885 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 13:25:45.902782 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811890 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 13:25:45.902782 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811895 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 13:25:45.902782 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811900 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 13:25:45.902782 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811904 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 13:25:45.902782 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811909 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 13:25:45.902782 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811915 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 13:25:45.902782 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811919 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 13:25:45.902782 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811923 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 13:25:45.902782 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811927 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 13:25:45.902782 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811933 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 13:25:45.916735 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811939 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 13:25:45.916735 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811943 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 13:25:45.916735 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811947 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 13:25:45.916735 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811952 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 13:25:45.916735 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811956 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 13:25:45.916735 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811960 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 13:25:45.916735 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811964 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 13:25:45.916735 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811984 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 13:25:45.916735 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811990 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 13:25:45.916735 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811995 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 13:25:45.916735 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.811999 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 13:25:45.916735 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812003 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 13:25:45.916735 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812007 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 13:25:45.916735 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812011 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 13:25:45.916735 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812015 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 13:25:45.916735 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812019 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 13:25:45.916735 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812023 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 10 13:25:45.916735 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812028 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 13:25:45.916735 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812032 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 13:25:45.916735 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812036 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 13:25:45.921546 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812040 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 13:25:45.921546 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812044 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 13:25:45.921546 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812049 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 13:25:45.921546 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812053 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 13:25:45.921546 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812057 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 13:25:45.921546 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812062 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 13:25:45.921546 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812066 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 13:25:45.921546 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812070 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 13:25:45.921546 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812078 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 13:25:45.921546 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812083 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 13:25:45.921546 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812089 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 13:25:45.921546 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812093 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 13:25:45.921546 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812098 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 13:25:45.921546 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812102 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 13:25:45.921546 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812105 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 13:25:45.921546 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812109 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 13:25:45.921546 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812113 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 13:25:45.921546 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812117 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 13:25:45.921546 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812121 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 13:25:45.925177 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812125 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 13:25:45.925177 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812129 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 13:25:45.925177 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812134 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 13:25:45.925177 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812138 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 13:25:45.925177 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812142 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 13:25:45.925177 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812148 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 13:25:45.925177 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812154 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 13:25:45.925177 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812161 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 13:25:45.925177 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812165 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 13:25:45.925177 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812170 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 13:25:45.925177 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812174 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 13:25:45.925177 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812183 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 13:25:45.925177 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812187 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 13:25:45.925177 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812191 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 13:25:45.925177 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812195 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 13:25:45.925177 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812199 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 13:25:45.925177 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812203 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 13:25:45.925177 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812207 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 13:25:45.925177 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812211 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 13:25:46.073730 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812216 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 13:25:46.073730 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812221 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 13:25:46.073730 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.812225 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 13:25:46.073730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.812331 2575 flags.go:64] FLAG: --address="0.0.0.0" Jul 10 13:25:46.073730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.812343 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 10 13:25:46.073730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813288 2575 flags.go:64] FLAG: --anonymous-auth="true" Jul 10 13:25:46.073730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813299 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 10 13:25:46.073730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813306 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 10 13:25:46.073730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813310 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 10 13:25:46.073730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813315 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 10 13:25:46.073730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813321 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 10 13:25:46.073730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813325 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 10 13:25:46.073730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813329 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 10 13:25:46.073730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813334 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 10 13:25:46.073730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813337 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 10 13:25:46.073730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813341 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 10 13:25:46.073730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813345 2575 flags.go:64] FLAG: --cgroup-root="" Jul 10 13:25:46.073730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813349 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 10 13:25:46.073730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813353 2575 flags.go:64] FLAG: --client-ca-file="" Jul 10 13:25:46.073730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813356 2575 flags.go:64] FLAG: --cloud-provider="external" Jul 10 13:25:46.073730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813360 2575 flags.go:64] FLAG: --cluster-dns="[]" Jul 10 13:25:46.073730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813365 2575 flags.go:64] FLAG: --cluster-domain="" Jul 10 13:25:46.073730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813370 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 10 13:25:46.074778 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813374 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 10 13:25:46.074778 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813380 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 10 13:25:46.074778 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813384 2575 flags.go:64] FLAG: --container-log-max-files="5" Jul 10 13:25:46.074778 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813389 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 10 13:25:46.074778 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813393 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 10 13:25:46.074778 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813397 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 10 13:25:46.074778 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813401 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 10 13:25:46.074778 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813405 2575 flags.go:64] FLAG: --contention-profiling="false" Jul 10 13:25:46.074778 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813409 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 10 13:25:46.074778 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813413 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 10 13:25:46.074778 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813417 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 10 13:25:46.074778 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813421 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 10 13:25:46.074778 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813427 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 10 13:25:46.074778 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813430 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 10 13:25:46.074778 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813434 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 10 13:25:46.074778 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813438 2575 flags.go:64] FLAG: --enable-load-reader="false" Jul 10 13:25:46.074778 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813441 2575 flags.go:64] FLAG: --enable-server="true" Jul 10 13:25:46.074778 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813446 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 10 13:25:46.074778 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813453 2575 flags.go:64] FLAG: --event-burst="100" Jul 10 13:25:46.074778 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813457 2575 flags.go:64] FLAG: --event-qps="50" Jul 10 13:25:46.074778 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813461 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 10 13:25:46.074778 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813464 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 10 13:25:46.074778 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813468 2575 flags.go:64] FLAG: --eviction-hard="" Jul 10 13:25:46.074778 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813473 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 10 13:25:46.075860 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813477 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 10 13:25:46.075860 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813481 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 10 13:25:46.075860 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813485 2575 flags.go:64] FLAG: --eviction-soft="" Jul 10 13:25:46.075860 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813488 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 10 13:25:46.075860 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813492 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 10 13:25:46.075860 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813496 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 10 13:25:46.075860 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813499 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jul 10 13:25:46.075860 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813503 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 10 13:25:46.075860 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813506 2575 flags.go:64] FLAG: --fail-swap-on="true" Jul 10 13:25:46.075860 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813511 2575 flags.go:64] FLAG: --feature-gates="" Jul 10 13:25:46.075860 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813516 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jul 10 13:25:46.075860 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813520 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 10 13:25:46.075860 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813524 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 10 13:25:46.075860 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813528 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 10 13:25:46.075860 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813532 2575 flags.go:64] FLAG: --healthz-port="10248" Jul 10 13:25:46.075860 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813536 2575 flags.go:64] FLAG: --help="false" Jul 10 13:25:46.075860 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813540 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-128-57.ec2.internal" Jul 10 13:25:46.075860 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813545 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 10 13:25:46.075860 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813548 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jul 10 13:25:46.075860 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813552 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 10 13:25:46.075860 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813556 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 10 13:25:46.075860 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813561 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 10 13:25:46.075860 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813564 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 10 13:25:46.075860 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813568 2575 flags.go:64] FLAG: --image-service-endpoint="" Jul 10 13:25:46.078685 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813572 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 10 13:25:46.078685 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813575 2575 flags.go:64] FLAG: --kube-api-burst="100" Jul 10 13:25:46.078685 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813579 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 10 13:25:46.078685 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813584 2575 flags.go:64] FLAG: --kube-api-qps="50" Jul 10 13:25:46.078685 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813589 2575 flags.go:64] FLAG: --kube-reserved="" Jul 10 13:25:46.078685 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813594 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 10 13:25:46.078685 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813599 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 10 13:25:46.078685 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813602 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jul 10 13:25:46.078685 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813605 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 10 13:25:46.078685 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813608 2575 flags.go:64] FLAG: --lock-file="" Jul 10 13:25:46.078685 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813611 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 10 13:25:46.078685 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813614 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 10 13:25:46.078685 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813617 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 10 13:25:46.078685 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813623 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jul 10 13:25:46.078685 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813626 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 10 13:25:46.078685 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813628 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jul 10 13:25:46.078685 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813631 2575 flags.go:64] FLAG: --logging-format="text" Jul 10 13:25:46.078685 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813638 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 10 13:25:46.078685 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813641 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 10 13:25:46.078685 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813644 2575 flags.go:64] FLAG: --manifest-url="" Jul 10 13:25:46.078685 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813647 2575 flags.go:64] FLAG: --manifest-url-header="" Jul 10 13:25:46.078685 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813652 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 10 13:25:46.078685 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813655 2575 flags.go:64] FLAG: --max-open-files="1000000" Jul 10 13:25:46.078685 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813659 2575 flags.go:64] FLAG: --max-pods="110" Jul 10 13:25:46.078685 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813662 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 10 13:25:46.102121 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813665 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 10 13:25:46.102121 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813667 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jul 10 13:25:46.102121 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813670 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 10 13:25:46.102121 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813673 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 10 13:25:46.102121 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813676 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 10 13:25:46.102121 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813680 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 10 13:25:46.102121 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813688 2575 flags.go:64] FLAG: --node-status-max-images="50" Jul 10 13:25:46.102121 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813691 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 10 13:25:46.102121 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813694 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jul 10 13:25:46.102121 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813697 2575 flags.go:64] FLAG: --pod-cidr="" Jul 10 13:25:46.102121 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813701 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 10 13:25:46.102121 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813708 2575 flags.go:64] FLAG: --pod-manifest-path="" Jul 10 13:25:46.102121 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813711 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jul 10 13:25:46.102121 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813714 2575 flags.go:64] FLAG: --pods-per-core="0" Jul 10 13:25:46.102121 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813717 2575 flags.go:64] FLAG: --port="10250" Jul 10 13:25:46.102121 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813720 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 10 13:25:46.102121 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813723 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0aab879d4c72785cd" Jul 10 13:25:46.102121 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813726 2575 flags.go:64] FLAG: --qos-reserved="" Jul 10 13:25:46.102121 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813729 2575 flags.go:64] FLAG: --read-only-port="10255" Jul 10 13:25:46.102121 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813732 2575 flags.go:64] FLAG: --register-node="true" Jul 10 13:25:46.102121 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813735 2575 flags.go:64] FLAG: --register-with-taints="" Jul 10 13:25:46.102121 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813739 2575 flags.go:64] FLAG: --registry-burst="10" Jul 10 13:25:46.102121 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813742 2575 flags.go:64] FLAG: --registry-qps="5" Jul 10 13:25:46.102121 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813745 2575 flags.go:64] FLAG: --reserved-cpus="" Jul 10 13:25:46.103550 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813748 2575 flags.go:64] FLAG: --reserved-memory="" Jul 10 13:25:46.103550 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813753 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 10 13:25:46.103550 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813756 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 10 13:25:46.103550 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813759 2575 flags.go:64] FLAG: --rotate-certificates="false" Jul 10 13:25:46.103550 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813762 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 10 13:25:46.103550 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813765 2575 flags.go:64] FLAG: --runonce="false" Jul 10 13:25:46.103550 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813768 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 10 13:25:46.103550 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813771 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 10 13:25:46.103550 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813774 2575 flags.go:64] FLAG: --seccomp-default="false" Jul 10 13:25:46.103550 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813777 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 10 13:25:46.103550 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813780 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 10 13:25:46.103550 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813783 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 10 13:25:46.103550 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813786 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 10 13:25:46.103550 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813789 2575 flags.go:64] FLAG: --storage-driver-password="root" Jul 10 13:25:46.103550 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813792 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jul 10 13:25:46.103550 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813795 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jul 10 13:25:46.103550 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813798 2575 flags.go:64] FLAG: --storage-driver-user="root" Jul 10 13:25:46.103550 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813801 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 10 13:25:46.103550 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813804 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 10 13:25:46.103550 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813809 2575 flags.go:64] FLAG: --system-cgroups="" Jul 10 13:25:46.103550 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813812 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 10 13:25:46.103550 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813817 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 10 13:25:46.103550 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813820 2575 flags.go:64] FLAG: --tls-cert-file="" Jul 10 13:25:46.103550 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813823 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 10 13:25:46.103550 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813827 2575 flags.go:64] FLAG: --tls-min-version="" Jul 10 13:25:46.104903 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813830 2575 flags.go:64] FLAG: --tls-private-key-file="" Jul 10 13:25:46.104903 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813833 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jul 10 13:25:46.104903 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813835 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 10 13:25:46.104903 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813838 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jul 10 13:25:46.104903 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813841 2575 flags.go:64] FLAG: --v="2" Jul 10 13:25:46.104903 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813846 2575 flags.go:64] FLAG: --version="false" Jul 10 13:25:46.104903 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813850 2575 flags.go:64] FLAG: --vmodule="" Jul 10 13:25:46.104903 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813853 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 10 13:25:46.104903 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.813858 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 10 13:25:46.104903 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814000 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 13:25:46.104903 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814005 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 13:25:46.104903 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814008 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 13:25:46.104903 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814011 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 13:25:46.104903 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814014 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 13:25:46.104903 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814017 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 13:25:46.104903 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814020 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 13:25:46.104903 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814022 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 13:25:46.104903 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814025 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 13:25:46.104903 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814028 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 13:25:46.104903 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814031 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 13:25:46.104903 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814034 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 13:25:46.104903 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814036 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 13:25:46.106296 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814039 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 13:25:46.106296 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814042 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 13:25:46.106296 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814044 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 13:25:46.106296 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814047 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 13:25:46.106296 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814051 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 13:25:46.106296 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814055 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 13:25:46.106296 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814057 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 13:25:46.106296 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814060 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 13:25:46.106296 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814062 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 13:25:46.106296 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814065 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 13:25:46.106296 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814068 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 13:25:46.106296 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814070 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 13:25:46.106296 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814074 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 13:25:46.106296 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814077 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 13:25:46.106296 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814080 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 13:25:46.106296 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814083 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 13:25:46.106296 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814086 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 13:25:46.106296 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814090 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 13:25:46.106296 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814094 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 13:25:46.107190 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814098 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 13:25:46.107190 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814101 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 13:25:46.107190 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814103 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 13:25:46.107190 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814107 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 13:25:46.107190 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814110 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 13:25:46.107190 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814113 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 13:25:46.107190 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814116 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 13:25:46.107190 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814119 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 13:25:46.107190 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814122 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 13:25:46.107190 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814125 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 13:25:46.107190 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814128 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 13:25:46.107190 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814131 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 13:25:46.107190 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814133 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 13:25:46.107190 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814136 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 13:25:46.107190 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814138 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 13:25:46.107190 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814141 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 13:25:46.107190 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814144 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 13:25:46.107190 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814147 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 13:25:46.107190 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814150 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 13:25:46.107190 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814154 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 13:25:46.109317 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814156 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 13:25:46.109317 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814159 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 10 13:25:46.109317 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814162 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 13:25:46.109317 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814164 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 13:25:46.109317 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814167 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 13:25:46.109317 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814169 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 13:25:46.109317 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814172 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 13:25:46.109317 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814175 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 13:25:46.109317 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814177 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 13:25:46.109317 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814179 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 13:25:46.109317 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814182 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 13:25:46.109317 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814186 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 13:25:46.109317 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814188 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 13:25:46.109317 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814191 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 13:25:46.109317 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814193 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 13:25:46.109317 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814196 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 13:25:46.109317 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814199 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 13:25:46.109317 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814201 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 13:25:46.109317 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814204 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 13:25:46.110256 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814208 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 13:25:46.110256 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814211 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 13:25:46.110256 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814214 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 13:25:46.110256 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814217 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 13:25:46.110256 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814219 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 13:25:46.110256 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814222 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 13:25:46.110256 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814225 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 13:25:46.110256 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814227 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 13:25:46.110256 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814230 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 13:25:46.110256 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814232 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 13:25:46.110256 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814236 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 13:25:46.110256 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814239 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 13:25:46.110256 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814242 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 13:25:46.110256 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814245 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 13:25:46.110256 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814247 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 13:25:46.110256 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814250 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 13:25:46.110256 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814252 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 13:25:46.110256 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814255 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 13:25:46.110256 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814257 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 13:25:46.112747 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814260 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 13:25:46.112747 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814262 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 13:25:46.112747 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814265 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 13:25:46.112747 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814267 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 13:25:46.112747 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814270 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 13:25:46.112747 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814274 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 13:25:46.112747 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814277 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 13:25:46.112747 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814279 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 13:25:46.112747 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.814281 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 13:25:46.112747 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.814946 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 13:25:46.112747 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.822708 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 10 13:25:46.112747 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.822727 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 10 13:25:46.112747 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.822753 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 10 13:25:46.112747 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.822766 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 10 13:25:46.112747 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822846 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 13:25:46.113670 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822853 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 13:25:46.113670 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822858 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 13:25:46.113670 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822863 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 13:25:46.113670 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822868 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 13:25:46.113670 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822874 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 13:25:46.113670 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822879 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 13:25:46.113670 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822883 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 13:25:46.113670 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822887 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 13:25:46.113670 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822891 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 13:25:46.113670 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822895 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 13:25:46.113670 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822899 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 13:25:46.113670 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822902 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 13:25:46.113670 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822906 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 10 13:25:46.113670 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822911 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 13:25:46.113670 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822914 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 13:25:46.113670 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822918 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 13:25:46.113670 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822922 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 13:25:46.113670 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822925 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 13:25:46.113670 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822929 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 13:25:46.113670 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822933 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 13:25:46.115401 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822937 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 13:25:46.115401 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822941 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 13:25:46.115401 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822945 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 13:25:46.115401 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822948 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 13:25:46.115401 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822953 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 13:25:46.115401 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822957 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 13:25:46.115401 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822961 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 13:25:46.115401 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822965 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 13:25:46.115401 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822983 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 13:25:46.115401 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822988 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 13:25:46.115401 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822991 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 13:25:46.115401 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822995 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 13:25:46.115401 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.822998 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 13:25:46.115401 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823002 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 13:25:46.115401 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823006 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 13:25:46.115401 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823009 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 13:25:46.115401 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823013 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 13:25:46.115401 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823017 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 13:25:46.115401 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823024 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 13:25:46.115401 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823028 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 13:25:46.116742 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823032 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 13:25:46.116742 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823036 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 13:25:46.116742 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823040 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 13:25:46.116742 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823044 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 13:25:46.116742 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823048 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 13:25:46.116742 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823053 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 13:25:46.116742 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823056 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 13:25:46.116742 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823060 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 13:25:46.116742 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823064 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 13:25:46.116742 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823068 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 13:25:46.116742 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823072 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 13:25:46.116742 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823076 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 13:25:46.116742 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823081 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 13:25:46.116742 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823085 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 13:25:46.116742 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823089 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 13:25:46.116742 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823094 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 13:25:46.116742 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823098 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 13:25:46.116742 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823101 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 13:25:46.116742 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823106 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 13:25:46.116742 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823109 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 13:25:46.117680 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823113 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 13:25:46.117680 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823118 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 13:25:46.117680 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823121 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 13:25:46.117680 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823125 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 13:25:46.117680 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823131 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 13:25:46.117680 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823137 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 13:25:46.117680 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823141 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 13:25:46.117680 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823146 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 13:25:46.117680 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823150 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 13:25:46.117680 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823155 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 13:25:46.117680 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823161 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 13:25:46.117680 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823165 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 13:25:46.117680 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823171 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 13:25:46.117680 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823176 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 13:25:46.117680 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823181 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 13:25:46.117680 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823185 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 13:25:46.117680 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823189 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 13:25:46.117680 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823193 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 13:25:46.117680 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823197 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 13:25:46.118618 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823201 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 13:25:46.118618 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823205 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 13:25:46.118618 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823209 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 13:25:46.118618 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823213 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 13:25:46.118618 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823217 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 13:25:46.118618 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823221 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 13:25:46.118618 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823225 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 13:25:46.118618 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823229 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 13:25:46.118618 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823233 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 13:25:46.118618 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823237 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 13:25:46.118618 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823240 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 13:25:46.118618 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823245 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 13:25:46.118618 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823249 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 13:25:46.118618 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823253 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 13:25:46.118618 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823256 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 13:25:46.118618 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823261 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 13:25:46.118618 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823265 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 13:25:46.118618 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823269 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 13:25:46.118618 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823273 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 13:25:46.119531 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.823280 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 13:25:46.119531 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823451 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 13:25:46.119531 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823458 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 13:25:46.119531 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823462 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 13:25:46.119531 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823468 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 13:25:46.119531 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823478 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 13:25:46.119531 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823483 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 13:25:46.119531 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823487 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 13:25:46.119531 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823492 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 10 13:25:46.119531 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823496 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 13:25:46.119531 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823501 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 13:25:46.119531 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823505 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 13:25:46.119531 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823509 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 13:25:46.119531 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823514 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 13:25:46.119531 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823518 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 13:25:46.121629 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823523 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 13:25:46.121629 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823527 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 13:25:46.121629 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823531 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 13:25:46.121629 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823535 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 13:25:46.121629 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823539 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 13:25:46.121629 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823543 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 13:25:46.121629 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823548 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 13:25:46.121629 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823551 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 13:25:46.121629 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823555 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 13:25:46.121629 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823561 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 13:25:46.121629 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823566 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 13:25:46.121629 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823570 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 13:25:46.121629 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823574 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 13:25:46.121629 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823578 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 13:25:46.121629 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823583 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 13:25:46.121629 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823587 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 13:25:46.121629 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823591 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 13:25:46.121629 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823595 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 13:25:46.121629 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823598 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 13:25:46.121629 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823602 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 13:25:46.122567 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823606 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 13:25:46.122567 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823610 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 13:25:46.122567 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823616 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 13:25:46.122567 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823620 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 13:25:46.122567 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823624 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 13:25:46.122567 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823628 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 13:25:46.122567 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823632 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 13:25:46.122567 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823636 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 13:25:46.122567 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823640 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 13:25:46.122567 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823644 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 13:25:46.122567 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823648 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 13:25:46.122567 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823652 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 13:25:46.122567 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823656 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 13:25:46.122567 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823661 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 13:25:46.122567 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823666 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 13:25:46.122567 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823672 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 13:25:46.122567 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823676 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 13:25:46.122567 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823680 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 13:25:46.122567 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823684 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 13:25:46.123526 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823688 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 13:25:46.123526 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823692 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 13:25:46.123526 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823695 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 13:25:46.123526 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823699 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 13:25:46.123526 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823703 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 13:25:46.123526 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823707 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 13:25:46.123526 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823711 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 13:25:46.123526 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823715 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 13:25:46.123526 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823719 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 13:25:46.123526 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823724 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 13:25:46.123526 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823727 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 13:25:46.123526 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823731 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 13:25:46.123526 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823735 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 13:25:46.123526 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823739 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 13:25:46.123526 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823743 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 13:25:46.123526 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823748 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 13:25:46.123526 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823752 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 13:25:46.123526 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823756 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 13:25:46.123526 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823760 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 13:25:46.123526 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823763 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 13:25:46.124472 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823767 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 13:25:46.124472 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823771 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 13:25:46.124472 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823775 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 13:25:46.124472 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823779 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 13:25:46.124472 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823785 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 13:25:46.124472 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823788 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 13:25:46.124472 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823792 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 13:25:46.124472 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823796 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 13:25:46.124472 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823800 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 13:25:46.124472 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823803 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 13:25:46.124472 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823807 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 13:25:46.124472 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823811 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 13:25:46.124472 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823815 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 13:25:46.124472 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823819 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 13:25:46.124472 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823823 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 13:25:46.124472 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823827 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 13:25:46.124472 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823830 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 13:25:46.124472 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823834 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 13:25:46.124472 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823839 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 13:25:46.124472 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823842 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 13:25:46.126211 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823846 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 13:25:46.126211 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823850 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 13:25:46.126211 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823854 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 13:25:46.126211 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823858 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 13:25:46.126211 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823862 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 13:25:46.126211 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:45.823866 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 13:25:46.126211 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.823872 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 13:25:46.126211 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.824047 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jul 10 13:25:46.126211 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.826899 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 10 13:25:46.126211 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.828663 2575 server.go:1019] "Starting client certificate rotation" Jul 10 13:25:46.126211 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.828758 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 13:25:46.126211 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.828791 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 13:25:46.126211 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.834071 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 13:25:46.127104 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.835883 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 13:25:46.127104 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.846819 2575 log.go:25] "Validated CRI v1 runtime API" Jul 10 13:25:46.127104 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.849351 2575 log.go:25] "Validated CRI v1 image API" Jul 10 13:25:46.127104 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.850153 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 10 13:25:46.127104 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.852866 2575 fs.go:135] Filesystem UUIDs: map[1a795f5c-aa9c-42da-bb2b-3a1464dc78fa:/dev/nvme0n1p3 66745d1a-1d4b-4a59-83f5-2c4bb2736d72:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 10 13:25:46.127104 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.852889 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 10 13:25:46.128733 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.859606 2575 manager.go:216] Machine: {Timestamp:2026-07-10 13:25:45.858227962 +0000 UTC m=+0.386224592 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099923 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22c79ffa612c057131baaf1115ed8a SystemUUID:ec22c79f-fa61-2c05-7131-baaf1115ed8a BootID:8ade39b9-ffb4-46cf-b199-50a12e0c7238 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:15:3c:d0:7b:55 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:15:3c:d0:7b:55 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:c0:0b:50:96:cf Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 10 13:25:46.128733 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.859703 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 10 13:25:46.128733 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.859776 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 10 13:25:46.128733 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.863377 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 10 13:25:46.128733 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.863400 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-57.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 10 13:25:46.128733 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.864258 2575 topology_manager.go:138] "Creating topology manager with none policy" Jul 10 13:25:46.128733 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.864268 2575 container_manager_linux.go:309] "Creating device plugin manager" Jul 10 13:25:46.128733 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.864276 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 13:25:46.128733 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.864289 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 13:25:46.128733 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.866159 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 10 13:25:46.128733 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.869001 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 13:25:46.128733 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.870856 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 10 13:25:46.128733 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.870985 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 10 13:25:46.128733 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.871017 2575 kubelet.go:486] "Attempting to sync node with API server" Jul 10 13:25:46.128733 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.871027 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 10 13:25:46.128733 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.871041 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 10 13:25:46.128733 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.871050 2575 kubelet.go:398] "Adding apiserver pod source" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.871058 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.871347 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.871370 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.873957 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.877448 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.877498 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.878352 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.878373 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.878379 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.878386 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.878395 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.878401 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.878410 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.878416 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.878425 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.878431 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.878444 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.878451 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.879394 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.879419 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.882911 2575 server.go:1268] "Started kubelet" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.883123 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.883190 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.883369 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.883468 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-57.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:45.883463 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:45.883566 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.884615 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.886444 2575 server.go:310] "Adding debug handlers to kubelet server" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:45.887705 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-57.ec2.internal.18c0f08e2dc911fe default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-57.ec2.internal,UID:ip-10-0-128-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-57.ec2.internal,},FirstTimestamp:2026-07-10 13:25:45.88289075 +0000 UTC m=+0.410887380,LastTimestamp:2026-07-10 13:25:45.88289075 +0000 UTC m=+0.410887380,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-57.ec2.internal,}" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:45.889082 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.894427 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:45.897638 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-57.ec2.internal\" not found" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.897721 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.898350 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.898358 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.898388 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.898517 2575 reconstruct.go:97] "Volume reconstruction finished" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.898524 2575 reconciler.go:29] "Reconciler: start to sync state" Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.899406 2575 factory.go:55] Registering systemd factory Jul 10 13:25:46.130439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.899426 2575 factory.go:223] Registration of the systemd container factory successfully Jul 10 13:25:46.132308 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.899650 2575 factory.go:153] Registering CRI-O factory Jul 10 13:25:46.132308 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.899666 2575 factory.go:223] Registration of the crio container factory successfully Jul 10 13:25:46.132308 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.899714 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 10 13:25:46.132308 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.899737 2575 factory.go:103] Registering Raw factory Jul 10 13:25:46.132308 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.899751 2575 manager.go:1196] Started watching for new ooms in manager Jul 10 13:25:46.132308 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.900366 2575 manager.go:349] Starting recovery of all containers Jul 10 13:25:46.132308 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:45.903033 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 10 13:25:46.132308 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:45.903134 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 10 13:25:46.132308 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.909731 2575 manager.go:354] Recovery completed Jul 10 13:25:46.132308 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.916351 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 13:25:46.132308 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.918990 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-57.ec2.internal" event="NodeHasSufficientMemory" Jul 10 13:25:46.132308 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.921521 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 13:25:46.132308 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.921852 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-57.ec2.internal" event="NodeHasSufficientPID" Jul 10 13:25:46.132308 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.922537 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 10 13:25:46.132308 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.922548 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 10 13:25:46.132308 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.922567 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 10 13:25:46.132308 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.922581 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 13:25:46.132308 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.923783 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-57.ec2.internal" event="NodeHasSufficientMemory" Jul 10 13:25:46.132308 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.923833 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 13:25:46.132308 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.923850 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-57.ec2.internal" event="NodeHasSufficientPID" Jul 10 13:25:46.132308 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:45.924049 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-57.ec2.internal.18c0f08e301634cc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-57.ec2.internal,UID:ip-10-0-128-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-57.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-57.ec2.internal,},FirstTimestamp:2026-07-10 13:25:45.921500364 +0000 UTC m=+0.449496996,LastTimestamp:2026-07-10 13:25:45.921500364 +0000 UTC m=+0.449496996,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-57.ec2.internal,}" Jul 10 13:25:46.132308 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.924737 2575 policy_none.go:49] "None policy: Start" Jul 10 13:25:46.132308 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.924750 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 10 13:25:46.132308 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.924759 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 10 13:25:46.132308 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.927214 2575 policy_none.go:47] "Start" Jul 10 13:25:46.132308 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.928557 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hj89b" Jul 10 13:25:46.132308 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:45.932123 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-57.ec2.internal.18c0f08e30177ef0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-57.ec2.internal,UID:ip-10-0-128-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-57.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-57.ec2.internal,},FirstTimestamp:2026-07-10 13:25:45.92158488 +0000 UTC m=+0.449581512,LastTimestamp:2026-07-10 13:25:45.92158488 +0000 UTC m=+0.449581512,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-57.ec2.internal,}" Jul 10 13:25:46.134488 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:45.934577 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-57.ec2.internal.18c0f08e301bd003 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-57.ec2.internal,UID:ip-10-0-128-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-57.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-57.ec2.internal,},FirstTimestamp:2026-07-10 13:25:45.921867779 +0000 UTC m=+0.449864412,LastTimestamp:2026-07-10 13:25:45.921867779 +0000 UTC m=+0.449864412,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-57.ec2.internal,}" Jul 10 13:25:46.134488 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.942961 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hj89b" Jul 10 13:25:46.134488 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:45.945252 2575 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-57.ec2.internal.18c0f08e301634cc\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-57.ec2.internal.18c0f08e301634cc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-57.ec2.internal,UID:ip-10-0-128-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-57.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-57.ec2.internal,},FirstTimestamp:2026-07-10 13:25:45.921500364 +0000 UTC m=+0.449496996,LastTimestamp:2026-07-10 13:25:45.923796576 +0000 UTC m=+0.451793208,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-57.ec2.internal,}" Jul 10 13:25:46.134488 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.952614 2575 manager.go:337] "Starting Device Plugin manager" Jul 10 13:25:46.134488 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:45.952648 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 10 13:25:46.134488 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.952659 2575 server.go:87] "Starting device plugin registration server" Jul 10 13:25:46.134488 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.952881 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 10 13:25:46.134488 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.952892 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 10 13:25:46.134488 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.952963 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 10 13:25:46.134488 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.953058 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 10 13:25:46.134488 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.953066 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 10 13:25:46.134488 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:45.953517 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 10 13:25:46.134488 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:45.953611 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-57.ec2.internal\" not found" Jul 10 13:25:46.134488 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:45.955691 2575 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-57.ec2.internal.18c0f08e30177ef0\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-57.ec2.internal.18c0f08e30177ef0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-57.ec2.internal,UID:ip-10-0-128-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-57.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-57.ec2.internal,},FirstTimestamp:2026-07-10 13:25:45.92158488 +0000 UTC m=+0.449581512,LastTimestamp:2026-07-10 13:25:45.923841105 +0000 UTC m=+0.451837738,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-57.ec2.internal,}" Jul 10 13:25:46.134488 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:45.964709 2575 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-57.ec2.internal.18c0f08e301bd003\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-57.ec2.internal.18c0f08e301bd003 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-57.ec2.internal,UID:ip-10-0-128-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-57.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-57.ec2.internal,},FirstTimestamp:2026-07-10 13:25:45.921867779 +0000 UTC m=+0.449864412,LastTimestamp:2026-07-10 13:25:45.923868588 +0000 UTC m=+0.451865221,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-57.ec2.internal,}" Jul 10 13:25:46.134488 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:45.971439 2575 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2607 into the system container \"/system.slice\": " Jul 10 13:25:46.135408 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:45.977305 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-57.ec2.internal.18c0f08e3211df13 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-57.ec2.internal,UID:ip-10-0-128-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-128-57.ec2.internal,},FirstTimestamp:2026-07-10 13:25:45.954770707 +0000 UTC m=+0.482767328,LastTimestamp:2026-07-10 13:25:45.954770707 +0000 UTC m=+0.482767328,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-57.ec2.internal,}" Jul 10 13:25:46.135408 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:46.053713 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 13:25:46.135408 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:46.054727 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-57.ec2.internal" event="NodeHasSufficientMemory" Jul 10 13:25:46.135408 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:46.054753 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 13:25:46.135408 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:46.054765 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-57.ec2.internal" event="NodeHasSufficientPID" Jul 10 13:25:46.135408 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:46.054791 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-57.ec2.internal" Jul 10 13:25:46.135408 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:46.064009 2575 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-57.ec2.internal.18c0f08e301634cc\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-57.ec2.internal.18c0f08e301634cc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-57.ec2.internal,UID:ip-10-0-128-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-57.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-57.ec2.internal,},FirstTimestamp:2026-07-10 13:25:45.921500364 +0000 UTC m=+0.449496996,LastTimestamp:2026-07-10 13:25:46.054738981 +0000 UTC m=+0.582735610,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-57.ec2.internal,}" Jul 10 13:25:46.135408 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:46.080861 2575 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-128-57.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-128-57.ec2.internal" Jul 10 13:25:46.135408 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:46.080813 2575 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-57.ec2.internal.18c0f08e30177ef0\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-57.ec2.internal.18c0f08e30177ef0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-57.ec2.internal,UID:ip-10-0-128-57.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-57.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-57.ec2.internal,},FirstTimestamp:2026-07-10 13:25:45.92158488 +0000 UTC m=+0.449581512,LastTimestamp:2026-07-10 13:25:46.054757331 +0000 UTC m=+0.582753961,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-57.ec2.internal,}" Jul 10 13:25:46.135408 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:46.113101 2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-57.ec2.internal\" not found" node="ip-10-0-128-57.ec2.internal" Jul 10 13:25:48.175173 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.167954 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 13:25:48.175173 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.167986 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 10 13:25:48.175173 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.169697 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-57.ec2.internal" event="NodeHasSufficientMemory" Jul 10 13:25:48.175173 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.169733 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 13:25:48.175173 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.169750 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-57.ec2.internal" event="NodeHasSufficientPID" Jul 10 13:25:48.175173 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.169791 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-57.ec2.internal" Jul 10 13:25:48.184342 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.184326 2575 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-57.ec2.internal" not found Jul 10 13:25:48.185240 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.185224 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-57.ec2.internal" Jul 10 13:25:48.185280 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:48.185250 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-57.ec2.internal\": node \"ip-10-0-128-57.ec2.internal\" not found" Jul 10 13:25:48.209960 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:48.209907 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-57.ec2.internal\" not found" Jul 10 13:25:48.230702 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.230670 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 10 13:25:48.231837 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.231813 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 10 13:25:48.231940 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.231854 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 10 13:25:48.231940 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.231877 2575 kubelet.go:2448] "Starting kubelet main sync loop" Jul 10 13:25:48.231940 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:48.231914 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 10 13:25:48.233782 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.233768 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 13:25:48.244438 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.244417 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 13:25:48.310379 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:48.310351 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-57.ec2.internal\" not found" Jul 10 13:25:48.314503 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.314487 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 13:25:48.315454 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.315435 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-57.ec2.internal" event="NodeHasSufficientMemory" Jul 10 13:25:48.315504 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.315467 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 13:25:48.315504 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.315479 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-57.ec2.internal" event="NodeHasSufficientPID" Jul 10 13:25:48.332024 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.332002 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-57.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-57.ec2.internal"] Jul 10 13:25:48.332076 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.332063 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 13:25:48.333368 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.333356 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-57.ec2.internal" event="NodeHasSufficientMemory" Jul 10 13:25:48.333410 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.333380 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 13:25:48.333410 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.333394 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-57.ec2.internal" event="NodeHasSufficientPID" Jul 10 13:25:48.335669 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.335658 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 13:25:48.335772 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.335753 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-57.ec2.internal" Jul 10 13:25:48.335817 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.335807 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 13:25:48.336389 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.336375 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-57.ec2.internal" event="NodeHasSufficientMemory" Jul 10 13:25:48.336450 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.336395 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 13:25:48.336450 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.336407 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-57.ec2.internal" event="NodeHasSufficientPID" Jul 10 13:25:48.336450 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.336413 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-57.ec2.internal" event="NodeHasSufficientMemory" Jul 10 13:25:48.336450 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.336435 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 13:25:48.336450 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.336446 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-57.ec2.internal" event="NodeHasSufficientPID" Jul 10 13:25:48.338618 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.338594 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-57.ec2.internal" Jul 10 13:25:48.338618 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.338617 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 13:25:48.339270 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.339248 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-57.ec2.internal" event="NodeHasSufficientMemory" Jul 10 13:25:48.339270 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.339269 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-57.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 13:25:48.339384 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.339277 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-57.ec2.internal" event="NodeHasSufficientPID" Jul 10 13:25:48.365192 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:48.365174 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-57.ec2.internal\" not found" node="ip-10-0-128-57.ec2.internal" Jul 10 13:25:48.365851 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.365827 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 13:20:47 +0000 UTC" deadline="2028-04-22 12:12:20.389689092 +0000 UTC" Jul 10 13:25:48.365914 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.365852 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15646h46m32.023840184s" Jul 10 13:25:48.369471 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:48.369454 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-57.ec2.internal\" not found" node="ip-10-0-128-57.ec2.internal" Jul 10 13:25:48.393811 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.393788 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/458d73c590723f0c3a294d2b5737a239-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-57.ec2.internal\" (UID: \"458d73c590723f0c3a294d2b5737a239\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-57.ec2.internal" Jul 10 13:25:48.393930 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.393821 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/458d73c590723f0c3a294d2b5737a239-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-57.ec2.internal\" (UID: \"458d73c590723f0c3a294d2b5737a239\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-57.ec2.internal" Jul 10 13:25:48.393930 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.393842 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b32c6e6093dd88d5ed1fac2adab9431-config\") pod \"kube-apiserver-proxy-ip-10-0-128-57.ec2.internal\" (UID: \"2b32c6e6093dd88d5ed1fac2adab9431\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-57.ec2.internal" Jul 10 13:25:48.410484 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:48.410462 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-57.ec2.internal\" not found" Jul 10 13:25:48.433669 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.433649 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 13:25:48.494420 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.494340 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/458d73c590723f0c3a294d2b5737a239-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-57.ec2.internal\" (UID: \"458d73c590723f0c3a294d2b5737a239\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-57.ec2.internal" Jul 10 13:25:48.494420 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.494375 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/458d73c590723f0c3a294d2b5737a239-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-57.ec2.internal\" (UID: \"458d73c590723f0c3a294d2b5737a239\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-57.ec2.internal" Jul 10 13:25:48.494420 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.494394 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b32c6e6093dd88d5ed1fac2adab9431-config\") pod \"kube-apiserver-proxy-ip-10-0-128-57.ec2.internal\" (UID: \"2b32c6e6093dd88d5ed1fac2adab9431\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-57.ec2.internal" Jul 10 13:25:48.494661 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.494463 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/458d73c590723f0c3a294d2b5737a239-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-57.ec2.internal\" (UID: \"458d73c590723f0c3a294d2b5737a239\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-57.ec2.internal" Jul 10 13:25:48.494661 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.494557 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/458d73c590723f0c3a294d2b5737a239-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-57.ec2.internal\" (UID: \"458d73c590723f0c3a294d2b5737a239\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-57.ec2.internal" Jul 10 13:25:48.494661 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.494603 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b32c6e6093dd88d5ed1fac2adab9431-config\") pod \"kube-apiserver-proxy-ip-10-0-128-57.ec2.internal\" (UID: \"2b32c6e6093dd88d5ed1fac2adab9431\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-57.ec2.internal" Jul 10 13:25:48.511473 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:48.511444 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-57.ec2.internal\" not found" Jul 10 13:25:48.611989 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:48.611950 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-57.ec2.internal\" not found" Jul 10 13:25:48.667464 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.667427 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-57.ec2.internal" Jul 10 13:25:48.672309 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.672288 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-57.ec2.internal" Jul 10 13:25:48.712716 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:48.712687 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-57.ec2.internal\" not found" Jul 10 13:25:48.724255 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.724233 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 13:25:48.787116 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.787035 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-57.ec2.internal" Jul 10 13:25:48.805433 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.805415 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 13:25:48.806317 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.806305 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-57.ec2.internal" Jul 10 13:25:48.813218 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:48.813200 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 13:25:49.161955 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.161929 2575 apiserver.go:52] "Watching apiserver" Jul 10 13:25:49.167512 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.167490 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 10 13:25:49.169286 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.169266 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-rbd82","openshift-dns/node-resolver-9rwhx","openshift-multus/multus-additional-cni-plugins-8glbv","openshift-multus/multus-b7g54","openshift-network-diagnostics/network-check-target-494zp","openshift-network-operator/iptables-alerter-snsmn","openshift-ovn-kubernetes/ovnkube-node-rpg2g","kube-system/global-pull-secret-syncer-hq6lx","kube-system/konnectivity-agent-ltbc5","kube-system/kube-apiserver-proxy-ip-10-0-128-57.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq","openshift-cluster-node-tuning-operator/tuned-5ppsw","openshift-image-registry/node-ca-bvlcd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-57.ec2.internal"] Jul 10 13:25:49.171754 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.171725 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:25:49.171867 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:49.171797 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbd82" podUID="7b8019d7-b55b-47d7-b875-c93668f52dfc" Jul 10 13:25:49.173964 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.173946 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9rwhx" Jul 10 13:25:49.176212 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.176190 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kp9pb\"" Jul 10 13:25:49.176602 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.176216 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 10 13:25:49.176602 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.176312 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 10 13:25:49.176602 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.176462 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8glbv" Jul 10 13:25:49.178272 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.178257 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 10 13:25:49.178359 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.178334 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 10 13:25:49.178489 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.178471 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 10 13:25:49.178489 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.178484 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tnxgd\"" Jul 10 13:25:49.178573 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.178559 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 10 13:25:49.178628 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.178614 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 10 13:25:49.178925 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.178909 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.180623 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.180608 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 10 13:25:49.180839 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.180827 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cpdf7\"" Jul 10 13:25:49.181292 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.181276 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:25:49.181362 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:49.181344 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-494zp" podUID="37bbeacf-a902-4e2a-91f0-df30789f83ec" Jul 10 13:25:49.183571 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.183555 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-snsmn" Jul 10 13:25:49.185506 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.185486 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 10 13:25:49.185650 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.185621 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-q9nbk\"" Jul 10 13:25:49.185838 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.185821 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 10 13:25:49.185913 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.185901 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.185982 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.185902 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 10 13:25:49.187453 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.187435 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 10 13:25:49.187559 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.187548 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 10 13:25:49.187744 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.187725 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 10 13:25:49.188133 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.188118 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 10 13:25:49.188597 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.188582 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:25:49.188672 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:49.188655 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hq6lx" podUID="633592e9-f523-4eb4-af61-f1da4eb57acc" Jul 10 13:25:49.188859 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.188842 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 10 13:25:49.188859 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.188851 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 10 13:25:49.188979 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.188841 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 10 13:25:49.188979 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.188870 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-t4ktx\"" Jul 10 13:25:49.192446 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.191829 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ltbc5" Jul 10 13:25:49.193980 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.193959 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq" Jul 10 13:25:49.194246 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.194119 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 10 13:25:49.194246 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.194183 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 10 13:25:49.194425 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.194407 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qt66d\"" Jul 10 13:25:49.196288 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.196271 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 10 13:25:49.196288 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.196278 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 10 13:25:49.196550 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.196538 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.196784 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.196767 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 10 13:25:49.196995 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.196984 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pckl6\"" Jul 10 13:25:49.198037 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198022 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/633592e9-f523-4eb4-af61-f1da4eb57acc-kubelet-config\") pod \"global-pull-secret-syncer-hq6lx\" (UID: \"633592e9-f523-4eb4-af61-f1da4eb57acc\") " pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:25:49.198126 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198044 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-host-var-lib-cni-bin\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.198126 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198061 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-hostroot\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.198126 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198075 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-multus-conf-dir\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.198126 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198090 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9debde60-fa1b-4aa5-9970-5b1412bf37cb-cnibin\") pod \"multus-additional-cni-plugins-8glbv\" (UID: \"9debde60-fa1b-4aa5-9970-5b1412bf37cb\") " pod="openshift-multus/multus-additional-cni-plugins-8glbv" Jul 10 13:25:49.198301 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198122 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-etc-kubernetes\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.198301 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198148 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9debde60-fa1b-4aa5-9970-5b1412bf37cb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8glbv\" (UID: \"9debde60-fa1b-4aa5-9970-5b1412bf37cb\") " pod="openshift-multus/multus-additional-cni-plugins-8glbv" Jul 10 13:25:49.198301 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198165 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b59fs\" (UniqueName: \"kubernetes.io/projected/9debde60-fa1b-4aa5-9970-5b1412bf37cb-kube-api-access-b59fs\") pod \"multus-additional-cni-plugins-8glbv\" (UID: \"9debde60-fa1b-4aa5-9970-5b1412bf37cb\") " pod="openshift-multus/multus-additional-cni-plugins-8glbv" Jul 10 13:25:49.198301 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198187 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-system-cni-dir\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.198301 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198227 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a3d8cb70-3897-4ea7-9588-6b7034cd05c8-iptables-alerter-script\") pod \"iptables-alerter-snsmn\" (UID: \"a3d8cb70-3897-4ea7-9588-6b7034cd05c8\") " pod="openshift-network-operator/iptables-alerter-snsmn" Jul 10 13:25:49.198301 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198266 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3d8cb70-3897-4ea7-9588-6b7034cd05c8-host-slash\") pod \"iptables-alerter-snsmn\" (UID: \"a3d8cb70-3897-4ea7-9588-6b7034cd05c8\") " pod="openshift-network-operator/iptables-alerter-snsmn" Jul 10 13:25:49.198301 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198298 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-host-run-netns\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.198672 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198317 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-run-openvswitch\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.198672 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198321 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 10 13:25:49.198672 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198354 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b8019d7-b55b-47d7-b875-c93668f52dfc-metrics-certs\") pod \"network-metrics-daemon-rbd82\" (UID: \"7b8019d7-b55b-47d7-b875-c93668f52dfc\") " pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:25:49.198672 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198381 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9debde60-fa1b-4aa5-9970-5b1412bf37cb-os-release\") pod \"multus-additional-cni-plugins-8glbv\" (UID: \"9debde60-fa1b-4aa5-9970-5b1412bf37cb\") " pod="openshift-multus/multus-additional-cni-plugins-8glbv" Jul 10 13:25:49.198672 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198404 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e7e01989-a0c5-4924-bebf-bad6bf0f0844-ovnkube-config\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.198672 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198408 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-thvzd\"" Jul 10 13:25:49.198672 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198429 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-host-var-lib-kubelet\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.198672 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198451 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-systemd-units\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.198672 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198474 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-os-release\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.198672 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198500 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-992g2\" (UniqueName: \"kubernetes.io/projected/7b8019d7-b55b-47d7-b875-c93668f52dfc-kube-api-access-992g2\") pod \"network-metrics-daemon-rbd82\" (UID: \"7b8019d7-b55b-47d7-b875-c93668f52dfc\") " pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:25:49.198672 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198524 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-host-var-lib-cni-multus\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.198672 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198556 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 10 13:25:49.198672 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198547 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh98v\" (UniqueName: \"kubernetes.io/projected/314a9fb7-08f0-444c-b974-73b7b5eaf324-kube-api-access-jh98v\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.198672 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198588 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-run-ovn\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.198672 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198611 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-host-run-ovn-kubernetes\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.198672 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198658 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-host-cni-bin\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.198672 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198678 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-multus-cni-dir\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.199277 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198695 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-host-run-multus-certs\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.199277 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198717 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-var-lib-openvswitch\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.199277 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198738 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7e01989-a0c5-4924-bebf-bad6bf0f0844-ovn-node-metrics-cert\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.199277 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198762 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9debde60-fa1b-4aa5-9970-5b1412bf37cb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8glbv\" (UID: \"9debde60-fa1b-4aa5-9970-5b1412bf37cb\") " pod="openshift-multus/multus-additional-cni-plugins-8glbv" Jul 10 13:25:49.199277 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198779 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxsf6\" (UniqueName: \"kubernetes.io/projected/37bbeacf-a902-4e2a-91f0-df30789f83ec-kube-api-access-jxsf6\") pod \"network-check-target-494zp\" (UID: \"37bbeacf-a902-4e2a-91f0-df30789f83ec\") " pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:25:49.199277 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198814 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpmdq\" (UniqueName: \"kubernetes.io/projected/a3c237cf-7931-4c12-868e-351a7abcdd91-kube-api-access-dpmdq\") pod \"node-resolver-9rwhx\" (UID: \"a3c237cf-7931-4c12-868e-351a7abcdd91\") " pod="openshift-dns/node-resolver-9rwhx" Jul 10 13:25:49.199277 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198824 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bvlcd" Jul 10 13:25:49.199277 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198835 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-host-kubelet\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.199277 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198851 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-run-systemd\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.199277 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198878 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-host-cni-netd\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.199277 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198898 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e7e01989-a0c5-4924-bebf-bad6bf0f0844-env-overrides\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.199277 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198913 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/633592e9-f523-4eb4-af61-f1da4eb57acc-original-pull-secret\") pod \"global-pull-secret-syncer-hq6lx\" (UID: \"633592e9-f523-4eb4-af61-f1da4eb57acc\") " pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:25:49.199277 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198953 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a3c237cf-7931-4c12-868e-351a7abcdd91-hosts-file\") pod \"node-resolver-9rwhx\" (UID: \"a3c237cf-7931-4c12-868e-351a7abcdd91\") " pod="openshift-dns/node-resolver-9rwhx" Jul 10 13:25:49.199277 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198974 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-cnibin\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.199277 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.198990 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/314a9fb7-08f0-444c-b974-73b7b5eaf324-cni-binary-copy\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.199277 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.199010 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt9nx\" (UniqueName: \"kubernetes.io/projected/a3d8cb70-3897-4ea7-9588-6b7034cd05c8-kube-api-access-bt9nx\") pod \"iptables-alerter-snsmn\" (UID: \"a3d8cb70-3897-4ea7-9588-6b7034cd05c8\") " pod="openshift-network-operator/iptables-alerter-snsmn" Jul 10 13:25:49.199277 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.199031 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-node-log\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.199785 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.199051 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9debde60-fa1b-4aa5-9970-5b1412bf37cb-system-cni-dir\") pod \"multus-additional-cni-plugins-8glbv\" (UID: \"9debde60-fa1b-4aa5-9970-5b1412bf37cb\") " pod="openshift-multus/multus-additional-cni-plugins-8glbv" Jul 10 13:25:49.199785 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.199066 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-host-run-k8s-cni-cncf-io\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.199785 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.199080 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-etc-openvswitch\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.199785 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.199099 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-log-socket\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.199785 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.199129 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-multus-socket-dir-parent\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.199785 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.199152 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/314a9fb7-08f0-444c-b974-73b7b5eaf324-multus-daemon-config\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.199785 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.199170 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9debde60-fa1b-4aa5-9970-5b1412bf37cb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8glbv\" (UID: \"9debde60-fa1b-4aa5-9970-5b1412bf37cb\") " pod="openshift-multus/multus-additional-cni-plugins-8glbv" Jul 10 13:25:49.199785 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.199185 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/633592e9-f523-4eb4-af61-f1da4eb57acc-dbus\") pod \"global-pull-secret-syncer-hq6lx\" (UID: \"633592e9-f523-4eb4-af61-f1da4eb57acc\") " pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:25:49.199785 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.199199 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3c237cf-7931-4c12-868e-351a7abcdd91-tmp-dir\") pod \"node-resolver-9rwhx\" (UID: \"a3c237cf-7931-4c12-868e-351a7abcdd91\") " pod="openshift-dns/node-resolver-9rwhx" Jul 10 13:25:49.199785 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.199213 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-host-run-netns\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.199785 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.199228 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.199785 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.199253 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lkr6\" (UniqueName: \"kubernetes.io/projected/e7e01989-a0c5-4924-bebf-bad6bf0f0844-kube-api-access-8lkr6\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.199785 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.199271 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9debde60-fa1b-4aa5-9970-5b1412bf37cb-cni-binary-copy\") pod \"multus-additional-cni-plugins-8glbv\" (UID: \"9debde60-fa1b-4aa5-9970-5b1412bf37cb\") " pod="openshift-multus/multus-additional-cni-plugins-8glbv" Jul 10 13:25:49.199785 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.199286 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-host-slash\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.199785 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.199300 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e7e01989-a0c5-4924-bebf-bad6bf0f0844-ovnkube-script-lib\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.200665 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.200632 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 10 13:25:49.200738 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.200726 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 10 13:25:49.200800 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.200728 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 10 13:25:49.200848 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.200829 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mpn6r\"" Jul 10 13:25:49.203929 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.203913 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 13:25:49.229955 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.229940 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pzmjw" Jul 10 13:25:49.245256 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.245240 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pzmjw" Jul 10 13:25:49.287780 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.287759 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 10 13:25:49.299650 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.299480 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpmdq\" (UniqueName: \"kubernetes.io/projected/a3c237cf-7931-4c12-868e-351a7abcdd91-kube-api-access-dpmdq\") pod \"node-resolver-9rwhx\" (UID: \"a3c237cf-7931-4c12-868e-351a7abcdd91\") " pod="openshift-dns/node-resolver-9rwhx" Jul 10 13:25:49.299650 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.299519 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-host-kubelet\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.299650 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.299564 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-run-systemd\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.299650 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.299605 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-host-cni-netd\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.299650 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.299610 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-host-kubelet\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.299650 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.299626 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e7e01989-a0c5-4924-bebf-bad6bf0f0844-env-overrides\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.299898 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.299685 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d00d790d-6a52-4aba-ab4d-2ae046329f92-registration-dir\") pod \"aws-ebs-csi-driver-node-cztrq\" (UID: \"d00d790d-6a52-4aba-ab4d-2ae046329f92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq" Jul 10 13:25:49.299898 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.299700 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-run-systemd\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.299898 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.299729 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-run\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.299898 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.299750 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-host-cni-netd\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.299898 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.299761 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/633592e9-f523-4eb4-af61-f1da4eb57acc-original-pull-secret\") pod \"global-pull-secret-syncer-hq6lx\" (UID: \"633592e9-f523-4eb4-af61-f1da4eb57acc\") " pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:25:49.299898 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.299789 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a3c237cf-7931-4c12-868e-351a7abcdd91-hosts-file\") pod \"node-resolver-9rwhx\" (UID: \"a3c237cf-7931-4c12-868e-351a7abcdd91\") " pod="openshift-dns/node-resolver-9rwhx" Jul 10 13:25:49.299898 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.299813 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-cnibin\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.299898 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.299845 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/314a9fb7-08f0-444c-b974-73b7b5eaf324-cni-binary-copy\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.299898 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.299882 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt9nx\" (UniqueName: \"kubernetes.io/projected/a3d8cb70-3897-4ea7-9588-6b7034cd05c8-kube-api-access-bt9nx\") pod \"iptables-alerter-snsmn\" (UID: \"a3d8cb70-3897-4ea7-9588-6b7034cd05c8\") " pod="openshift-network-operator/iptables-alerter-snsmn" Jul 10 13:25:49.300234 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.299909 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-node-log\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.300234 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.299942 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9debde60-fa1b-4aa5-9970-5b1412bf37cb-system-cni-dir\") pod \"multus-additional-cni-plugins-8glbv\" (UID: \"9debde60-fa1b-4aa5-9970-5b1412bf37cb\") " pod="openshift-multus/multus-additional-cni-plugins-8glbv" Jul 10 13:25:49.300234 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.299975 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k59qp\" (UniqueName: \"kubernetes.io/projected/7c327241-7b52-4e48-83dc-bb9629af3edc-kube-api-access-k59qp\") pod \"node-ca-bvlcd\" (UID: \"7c327241-7b52-4e48-83dc-bb9629af3edc\") " pod="openshift-image-registry/node-ca-bvlcd" Jul 10 13:25:49.300234 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.300003 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-host-run-k8s-cni-cncf-io\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.300234 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.300029 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-etc-openvswitch\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.300234 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.300053 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-log-socket\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.300234 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.300079 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-var-lib-kubelet\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.300234 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.300108 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-multus-socket-dir-parent\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.300234 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.300135 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/314a9fb7-08f0-444c-b974-73b7b5eaf324-multus-daemon-config\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.300234 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.300161 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9debde60-fa1b-4aa5-9970-5b1412bf37cb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8glbv\" (UID: \"9debde60-fa1b-4aa5-9970-5b1412bf37cb\") " pod="openshift-multus/multus-additional-cni-plugins-8glbv" Jul 10 13:25:49.300234 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.300185 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9debde60-fa1b-4aa5-9970-5b1412bf37cb-system-cni-dir\") pod \"multus-additional-cni-plugins-8glbv\" (UID: \"9debde60-fa1b-4aa5-9970-5b1412bf37cb\") " pod="openshift-multus/multus-additional-cni-plugins-8glbv" Jul 10 13:25:49.300877 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.300186 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nr7n\" (UniqueName: \"kubernetes.io/projected/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-kube-api-access-9nr7n\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.300877 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:49.300317 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 13:25:49.300877 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.300332 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e7e01989-a0c5-4924-bebf-bad6bf0f0844-env-overrides\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.300877 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:49.300410 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/633592e9-f523-4eb4-af61-f1da4eb57acc-original-pull-secret podName:633592e9-f523-4eb4-af61-f1da4eb57acc nodeName:}" failed. No retries permitted until 2026-07-10 13:25:49.800389245 +0000 UTC m=+3.039721143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/633592e9-f523-4eb4-af61-f1da4eb57acc-original-pull-secret") pod "global-pull-secret-syncer-hq6lx" (UID: "633592e9-f523-4eb4-af61-f1da4eb57acc") : object "kube-system"/"original-pull-secret" not registered Jul 10 13:25:49.300877 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.300423 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-cnibin\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.300877 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.300496 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9debde60-fa1b-4aa5-9970-5b1412bf37cb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8glbv\" (UID: \"9debde60-fa1b-4aa5-9970-5b1412bf37cb\") " pod="openshift-multus/multus-additional-cni-plugins-8glbv" Jul 10 13:25:49.300877 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.300541 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-host-run-k8s-cni-cncf-io\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.300877 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.300574 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-etc-openvswitch\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.300877 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.300609 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-log-socket\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.300877 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.300631 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/633592e9-f523-4eb4-af61-f1da4eb57acc-dbus\") pod \"global-pull-secret-syncer-hq6lx\" (UID: \"633592e9-f523-4eb4-af61-f1da4eb57acc\") " pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:25:49.300877 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.300655 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-multus-socket-dir-parent\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.300877 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.300673 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3c237cf-7931-4c12-868e-351a7abcdd91-tmp-dir\") pod \"node-resolver-9rwhx\" (UID: \"a3c237cf-7931-4c12-868e-351a7abcdd91\") " pod="openshift-dns/node-resolver-9rwhx" Jul 10 13:25:49.300877 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.300688 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-host-run-netns\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.300877 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.300705 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.300877 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.300716 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a3c237cf-7931-4c12-868e-351a7abcdd91-hosts-file\") pod \"node-resolver-9rwhx\" (UID: \"a3c237cf-7931-4c12-868e-351a7abcdd91\") " pod="openshift-dns/node-resolver-9rwhx" Jul 10 13:25:49.300877 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.300817 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.300877 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.300879 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lkr6\" (UniqueName: \"kubernetes.io/projected/e7e01989-a0c5-4924-bebf-bad6bf0f0844-kube-api-access-8lkr6\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.301730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.300928 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9debde60-fa1b-4aa5-9970-5b1412bf37cb-cni-binary-copy\") pod \"multus-additional-cni-plugins-8glbv\" (UID: \"9debde60-fa1b-4aa5-9970-5b1412bf37cb\") " pod="openshift-multus/multus-additional-cni-plugins-8glbv" Jul 10 13:25:49.301730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.301032 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/314a9fb7-08f0-444c-b974-73b7b5eaf324-cni-binary-copy\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.301730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.301110 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/314a9fb7-08f0-444c-b974-73b7b5eaf324-multus-daemon-config\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.301730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.301112 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3c237cf-7931-4c12-868e-351a7abcdd91-tmp-dir\") pod \"node-resolver-9rwhx\" (UID: \"a3c237cf-7931-4c12-868e-351a7abcdd91\") " pod="openshift-dns/node-resolver-9rwhx" Jul 10 13:25:49.301730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.301149 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-host-run-netns\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.301730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.301192 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-host-slash\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.301730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.301234 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e7e01989-a0c5-4924-bebf-bad6bf0f0844-ovnkube-script-lib\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.301730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.301256 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/633592e9-f523-4eb4-af61-f1da4eb57acc-dbus\") pod \"global-pull-secret-syncer-hq6lx\" (UID: \"633592e9-f523-4eb4-af61-f1da4eb57acc\") " pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:25:49.301730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.301259 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7c327241-7b52-4e48-83dc-bb9629af3edc-serviceca\") pod \"node-ca-bvlcd\" (UID: \"7c327241-7b52-4e48-83dc-bb9629af3edc\") " pod="openshift-image-registry/node-ca-bvlcd" Jul 10 13:25:49.301730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.301307 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/633592e9-f523-4eb4-af61-f1da4eb57acc-kubelet-config\") pod \"global-pull-secret-syncer-hq6lx\" (UID: \"633592e9-f523-4eb4-af61-f1da4eb57acc\") " pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:25:49.301730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.301309 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-host-slash\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.301730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.301456 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-host-var-lib-cni-bin\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.301730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.301489 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-hostroot\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.301730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.301545 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-multus-conf-dir\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.301730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.301576 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9debde60-fa1b-4aa5-9970-5b1412bf37cb-cnibin\") pod \"multus-additional-cni-plugins-8glbv\" (UID: \"9debde60-fa1b-4aa5-9970-5b1412bf37cb\") " pod="openshift-multus/multus-additional-cni-plugins-8glbv" Jul 10 13:25:49.301730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.301602 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-etc-modprobe-d\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.301730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.301627 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-sys\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.301730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.301706 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-etc-kubernetes\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.302670 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.301764 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9debde60-fa1b-4aa5-9970-5b1412bf37cb-cnibin\") pod \"multus-additional-cni-plugins-8glbv\" (UID: \"9debde60-fa1b-4aa5-9970-5b1412bf37cb\") " pod="openshift-multus/multus-additional-cni-plugins-8glbv" Jul 10 13:25:49.302670 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.301784 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9debde60-fa1b-4aa5-9970-5b1412bf37cb-cni-binary-copy\") pod \"multus-additional-cni-plugins-8glbv\" (UID: \"9debde60-fa1b-4aa5-9970-5b1412bf37cb\") " pod="openshift-multus/multus-additional-cni-plugins-8glbv" Jul 10 13:25:49.302670 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.301801 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-host-var-lib-cni-bin\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.302670 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.301819 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-hostroot\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.302670 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.301850 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9debde60-fa1b-4aa5-9970-5b1412bf37cb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8glbv\" (UID: \"9debde60-fa1b-4aa5-9970-5b1412bf37cb\") " pod="openshift-multus/multus-additional-cni-plugins-8glbv" Jul 10 13:25:49.302670 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.301850 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-multus-conf-dir\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.302670 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.301865 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/633592e9-f523-4eb4-af61-f1da4eb57acc-kubelet-config\") pod \"global-pull-secret-syncer-hq6lx\" (UID: \"633592e9-f523-4eb4-af61-f1da4eb57acc\") " pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:25:49.302670 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.301892 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b59fs\" (UniqueName: \"kubernetes.io/projected/9debde60-fa1b-4aa5-9970-5b1412bf37cb-kube-api-access-b59fs\") pod \"multus-additional-cni-plugins-8glbv\" (UID: \"9debde60-fa1b-4aa5-9970-5b1412bf37cb\") " pod="openshift-multus/multus-additional-cni-plugins-8glbv" Jul 10 13:25:49.302670 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.301913 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-etc-kubernetes\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.302670 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.301920 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e7e01989-a0c5-4924-bebf-bad6bf0f0844-ovnkube-script-lib\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.302670 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302007 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-node-log\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.302670 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302039 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/02457bf7-b2c7-4acb-a724-924903432966-konnectivity-ca\") pod \"konnectivity-agent-ltbc5\" (UID: \"02457bf7-b2c7-4acb-a724-924903432966\") " pod="kube-system/konnectivity-agent-ltbc5" Jul 10 13:25:49.302670 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302085 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d00d790d-6a52-4aba-ab4d-2ae046329f92-socket-dir\") pod \"aws-ebs-csi-driver-node-cztrq\" (UID: \"d00d790d-6a52-4aba-ab4d-2ae046329f92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq" Jul 10 13:25:49.302670 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302123 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-etc-sysctl-d\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.302670 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302151 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-lib-modules\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.302670 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302183 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-system-cni-dir\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.302670 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302207 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a3d8cb70-3897-4ea7-9588-6b7034cd05c8-iptables-alerter-script\") pod \"iptables-alerter-snsmn\" (UID: \"a3d8cb70-3897-4ea7-9588-6b7034cd05c8\") " pod="openshift-network-operator/iptables-alerter-snsmn" Jul 10 13:25:49.303490 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302254 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3d8cb70-3897-4ea7-9588-6b7034cd05c8-host-slash\") pod \"iptables-alerter-snsmn\" (UID: \"a3d8cb70-3897-4ea7-9588-6b7034cd05c8\") " pod="openshift-network-operator/iptables-alerter-snsmn" Jul 10 13:25:49.303490 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302290 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-system-cni-dir\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.303490 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302303 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-host-run-netns\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.303490 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302325 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a3d8cb70-3897-4ea7-9588-6b7034cd05c8-host-slash\") pod \"iptables-alerter-snsmn\" (UID: \"a3d8cb70-3897-4ea7-9588-6b7034cd05c8\") " pod="openshift-network-operator/iptables-alerter-snsmn" Jul 10 13:25:49.303490 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302327 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c327241-7b52-4e48-83dc-bb9629af3edc-host\") pod \"node-ca-bvlcd\" (UID: \"7c327241-7b52-4e48-83dc-bb9629af3edc\") " pod="openshift-image-registry/node-ca-bvlcd" Jul 10 13:25:49.303490 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302355 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-etc-tuned\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.303490 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302380 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-run-openvswitch\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.303490 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302395 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-host-run-netns\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.303490 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302404 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b8019d7-b55b-47d7-b875-c93668f52dfc-metrics-certs\") pod \"network-metrics-daemon-rbd82\" (UID: \"7b8019d7-b55b-47d7-b875-c93668f52dfc\") " pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:25:49.303490 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302442 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9debde60-fa1b-4aa5-9970-5b1412bf37cb-os-release\") pod \"multus-additional-cni-plugins-8glbv\" (UID: \"9debde60-fa1b-4aa5-9970-5b1412bf37cb\") " pod="openshift-multus/multus-additional-cni-plugins-8glbv" Jul 10 13:25:49.303490 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302462 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-run-openvswitch\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.303490 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302470 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h8ck\" (UniqueName: \"kubernetes.io/projected/d00d790d-6a52-4aba-ab4d-2ae046329f92-kube-api-access-9h8ck\") pod \"aws-ebs-csi-driver-node-cztrq\" (UID: \"d00d790d-6a52-4aba-ab4d-2ae046329f92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq" Jul 10 13:25:49.303490 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302451 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9debde60-fa1b-4aa5-9970-5b1412bf37cb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8glbv\" (UID: \"9debde60-fa1b-4aa5-9970-5b1412bf37cb\") " pod="openshift-multus/multus-additional-cni-plugins-8glbv" Jul 10 13:25:49.303490 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302502 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e7e01989-a0c5-4924-bebf-bad6bf0f0844-ovnkube-config\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.303490 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302529 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d00d790d-6a52-4aba-ab4d-2ae046329f92-device-dir\") pod \"aws-ebs-csi-driver-node-cztrq\" (UID: \"d00d790d-6a52-4aba-ab4d-2ae046329f92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq" Jul 10 13:25:49.303490 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302537 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9debde60-fa1b-4aa5-9970-5b1412bf37cb-os-release\") pod \"multus-additional-cni-plugins-8glbv\" (UID: \"9debde60-fa1b-4aa5-9970-5b1412bf37cb\") " pod="openshift-multus/multus-additional-cni-plugins-8glbv" Jul 10 13:25:49.303490 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:49.302541 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 13:25:49.304231 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302551 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d00d790d-6a52-4aba-ab4d-2ae046329f92-etc-selinux\") pod \"aws-ebs-csi-driver-node-cztrq\" (UID: \"d00d790d-6a52-4aba-ab4d-2ae046329f92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq" Jul 10 13:25:49.304231 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302601 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-etc-kubernetes\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.304231 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:49.302624 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b8019d7-b55b-47d7-b875-c93668f52dfc-metrics-certs podName:7b8019d7-b55b-47d7-b875-c93668f52dfc nodeName:}" failed. No retries permitted until 2026-07-10 13:25:49.802608418 +0000 UTC m=+3.041940321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b8019d7-b55b-47d7-b875-c93668f52dfc-metrics-certs") pod "network-metrics-daemon-rbd82" (UID: "7b8019d7-b55b-47d7-b875-c93668f52dfc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 13:25:49.304231 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302677 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-host-var-lib-kubelet\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.304231 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302699 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-systemd-units\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.304231 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302740 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-os-release\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.304231 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302768 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-host-var-lib-kubelet\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.304231 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302770 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a3d8cb70-3897-4ea7-9588-6b7034cd05c8-iptables-alerter-script\") pod \"iptables-alerter-snsmn\" (UID: \"a3d8cb70-3897-4ea7-9588-6b7034cd05c8\") " pod="openshift-network-operator/iptables-alerter-snsmn" Jul 10 13:25:49.304231 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302805 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-systemd-units\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.304231 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302773 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d00d790d-6a52-4aba-ab4d-2ae046329f92-sys-fs\") pod \"aws-ebs-csi-driver-node-cztrq\" (UID: \"d00d790d-6a52-4aba-ab4d-2ae046329f92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq" Jul 10 13:25:49.304231 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302842 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-os-release\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.304231 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302842 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-tmp\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.304231 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302881 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-992g2\" (UniqueName: \"kubernetes.io/projected/7b8019d7-b55b-47d7-b875-c93668f52dfc-kube-api-access-992g2\") pod \"network-metrics-daemon-rbd82\" (UID: \"7b8019d7-b55b-47d7-b875-c93668f52dfc\") " pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:25:49.304231 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302915 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/02457bf7-b2c7-4acb-a724-924903432966-agent-certs\") pod \"konnectivity-agent-ltbc5\" (UID: \"02457bf7-b2c7-4acb-a724-924903432966\") " pod="kube-system/konnectivity-agent-ltbc5" Jul 10 13:25:49.304231 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302948 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-etc-systemd\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.304231 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302975 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-host-var-lib-cni-multus\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.304742 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.302985 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e7e01989-a0c5-4924-bebf-bad6bf0f0844-ovnkube-config\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.304742 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.303009 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh98v\" (UniqueName: \"kubernetes.io/projected/314a9fb7-08f0-444c-b974-73b7b5eaf324-kube-api-access-jh98v\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.304742 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.303034 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-run-ovn\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.304742 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.303049 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-host-var-lib-cni-multus\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.304742 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.303055 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-host-run-ovn-kubernetes\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.304742 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.303099 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-run-ovn\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.304742 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.303105 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-host-cni-bin\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.304742 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.303136 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-host-run-ovn-kubernetes\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.304742 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.303138 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d00d790d-6a52-4aba-ab4d-2ae046329f92-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cztrq\" (UID: \"d00d790d-6a52-4aba-ab4d-2ae046329f92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq" Jul 10 13:25:49.304742 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.303163 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-host-cni-bin\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.304742 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.303181 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-etc-sysconfig\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.304742 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.303205 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-etc-sysctl-conf\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.304742 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.303236 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-multus-cni-dir\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.304742 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.303276 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-host-run-multus-certs\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.304742 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.303320 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-var-lib-openvswitch\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.304742 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.303351 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-host-run-multus-certs\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.304742 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.303347 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7e01989-a0c5-4924-bebf-bad6bf0f0844-ovn-node-metrics-cert\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.305212 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.303392 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e7e01989-a0c5-4924-bebf-bad6bf0f0844-var-lib-openvswitch\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.305212 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.303353 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/314a9fb7-08f0-444c-b974-73b7b5eaf324-multus-cni-dir\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.305212 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.303416 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9debde60-fa1b-4aa5-9970-5b1412bf37cb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8glbv\" (UID: \"9debde60-fa1b-4aa5-9970-5b1412bf37cb\") " pod="openshift-multus/multus-additional-cni-plugins-8glbv" Jul 10 13:25:49.305212 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.303449 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxsf6\" (UniqueName: \"kubernetes.io/projected/37bbeacf-a902-4e2a-91f0-df30789f83ec-kube-api-access-jxsf6\") pod \"network-check-target-494zp\" (UID: \"37bbeacf-a902-4e2a-91f0-df30789f83ec\") " pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:25:49.305212 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.303473 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-host\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.305212 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.303743 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 10 13:25:49.305212 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.304470 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9debde60-fa1b-4aa5-9970-5b1412bf37cb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8glbv\" (UID: \"9debde60-fa1b-4aa5-9970-5b1412bf37cb\") " pod="openshift-multus/multus-additional-cni-plugins-8glbv" Jul 10 13:25:49.306501 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.306481 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e7e01989-a0c5-4924-bebf-bad6bf0f0844-ovn-node-metrics-cert\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.313067 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.313047 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpmdq\" (UniqueName: \"kubernetes.io/projected/a3c237cf-7931-4c12-868e-351a7abcdd91-kube-api-access-dpmdq\") pod \"node-resolver-9rwhx\" (UID: \"a3c237cf-7931-4c12-868e-351a7abcdd91\") " pod="openshift-dns/node-resolver-9rwhx" Jul 10 13:25:49.317052 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:49.316267 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 13:25:49.317052 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:49.316298 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 13:25:49.317052 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:49.316330 2575 projected.go:196] Error preparing data for projected volume kube-api-access-jxsf6 for pod openshift-network-diagnostics/network-check-target-494zp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 13:25:49.317052 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:49.316406 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37bbeacf-a902-4e2a-91f0-df30789f83ec-kube-api-access-jxsf6 podName:37bbeacf-a902-4e2a-91f0-df30789f83ec nodeName:}" failed. No retries permitted until 2026-07-10 13:25:49.816389141 +0000 UTC m=+3.055721059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jxsf6" (UniqueName: "kubernetes.io/projected/37bbeacf-a902-4e2a-91f0-df30789f83ec-kube-api-access-jxsf6") pod "network-check-target-494zp" (UID: "37bbeacf-a902-4e2a-91f0-df30789f83ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 13:25:49.318625 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.318462 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-992g2\" (UniqueName: \"kubernetes.io/projected/7b8019d7-b55b-47d7-b875-c93668f52dfc-kube-api-access-992g2\") pod \"network-metrics-daemon-rbd82\" (UID: \"7b8019d7-b55b-47d7-b875-c93668f52dfc\") " pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:25:49.319381 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.319356 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lkr6\" (UniqueName: \"kubernetes.io/projected/e7e01989-a0c5-4924-bebf-bad6bf0f0844-kube-api-access-8lkr6\") pod \"ovnkube-node-rpg2g\" (UID: \"e7e01989-a0c5-4924-bebf-bad6bf0f0844\") " pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.319597 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.319581 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b59fs\" (UniqueName: \"kubernetes.io/projected/9debde60-fa1b-4aa5-9970-5b1412bf37cb-kube-api-access-b59fs\") pod \"multus-additional-cni-plugins-8glbv\" (UID: \"9debde60-fa1b-4aa5-9970-5b1412bf37cb\") " pod="openshift-multus/multus-additional-cni-plugins-8glbv" Jul 10 13:25:49.319666 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.319621 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh98v\" (UniqueName: \"kubernetes.io/projected/314a9fb7-08f0-444c-b974-73b7b5eaf324-kube-api-access-jh98v\") pod \"multus-b7g54\" (UID: \"314a9fb7-08f0-444c-b974-73b7b5eaf324\") " pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.319708 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.319621 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt9nx\" (UniqueName: \"kubernetes.io/projected/a3d8cb70-3897-4ea7-9588-6b7034cd05c8-kube-api-access-bt9nx\") pod \"iptables-alerter-snsmn\" (UID: \"a3d8cb70-3897-4ea7-9588-6b7034cd05c8\") " pod="openshift-network-operator/iptables-alerter-snsmn" Jul 10 13:25:49.374248 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:49.374215 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod458d73c590723f0c3a294d2b5737a239.slice/crio-1449be72d029e2ad0f5efe37f42ce00b024bf23319490ef1e7041a91456a54d3 WatchSource:0}: Error finding container 1449be72d029e2ad0f5efe37f42ce00b024bf23319490ef1e7041a91456a54d3: Status 404 returned error can't find the container with id 1449be72d029e2ad0f5efe37f42ce00b024bf23319490ef1e7041a91456a54d3 Jul 10 13:25:49.380139 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.380119 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 13:25:49.384769 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:49.384750 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b32c6e6093dd88d5ed1fac2adab9431.slice/crio-551a6e90afdd8827b0a9d444bd17c0916bc35d2d80e1c5acb95ec0a795c6ffaf WatchSource:0}: Error finding container 551a6e90afdd8827b0a9d444bd17c0916bc35d2d80e1c5acb95ec0a795c6ffaf: Status 404 returned error can't find the container with id 551a6e90afdd8827b0a9d444bd17c0916bc35d2d80e1c5acb95ec0a795c6ffaf Jul 10 13:25:49.403809 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.403789 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7c327241-7b52-4e48-83dc-bb9629af3edc-serviceca\") pod \"node-ca-bvlcd\" (UID: \"7c327241-7b52-4e48-83dc-bb9629af3edc\") " pod="openshift-image-registry/node-ca-bvlcd" Jul 10 13:25:49.403905 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.403822 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-etc-modprobe-d\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.403905 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.403838 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-sys\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.403905 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.403854 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/02457bf7-b2c7-4acb-a724-924903432966-konnectivity-ca\") pod \"konnectivity-agent-ltbc5\" (UID: \"02457bf7-b2c7-4acb-a724-924903432966\") " pod="kube-system/konnectivity-agent-ltbc5" Jul 10 13:25:49.403905 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.403876 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d00d790d-6a52-4aba-ab4d-2ae046329f92-socket-dir\") pod \"aws-ebs-csi-driver-node-cztrq\" (UID: \"d00d790d-6a52-4aba-ab4d-2ae046329f92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq" Jul 10 13:25:49.403905 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.403898 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-etc-sysctl-d\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.404149 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.403935 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-sys\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.404149 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.403963 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-etc-modprobe-d\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.404149 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.403961 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-lib-modules\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.404149 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404006 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-etc-sysctl-d\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.404149 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404014 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c327241-7b52-4e48-83dc-bb9629af3edc-host\") pod \"node-ca-bvlcd\" (UID: \"7c327241-7b52-4e48-83dc-bb9629af3edc\") " pod="openshift-image-registry/node-ca-bvlcd" Jul 10 13:25:49.404149 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404033 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d00d790d-6a52-4aba-ab4d-2ae046329f92-socket-dir\") pod \"aws-ebs-csi-driver-node-cztrq\" (UID: \"d00d790d-6a52-4aba-ab4d-2ae046329f92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq" Jul 10 13:25:49.404149 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404049 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c327241-7b52-4e48-83dc-bb9629af3edc-host\") pod \"node-ca-bvlcd\" (UID: \"7c327241-7b52-4e48-83dc-bb9629af3edc\") " pod="openshift-image-registry/node-ca-bvlcd" Jul 10 13:25:49.404149 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404075 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-lib-modules\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.404149 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404123 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-etc-tuned\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.404579 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404181 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h8ck\" (UniqueName: \"kubernetes.io/projected/d00d790d-6a52-4aba-ab4d-2ae046329f92-kube-api-access-9h8ck\") pod \"aws-ebs-csi-driver-node-cztrq\" (UID: \"d00d790d-6a52-4aba-ab4d-2ae046329f92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq" Jul 10 13:25:49.404579 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404223 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d00d790d-6a52-4aba-ab4d-2ae046329f92-device-dir\") pod \"aws-ebs-csi-driver-node-cztrq\" (UID: \"d00d790d-6a52-4aba-ab4d-2ae046329f92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq" Jul 10 13:25:49.404579 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404249 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d00d790d-6a52-4aba-ab4d-2ae046329f92-etc-selinux\") pod \"aws-ebs-csi-driver-node-cztrq\" (UID: \"d00d790d-6a52-4aba-ab4d-2ae046329f92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq" Jul 10 13:25:49.404579 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404273 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-etc-kubernetes\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.404579 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404293 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d00d790d-6a52-4aba-ab4d-2ae046329f92-device-dir\") pod \"aws-ebs-csi-driver-node-cztrq\" (UID: \"d00d790d-6a52-4aba-ab4d-2ae046329f92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq" Jul 10 13:25:49.404579 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404300 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d00d790d-6a52-4aba-ab4d-2ae046329f92-sys-fs\") pod \"aws-ebs-csi-driver-node-cztrq\" (UID: \"d00d790d-6a52-4aba-ab4d-2ae046329f92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq" Jul 10 13:25:49.404579 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404311 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7c327241-7b52-4e48-83dc-bb9629af3edc-serviceca\") pod \"node-ca-bvlcd\" (UID: \"7c327241-7b52-4e48-83dc-bb9629af3edc\") " pod="openshift-image-registry/node-ca-bvlcd" Jul 10 13:25:49.404579 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404325 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-tmp\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.404579 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404366 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/02457bf7-b2c7-4acb-a724-924903432966-agent-certs\") pod \"konnectivity-agent-ltbc5\" (UID: \"02457bf7-b2c7-4acb-a724-924903432966\") " pod="kube-system/konnectivity-agent-ltbc5" Jul 10 13:25:49.404579 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404381 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/02457bf7-b2c7-4acb-a724-924903432966-konnectivity-ca\") pod \"konnectivity-agent-ltbc5\" (UID: \"02457bf7-b2c7-4acb-a724-924903432966\") " pod="kube-system/konnectivity-agent-ltbc5" Jul 10 13:25:49.404579 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404392 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-etc-systemd\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.404579 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404401 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d00d790d-6a52-4aba-ab4d-2ae046329f92-etc-selinux\") pod \"aws-ebs-csi-driver-node-cztrq\" (UID: \"d00d790d-6a52-4aba-ab4d-2ae046329f92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq" Jul 10 13:25:49.404579 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404425 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d00d790d-6a52-4aba-ab4d-2ae046329f92-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cztrq\" (UID: \"d00d790d-6a52-4aba-ab4d-2ae046329f92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq" Jul 10 13:25:49.404579 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404437 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-etc-kubernetes\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.404579 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404450 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-etc-sysconfig\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.404579 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404441 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d00d790d-6a52-4aba-ab4d-2ae046329f92-sys-fs\") pod \"aws-ebs-csi-driver-node-cztrq\" (UID: \"d00d790d-6a52-4aba-ab4d-2ae046329f92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq" Jul 10 13:25:49.404579 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404475 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-etc-sysctl-conf\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.405422 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404489 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d00d790d-6a52-4aba-ab4d-2ae046329f92-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cztrq\" (UID: \"d00d790d-6a52-4aba-ab4d-2ae046329f92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq" Jul 10 13:25:49.405422 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404495 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-etc-systemd\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.405422 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404523 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-host\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.405422 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404548 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d00d790d-6a52-4aba-ab4d-2ae046329f92-registration-dir\") pod \"aws-ebs-csi-driver-node-cztrq\" (UID: \"d00d790d-6a52-4aba-ab4d-2ae046329f92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq" Jul 10 13:25:49.405422 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404559 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-etc-sysconfig\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.405422 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404566 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-run\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.405422 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404604 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-etc-sysctl-conf\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.405422 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404601 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-host\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.405422 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404606 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k59qp\" (UniqueName: \"kubernetes.io/projected/7c327241-7b52-4e48-83dc-bb9629af3edc-kube-api-access-k59qp\") pod \"node-ca-bvlcd\" (UID: \"7c327241-7b52-4e48-83dc-bb9629af3edc\") " pod="openshift-image-registry/node-ca-bvlcd" Jul 10 13:25:49.405422 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404670 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d00d790d-6a52-4aba-ab4d-2ae046329f92-registration-dir\") pod \"aws-ebs-csi-driver-node-cztrq\" (UID: \"d00d790d-6a52-4aba-ab4d-2ae046329f92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq" Jul 10 13:25:49.405422 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404679 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-var-lib-kubelet\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.405422 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404707 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nr7n\" (UniqueName: \"kubernetes.io/projected/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-kube-api-access-9nr7n\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.405422 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404715 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-var-lib-kubelet\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.405422 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.404680 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-run\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.406814 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.406787 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-tmp\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.406907 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.406891 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/02457bf7-b2c7-4acb-a724-924903432966-agent-certs\") pod \"konnectivity-agent-ltbc5\" (UID: \"02457bf7-b2c7-4acb-a724-924903432966\") " pod="kube-system/konnectivity-agent-ltbc5" Jul 10 13:25:49.406950 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.406890 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-etc-tuned\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.413000 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.412945 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h8ck\" (UniqueName: \"kubernetes.io/projected/d00d790d-6a52-4aba-ab4d-2ae046329f92-kube-api-access-9h8ck\") pod \"aws-ebs-csi-driver-node-cztrq\" (UID: \"d00d790d-6a52-4aba-ab4d-2ae046329f92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq" Jul 10 13:25:49.413451 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.413433 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k59qp\" (UniqueName: \"kubernetes.io/projected/7c327241-7b52-4e48-83dc-bb9629af3edc-kube-api-access-k59qp\") pod \"node-ca-bvlcd\" (UID: \"7c327241-7b52-4e48-83dc-bb9629af3edc\") " pod="openshift-image-registry/node-ca-bvlcd" Jul 10 13:25:49.413663 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.413629 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nr7n\" (UniqueName: \"kubernetes.io/projected/cda07ec0-00c9-4b8c-9050-8fcb69fc15ca-kube-api-access-9nr7n\") pod \"tuned-5ppsw\" (UID: \"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca\") " pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.496351 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.496319 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9rwhx" Jul 10 13:25:49.524239 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.524220 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8glbv" Jul 10 13:25:49.531881 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:49.531851 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9debde60_fa1b_4aa5_9970_5b1412bf37cb.slice/crio-742e3111b3caf1d7f32725d4065a603ee98fc70343f090f297813d51d532da25 WatchSource:0}: Error finding container 742e3111b3caf1d7f32725d4065a603ee98fc70343f090f297813d51d532da25: Status 404 returned error can't find the container with id 742e3111b3caf1d7f32725d4065a603ee98fc70343f090f297813d51d532da25 Jul 10 13:25:49.544545 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.544528 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b7g54" Jul 10 13:25:49.552500 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:49.552481 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod314a9fb7_08f0_444c_b974_73b7b5eaf324.slice/crio-333e066e4606ff5dfe94bb61efe75d0c3b2d02eebe69b14c34257cbf2563463d WatchSource:0}: Error finding container 333e066e4606ff5dfe94bb61efe75d0c3b2d02eebe69b14c34257cbf2563463d: Status 404 returned error can't find the container with id 333e066e4606ff5dfe94bb61efe75d0c3b2d02eebe69b14c34257cbf2563463d Jul 10 13:25:49.553853 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.553839 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-snsmn" Jul 10 13:25:49.561842 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:49.561822 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3d8cb70_3897_4ea7_9588_6b7034cd05c8.slice/crio-d77031aa34e8f59e47f52b4495bd6d4de999c2ba1658eab8d820f78c37c59d6d WatchSource:0}: Error finding container d77031aa34e8f59e47f52b4495bd6d4de999c2ba1658eab8d820f78c37c59d6d: Status 404 returned error can't find the container with id d77031aa34e8f59e47f52b4495bd6d4de999c2ba1658eab8d820f78c37c59d6d Jul 10 13:25:49.567770 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.567752 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:25:49.574994 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:49.574962 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7e01989_a0c5_4924_bebf_bad6bf0f0844.slice/crio-c9625e71271f012566c79115b4bb35aab353859dc1322dc4641b9f1ed377aa9f WatchSource:0}: Error finding container c9625e71271f012566c79115b4bb35aab353859dc1322dc4641b9f1ed377aa9f: Status 404 returned error can't find the container with id c9625e71271f012566c79115b4bb35aab353859dc1322dc4641b9f1ed377aa9f Jul 10 13:25:49.584025 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.584011 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ltbc5" Jul 10 13:25:49.592060 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:49.592042 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02457bf7_b2c7_4acb_a724_924903432966.slice/crio-38e1024b2e068c11614b7eb42f6e87726a6e44c4dbc15ae8dcc691ab3a8f1088 WatchSource:0}: Error finding container 38e1024b2e068c11614b7eb42f6e87726a6e44c4dbc15ae8dcc691ab3a8f1088: Status 404 returned error can't find the container with id 38e1024b2e068c11614b7eb42f6e87726a6e44c4dbc15ae8dcc691ab3a8f1088 Jul 10 13:25:49.596728 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.596713 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq" Jul 10 13:25:49.604123 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:49.604106 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd00d790d_6a52_4aba_ab4d_2ae046329f92.slice/crio-c0086cf3b89269e618ff1e149d194fd5322516870239db29462c3cce6fa27984 WatchSource:0}: Error finding container c0086cf3b89269e618ff1e149d194fd5322516870239db29462c3cce6fa27984: Status 404 returned error can't find the container with id c0086cf3b89269e618ff1e149d194fd5322516870239db29462c3cce6fa27984 Jul 10 13:25:49.620559 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.620541 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" Jul 10 13:25:49.625440 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.625426 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bvlcd" Jul 10 13:25:49.629450 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:49.629297 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcda07ec0_00c9_4b8c_9050_8fcb69fc15ca.slice/crio-7e992e47e74a5dc82ed48805f79d0c852c2dcdb29998e128f71cdee098bd37fd WatchSource:0}: Error finding container 7e992e47e74a5dc82ed48805f79d0c852c2dcdb29998e128f71cdee098bd37fd: Status 404 returned error can't find the container with id 7e992e47e74a5dc82ed48805f79d0c852c2dcdb29998e128f71cdee098bd37fd Jul 10 13:25:49.633445 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:25:49.633429 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c327241_7b52_4e48_83dc_bb9629af3edc.slice/crio-33d344056ca12178a2750fa66dd38b421f87c9b3991eba10a509b9d1134b9aed WatchSource:0}: Error finding container 33d344056ca12178a2750fa66dd38b421f87c9b3991eba10a509b9d1134b9aed: Status 404 returned error can't find the container with id 33d344056ca12178a2750fa66dd38b421f87c9b3991eba10a509b9d1134b9aed Jul 10 13:25:49.807344 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.807259 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b8019d7-b55b-47d7-b875-c93668f52dfc-metrics-certs\") pod \"network-metrics-daemon-rbd82\" (UID: \"7b8019d7-b55b-47d7-b875-c93668f52dfc\") " pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:25:49.807344 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.807309 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/633592e9-f523-4eb4-af61-f1da4eb57acc-original-pull-secret\") pod \"global-pull-secret-syncer-hq6lx\" (UID: \"633592e9-f523-4eb4-af61-f1da4eb57acc\") " pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:25:49.807521 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:49.807406 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 13:25:49.807521 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:49.807408 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 13:25:49.807521 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:49.807456 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/633592e9-f523-4eb4-af61-f1da4eb57acc-original-pull-secret podName:633592e9-f523-4eb4-af61-f1da4eb57acc nodeName:}" failed. No retries permitted until 2026-07-10 13:25:50.807442249 +0000 UTC m=+4.046774148 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/633592e9-f523-4eb4-af61-f1da4eb57acc-original-pull-secret") pod "global-pull-secret-syncer-hq6lx" (UID: "633592e9-f523-4eb4-af61-f1da4eb57acc") : object "kube-system"/"original-pull-secret" not registered Jul 10 13:25:49.807521 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:49.807469 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b8019d7-b55b-47d7-b875-c93668f52dfc-metrics-certs podName:7b8019d7-b55b-47d7-b875-c93668f52dfc nodeName:}" failed. No retries permitted until 2026-07-10 13:25:50.807463022 +0000 UTC m=+4.046794921 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b8019d7-b55b-47d7-b875-c93668f52dfc-metrics-certs") pod "network-metrics-daemon-rbd82" (UID: "7b8019d7-b55b-47d7-b875-c93668f52dfc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 13:25:49.908000 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:49.907972 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxsf6\" (UniqueName: \"kubernetes.io/projected/37bbeacf-a902-4e2a-91f0-df30789f83ec-kube-api-access-jxsf6\") pod \"network-check-target-494zp\" (UID: \"37bbeacf-a902-4e2a-91f0-df30789f83ec\") " pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:25:49.908151 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:49.908134 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 13:25:49.908187 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:49.908157 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 13:25:49.908187 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:49.908168 2575 projected.go:196] Error preparing data for projected volume kube-api-access-jxsf6 for pod openshift-network-diagnostics/network-check-target-494zp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 13:25:49.908266 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:49.908214 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37bbeacf-a902-4e2a-91f0-df30789f83ec-kube-api-access-jxsf6 podName:37bbeacf-a902-4e2a-91f0-df30789f83ec nodeName:}" failed. No retries permitted until 2026-07-10 13:25:50.908201526 +0000 UTC m=+4.147533425 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxsf6" (UniqueName: "kubernetes.io/projected/37bbeacf-a902-4e2a-91f0-df30789f83ec-kube-api-access-jxsf6") pod "network-check-target-494zp" (UID: "37bbeacf-a902-4e2a-91f0-df30789f83ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 13:25:50.252659 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:50.249052 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 13:20:49 +0000 UTC" deadline="2028-01-15 23:33:29.440529722 +0000 UTC" Jul 10 13:25:50.252659 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:50.249104 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13306h7m39.191430185s" Jul 10 13:25:50.265190 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:50.265129 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-57.ec2.internal" event={"ID":"2b32c6e6093dd88d5ed1fac2adab9431","Type":"ContainerStarted","Data":"551a6e90afdd8827b0a9d444bd17c0916bc35d2d80e1c5acb95ec0a795c6ffaf"} Jul 10 13:25:50.288812 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:50.288670 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" event={"ID":"e7e01989-a0c5-4924-bebf-bad6bf0f0844","Type":"ContainerStarted","Data":"c9625e71271f012566c79115b4bb35aab353859dc1322dc4641b9f1ed377aa9f"} Jul 10 13:25:50.304876 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:50.304833 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8glbv" event={"ID":"9debde60-fa1b-4aa5-9970-5b1412bf37cb","Type":"ContainerStarted","Data":"742e3111b3caf1d7f32725d4065a603ee98fc70343f090f297813d51d532da25"} Jul 10 13:25:50.318446 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:50.318410 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-57.ec2.internal" event={"ID":"458d73c590723f0c3a294d2b5737a239","Type":"ContainerStarted","Data":"1449be72d029e2ad0f5efe37f42ce00b024bf23319490ef1e7041a91456a54d3"} Jul 10 13:25:50.333147 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:50.333072 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bvlcd" event={"ID":"7c327241-7b52-4e48-83dc-bb9629af3edc","Type":"ContainerStarted","Data":"33d344056ca12178a2750fa66dd38b421f87c9b3991eba10a509b9d1134b9aed"} Jul 10 13:25:50.351356 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:50.351318 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" event={"ID":"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca","Type":"ContainerStarted","Data":"7e992e47e74a5dc82ed48805f79d0c852c2dcdb29998e128f71cdee098bd37fd"} Jul 10 13:25:50.372041 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:50.371997 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq" event={"ID":"d00d790d-6a52-4aba-ab4d-2ae046329f92","Type":"ContainerStarted","Data":"c0086cf3b89269e618ff1e149d194fd5322516870239db29462c3cce6fa27984"} Jul 10 13:25:50.401688 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:50.401655 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ltbc5" event={"ID":"02457bf7-b2c7-4acb-a724-924903432966","Type":"ContainerStarted","Data":"38e1024b2e068c11614b7eb42f6e87726a6e44c4dbc15ae8dcc691ab3a8f1088"} Jul 10 13:25:50.410229 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:50.410155 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-snsmn" event={"ID":"a3d8cb70-3897-4ea7-9588-6b7034cd05c8","Type":"ContainerStarted","Data":"d77031aa34e8f59e47f52b4495bd6d4de999c2ba1658eab8d820f78c37c59d6d"} Jul 10 13:25:50.420958 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:50.420923 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b7g54" event={"ID":"314a9fb7-08f0-444c-b974-73b7b5eaf324","Type":"ContainerStarted","Data":"333e066e4606ff5dfe94bb61efe75d0c3b2d02eebe69b14c34257cbf2563463d"} Jul 10 13:25:50.436693 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:50.436607 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9rwhx" event={"ID":"a3c237cf-7931-4c12-868e-351a7abcdd91","Type":"ContainerStarted","Data":"60d4ca1d0bc9221eea193643beb541d1cff7f34b559a7f5fb73652cbee94388c"} Jul 10 13:25:50.815631 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:50.814880 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b8019d7-b55b-47d7-b875-c93668f52dfc-metrics-certs\") pod \"network-metrics-daemon-rbd82\" (UID: \"7b8019d7-b55b-47d7-b875-c93668f52dfc\") " pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:25:50.815631 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:50.814949 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/633592e9-f523-4eb4-af61-f1da4eb57acc-original-pull-secret\") pod \"global-pull-secret-syncer-hq6lx\" (UID: \"633592e9-f523-4eb4-af61-f1da4eb57acc\") " pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:25:50.815631 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:50.815071 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 13:25:50.815631 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:50.815131 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/633592e9-f523-4eb4-af61-f1da4eb57acc-original-pull-secret podName:633592e9-f523-4eb4-af61-f1da4eb57acc nodeName:}" failed. No retries permitted until 2026-07-10 13:25:52.815113381 +0000 UTC m=+6.054445297 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/633592e9-f523-4eb4-af61-f1da4eb57acc-original-pull-secret") pod "global-pull-secret-syncer-hq6lx" (UID: "633592e9-f523-4eb4-af61-f1da4eb57acc") : object "kube-system"/"original-pull-secret" not registered Jul 10 13:25:50.815631 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:50.815545 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 13:25:50.815631 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:50.815594 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b8019d7-b55b-47d7-b875-c93668f52dfc-metrics-certs podName:7b8019d7-b55b-47d7-b875-c93668f52dfc nodeName:}" failed. No retries permitted until 2026-07-10 13:25:52.815579677 +0000 UTC m=+6.054911581 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b8019d7-b55b-47d7-b875-c93668f52dfc-metrics-certs") pod "network-metrics-daemon-rbd82" (UID: "7b8019d7-b55b-47d7-b875-c93668f52dfc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 13:25:50.916108 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:50.916073 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxsf6\" (UniqueName: \"kubernetes.io/projected/37bbeacf-a902-4e2a-91f0-df30789f83ec-kube-api-access-jxsf6\") pod \"network-check-target-494zp\" (UID: \"37bbeacf-a902-4e2a-91f0-df30789f83ec\") " pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:25:50.916276 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:50.916247 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 13:25:50.916276 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:50.916266 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 13:25:50.916398 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:50.916279 2575 projected.go:196] Error preparing data for projected volume kube-api-access-jxsf6 for pod openshift-network-diagnostics/network-check-target-494zp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 13:25:50.916398 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:50.916334 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37bbeacf-a902-4e2a-91f0-df30789f83ec-kube-api-access-jxsf6 podName:37bbeacf-a902-4e2a-91f0-df30789f83ec nodeName:}" failed. No retries permitted until 2026-07-10 13:25:52.916315471 +0000 UTC m=+6.155647384 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxsf6" (UniqueName: "kubernetes.io/projected/37bbeacf-a902-4e2a-91f0-df30789f83ec-kube-api-access-jxsf6") pod "network-check-target-494zp" (UID: "37bbeacf-a902-4e2a-91f0-df30789f83ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 13:25:51.232392 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:51.232362 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:25:51.232564 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:51.232490 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hq6lx" podUID="633592e9-f523-4eb4-af61-f1da4eb57acc" Jul 10 13:25:51.232995 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:51.232955 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:25:51.233162 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:51.233131 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbd82" podUID="7b8019d7-b55b-47d7-b875-c93668f52dfc" Jul 10 13:25:51.233240 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:51.233200 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:25:51.233292 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:51.233269 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-494zp" podUID="37bbeacf-a902-4e2a-91f0-df30789f83ec" Jul 10 13:25:51.249678 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:51.249630 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 13:20:49 +0000 UTC" deadline="2028-02-16 10:53:47.348716901 +0000 UTC" Jul 10 13:25:51.249678 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:51.249676 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14061h27m56.09904546s" Jul 10 13:25:52.832699 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:52.832663 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/633592e9-f523-4eb4-af61-f1da4eb57acc-original-pull-secret\") pod \"global-pull-secret-syncer-hq6lx\" (UID: \"633592e9-f523-4eb4-af61-f1da4eb57acc\") " pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:25:52.833268 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:52.832735 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b8019d7-b55b-47d7-b875-c93668f52dfc-metrics-certs\") pod \"network-metrics-daemon-rbd82\" (UID: \"7b8019d7-b55b-47d7-b875-c93668f52dfc\") " pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:25:52.833268 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:52.832874 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 13:25:52.833268 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:52.832938 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b8019d7-b55b-47d7-b875-c93668f52dfc-metrics-certs podName:7b8019d7-b55b-47d7-b875-c93668f52dfc nodeName:}" failed. No retries permitted until 2026-07-10 13:25:56.832918849 +0000 UTC m=+10.072250753 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b8019d7-b55b-47d7-b875-c93668f52dfc-metrics-certs") pod "network-metrics-daemon-rbd82" (UID: "7b8019d7-b55b-47d7-b875-c93668f52dfc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 13:25:52.833268 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:52.833122 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 13:25:52.833268 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:52.833171 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/633592e9-f523-4eb4-af61-f1da4eb57acc-original-pull-secret podName:633592e9-f523-4eb4-af61-f1da4eb57acc nodeName:}" failed. No retries permitted until 2026-07-10 13:25:56.833155941 +0000 UTC m=+10.072487840 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/633592e9-f523-4eb4-af61-f1da4eb57acc-original-pull-secret") pod "global-pull-secret-syncer-hq6lx" (UID: "633592e9-f523-4eb4-af61-f1da4eb57acc") : object "kube-system"/"original-pull-secret" not registered Jul 10 13:25:52.933117 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:52.933076 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxsf6\" (UniqueName: \"kubernetes.io/projected/37bbeacf-a902-4e2a-91f0-df30789f83ec-kube-api-access-jxsf6\") pod \"network-check-target-494zp\" (UID: \"37bbeacf-a902-4e2a-91f0-df30789f83ec\") " pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:25:52.933299 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:52.933283 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 13:25:52.933363 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:52.933306 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 13:25:52.933363 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:52.933319 2575 projected.go:196] Error preparing data for projected volume kube-api-access-jxsf6 for pod openshift-network-diagnostics/network-check-target-494zp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 13:25:52.933451 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:52.933376 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37bbeacf-a902-4e2a-91f0-df30789f83ec-kube-api-access-jxsf6 podName:37bbeacf-a902-4e2a-91f0-df30789f83ec nodeName:}" failed. No retries permitted until 2026-07-10 13:25:56.933357339 +0000 UTC m=+10.172689257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxsf6" (UniqueName: "kubernetes.io/projected/37bbeacf-a902-4e2a-91f0-df30789f83ec-kube-api-access-jxsf6") pod "network-check-target-494zp" (UID: "37bbeacf-a902-4e2a-91f0-df30789f83ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 13:25:53.233187 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:53.232305 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:25:53.233187 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:53.232438 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hq6lx" podUID="633592e9-f523-4eb4-af61-f1da4eb57acc" Jul 10 13:25:53.233187 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:53.232507 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:25:53.233187 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:53.232630 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbd82" podUID="7b8019d7-b55b-47d7-b875-c93668f52dfc" Jul 10 13:25:53.233187 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:53.232701 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:25:53.233187 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:53.232810 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-494zp" podUID="37bbeacf-a902-4e2a-91f0-df30789f83ec" Jul 10 13:25:55.232696 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:55.232662 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:25:55.233138 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:55.232786 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hq6lx" podUID="633592e9-f523-4eb4-af61-f1da4eb57acc" Jul 10 13:25:55.233138 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:55.233037 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:25:55.233277 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:55.233155 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:25:55.233277 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:55.233151 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-494zp" podUID="37bbeacf-a902-4e2a-91f0-df30789f83ec" Jul 10 13:25:55.233277 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:55.233259 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbd82" podUID="7b8019d7-b55b-47d7-b875-c93668f52dfc" Jul 10 13:25:56.864811 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:56.864775 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b8019d7-b55b-47d7-b875-c93668f52dfc-metrics-certs\") pod \"network-metrics-daemon-rbd82\" (UID: \"7b8019d7-b55b-47d7-b875-c93668f52dfc\") " pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:25:56.865219 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:56.864846 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/633592e9-f523-4eb4-af61-f1da4eb57acc-original-pull-secret\") pod \"global-pull-secret-syncer-hq6lx\" (UID: \"633592e9-f523-4eb4-af61-f1da4eb57acc\") " pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:25:56.865219 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:56.864990 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 13:25:56.865219 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:56.864998 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 13:25:56.865219 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:56.865046 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/633592e9-f523-4eb4-af61-f1da4eb57acc-original-pull-secret podName:633592e9-f523-4eb4-af61-f1da4eb57acc nodeName:}" failed. No retries permitted until 2026-07-10 13:26:04.865029363 +0000 UTC m=+18.104361282 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/633592e9-f523-4eb4-af61-f1da4eb57acc-original-pull-secret") pod "global-pull-secret-syncer-hq6lx" (UID: "633592e9-f523-4eb4-af61-f1da4eb57acc") : object "kube-system"/"original-pull-secret" not registered Jul 10 13:25:56.865219 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:56.865061 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b8019d7-b55b-47d7-b875-c93668f52dfc-metrics-certs podName:7b8019d7-b55b-47d7-b875-c93668f52dfc nodeName:}" failed. No retries permitted until 2026-07-10 13:26:04.865054595 +0000 UTC m=+18.104386494 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b8019d7-b55b-47d7-b875-c93668f52dfc-metrics-certs") pod "network-metrics-daemon-rbd82" (UID: "7b8019d7-b55b-47d7-b875-c93668f52dfc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 13:25:56.965370 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:56.965329 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxsf6\" (UniqueName: \"kubernetes.io/projected/37bbeacf-a902-4e2a-91f0-df30789f83ec-kube-api-access-jxsf6\") pod \"network-check-target-494zp\" (UID: \"37bbeacf-a902-4e2a-91f0-df30789f83ec\") " pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:25:56.965538 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:56.965504 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 13:25:56.965538 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:56.965530 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 13:25:56.965668 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:56.965544 2575 projected.go:196] Error preparing data for projected volume kube-api-access-jxsf6 for pod openshift-network-diagnostics/network-check-target-494zp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 13:25:56.965668 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:56.965602 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37bbeacf-a902-4e2a-91f0-df30789f83ec-kube-api-access-jxsf6 podName:37bbeacf-a902-4e2a-91f0-df30789f83ec nodeName:}" failed. No retries permitted until 2026-07-10 13:26:04.965583216 +0000 UTC m=+18.204915129 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxsf6" (UniqueName: "kubernetes.io/projected/37bbeacf-a902-4e2a-91f0-df30789f83ec-kube-api-access-jxsf6") pod "network-check-target-494zp" (UID: "37bbeacf-a902-4e2a-91f0-df30789f83ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 13:25:57.232297 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:57.232092 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:25:57.232297 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:57.232113 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:25:57.232297 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:57.232113 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:25:57.232297 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:57.232217 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hq6lx" podUID="633592e9-f523-4eb4-af61-f1da4eb57acc" Jul 10 13:25:57.232561 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:57.232294 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-494zp" podUID="37bbeacf-a902-4e2a-91f0-df30789f83ec" Jul 10 13:25:57.232561 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:57.232378 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbd82" podUID="7b8019d7-b55b-47d7-b875-c93668f52dfc" Jul 10 13:25:59.232920 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:59.232884 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:25:59.233362 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:59.233015 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:25:59.233362 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:59.233023 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hq6lx" podUID="633592e9-f523-4eb4-af61-f1da4eb57acc" Jul 10 13:25:59.233362 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:59.233141 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbd82" podUID="7b8019d7-b55b-47d7-b875-c93668f52dfc" Jul 10 13:25:59.233362 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:25:59.233187 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:25:59.233362 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:25:59.233253 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-494zp" podUID="37bbeacf-a902-4e2a-91f0-df30789f83ec" Jul 10 13:26:01.232823 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:01.232794 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:26:01.233288 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:01.232918 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hq6lx" podUID="633592e9-f523-4eb4-af61-f1da4eb57acc" Jul 10 13:26:01.233358 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:01.233291 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:26:01.233407 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:01.233374 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbd82" podUID="7b8019d7-b55b-47d7-b875-c93668f52dfc" Jul 10 13:26:01.233454 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:01.233418 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:26:01.233506 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:01.233474 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-494zp" podUID="37bbeacf-a902-4e2a-91f0-df30789f83ec" Jul 10 13:26:03.232898 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:03.232856 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:26:03.232898 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:03.232893 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:26:03.233766 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:03.233005 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:26:03.233766 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:03.233008 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hq6lx" podUID="633592e9-f523-4eb4-af61-f1da4eb57acc" Jul 10 13:26:03.233766 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:03.233085 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbd82" podUID="7b8019d7-b55b-47d7-b875-c93668f52dfc" Jul 10 13:26:03.233766 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:03.233157 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-494zp" podUID="37bbeacf-a902-4e2a-91f0-df30789f83ec" Jul 10 13:26:04.925024 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:04.924992 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b8019d7-b55b-47d7-b875-c93668f52dfc-metrics-certs\") pod \"network-metrics-daemon-rbd82\" (UID: \"7b8019d7-b55b-47d7-b875-c93668f52dfc\") " pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:26:04.925370 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:04.925042 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/633592e9-f523-4eb4-af61-f1da4eb57acc-original-pull-secret\") pod \"global-pull-secret-syncer-hq6lx\" (UID: \"633592e9-f523-4eb4-af61-f1da4eb57acc\") " pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:26:04.925370 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:04.925163 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 13:26:04.925370 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:04.925199 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 13:26:04.925370 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:04.925240 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b8019d7-b55b-47d7-b875-c93668f52dfc-metrics-certs podName:7b8019d7-b55b-47d7-b875-c93668f52dfc nodeName:}" failed. No retries permitted until 2026-07-10 13:26:20.925221323 +0000 UTC m=+34.164553226 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b8019d7-b55b-47d7-b875-c93668f52dfc-metrics-certs") pod "network-metrics-daemon-rbd82" (UID: "7b8019d7-b55b-47d7-b875-c93668f52dfc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 13:26:04.925370 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:04.925282 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/633592e9-f523-4eb4-af61-f1da4eb57acc-original-pull-secret podName:633592e9-f523-4eb4-af61-f1da4eb57acc nodeName:}" failed. No retries permitted until 2026-07-10 13:26:20.925265239 +0000 UTC m=+34.164597138 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/633592e9-f523-4eb4-af61-f1da4eb57acc-original-pull-secret") pod "global-pull-secret-syncer-hq6lx" (UID: "633592e9-f523-4eb4-af61-f1da4eb57acc") : object "kube-system"/"original-pull-secret" not registered Jul 10 13:26:05.026278 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:05.026245 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxsf6\" (UniqueName: \"kubernetes.io/projected/37bbeacf-a902-4e2a-91f0-df30789f83ec-kube-api-access-jxsf6\") pod \"network-check-target-494zp\" (UID: \"37bbeacf-a902-4e2a-91f0-df30789f83ec\") " pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:26:05.026430 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:05.026409 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 13:26:05.026496 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:05.026437 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 13:26:05.026496 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:05.026451 2575 projected.go:196] Error preparing data for projected volume kube-api-access-jxsf6 for pod openshift-network-diagnostics/network-check-target-494zp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 13:26:05.026573 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:05.026511 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37bbeacf-a902-4e2a-91f0-df30789f83ec-kube-api-access-jxsf6 podName:37bbeacf-a902-4e2a-91f0-df30789f83ec nodeName:}" failed. No retries permitted until 2026-07-10 13:26:21.026495156 +0000 UTC m=+34.265827075 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxsf6" (UniqueName: "kubernetes.io/projected/37bbeacf-a902-4e2a-91f0-df30789f83ec-kube-api-access-jxsf6") pod "network-check-target-494zp" (UID: "37bbeacf-a902-4e2a-91f0-df30789f83ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 13:26:05.232568 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:05.232301 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:26:05.232568 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:05.232327 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:26:05.232568 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:05.232431 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:26:05.232568 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:05.232447 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbd82" podUID="7b8019d7-b55b-47d7-b875-c93668f52dfc" Jul 10 13:26:05.232568 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:05.232523 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-494zp" podUID="37bbeacf-a902-4e2a-91f0-df30789f83ec" Jul 10 13:26:05.232568 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:05.232569 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hq6lx" podUID="633592e9-f523-4eb4-af61-f1da4eb57acc" Jul 10 13:26:07.232079 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:07.232044 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:26:07.232079 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:07.232071 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:26:07.232623 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:07.232042 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:26:07.232623 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:07.232159 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-494zp" podUID="37bbeacf-a902-4e2a-91f0-df30789f83ec" Jul 10 13:26:07.232623 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:07.232235 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbd82" podUID="7b8019d7-b55b-47d7-b875-c93668f52dfc" Jul 10 13:26:07.232623 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:07.232296 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hq6lx" podUID="633592e9-f523-4eb4-af61-f1da4eb57acc" Jul 10 13:26:09.232266 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:09.232242 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:26:09.232663 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:09.232366 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbd82" podUID="7b8019d7-b55b-47d7-b875-c93668f52dfc" Jul 10 13:26:09.232663 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:09.232427 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:26:09.232663 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:09.232490 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-494zp" podUID="37bbeacf-a902-4e2a-91f0-df30789f83ec" Jul 10 13:26:09.232663 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:09.232514 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:26:09.232663 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:09.232631 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hq6lx" podUID="633592e9-f523-4eb4-af61-f1da4eb57acc" Jul 10 13:26:09.480527 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:09.480385 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" event={"ID":"cda07ec0-00c9-4b8c-9050-8fcb69fc15ca","Type":"ContainerStarted","Data":"75a57098faa2a8160dc6e46e47c532cc8b406e538690f978c11697d5667f30ea"} Jul 10 13:26:09.500368 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:09.500328 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5ppsw" podStartSLOduration=1.899007052 podStartE2EDuration="21.500316183s" totalImagesPullingTime="19.601309131s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:26:09.500097327 +0000 UTC m=+22.739429245" watchObservedRunningTime="2026-07-10 13:26:09.500316183 +0000 UTC m=+22.739648104" Jul 10 13:26:10.484423 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:10.484128 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bvlcd" event={"ID":"7c327241-7b52-4e48-83dc-bb9629af3edc","Type":"ContainerStarted","Data":"854801614e3e4cb7bc7bdd6d065aac1bc140847c4aa3dcc2af08f387c1630ef9"} Jul 10 13:26:10.485791 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:10.485760 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq" event={"ID":"d00d790d-6a52-4aba-ab4d-2ae046329f92","Type":"ContainerStarted","Data":"66059a158071c6855331f3caa769459430a1b92f553a4703bd1a1f4c2f0894bd"} Jul 10 13:26:10.487250 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:10.487222 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ltbc5" event={"ID":"02457bf7-b2c7-4acb-a724-924903432966","Type":"ContainerStarted","Data":"6a8b271afae332f1cd3687f5e76f169073d523f60e7cb7269e8fff5ff433b4ff"} Jul 10 13:26:10.488904 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:10.488881 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b7g54" event={"ID":"314a9fb7-08f0-444c-b974-73b7b5eaf324","Type":"ContainerStarted","Data":"a53727b61fcbde07efcf6023a0f51abe67e37ce3f6dfe7dd684b2f1076d6123c"} Jul 10 13:26:10.490372 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:10.490349 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9rwhx" event={"ID":"a3c237cf-7931-4c12-868e-351a7abcdd91","Type":"ContainerStarted","Data":"1f7c8bbe3d2163d5ee54b84f42215b0bf326e390d54fad001689e1f5368e1763"} Jul 10 13:26:10.491851 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:10.491829 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-57.ec2.internal" event={"ID":"2b32c6e6093dd88d5ed1fac2adab9431","Type":"ContainerStarted","Data":"ff9d7fdd9988e263b2d6c539f60a869f50c60af07523a8034b98351f48295746"} Jul 10 13:26:10.494278 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:10.494232 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rpg2g_e7e01989-a0c5-4924-bebf-bad6bf0f0844/ovn-acl-logging/0.log" Jul 10 13:26:10.494557 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:10.494539 2575 generic.go:356] "Generic (PLEG): container finished" podID="e7e01989-a0c5-4924-bebf-bad6bf0f0844" containerID="6e7b3ed3382d52df42e75ba8d5e1163d1dd6a9f51114ef2ee6e0913fc31bccf6" exitCode=1 Jul 10 13:26:10.494613 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:10.494595 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" event={"ID":"e7e01989-a0c5-4924-bebf-bad6bf0f0844","Type":"ContainerStarted","Data":"0ffd2f9d8b4328a92bebd1c629d3592846d436ecf571fdacfcb249d40c08d92b"} Jul 10 13:26:10.494677 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:10.494656 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" event={"ID":"e7e01989-a0c5-4924-bebf-bad6bf0f0844","Type":"ContainerStarted","Data":"c86fd1916a3b97e4db3568d145fbda3d184f206c796e515a8b7ecfa02bc72f91"} Jul 10 13:26:10.494719 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:10.494707 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" event={"ID":"e7e01989-a0c5-4924-bebf-bad6bf0f0844","Type":"ContainerStarted","Data":"dba6cffdb9b5ee74022faefe050706b37af576e4acfc37b2a5c89eedb54c61d1"} Jul 10 13:26:10.494760 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:10.494742 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" event={"ID":"e7e01989-a0c5-4924-bebf-bad6bf0f0844","Type":"ContainerStarted","Data":"d8b94101a42f6672d218f9bdf32f11ed7faea1c6e055947fccd347d422db346d"} Jul 10 13:26:10.494803 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:10.494789 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" event={"ID":"e7e01989-a0c5-4924-bebf-bad6bf0f0844","Type":"ContainerDied","Data":"6e7b3ed3382d52df42e75ba8d5e1163d1dd6a9f51114ef2ee6e0913fc31bccf6"} Jul 10 13:26:10.494849 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:10.494836 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" event={"ID":"e7e01989-a0c5-4924-bebf-bad6bf0f0844","Type":"ContainerStarted","Data":"3544253f3dd3cc8b9f23a69d857cc73d797dd3ac321a9ebbdb070fcd305cdc85"} Jul 10 13:26:10.495973 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:10.495953 2575 generic.go:356] "Generic (PLEG): container finished" podID="9debde60-fa1b-4aa5-9970-5b1412bf37cb" containerID="89e603bf95d63ffbfc463f197c210582aa9e285a443621c09466b0b2ec974ff8" exitCode=0 Jul 10 13:26:10.496053 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:10.496029 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8glbv" event={"ID":"9debde60-fa1b-4aa5-9970-5b1412bf37cb","Type":"ContainerDied","Data":"89e603bf95d63ffbfc463f197c210582aa9e285a443621c09466b0b2ec974ff8"} Jul 10 13:26:10.497436 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:10.497420 2575 generic.go:356] "Generic (PLEG): container finished" podID="458d73c590723f0c3a294d2b5737a239" containerID="3797686d63e53d213c5cbaf793bcc5e4ea772e22bd15ba84cc33aa8e61a702d9" exitCode=0 Jul 10 13:26:10.497503 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:10.497490 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-57.ec2.internal" event={"ID":"458d73c590723f0c3a294d2b5737a239","Type":"ContainerDied","Data":"3797686d63e53d213c5cbaf793bcc5e4ea772e22bd15ba84cc33aa8e61a702d9"} Jul 10 13:26:10.499367 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:10.499331 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bvlcd" podStartSLOduration=7.3015312439999995 podStartE2EDuration="22.499319234s" totalImagesPullingTime="15.19778799s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:26:10.49876916 +0000 UTC m=+23.738101082" watchObservedRunningTime="2026-07-10 13:26:10.499319234 +0000 UTC m=+23.738651183" Jul 10 13:26:10.515258 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:10.515223 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-b7g54" podStartSLOduration=2.8348437950000003 podStartE2EDuration="22.515211785s" totalImagesPullingTime="19.68036799s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:26:10.51494778 +0000 UTC m=+23.754279700" watchObservedRunningTime="2026-07-10 13:26:10.515211785 +0000 UTC m=+23.754543706" Jul 10 13:26:10.532404 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:10.532362 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-57.ec2.internal" podStartSLOduration=22.532345247 podStartE2EDuration="22.532345247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:25:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:26:10.532232647 +0000 UTC m=+23.771564561" watchObservedRunningTime="2026-07-10 13:26:10.532345247 +0000 UTC m=+23.771677168" Jul 10 13:26:10.551574 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:10.551527 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9rwhx" podStartSLOduration=2.820430886 podStartE2EDuration="22.55151309s" totalImagesPullingTime="19.731082204s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:26:10.551277219 +0000 UTC m=+23.790609141" watchObservedRunningTime="2026-07-10 13:26:10.55151309 +0000 UTC m=+23.790845012" Jul 10 13:26:10.567399 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:10.567364 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ltbc5" podStartSLOduration=2.928646812 podStartE2EDuration="22.567350991s" totalImagesPullingTime="19.638704179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:26:10.566659594 +0000 UTC m=+23.805991516" watchObservedRunningTime="2026-07-10 13:26:10.567350991 +0000 UTC m=+23.806682912" Jul 10 13:26:11.232228 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:11.232087 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:26:11.232310 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:11.232087 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:26:11.232366 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:11.232308 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbd82" podUID="7b8019d7-b55b-47d7-b875-c93668f52dfc" Jul 10 13:26:11.232417 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:11.232112 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:26:11.232417 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:11.232372 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hq6lx" podUID="633592e9-f523-4eb4-af61-f1da4eb57acc" Jul 10 13:26:11.232526 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:11.232436 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-494zp" podUID="37bbeacf-a902-4e2a-91f0-df30789f83ec" Jul 10 13:26:11.244679 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:11.244661 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 10 13:26:11.260263 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:11.260192 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T13:26:11.244675881Z","UUID":"21aab3a6-b0ed-4fc4-be1d-883f7ba4f766","Handler":null,"Name":"","Endpoint":""} Jul 10 13:26:11.261502 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:11.261485 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 10 13:26:11.261583 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:11.261516 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 10 13:26:11.502246 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:11.502160 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-57.ec2.internal" event={"ID":"458d73c590723f0c3a294d2b5737a239","Type":"ContainerStarted","Data":"ba64b02a3db3979b8d58ee449ce1aebef9e479c01045fddb6a0c4f1bbd0d0405"} Jul 10 13:26:11.504182 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:11.504155 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq" event={"ID":"d00d790d-6a52-4aba-ab4d-2ae046329f92","Type":"ContainerStarted","Data":"ff074747efc6f29a04501a938495cf361bfe55e38e252cf1809307c0ef154d09"} Jul 10 13:26:11.505696 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:11.505670 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-snsmn" event={"ID":"a3d8cb70-3897-4ea7-9588-6b7034cd05c8","Type":"ContainerStarted","Data":"90992f546052516e506384d7f0ce89a1f4ecc779d3d6e2eb20dcbbc26cbd6717"} Jul 10 13:26:11.519691 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:11.519632 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-57.ec2.internal" podStartSLOduration=23.519616105 podStartE2EDuration="23.519616105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:25:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:26:11.519233696 +0000 UTC m=+24.758565617" watchObservedRunningTime="2026-07-10 13:26:11.519616105 +0000 UTC m=+24.758948047" Jul 10 13:26:11.535437 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:11.535401 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-snsmn" podStartSLOduration=3.939878015 podStartE2EDuration="23.535389714s" totalImagesPullingTime="19.595511699s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:26:11.534839062 +0000 UTC m=+24.774170982" watchObservedRunningTime="2026-07-10 13:26:11.535389714 +0000 UTC m=+24.774721635" Jul 10 13:26:12.510593 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:12.510568 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rpg2g_e7e01989-a0c5-4924-bebf-bad6bf0f0844/ovn-acl-logging/0.log" Jul 10 13:26:12.511152 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:12.510981 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" event={"ID":"e7e01989-a0c5-4924-bebf-bad6bf0f0844","Type":"ContainerStarted","Data":"01765b272db5338d0ee9f51e75b97ddef8ef6b3473de0f1d3d04c611d9c5fa94"} Jul 10 13:26:13.232405 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:13.232372 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:26:13.232405 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:13.232404 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:26:13.232662 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:13.232410 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:26:13.232662 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:13.232487 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hq6lx" podUID="633592e9-f523-4eb4-af61-f1da4eb57acc" Jul 10 13:26:13.232662 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:13.232605 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbd82" podUID="7b8019d7-b55b-47d7-b875-c93668f52dfc" Jul 10 13:26:13.232825 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:13.232692 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-494zp" podUID="37bbeacf-a902-4e2a-91f0-df30789f83ec" Jul 10 13:26:13.514792 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:13.514718 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq" event={"ID":"d00d790d-6a52-4aba-ab4d-2ae046329f92","Type":"ContainerStarted","Data":"5350a86fc047415e51ef8dcccb40a416f4981ff850a5d9f9c39d8a7f973bb657"} Jul 10 13:26:13.536729 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:13.536681 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cztrq" podStartSLOduration=3.180537218 podStartE2EDuration="25.536666374s" totalImagesPullingTime="22.356129156s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:25:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:26:13.53612813 +0000 UTC m=+26.775460051" watchObservedRunningTime="2026-07-10 13:26:13.536666374 +0000 UTC m=+26.775998294" Jul 10 13:26:15.067263 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:15.067048 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ltbc5" Jul 10 13:26:15.067780 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:15.067591 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ltbc5" Jul 10 13:26:15.232858 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:15.232826 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:26:15.233062 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:15.232833 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:26:15.233062 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:15.232955 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbd82" podUID="7b8019d7-b55b-47d7-b875-c93668f52dfc" Jul 10 13:26:15.233062 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:15.232968 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:26:15.233062 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:15.233030 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hq6lx" podUID="633592e9-f523-4eb4-af61-f1da4eb57acc" Jul 10 13:26:15.233246 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:15.233127 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-494zp" podUID="37bbeacf-a902-4e2a-91f0-df30789f83ec" Jul 10 13:26:15.522797 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:15.522769 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rpg2g_e7e01989-a0c5-4924-bebf-bad6bf0f0844/ovn-acl-logging/0.log" Jul 10 13:26:15.523211 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:15.523176 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" event={"ID":"e7e01989-a0c5-4924-bebf-bad6bf0f0844","Type":"ContainerStarted","Data":"df11cafb0afc0a3ab17a482057207342bf9f55f76958a67513b6f90f912c8176"} Jul 10 13:26:15.523465 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:15.523443 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ltbc5" Jul 10 13:26:15.523832 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:15.523810 2575 scope.go:117] "RemoveContainer" containerID="6e7b3ed3382d52df42e75ba8d5e1163d1dd6a9f51114ef2ee6e0913fc31bccf6" Jul 10 13:26:15.523991 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:15.523974 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ltbc5" Jul 10 13:26:16.681237 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:16.681192 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-494zp"] Jul 10 13:26:16.681678 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:16.681315 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:26:16.681678 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:16.681399 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-494zp" podUID="37bbeacf-a902-4e2a-91f0-df30789f83ec" Jul 10 13:26:16.685969 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:16.685935 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rbd82"] Jul 10 13:26:16.686072 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:16.686039 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:26:16.686142 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:16.686122 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbd82" podUID="7b8019d7-b55b-47d7-b875-c93668f52dfc" Jul 10 13:26:16.688447 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:16.688421 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hq6lx"] Jul 10 13:26:16.688554 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:16.688517 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:26:16.688627 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:16.688600 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hq6lx" podUID="633592e9-f523-4eb4-af61-f1da4eb57acc" Jul 10 13:26:17.530926 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:17.530758 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rpg2g_e7e01989-a0c5-4924-bebf-bad6bf0f0844/ovn-acl-logging/0.log" Jul 10 13:26:17.531294 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:17.531269 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" event={"ID":"e7e01989-a0c5-4924-bebf-bad6bf0f0844","Type":"ContainerStarted","Data":"403270d2e96a12cb0df377ddd0d1225822e124f944bee88c0e97f57658b00de5"} Jul 10 13:26:17.531460 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:17.531435 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:26:17.531541 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:17.531504 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:26:17.531541 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:17.531538 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:26:17.533205 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:17.533183 2575 generic.go:356] "Generic (PLEG): container finished" podID="9debde60-fa1b-4aa5-9970-5b1412bf37cb" containerID="a9c6173d6f2eea4118894d11372acec36eea7c523b23227ada61f14038fa8434" exitCode=0 Jul 10 13:26:17.533302 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:17.533267 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8glbv" event={"ID":"9debde60-fa1b-4aa5-9970-5b1412bf37cb","Type":"ContainerDied","Data":"a9c6173d6f2eea4118894d11372acec36eea7c523b23227ada61f14038fa8434"} Jul 10 13:26:17.548850 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:17.548830 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:26:17.548982 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:17.548967 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:26:17.558905 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:17.558868 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" podStartSLOduration=9.57625041 podStartE2EDuration="29.558855658s" totalImagesPullingTime="19.982605248s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:26:17.558152314 +0000 UTC m=+30.797484263" watchObservedRunningTime="2026-07-10 13:26:17.558855658 +0000 UTC m=+30.798187579" Jul 10 13:26:18.235365 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:18.235336 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:26:18.235782 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:18.235445 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:26:18.235782 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:18.235473 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:26:18.235782 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:18.235466 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hq6lx" podUID="633592e9-f523-4eb4-af61-f1da4eb57acc" Jul 10 13:26:18.235782 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:18.235600 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbd82" podUID="7b8019d7-b55b-47d7-b875-c93668f52dfc" Jul 10 13:26:18.235782 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:18.235693 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-494zp" podUID="37bbeacf-a902-4e2a-91f0-df30789f83ec" Jul 10 13:26:19.540410 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:19.540381 2575 generic.go:356] "Generic (PLEG): container finished" podID="9debde60-fa1b-4aa5-9970-5b1412bf37cb" containerID="a0d52365bece8f97f4c232cca214afec0ed3d5ace282b5b89976c63b7db825b7" exitCode=0 Jul 10 13:26:19.541116 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:19.540441 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8glbv" event={"ID":"9debde60-fa1b-4aa5-9970-5b1412bf37cb","Type":"ContainerDied","Data":"a0d52365bece8f97f4c232cca214afec0ed3d5ace282b5b89976c63b7db825b7"} Jul 10 13:26:19.550845 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:19.550810 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" podUID="e7e01989-a0c5-4924-bebf-bad6bf0f0844" containerName="ovnkube-controller" probeResult="failure" output="" Jul 10 13:26:20.233126 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:20.233100 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:26:20.233262 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:20.233103 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:26:20.233262 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:20.233219 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rbd82" podUID="7b8019d7-b55b-47d7-b875-c93668f52dfc" Jul 10 13:26:20.233360 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:20.233102 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:26:20.233360 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:20.233294 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hq6lx" podUID="633592e9-f523-4eb4-af61-f1da4eb57acc" Jul 10 13:26:20.233453 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:20.233379 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-494zp" podUID="37bbeacf-a902-4e2a-91f0-df30789f83ec" Jul 10 13:26:20.544450 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:20.544391 2575 generic.go:356] "Generic (PLEG): container finished" podID="9debde60-fa1b-4aa5-9970-5b1412bf37cb" containerID="0ebfb20b58e41701919737b64079f7657667606f59e9befa9cfcee0e0d02c584" exitCode=0 Jul 10 13:26:20.544758 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:20.544451 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8glbv" event={"ID":"9debde60-fa1b-4aa5-9970-5b1412bf37cb","Type":"ContainerDied","Data":"0ebfb20b58e41701919737b64079f7657667606f59e9befa9cfcee0e0d02c584"} Jul 10 13:26:20.953440 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:20.953410 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/633592e9-f523-4eb4-af61-f1da4eb57acc-original-pull-secret\") pod \"global-pull-secret-syncer-hq6lx\" (UID: \"633592e9-f523-4eb4-af61-f1da4eb57acc\") " pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:26:20.953591 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:20.953453 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b8019d7-b55b-47d7-b875-c93668f52dfc-metrics-certs\") pod \"network-metrics-daemon-rbd82\" (UID: \"7b8019d7-b55b-47d7-b875-c93668f52dfc\") " pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:26:20.953591 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:20.953549 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 13:26:20.953591 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:20.953551 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 13:26:20.953717 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:20.953598 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b8019d7-b55b-47d7-b875-c93668f52dfc-metrics-certs podName:7b8019d7-b55b-47d7-b875-c93668f52dfc nodeName:}" failed. No retries permitted until 2026-07-10 13:26:52.953584905 +0000 UTC m=+66.192916804 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b8019d7-b55b-47d7-b875-c93668f52dfc-metrics-certs") pod "network-metrics-daemon-rbd82" (UID: "7b8019d7-b55b-47d7-b875-c93668f52dfc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 13:26:20.953717 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:20.953610 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/633592e9-f523-4eb4-af61-f1da4eb57acc-original-pull-secret podName:633592e9-f523-4eb4-af61-f1da4eb57acc nodeName:}" failed. No retries permitted until 2026-07-10 13:26:52.953604911 +0000 UTC m=+66.192936809 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/633592e9-f523-4eb4-af61-f1da4eb57acc-original-pull-secret") pod "global-pull-secret-syncer-hq6lx" (UID: "633592e9-f523-4eb4-af61-f1da4eb57acc") : object "kube-system"/"original-pull-secret" not registered Jul 10 13:26:21.054459 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:21.054432 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxsf6\" (UniqueName: \"kubernetes.io/projected/37bbeacf-a902-4e2a-91f0-df30789f83ec-kube-api-access-jxsf6\") pod \"network-check-target-494zp\" (UID: \"37bbeacf-a902-4e2a-91f0-df30789f83ec\") " pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:26:21.054588 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:21.054571 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 13:26:21.054656 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:21.054593 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 13:26:21.054656 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:21.054603 2575 projected.go:196] Error preparing data for projected volume kube-api-access-jxsf6 for pod openshift-network-diagnostics/network-check-target-494zp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 13:26:21.054724 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:21.054664 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37bbeacf-a902-4e2a-91f0-df30789f83ec-kube-api-access-jxsf6 podName:37bbeacf-a902-4e2a-91f0-df30789f83ec nodeName:}" failed. No retries permitted until 2026-07-10 13:26:53.054630971 +0000 UTC m=+66.293962872 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jxsf6" (UniqueName: "kubernetes.io/projected/37bbeacf-a902-4e2a-91f0-df30789f83ec-kube-api-access-jxsf6") pod "network-check-target-494zp" (UID: "37bbeacf-a902-4e2a-91f0-df30789f83ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 13:26:21.983060 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:21.983035 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-57.ec2.internal" event="NodeReady" Jul 10 13:26:21.983401 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:21.983164 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 10 13:26:22.018568 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.018534 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-849d455874-q76sx"] Jul 10 13:26:22.021053 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.021037 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:22.022947 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.022921 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 10 13:26:22.022947 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.022946 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 10 13:26:22.023136 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.022994 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 10 13:26:22.023136 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.023031 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-r7g28\"" Jul 10 13:26:22.028521 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.028502 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 10 13:26:22.034626 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.034607 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-849d455874-q76sx"] Jul 10 13:26:22.037411 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.037372 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gjkg6"] Jul 10 13:26:22.040281 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.040264 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xzm2l"] Jul 10 13:26:22.040411 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.040395 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gjkg6" Jul 10 13:26:22.042288 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.042264 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 10 13:26:22.042372 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.042353 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sj6cx\"" Jul 10 13:26:22.042422 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.042385 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 10 13:26:22.042800 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.042784 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xzm2l" Jul 10 13:26:22.044278 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.044264 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 10 13:26:22.044588 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.044569 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 10 13:26:22.044692 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.044570 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 10 13:26:22.044692 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.044651 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-whvbg\"" Jul 10 13:26:22.052334 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.052201 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xzm2l"] Jul 10 13:26:22.053131 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.053111 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gjkg6"] Jul 10 13:26:22.162134 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.162103 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/816669aa-a543-4738-9c33-af588b14e4b1-ca-trust-extracted\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:22.162305 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.162144 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/051b95cc-7289-4c0c-aa25-98fe724192d6-config-volume\") pod \"dns-default-gjkg6\" (UID: \"051b95cc-7289-4c0c-aa25-98fe724192d6\") " pod="openshift-dns/dns-default-gjkg6" Jul 10 13:26:22.162305 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.162169 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58lbf\" (UniqueName: \"kubernetes.io/projected/051b95cc-7289-4c0c-aa25-98fe724192d6-kube-api-access-58lbf\") pod \"dns-default-gjkg6\" (UID: \"051b95cc-7289-4c0c-aa25-98fe724192d6\") " pod="openshift-dns/dns-default-gjkg6" Jul 10 13:26:22.162305 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.162194 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/35afbd6c-d5c1-4deb-929d-71dbf71b6d0d-cert\") pod \"ingress-canary-xzm2l\" (UID: \"35afbd6c-d5c1-4deb-929d-71dbf71b6d0d\") " pod="openshift-ingress-canary/ingress-canary-xzm2l" Jul 10 13:26:22.162305 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.162239 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/051b95cc-7289-4c0c-aa25-98fe724192d6-tmp-dir\") pod \"dns-default-gjkg6\" (UID: \"051b95cc-7289-4c0c-aa25-98fe724192d6\") " pod="openshift-dns/dns-default-gjkg6" Jul 10 13:26:22.162305 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.162272 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/816669aa-a543-4738-9c33-af588b14e4b1-installation-pull-secrets\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:22.162305 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.162296 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/816669aa-a543-4738-9c33-af588b14e4b1-image-registry-private-configuration\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:22.162551 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.162323 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/816669aa-a543-4738-9c33-af588b14e4b1-registry-certificates\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:22.162551 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.162341 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsr7j\" (UniqueName: \"kubernetes.io/projected/35afbd6c-d5c1-4deb-929d-71dbf71b6d0d-kube-api-access-fsr7j\") pod \"ingress-canary-xzm2l\" (UID: \"35afbd6c-d5c1-4deb-929d-71dbf71b6d0d\") " pod="openshift-ingress-canary/ingress-canary-xzm2l" Jul 10 13:26:22.162551 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.162372 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-bound-sa-token\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:22.162551 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.162417 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qp99\" (UniqueName: \"kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-kube-api-access-5qp99\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:22.162551 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.162452 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-registry-tls\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:22.162551 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.162472 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/816669aa-a543-4738-9c33-af588b14e4b1-trusted-ca\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:22.162551 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.162497 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/051b95cc-7289-4c0c-aa25-98fe724192d6-metrics-tls\") pod \"dns-default-gjkg6\" (UID: \"051b95cc-7289-4c0c-aa25-98fe724192d6\") " pod="openshift-dns/dns-default-gjkg6" Jul 10 13:26:22.232559 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.232442 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:26:22.232559 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.232487 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:26:22.232559 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.232447 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:26:22.234908 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.234725 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 13:26:22.234908 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.234809 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 13:26:22.234908 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.234827 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4gcrn\"" Jul 10 13:26:22.234908 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.234895 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lkjb8\"" Jul 10 13:26:22.235189 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.234953 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 13:26:22.235189 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.235072 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 13:26:22.262737 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.262719 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qp99\" (UniqueName: \"kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-kube-api-access-5qp99\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:22.262821 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.262757 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-registry-tls\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:22.262821 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.262775 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/816669aa-a543-4738-9c33-af588b14e4b1-trusted-ca\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:22.262821 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.262790 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/051b95cc-7289-4c0c-aa25-98fe724192d6-metrics-tls\") pod \"dns-default-gjkg6\" (UID: \"051b95cc-7289-4c0c-aa25-98fe724192d6\") " pod="openshift-dns/dns-default-gjkg6" Jul 10 13:26:22.262821 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.262815 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/816669aa-a543-4738-9c33-af588b14e4b1-ca-trust-extracted\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:22.262971 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.262833 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/051b95cc-7289-4c0c-aa25-98fe724192d6-config-volume\") pod \"dns-default-gjkg6\" (UID: \"051b95cc-7289-4c0c-aa25-98fe724192d6\") " pod="openshift-dns/dns-default-gjkg6" Jul 10 13:26:22.262971 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.262849 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58lbf\" (UniqueName: \"kubernetes.io/projected/051b95cc-7289-4c0c-aa25-98fe724192d6-kube-api-access-58lbf\") pod \"dns-default-gjkg6\" (UID: \"051b95cc-7289-4c0c-aa25-98fe724192d6\") " pod="openshift-dns/dns-default-gjkg6" Jul 10 13:26:22.262971 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:22.262870 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 13:26:22.262971 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:22.262885 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-849d455874-q76sx: secret "image-registry-tls" not found Jul 10 13:26:22.262971 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:22.262934 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-registry-tls podName:816669aa-a543-4738-9c33-af588b14e4b1 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:22.762914656 +0000 UTC m=+36.002246570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-registry-tls") pod "image-registry-849d455874-q76sx" (UID: "816669aa-a543-4738-9c33-af588b14e4b1") : secret "image-registry-tls" not found Jul 10 13:26:22.263199 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:22.262991 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 13:26:22.263199 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.262872 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/35afbd6c-d5c1-4deb-929d-71dbf71b6d0d-cert\") pod \"ingress-canary-xzm2l\" (UID: \"35afbd6c-d5c1-4deb-929d-71dbf71b6d0d\") " pod="openshift-ingress-canary/ingress-canary-xzm2l" Jul 10 13:26:22.263199 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:22.263048 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/051b95cc-7289-4c0c-aa25-98fe724192d6-metrics-tls podName:051b95cc-7289-4c0c-aa25-98fe724192d6 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:22.763033783 +0000 UTC m=+36.002365691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/051b95cc-7289-4c0c-aa25-98fe724192d6-metrics-tls") pod "dns-default-gjkg6" (UID: "051b95cc-7289-4c0c-aa25-98fe724192d6") : secret "dns-default-metrics-tls" not found Jul 10 13:26:22.263199 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.263098 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/051b95cc-7289-4c0c-aa25-98fe724192d6-tmp-dir\") pod \"dns-default-gjkg6\" (UID: \"051b95cc-7289-4c0c-aa25-98fe724192d6\") " pod="openshift-dns/dns-default-gjkg6" Jul 10 13:26:22.263199 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.263140 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/816669aa-a543-4738-9c33-af588b14e4b1-installation-pull-secrets\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:22.263424 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.263246 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/816669aa-a543-4738-9c33-af588b14e4b1-image-registry-private-configuration\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:22.263424 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.263286 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/816669aa-a543-4738-9c33-af588b14e4b1-registry-certificates\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:22.263424 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.263312 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsr7j\" (UniqueName: \"kubernetes.io/projected/35afbd6c-d5c1-4deb-929d-71dbf71b6d0d-kube-api-access-fsr7j\") pod \"ingress-canary-xzm2l\" (UID: \"35afbd6c-d5c1-4deb-929d-71dbf71b6d0d\") " pod="openshift-ingress-canary/ingress-canary-xzm2l" Jul 10 13:26:22.263424 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.263368 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-bound-sa-token\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:22.263424 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.263387 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/051b95cc-7289-4c0c-aa25-98fe724192d6-tmp-dir\") pod \"dns-default-gjkg6\" (UID: \"051b95cc-7289-4c0c-aa25-98fe724192d6\") " pod="openshift-dns/dns-default-gjkg6" Jul 10 13:26:22.263424 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.263250 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/816669aa-a543-4738-9c33-af588b14e4b1-ca-trust-extracted\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:22.263691 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.263477 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/051b95cc-7289-4c0c-aa25-98fe724192d6-config-volume\") pod \"dns-default-gjkg6\" (UID: \"051b95cc-7289-4c0c-aa25-98fe724192d6\") " pod="openshift-dns/dns-default-gjkg6" Jul 10 13:26:22.263742 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.263705 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/816669aa-a543-4738-9c33-af588b14e4b1-trusted-ca\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:22.263889 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.263873 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/816669aa-a543-4738-9c33-af588b14e4b1-registry-certificates\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:22.267127 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.267101 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/816669aa-a543-4738-9c33-af588b14e4b1-image-registry-private-configuration\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:22.267127 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.267120 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/35afbd6c-d5c1-4deb-929d-71dbf71b6d0d-cert\") pod \"ingress-canary-xzm2l\" (UID: \"35afbd6c-d5c1-4deb-929d-71dbf71b6d0d\") " pod="openshift-ingress-canary/ingress-canary-xzm2l" Jul 10 13:26:22.267243 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.267128 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/816669aa-a543-4738-9c33-af588b14e4b1-installation-pull-secrets\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:22.271365 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.271337 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qp99\" (UniqueName: \"kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-kube-api-access-5qp99\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:22.271605 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.271566 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58lbf\" (UniqueName: \"kubernetes.io/projected/051b95cc-7289-4c0c-aa25-98fe724192d6-kube-api-access-58lbf\") pod \"dns-default-gjkg6\" (UID: \"051b95cc-7289-4c0c-aa25-98fe724192d6\") " pod="openshift-dns/dns-default-gjkg6" Jul 10 13:26:22.272113 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.272093 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-bound-sa-token\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:22.272183 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.272157 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsr7j\" (UniqueName: \"kubernetes.io/projected/35afbd6c-d5c1-4deb-929d-71dbf71b6d0d-kube-api-access-fsr7j\") pod \"ingress-canary-xzm2l\" (UID: \"35afbd6c-d5c1-4deb-929d-71dbf71b6d0d\") " pod="openshift-ingress-canary/ingress-canary-xzm2l" Jul 10 13:26:22.360533 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.360509 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xzm2l" Jul 10 13:26:22.508101 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.508034 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xzm2l"] Jul 10 13:26:22.512973 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:26:22.512945 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35afbd6c_d5c1_4deb_929d_71dbf71b6d0d.slice/crio-b6720222a0d425f7db1c6c94db51f5f63ce9b077682ae72fdd5a70a750b8da08 WatchSource:0}: Error finding container b6720222a0d425f7db1c6c94db51f5f63ce9b077682ae72fdd5a70a750b8da08: Status 404 returned error can't find the container with id b6720222a0d425f7db1c6c94db51f5f63ce9b077682ae72fdd5a70a750b8da08 Jul 10 13:26:22.550087 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.550058 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xzm2l" event={"ID":"35afbd6c-d5c1-4deb-929d-71dbf71b6d0d","Type":"ContainerStarted","Data":"b6720222a0d425f7db1c6c94db51f5f63ce9b077682ae72fdd5a70a750b8da08"} Jul 10 13:26:22.767917 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.767832 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-registry-tls\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:22.767917 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:22.767875 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/051b95cc-7289-4c0c-aa25-98fe724192d6-metrics-tls\") pod \"dns-default-gjkg6\" (UID: \"051b95cc-7289-4c0c-aa25-98fe724192d6\") " pod="openshift-dns/dns-default-gjkg6" Jul 10 13:26:22.768127 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:22.767990 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 13:26:22.768127 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:22.768060 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/051b95cc-7289-4c0c-aa25-98fe724192d6-metrics-tls podName:051b95cc-7289-4c0c-aa25-98fe724192d6 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:23.768041896 +0000 UTC m=+37.007373798 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/051b95cc-7289-4c0c-aa25-98fe724192d6-metrics-tls") pod "dns-default-gjkg6" (UID: "051b95cc-7289-4c0c-aa25-98fe724192d6") : secret "dns-default-metrics-tls" not found Jul 10 13:26:22.768127 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:22.767994 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 13:26:22.768127 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:22.768085 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-849d455874-q76sx: secret "image-registry-tls" not found Jul 10 13:26:22.768301 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:22.768136 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-registry-tls podName:816669aa-a543-4738-9c33-af588b14e4b1 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:23.768122972 +0000 UTC m=+37.007454886 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-registry-tls") pod "image-registry-849d455874-q76sx" (UID: "816669aa-a543-4738-9c33-af588b14e4b1") : secret "image-registry-tls" not found Jul 10 13:26:23.776332 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:23.776295 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-registry-tls\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:23.776894 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:23.776341 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/051b95cc-7289-4c0c-aa25-98fe724192d6-metrics-tls\") pod \"dns-default-gjkg6\" (UID: \"051b95cc-7289-4c0c-aa25-98fe724192d6\") " pod="openshift-dns/dns-default-gjkg6" Jul 10 13:26:23.776894 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:23.776451 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 13:26:23.776894 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:23.776451 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 13:26:23.776894 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:23.776477 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-849d455874-q76sx: secret "image-registry-tls" not found Jul 10 13:26:23.776894 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:23.776501 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/051b95cc-7289-4c0c-aa25-98fe724192d6-metrics-tls podName:051b95cc-7289-4c0c-aa25-98fe724192d6 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:25.776488867 +0000 UTC m=+39.015820765 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/051b95cc-7289-4c0c-aa25-98fe724192d6-metrics-tls") pod "dns-default-gjkg6" (UID: "051b95cc-7289-4c0c-aa25-98fe724192d6") : secret "dns-default-metrics-tls" not found Jul 10 13:26:23.776894 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:23.776531 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-registry-tls podName:816669aa-a543-4738-9c33-af588b14e4b1 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:25.776514593 +0000 UTC m=+39.015846499 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-registry-tls") pod "image-registry-849d455874-q76sx" (UID: "816669aa-a543-4738-9c33-af588b14e4b1") : secret "image-registry-tls" not found Jul 10 13:26:25.793791 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:25.793754 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-registry-tls\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:25.793791 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:25.793793 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/051b95cc-7289-4c0c-aa25-98fe724192d6-metrics-tls\") pod \"dns-default-gjkg6\" (UID: \"051b95cc-7289-4c0c-aa25-98fe724192d6\") " pod="openshift-dns/dns-default-gjkg6" Jul 10 13:26:25.794299 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:25.793938 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 13:26:25.794299 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:25.793946 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 13:26:25.794299 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:25.793969 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-849d455874-q76sx: secret "image-registry-tls" not found Jul 10 13:26:25.794299 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:25.793995 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/051b95cc-7289-4c0c-aa25-98fe724192d6-metrics-tls podName:051b95cc-7289-4c0c-aa25-98fe724192d6 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:29.793976319 +0000 UTC m=+43.033308241 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/051b95cc-7289-4c0c-aa25-98fe724192d6-metrics-tls") pod "dns-default-gjkg6" (UID: "051b95cc-7289-4c0c-aa25-98fe724192d6") : secret "dns-default-metrics-tls" not found Jul 10 13:26:25.794299 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:25.794024 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-registry-tls podName:816669aa-a543-4738-9c33-af588b14e4b1 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:29.794006726 +0000 UTC m=+43.033338638 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-registry-tls") pod "image-registry-849d455874-q76sx" (UID: "816669aa-a543-4738-9c33-af588b14e4b1") : secret "image-registry-tls" not found Jul 10 13:26:27.565522 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:27.565371 2575 generic.go:356] "Generic (PLEG): container finished" podID="9debde60-fa1b-4aa5-9970-5b1412bf37cb" containerID="6a117ac6bf4a39e9d0c400ce5d7ea60586c190ef6f3d8d31b4849db96923155d" exitCode=0 Jul 10 13:26:27.566155 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:27.565440 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8glbv" event={"ID":"9debde60-fa1b-4aa5-9970-5b1412bf37cb","Type":"ContainerDied","Data":"6a117ac6bf4a39e9d0c400ce5d7ea60586c190ef6f3d8d31b4849db96923155d"} Jul 10 13:26:27.567122 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:27.567101 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xzm2l" event={"ID":"35afbd6c-d5c1-4deb-929d-71dbf71b6d0d","Type":"ContainerStarted","Data":"bcfcde794a979405e8627ea1ac36a999456782a57eeff926a447f5115c742219"} Jul 10 13:26:27.610533 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:27.610005 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xzm2l" podStartSLOduration=1.3553221149999999 podStartE2EDuration="5.609986199s" totalImagesPullingTime="4.254664084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:26:27.6095702 +0000 UTC m=+40.848902123" watchObservedRunningTime="2026-07-10 13:26:27.609986199 +0000 UTC m=+40.849318121" Jul 10 13:26:28.572202 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:28.572167 2575 generic.go:356] "Generic (PLEG): container finished" podID="9debde60-fa1b-4aa5-9970-5b1412bf37cb" containerID="a5f06631ede73dff299cf704eeb5dc3d96301cfca96a613499820da9c4a67837" exitCode=0 Jul 10 13:26:28.572705 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:28.572259 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8glbv" event={"ID":"9debde60-fa1b-4aa5-9970-5b1412bf37cb","Type":"ContainerDied","Data":"a5f06631ede73dff299cf704eeb5dc3d96301cfca96a613499820da9c4a67837"} Jul 10 13:26:29.577268 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:29.577227 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8glbv" event={"ID":"9debde60-fa1b-4aa5-9970-5b1412bf37cb","Type":"ContainerStarted","Data":"edfe9b7cb03de6a23b09e789abc6531f2dd9b0d7122d94a45f9199211dfb6823"} Jul 10 13:26:29.600593 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:29.600547 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8glbv" podStartSLOduration=7.417342122 podStartE2EDuration="41.600533843s" totalImagesPullingTime="34.183191721s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:25:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:26:29.600012078 +0000 UTC m=+42.839344010" watchObservedRunningTime="2026-07-10 13:26:29.600533843 +0000 UTC m=+42.839865763" Jul 10 13:26:29.825379 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:29.825346 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-registry-tls\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:29.825379 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:29.825381 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/051b95cc-7289-4c0c-aa25-98fe724192d6-metrics-tls\") pod \"dns-default-gjkg6\" (UID: \"051b95cc-7289-4c0c-aa25-98fe724192d6\") " pod="openshift-dns/dns-default-gjkg6" Jul 10 13:26:29.825575 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:29.825497 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 13:26:29.825575 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:29.825552 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/051b95cc-7289-4c0c-aa25-98fe724192d6-metrics-tls podName:051b95cc-7289-4c0c-aa25-98fe724192d6 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:37.825539857 +0000 UTC m=+51.064871756 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/051b95cc-7289-4c0c-aa25-98fe724192d6-metrics-tls") pod "dns-default-gjkg6" (UID: "051b95cc-7289-4c0c-aa25-98fe724192d6") : secret "dns-default-metrics-tls" not found Jul 10 13:26:29.825575 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:29.825500 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 13:26:29.825575 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:29.825569 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-849d455874-q76sx: secret "image-registry-tls" not found Jul 10 13:26:29.825723 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:29.825594 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-registry-tls podName:816669aa-a543-4738-9c33-af588b14e4b1 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:37.825583874 +0000 UTC m=+51.064915790 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-registry-tls") pod "image-registry-849d455874-q76sx" (UID: "816669aa-a543-4738-9c33-af588b14e4b1") : secret "image-registry-tls" not found Jul 10 13:26:37.882562 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:37.882524 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-registry-tls\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:37.882562 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:37.882566 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/051b95cc-7289-4c0c-aa25-98fe724192d6-metrics-tls\") pod \"dns-default-gjkg6\" (UID: \"051b95cc-7289-4c0c-aa25-98fe724192d6\") " pod="openshift-dns/dns-default-gjkg6" Jul 10 13:26:37.882999 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:37.882690 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 13:26:37.882999 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:37.882710 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-849d455874-q76sx: secret "image-registry-tls" not found Jul 10 13:26:37.882999 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:37.882716 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 13:26:37.882999 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:37.882766 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/051b95cc-7289-4c0c-aa25-98fe724192d6-metrics-tls podName:051b95cc-7289-4c0c-aa25-98fe724192d6 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:53.882751105 +0000 UTC m=+67.122083003 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/051b95cc-7289-4c0c-aa25-98fe724192d6-metrics-tls") pod "dns-default-gjkg6" (UID: "051b95cc-7289-4c0c-aa25-98fe724192d6") : secret "dns-default-metrics-tls" not found Jul 10 13:26:37.882999 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:37.882778 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-registry-tls podName:816669aa-a543-4738-9c33-af588b14e4b1 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:53.882772564 +0000 UTC m=+67.122104463 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-registry-tls") pod "image-registry-849d455874-q76sx" (UID: "816669aa-a543-4738-9c33-af588b14e4b1") : secret "image-registry-tls" not found Jul 10 13:26:43.627335 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.627304 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbcbj"] Jul 10 13:26:43.628971 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.628955 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbcbj" Jul 10 13:26:43.630263 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.630232 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mztld"] Jul 10 13:26:43.631571 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.631551 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wwrxm\"" Jul 10 13:26:43.631688 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.631575 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mztld" Jul 10 13:26:43.631688 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.631581 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 10 13:26:43.632298 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.632279 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 10 13:26:43.632412 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.632326 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 10 13:26:43.633226 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.633205 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 10 13:26:43.633312 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.633301 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 10 13:26:43.633801 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.633785 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 10 13:26:43.633894 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.633788 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 10 13:26:43.634008 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.633992 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jfmvw\"" Jul 10 13:26:43.643586 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.643568 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbcbj"] Jul 10 13:26:43.644488 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.644405 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mztld"] Jul 10 13:26:43.727889 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.727862 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-28dd7"] Jul 10 13:26:43.729502 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.729487 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-28dd7" Jul 10 13:26:43.731002 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.730985 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgxgh"] Jul 10 13:26:43.731545 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.731528 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 10 13:26:43.731633 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.731566 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 10 13:26:43.731633 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.731574 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 10 13:26:43.731764 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.731632 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 10 13:26:43.733619 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.733598 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-srtz4\"" Jul 10 13:26:43.736365 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.733685 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgxgh" Jul 10 13:26:43.737163 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.737140 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 10 13:26:43.737251 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.737173 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 10 13:26:43.737397 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.737373 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-krvfr\"" Jul 10 13:26:43.737698 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.737681 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 10 13:26:43.737801 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.737695 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 10 13:26:43.737801 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.737761 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-l4859"] Jul 10 13:26:43.739500 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.739483 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7bcdf5f866-j6l87"] Jul 10 13:26:43.739611 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.739588 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-l4859" Jul 10 13:26:43.741192 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.741180 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-hrq6g"] Jul 10 13:26:43.741315 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.741299 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:26:43.741820 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.741798 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 10 13:26:43.741975 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.741959 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 10 13:26:43.742223 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.742206 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 10 13:26:43.742303 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.742276 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 10 13:26:43.742703 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.742684 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-hrq6g" Jul 10 13:26:43.742787 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.742773 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-td6hn\"" Jul 10 13:26:43.743244 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.743227 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 10 13:26:43.744001 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.743981 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 10 13:26:43.744128 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.744024 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-g5rt8\"" Jul 10 13:26:43.744128 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.744024 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 10 13:26:43.744315 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.744298 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 10 13:26:43.744967 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.744525 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 10 13:26:43.744967 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.744533 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 10 13:26:43.744967 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.744565 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 10 13:26:43.744967 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.744802 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-28dd7"] Jul 10 13:26:43.745312 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.745293 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 10 13:26:43.745435 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.745371 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 10 13:26:43.745569 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.745544 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-88zs6\"" Jul 10 13:26:43.745722 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.745704 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 10 13:26:43.745910 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.745891 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgxgh"] Jul 10 13:26:43.749346 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.749326 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 10 13:26:43.751464 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.751227 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 10 13:26:43.751464 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.751400 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-l4859"] Jul 10 13:26:43.752333 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.752307 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-hrq6g"] Jul 10 13:26:43.753403 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.753383 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7bcdf5f866-j6l87"] Jul 10 13:26:43.824226 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.824200 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d13a73e0-bd87-4a7b-b968-34290f15f6f0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lbcbj\" (UID: \"d13a73e0-bd87-4a7b-b968-34290f15f6f0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbcbj" Jul 10 13:26:43.824316 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.824234 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xs88\" (UniqueName: \"kubernetes.io/projected/ed62a749-d965-432a-b2c7-d4ad2e42a8f4-kube-api-access-5xs88\") pod \"cluster-samples-operator-65db858894-mztld\" (UID: \"ed62a749-d965-432a-b2c7-d4ad2e42a8f4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mztld" Jul 10 13:26:43.824316 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.824255 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed62a749-d965-432a-b2c7-d4ad2e42a8f4-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mztld\" (UID: \"ed62a749-d965-432a-b2c7-d4ad2e42a8f4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mztld" Jul 10 13:26:43.824316 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.824295 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wpx4\" (UniqueName: \"kubernetes.io/projected/d13a73e0-bd87-4a7b-b968-34290f15f6f0-kube-api-access-8wpx4\") pod \"cluster-monitoring-operator-5f7f494dd4-lbcbj\" (UID: \"d13a73e0-bd87-4a7b-b968-34290f15f6f0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbcbj" Jul 10 13:26:43.824413 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.824339 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d13a73e0-bd87-4a7b-b968-34290f15f6f0-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-lbcbj\" (UID: \"d13a73e0-bd87-4a7b-b968-34290f15f6f0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbcbj" Jul 10 13:26:43.828916 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.828893 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-v5lz8"] Jul 10 13:26:43.830575 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.830563 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-v5lz8" Jul 10 13:26:43.832418 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.832399 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cz854"] Jul 10 13:26:43.833082 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.833065 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-sp9wz\"" Jul 10 13:26:43.833955 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.833939 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cz854" Jul 10 13:26:43.835987 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.835967 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-cqjz8\"" Jul 10 13:26:43.836098 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.835973 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 10 13:26:43.836098 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.835971 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 10 13:26:43.842751 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.842727 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-v5lz8"] Jul 10 13:26:43.845020 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.845002 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cz854"] Jul 10 13:26:43.925534 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.925450 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-stats-auth\") pod \"router-default-7bcdf5f866-j6l87\" (UID: \"e3cb5d91-edc8-4b74-bcb4-464cad827f6f\") " pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:26:43.925534 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.925502 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24qpl\" (UniqueName: \"kubernetes.io/projected/5702eeb0-bcc8-4557-87a8-f25f6e3f46cf-kube-api-access-24qpl\") pod \"insights-operator-68d9dd94cf-l4859\" (UID: \"5702eeb0-bcc8-4557-87a8-f25f6e3f46cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-l4859" Jul 10 13:26:43.925804 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.925568 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0676f234-f4cc-452c-9b61-71cf7efdb704-config\") pod \"service-ca-operator-7695fc6c8c-bgxgh\" (UID: \"0676f234-f4cc-452c-9b61-71cf7efdb704\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgxgh" Jul 10 13:26:43.925804 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.925658 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d13a73e0-bd87-4a7b-b968-34290f15f6f0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lbcbj\" (UID: \"d13a73e0-bd87-4a7b-b968-34290f15f6f0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbcbj" Jul 10 13:26:43.925804 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.925682 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f479ff22-0215-45f4-aad7-be153e8abb4b-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-28dd7\" (UID: \"f479ff22-0215-45f4-aad7-be153e8abb4b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-28dd7" Jul 10 13:26:43.925804 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.925705 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wpx4\" (UniqueName: \"kubernetes.io/projected/d13a73e0-bd87-4a7b-b968-34290f15f6f0-kube-api-access-8wpx4\") pod \"cluster-monitoring-operator-5f7f494dd4-lbcbj\" (UID: \"d13a73e0-bd87-4a7b-b968-34290f15f6f0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbcbj" Jul 10 13:26:43.925804 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.925727 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-metrics-certs\") pod \"router-default-7bcdf5f866-j6l87\" (UID: \"e3cb5d91-edc8-4b74-bcb4-464cad827f6f\") " pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:26:43.925804 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.925763 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f479ff22-0215-45f4-aad7-be153e8abb4b-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-28dd7\" (UID: \"f479ff22-0215-45f4-aad7-be153e8abb4b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-28dd7" Jul 10 13:26:43.925804 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.925787 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xztgm\" (UniqueName: \"kubernetes.io/projected/0676f234-f4cc-452c-9b61-71cf7efdb704-kube-api-access-xztgm\") pod \"service-ca-operator-7695fc6c8c-bgxgh\" (UID: \"0676f234-f4cc-452c-9b61-71cf7efdb704\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgxgh" Jul 10 13:26:43.925804 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:43.925802 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 13:26:43.926131 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.925817 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/63c89ec5-2de9-4855-8fe8-57baaa8e0588-trusted-ca\") pod \"console-operator-7866497494-hrq6g\" (UID: \"63c89ec5-2de9-4855-8fe8-57baaa8e0588\") " pod="openshift-console-operator/console-operator-7866497494-hrq6g" Jul 10 13:26:43.926131 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.925855 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h944q\" (UniqueName: \"kubernetes.io/projected/63c89ec5-2de9-4855-8fe8-57baaa8e0588-kube-api-access-h944q\") pod \"console-operator-7866497494-hrq6g\" (UID: \"63c89ec5-2de9-4855-8fe8-57baaa8e0588\") " pod="openshift-console-operator/console-operator-7866497494-hrq6g" Jul 10 13:26:43.926131 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:43.925887 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d13a73e0-bd87-4a7b-b968-34290f15f6f0-cluster-monitoring-operator-tls podName:d13a73e0-bd87-4a7b-b968-34290f15f6f0 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:44.425868929 +0000 UTC m=+57.665200828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d13a73e0-bd87-4a7b-b968-34290f15f6f0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lbcbj" (UID: "d13a73e0-bd87-4a7b-b968-34290f15f6f0") : secret "cluster-monitoring-operator-tls" not found Jul 10 13:26:43.926131 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.925916 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-service-ca-bundle\") pod \"router-default-7bcdf5f866-j6l87\" (UID: \"e3cb5d91-edc8-4b74-bcb4-464cad827f6f\") " pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:26:43.926131 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.925945 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5702eeb0-bcc8-4557-87a8-f25f6e3f46cf-tmp\") pod \"insights-operator-68d9dd94cf-l4859\" (UID: \"5702eeb0-bcc8-4557-87a8-f25f6e3f46cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-l4859" Jul 10 13:26:43.926131 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.925980 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5702eeb0-bcc8-4557-87a8-f25f6e3f46cf-snapshots\") pod \"insights-operator-68d9dd94cf-l4859\" (UID: \"5702eeb0-bcc8-4557-87a8-f25f6e3f46cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-l4859" Jul 10 13:26:43.926131 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.926002 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5702eeb0-bcc8-4557-87a8-f25f6e3f46cf-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-l4859\" (UID: \"5702eeb0-bcc8-4557-87a8-f25f6e3f46cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-l4859" Jul 10 13:26:43.926131 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.926076 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-default-certificate\") pod \"router-default-7bcdf5f866-j6l87\" (UID: \"e3cb5d91-edc8-4b74-bcb4-464cad827f6f\") " pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:26:43.926454 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.926132 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g2r5\" (UniqueName: \"kubernetes.io/projected/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-kube-api-access-5g2r5\") pod \"router-default-7bcdf5f866-j6l87\" (UID: \"e3cb5d91-edc8-4b74-bcb4-464cad827f6f\") " pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:26:43.926454 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.926152 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63c89ec5-2de9-4855-8fe8-57baaa8e0588-serving-cert\") pod \"console-operator-7866497494-hrq6g\" (UID: \"63c89ec5-2de9-4855-8fe8-57baaa8e0588\") " pod="openshift-console-operator/console-operator-7866497494-hrq6g" Jul 10 13:26:43.926454 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.926183 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xs88\" (UniqueName: \"kubernetes.io/projected/ed62a749-d965-432a-b2c7-d4ad2e42a8f4-kube-api-access-5xs88\") pod \"cluster-samples-operator-65db858894-mztld\" (UID: \"ed62a749-d965-432a-b2c7-d4ad2e42a8f4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mztld" Jul 10 13:26:43.926454 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.926206 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0676f234-f4cc-452c-9b61-71cf7efdb704-serving-cert\") pod \"service-ca-operator-7695fc6c8c-bgxgh\" (UID: \"0676f234-f4cc-452c-9b61-71cf7efdb704\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgxgh" Jul 10 13:26:43.926454 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.926224 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5702eeb0-bcc8-4557-87a8-f25f6e3f46cf-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-l4859\" (UID: \"5702eeb0-bcc8-4557-87a8-f25f6e3f46cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-l4859" Jul 10 13:26:43.926454 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.926245 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5702eeb0-bcc8-4557-87a8-f25f6e3f46cf-serving-cert\") pod \"insights-operator-68d9dd94cf-l4859\" (UID: \"5702eeb0-bcc8-4557-87a8-f25f6e3f46cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-l4859" Jul 10 13:26:43.926454 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.926372 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed62a749-d965-432a-b2c7-d4ad2e42a8f4-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mztld\" (UID: \"ed62a749-d965-432a-b2c7-d4ad2e42a8f4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mztld" Jul 10 13:26:43.926454 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.926406 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flmtd\" (UniqueName: \"kubernetes.io/projected/f479ff22-0215-45f4-aad7-be153e8abb4b-kube-api-access-flmtd\") pod \"kube-storage-version-migrator-operator-799cb7f958-28dd7\" (UID: \"f479ff22-0215-45f4-aad7-be153e8abb4b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-28dd7" Jul 10 13:26:43.926454 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.926441 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d13a73e0-bd87-4a7b-b968-34290f15f6f0-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-lbcbj\" (UID: \"d13a73e0-bd87-4a7b-b968-34290f15f6f0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbcbj" Jul 10 13:26:43.926825 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:43.926461 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 13:26:43.926825 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.926467 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/63c89ec5-2de9-4855-8fe8-57baaa8e0588-config\") pod \"console-operator-7866497494-hrq6g\" (UID: \"63c89ec5-2de9-4855-8fe8-57baaa8e0588\") " pod="openshift-console-operator/console-operator-7866497494-hrq6g" Jul 10 13:26:43.926825 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:43.926505 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed62a749-d965-432a-b2c7-d4ad2e42a8f4-samples-operator-tls podName:ed62a749-d965-432a-b2c7-d4ad2e42a8f4 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:44.426491186 +0000 UTC m=+57.665823087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ed62a749-d965-432a-b2c7-d4ad2e42a8f4-samples-operator-tls") pod "cluster-samples-operator-65db858894-mztld" (UID: "ed62a749-d965-432a-b2c7-d4ad2e42a8f4") : secret "samples-operator-tls" not found Jul 10 13:26:43.927104 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.927086 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d13a73e0-bd87-4a7b-b968-34290f15f6f0-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-lbcbj\" (UID: \"d13a73e0-bd87-4a7b-b968-34290f15f6f0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbcbj" Jul 10 13:26:43.938462 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.938434 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xs88\" (UniqueName: \"kubernetes.io/projected/ed62a749-d965-432a-b2c7-d4ad2e42a8f4-kube-api-access-5xs88\") pod \"cluster-samples-operator-65db858894-mztld\" (UID: \"ed62a749-d965-432a-b2c7-d4ad2e42a8f4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mztld" Jul 10 13:26:43.938631 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:43.938528 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wpx4\" (UniqueName: \"kubernetes.io/projected/d13a73e0-bd87-4a7b-b968-34290f15f6f0-kube-api-access-8wpx4\") pod \"cluster-monitoring-operator-5f7f494dd4-lbcbj\" (UID: \"d13a73e0-bd87-4a7b-b968-34290f15f6f0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbcbj" Jul 10 13:26:44.027155 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.027128 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5702eeb0-bcc8-4557-87a8-f25f6e3f46cf-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-l4859\" (UID: \"5702eeb0-bcc8-4557-87a8-f25f6e3f46cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-l4859" Jul 10 13:26:44.027284 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.027173 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-default-certificate\") pod \"router-default-7bcdf5f866-j6l87\" (UID: \"e3cb5d91-edc8-4b74-bcb4-464cad827f6f\") " pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:26:44.027284 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.027197 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b67v4\" (UniqueName: \"kubernetes.io/projected/392e2bbd-a9f3-4032-a0dc-c59f5d4133e0-kube-api-access-b67v4\") pod \"volume-data-source-validator-78495597f6-cz854\" (UID: \"392e2bbd-a9f3-4032-a0dc-c59f5d4133e0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cz854" Jul 10 13:26:44.027284 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.027225 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g2r5\" (UniqueName: \"kubernetes.io/projected/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-kube-api-access-5g2r5\") pod \"router-default-7bcdf5f866-j6l87\" (UID: \"e3cb5d91-edc8-4b74-bcb4-464cad827f6f\") " pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:26:44.027284 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.027244 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63c89ec5-2de9-4855-8fe8-57baaa8e0588-serving-cert\") pod \"console-operator-7866497494-hrq6g\" (UID: \"63c89ec5-2de9-4855-8fe8-57baaa8e0588\") " pod="openshift-console-operator/console-operator-7866497494-hrq6g" Jul 10 13:26:44.027284 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.027264 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0676f234-f4cc-452c-9b61-71cf7efdb704-serving-cert\") pod \"service-ca-operator-7695fc6c8c-bgxgh\" (UID: \"0676f234-f4cc-452c-9b61-71cf7efdb704\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgxgh" Jul 10 13:26:44.027284 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.027280 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5702eeb0-bcc8-4557-87a8-f25f6e3f46cf-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-l4859\" (UID: \"5702eeb0-bcc8-4557-87a8-f25f6e3f46cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-l4859" Jul 10 13:26:44.027596 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.027304 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5702eeb0-bcc8-4557-87a8-f25f6e3f46cf-serving-cert\") pod \"insights-operator-68d9dd94cf-l4859\" (UID: \"5702eeb0-bcc8-4557-87a8-f25f6e3f46cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-l4859" Jul 10 13:26:44.027596 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.027562 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flmtd\" (UniqueName: \"kubernetes.io/projected/f479ff22-0215-45f4-aad7-be153e8abb4b-kube-api-access-flmtd\") pod \"kube-storage-version-migrator-operator-799cb7f958-28dd7\" (UID: \"f479ff22-0215-45f4-aad7-be153e8abb4b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-28dd7" Jul 10 13:26:44.027726 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.027604 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/63c89ec5-2de9-4855-8fe8-57baaa8e0588-config\") pod \"console-operator-7866497494-hrq6g\" (UID: \"63c89ec5-2de9-4855-8fe8-57baaa8e0588\") " pod="openshift-console-operator/console-operator-7866497494-hrq6g" Jul 10 13:26:44.027726 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.027661 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf5tt\" (UniqueName: \"kubernetes.io/projected/ff837081-8b7e-485d-93be-cc8c19a65840-kube-api-access-vf5tt\") pod \"network-check-source-869dcfcdcd-v5lz8\" (UID: \"ff837081-8b7e-485d-93be-cc8c19a65840\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-v5lz8" Jul 10 13:26:44.027726 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.027694 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-stats-auth\") pod \"router-default-7bcdf5f866-j6l87\" (UID: \"e3cb5d91-edc8-4b74-bcb4-464cad827f6f\") " pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:26:44.027877 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.027732 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24qpl\" (UniqueName: \"kubernetes.io/projected/5702eeb0-bcc8-4557-87a8-f25f6e3f46cf-kube-api-access-24qpl\") pod \"insights-operator-68d9dd94cf-l4859\" (UID: \"5702eeb0-bcc8-4557-87a8-f25f6e3f46cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-l4859" Jul 10 13:26:44.027877 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.027761 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0676f234-f4cc-452c-9b61-71cf7efdb704-config\") pod \"service-ca-operator-7695fc6c8c-bgxgh\" (UID: \"0676f234-f4cc-452c-9b61-71cf7efdb704\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgxgh" Jul 10 13:26:44.027877 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.027792 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5702eeb0-bcc8-4557-87a8-f25f6e3f46cf-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-l4859\" (UID: \"5702eeb0-bcc8-4557-87a8-f25f6e3f46cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-l4859" Jul 10 13:26:44.027877 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.027830 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f479ff22-0215-45f4-aad7-be153e8abb4b-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-28dd7\" (UID: \"f479ff22-0215-45f4-aad7-be153e8abb4b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-28dd7" Jul 10 13:26:44.027877 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.027867 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-metrics-certs\") pod \"router-default-7bcdf5f866-j6l87\" (UID: \"e3cb5d91-edc8-4b74-bcb4-464cad827f6f\") " pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:26:44.028113 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:44.027957 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 13:26:44.028113 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:44.028024 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-metrics-certs podName:e3cb5d91-edc8-4b74-bcb4-464cad827f6f nodeName:}" failed. No retries permitted until 2026-07-10 13:26:44.528006071 +0000 UTC m=+57.767337986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-metrics-certs") pod "router-default-7bcdf5f866-j6l87" (UID: "e3cb5d91-edc8-4b74-bcb4-464cad827f6f") : secret "router-metrics-certs-default" not found Jul 10 13:26:44.028230 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.028140 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5702eeb0-bcc8-4557-87a8-f25f6e3f46cf-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-l4859\" (UID: \"5702eeb0-bcc8-4557-87a8-f25f6e3f46cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-l4859" Jul 10 13:26:44.028714 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.028692 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f479ff22-0215-45f4-aad7-be153e8abb4b-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-28dd7\" (UID: \"f479ff22-0215-45f4-aad7-be153e8abb4b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-28dd7" Jul 10 13:26:44.028880 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.028783 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/63c89ec5-2de9-4855-8fe8-57baaa8e0588-config\") pod \"console-operator-7866497494-hrq6g\" (UID: \"63c89ec5-2de9-4855-8fe8-57baaa8e0588\") " pod="openshift-console-operator/console-operator-7866497494-hrq6g" Jul 10 13:26:44.028967 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.028813 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f479ff22-0215-45f4-aad7-be153e8abb4b-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-28dd7\" (UID: \"f479ff22-0215-45f4-aad7-be153e8abb4b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-28dd7" Jul 10 13:26:44.029031 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.028967 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xztgm\" (UniqueName: \"kubernetes.io/projected/0676f234-f4cc-452c-9b61-71cf7efdb704-kube-api-access-xztgm\") pod \"service-ca-operator-7695fc6c8c-bgxgh\" (UID: \"0676f234-f4cc-452c-9b61-71cf7efdb704\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgxgh" Jul 10 13:26:44.029031 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.029004 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/63c89ec5-2de9-4855-8fe8-57baaa8e0588-trusted-ca\") pod \"console-operator-7866497494-hrq6g\" (UID: \"63c89ec5-2de9-4855-8fe8-57baaa8e0588\") " pod="openshift-console-operator/console-operator-7866497494-hrq6g" Jul 10 13:26:44.029137 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.029031 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h944q\" (UniqueName: \"kubernetes.io/projected/63c89ec5-2de9-4855-8fe8-57baaa8e0588-kube-api-access-h944q\") pod \"console-operator-7866497494-hrq6g\" (UID: \"63c89ec5-2de9-4855-8fe8-57baaa8e0588\") " pod="openshift-console-operator/console-operator-7866497494-hrq6g" Jul 10 13:26:44.029137 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.029061 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-service-ca-bundle\") pod \"router-default-7bcdf5f866-j6l87\" (UID: \"e3cb5d91-edc8-4b74-bcb4-464cad827f6f\") " pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:26:44.029137 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.029084 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5702eeb0-bcc8-4557-87a8-f25f6e3f46cf-tmp\") pod \"insights-operator-68d9dd94cf-l4859\" (UID: \"5702eeb0-bcc8-4557-87a8-f25f6e3f46cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-l4859" Jul 10 13:26:44.029137 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.029127 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5702eeb0-bcc8-4557-87a8-f25f6e3f46cf-snapshots\") pod \"insights-operator-68d9dd94cf-l4859\" (UID: \"5702eeb0-bcc8-4557-87a8-f25f6e3f46cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-l4859" Jul 10 13:26:44.030234 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.029753 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5702eeb0-bcc8-4557-87a8-f25f6e3f46cf-snapshots\") pod \"insights-operator-68d9dd94cf-l4859\" (UID: \"5702eeb0-bcc8-4557-87a8-f25f6e3f46cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-l4859" Jul 10 13:26:44.030234 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.029955 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0676f234-f4cc-452c-9b61-71cf7efdb704-serving-cert\") pod \"service-ca-operator-7695fc6c8c-bgxgh\" (UID: \"0676f234-f4cc-452c-9b61-71cf7efdb704\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgxgh" Jul 10 13:26:44.030234 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.030051 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63c89ec5-2de9-4855-8fe8-57baaa8e0588-serving-cert\") pod \"console-operator-7866497494-hrq6g\" (UID: \"63c89ec5-2de9-4855-8fe8-57baaa8e0588\") " pod="openshift-console-operator/console-operator-7866497494-hrq6g" Jul 10 13:26:44.030234 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:44.030082 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-service-ca-bundle podName:e3cb5d91-edc8-4b74-bcb4-464cad827f6f nodeName:}" failed. No retries permitted until 2026-07-10 13:26:44.530064813 +0000 UTC m=+57.769396731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-service-ca-bundle") pod "router-default-7bcdf5f866-j6l87" (UID: "e3cb5d91-edc8-4b74-bcb4-464cad827f6f") : configmap references non-existent config key: service-ca.crt Jul 10 13:26:44.030234 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.028856 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0676f234-f4cc-452c-9b61-71cf7efdb704-config\") pod \"service-ca-operator-7695fc6c8c-bgxgh\" (UID: \"0676f234-f4cc-452c-9b61-71cf7efdb704\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgxgh" Jul 10 13:26:44.030234 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.030163 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-default-certificate\") pod \"router-default-7bcdf5f866-j6l87\" (UID: \"e3cb5d91-edc8-4b74-bcb4-464cad827f6f\") " pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:26:44.030234 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.030198 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/63c89ec5-2de9-4855-8fe8-57baaa8e0588-trusted-ca\") pod \"console-operator-7866497494-hrq6g\" (UID: \"63c89ec5-2de9-4855-8fe8-57baaa8e0588\") " pod="openshift-console-operator/console-operator-7866497494-hrq6g" Jul 10 13:26:44.030234 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.030236 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5702eeb0-bcc8-4557-87a8-f25f6e3f46cf-tmp\") pod \"insights-operator-68d9dd94cf-l4859\" (UID: \"5702eeb0-bcc8-4557-87a8-f25f6e3f46cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-l4859" Jul 10 13:26:44.030611 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.030590 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-stats-auth\") pod \"router-default-7bcdf5f866-j6l87\" (UID: \"e3cb5d91-edc8-4b74-bcb4-464cad827f6f\") " pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:26:44.030880 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.030853 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5702eeb0-bcc8-4557-87a8-f25f6e3f46cf-serving-cert\") pod \"insights-operator-68d9dd94cf-l4859\" (UID: \"5702eeb0-bcc8-4557-87a8-f25f6e3f46cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-l4859" Jul 10 13:26:44.031052 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.031035 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f479ff22-0215-45f4-aad7-be153e8abb4b-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-28dd7\" (UID: \"f479ff22-0215-45f4-aad7-be153e8abb4b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-28dd7" Jul 10 13:26:44.037027 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.037002 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g2r5\" (UniqueName: \"kubernetes.io/projected/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-kube-api-access-5g2r5\") pod \"router-default-7bcdf5f866-j6l87\" (UID: \"e3cb5d91-edc8-4b74-bcb4-464cad827f6f\") " pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:26:44.038370 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.038349 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flmtd\" (UniqueName: \"kubernetes.io/projected/f479ff22-0215-45f4-aad7-be153e8abb4b-kube-api-access-flmtd\") pod \"kube-storage-version-migrator-operator-799cb7f958-28dd7\" (UID: \"f479ff22-0215-45f4-aad7-be153e8abb4b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-28dd7" Jul 10 13:26:44.038476 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.038424 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xztgm\" (UniqueName: \"kubernetes.io/projected/0676f234-f4cc-452c-9b61-71cf7efdb704-kube-api-access-xztgm\") pod \"service-ca-operator-7695fc6c8c-bgxgh\" (UID: \"0676f234-f4cc-452c-9b61-71cf7efdb704\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgxgh" Jul 10 13:26:44.038476 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.038429 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24qpl\" (UniqueName: \"kubernetes.io/projected/5702eeb0-bcc8-4557-87a8-f25f6e3f46cf-kube-api-access-24qpl\") pod \"insights-operator-68d9dd94cf-l4859\" (UID: \"5702eeb0-bcc8-4557-87a8-f25f6e3f46cf\") " pod="openshift-insights/insights-operator-68d9dd94cf-l4859" Jul 10 13:26:44.039328 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.039311 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h944q\" (UniqueName: \"kubernetes.io/projected/63c89ec5-2de9-4855-8fe8-57baaa8e0588-kube-api-access-h944q\") pod \"console-operator-7866497494-hrq6g\" (UID: \"63c89ec5-2de9-4855-8fe8-57baaa8e0588\") " pod="openshift-console-operator/console-operator-7866497494-hrq6g" Jul 10 13:26:44.042244 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.042219 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-28dd7" Jul 10 13:26:44.052460 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.052442 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgxgh" Jul 10 13:26:44.058008 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.057990 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-l4859" Jul 10 13:26:44.069693 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.069659 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-hrq6g" Jul 10 13:26:44.138035 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.134039 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf5tt\" (UniqueName: \"kubernetes.io/projected/ff837081-8b7e-485d-93be-cc8c19a65840-kube-api-access-vf5tt\") pod \"network-check-source-869dcfcdcd-v5lz8\" (UID: \"ff837081-8b7e-485d-93be-cc8c19a65840\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-v5lz8" Jul 10 13:26:44.138035 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.134241 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b67v4\" (UniqueName: \"kubernetes.io/projected/392e2bbd-a9f3-4032-a0dc-c59f5d4133e0-kube-api-access-b67v4\") pod \"volume-data-source-validator-78495597f6-cz854\" (UID: \"392e2bbd-a9f3-4032-a0dc-c59f5d4133e0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cz854" Jul 10 13:26:44.148538 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.148433 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b67v4\" (UniqueName: \"kubernetes.io/projected/392e2bbd-a9f3-4032-a0dc-c59f5d4133e0-kube-api-access-b67v4\") pod \"volume-data-source-validator-78495597f6-cz854\" (UID: \"392e2bbd-a9f3-4032-a0dc-c59f5d4133e0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cz854" Jul 10 13:26:44.151260 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.151190 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf5tt\" (UniqueName: \"kubernetes.io/projected/ff837081-8b7e-485d-93be-cc8c19a65840-kube-api-access-vf5tt\") pod \"network-check-source-869dcfcdcd-v5lz8\" (UID: \"ff837081-8b7e-485d-93be-cc8c19a65840\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-v5lz8" Jul 10 13:26:44.216033 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.215344 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-28dd7"] Jul 10 13:26:44.217308 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:26:44.217270 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf479ff22_0215_45f4_aad7_be153e8abb4b.slice/crio-ea430e38a897d9e466ca6dbeb75d34d45ea80c366ea23bf5b73104ffed4faae2 WatchSource:0}: Error finding container ea430e38a897d9e466ca6dbeb75d34d45ea80c366ea23bf5b73104ffed4faae2: Status 404 returned error can't find the container with id ea430e38a897d9e466ca6dbeb75d34d45ea80c366ea23bf5b73104ffed4faae2 Jul 10 13:26:44.237736 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.237673 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-l4859"] Jul 10 13:26:44.240693 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:26:44.240669 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5702eeb0_bcc8_4557_87a8_f25f6e3f46cf.slice/crio-1983fcdc077ddaf5f58262852c5798dfb23510340100181a61136b6f968ffcd1 WatchSource:0}: Error finding container 1983fcdc077ddaf5f58262852c5798dfb23510340100181a61136b6f968ffcd1: Status 404 returned error can't find the container with id 1983fcdc077ddaf5f58262852c5798dfb23510340100181a61136b6f968ffcd1 Jul 10 13:26:44.252630 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.252611 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgxgh"] Jul 10 13:26:44.254197 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:26:44.254175 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0676f234_f4cc_452c_9b61_71cf7efdb704.slice/crio-56b2bd5bd7d3bd20846052d965fefc11fdbfacd454f18d47743a075d7d5eb3fb WatchSource:0}: Error finding container 56b2bd5bd7d3bd20846052d965fefc11fdbfacd454f18d47743a075d7d5eb3fb: Status 404 returned error can't find the container with id 56b2bd5bd7d3bd20846052d965fefc11fdbfacd454f18d47743a075d7d5eb3fb Jul 10 13:26:44.268443 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.268421 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-hrq6g"] Jul 10 13:26:44.270931 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:26:44.270911 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c89ec5_2de9_4855_8fe8_57baaa8e0588.slice/crio-0da7ab688072dd9c225fa8312f79aeee29667e3ff71923c6c13cbcae2bab6f86 WatchSource:0}: Error finding container 0da7ab688072dd9c225fa8312f79aeee29667e3ff71923c6c13cbcae2bab6f86: Status 404 returned error can't find the container with id 0da7ab688072dd9c225fa8312f79aeee29667e3ff71923c6c13cbcae2bab6f86 Jul 10 13:26:44.435935 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.435907 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d13a73e0-bd87-4a7b-b968-34290f15f6f0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lbcbj\" (UID: \"d13a73e0-bd87-4a7b-b968-34290f15f6f0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbcbj" Jul 10 13:26:44.436066 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:44.436037 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 13:26:44.436104 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:44.436095 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 13:26:44.436134 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:44.436097 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d13a73e0-bd87-4a7b-b968-34290f15f6f0-cluster-monitoring-operator-tls podName:d13a73e0-bd87-4a7b-b968-34290f15f6f0 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:45.43607896 +0000 UTC m=+58.675410875 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d13a73e0-bd87-4a7b-b968-34290f15f6f0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lbcbj" (UID: "d13a73e0-bd87-4a7b-b968-34290f15f6f0") : secret "cluster-monitoring-operator-tls" not found Jul 10 13:26:44.436173 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.436034 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed62a749-d965-432a-b2c7-d4ad2e42a8f4-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mztld\" (UID: \"ed62a749-d965-432a-b2c7-d4ad2e42a8f4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mztld" Jul 10 13:26:44.436173 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:44.436160 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed62a749-d965-432a-b2c7-d4ad2e42a8f4-samples-operator-tls podName:ed62a749-d965-432a-b2c7-d4ad2e42a8f4 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:45.436134786 +0000 UTC m=+58.675466693 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ed62a749-d965-432a-b2c7-d4ad2e42a8f4-samples-operator-tls") pod "cluster-samples-operator-65db858894-mztld" (UID: "ed62a749-d965-432a-b2c7-d4ad2e42a8f4") : secret "samples-operator-tls" not found Jul 10 13:26:44.439878 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.439837 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-v5lz8" Jul 10 13:26:44.445704 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.445690 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cz854" Jul 10 13:26:44.537477 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.537448 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-metrics-certs\") pod \"router-default-7bcdf5f866-j6l87\" (UID: \"e3cb5d91-edc8-4b74-bcb4-464cad827f6f\") " pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:26:44.537612 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.537502 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-service-ca-bundle\") pod \"router-default-7bcdf5f866-j6l87\" (UID: \"e3cb5d91-edc8-4b74-bcb4-464cad827f6f\") " pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:26:44.537612 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:44.537597 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 13:26:44.537725 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:44.537695 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-metrics-certs podName:e3cb5d91-edc8-4b74-bcb4-464cad827f6f nodeName:}" failed. No retries permitted until 2026-07-10 13:26:45.537671652 +0000 UTC m=+58.777003554 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-metrics-certs") pod "router-default-7bcdf5f866-j6l87" (UID: "e3cb5d91-edc8-4b74-bcb4-464cad827f6f") : secret "router-metrics-certs-default" not found Jul 10 13:26:44.537725 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:44.537722 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-service-ca-bundle podName:e3cb5d91-edc8-4b74-bcb4-464cad827f6f nodeName:}" failed. No retries permitted until 2026-07-10 13:26:45.537707881 +0000 UTC m=+58.777039779 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-service-ca-bundle") pod "router-default-7bcdf5f866-j6l87" (UID: "e3cb5d91-edc8-4b74-bcb4-464cad827f6f") : configmap references non-existent config key: service-ca.crt Jul 10 13:26:44.616436 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.616402 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-hrq6g" event={"ID":"63c89ec5-2de9-4855-8fe8-57baaa8e0588","Type":"ContainerStarted","Data":"0da7ab688072dd9c225fa8312f79aeee29667e3ff71923c6c13cbcae2bab6f86"} Jul 10 13:26:44.617511 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.617483 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-l4859" event={"ID":"5702eeb0-bcc8-4557-87a8-f25f6e3f46cf","Type":"ContainerStarted","Data":"1983fcdc077ddaf5f58262852c5798dfb23510340100181a61136b6f968ffcd1"} Jul 10 13:26:44.618514 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.618493 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgxgh" event={"ID":"0676f234-f4cc-452c-9b61-71cf7efdb704","Type":"ContainerStarted","Data":"56b2bd5bd7d3bd20846052d965fefc11fdbfacd454f18d47743a075d7d5eb3fb"} Jul 10 13:26:44.619425 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.619401 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-28dd7" event={"ID":"f479ff22-0215-45f4-aad7-be153e8abb4b","Type":"ContainerStarted","Data":"ea430e38a897d9e466ca6dbeb75d34d45ea80c366ea23bf5b73104ffed4faae2"} Jul 10 13:26:44.778146 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.778120 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-v5lz8"] Jul 10 13:26:44.779456 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:44.779428 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cz854"] Jul 10 13:26:44.781105 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:26:44.780975 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod392e2bbd_a9f3_4032_a0dc_c59f5d4133e0.slice/crio-02bd8c86e7cbda8e14d834fefa444327819a7789bd38c2ac454e7f3d1b21f0c1 WatchSource:0}: Error finding container 02bd8c86e7cbda8e14d834fefa444327819a7789bd38c2ac454e7f3d1b21f0c1: Status 404 returned error can't find the container with id 02bd8c86e7cbda8e14d834fefa444327819a7789bd38c2ac454e7f3d1b21f0c1 Jul 10 13:26:44.781281 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:26:44.781256 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff837081_8b7e_485d_93be_cc8c19a65840.slice/crio-f18b39824814694997cf246534b1f8607f41f92dc232949d1d1f05bb935e58a4 WatchSource:0}: Error finding container f18b39824814694997cf246534b1f8607f41f92dc232949d1d1f05bb935e58a4: Status 404 returned error can't find the container with id f18b39824814694997cf246534b1f8607f41f92dc232949d1d1f05bb935e58a4 Jul 10 13:26:45.444752 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:45.444716 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed62a749-d965-432a-b2c7-d4ad2e42a8f4-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mztld\" (UID: \"ed62a749-d965-432a-b2c7-d4ad2e42a8f4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mztld" Jul 10 13:26:45.444941 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:45.444790 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d13a73e0-bd87-4a7b-b968-34290f15f6f0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lbcbj\" (UID: \"d13a73e0-bd87-4a7b-b968-34290f15f6f0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbcbj" Jul 10 13:26:45.444941 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:45.444925 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 13:26:45.445058 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:45.444972 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d13a73e0-bd87-4a7b-b968-34290f15f6f0-cluster-monitoring-operator-tls podName:d13a73e0-bd87-4a7b-b968-34290f15f6f0 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:47.44495966 +0000 UTC m=+60.684291559 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d13a73e0-bd87-4a7b-b968-34290f15f6f0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lbcbj" (UID: "d13a73e0-bd87-4a7b-b968-34290f15f6f0") : secret "cluster-monitoring-operator-tls" not found Jul 10 13:26:45.445288 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:45.445272 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 13:26:45.445399 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:45.445324 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed62a749-d965-432a-b2c7-d4ad2e42a8f4-samples-operator-tls podName:ed62a749-d965-432a-b2c7-d4ad2e42a8f4 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:47.44530874 +0000 UTC m=+60.684640644 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ed62a749-d965-432a-b2c7-d4ad2e42a8f4-samples-operator-tls") pod "cluster-samples-operator-65db858894-mztld" (UID: "ed62a749-d965-432a-b2c7-d4ad2e42a8f4") : secret "samples-operator-tls" not found Jul 10 13:26:45.546143 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:45.546108 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-metrics-certs\") pod \"router-default-7bcdf5f866-j6l87\" (UID: \"e3cb5d91-edc8-4b74-bcb4-464cad827f6f\") " pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:26:45.546303 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:45.546164 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-service-ca-bundle\") pod \"router-default-7bcdf5f866-j6l87\" (UID: \"e3cb5d91-edc8-4b74-bcb4-464cad827f6f\") " pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:26:45.546382 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:45.546351 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-service-ca-bundle podName:e3cb5d91-edc8-4b74-bcb4-464cad827f6f nodeName:}" failed. No retries permitted until 2026-07-10 13:26:47.546332211 +0000 UTC m=+60.785664115 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-service-ca-bundle") pod "router-default-7bcdf5f866-j6l87" (UID: "e3cb5d91-edc8-4b74-bcb4-464cad827f6f") : configmap references non-existent config key: service-ca.crt Jul 10 13:26:45.546763 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:45.546742 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 13:26:45.546847 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:45.546802 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-metrics-certs podName:e3cb5d91-edc8-4b74-bcb4-464cad827f6f nodeName:}" failed. No retries permitted until 2026-07-10 13:26:47.546786339 +0000 UTC m=+60.786118241 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-metrics-certs") pod "router-default-7bcdf5f866-j6l87" (UID: "e3cb5d91-edc8-4b74-bcb4-464cad827f6f") : secret "router-metrics-certs-default" not found Jul 10 13:26:45.626256 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:45.626176 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cz854" event={"ID":"392e2bbd-a9f3-4032-a0dc-c59f5d4133e0","Type":"ContainerStarted","Data":"02bd8c86e7cbda8e14d834fefa444327819a7789bd38c2ac454e7f3d1b21f0c1"} Jul 10 13:26:45.628059 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:45.628021 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-v5lz8" event={"ID":"ff837081-8b7e-485d-93be-cc8c19a65840","Type":"ContainerStarted","Data":"f18b39824814694997cf246534b1f8607f41f92dc232949d1d1f05bb935e58a4"} Jul 10 13:26:47.466083 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:47.466026 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed62a749-d965-432a-b2c7-d4ad2e42a8f4-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mztld\" (UID: \"ed62a749-d965-432a-b2c7-d4ad2e42a8f4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mztld" Jul 10 13:26:47.466568 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:47.466128 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d13a73e0-bd87-4a7b-b968-34290f15f6f0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lbcbj\" (UID: \"d13a73e0-bd87-4a7b-b968-34290f15f6f0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbcbj" Jul 10 13:26:47.466568 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:47.466217 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 13:26:47.466568 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:47.466259 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 13:26:47.466568 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:47.466305 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed62a749-d965-432a-b2c7-d4ad2e42a8f4-samples-operator-tls podName:ed62a749-d965-432a-b2c7-d4ad2e42a8f4 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:51.466283562 +0000 UTC m=+64.705615467 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ed62a749-d965-432a-b2c7-d4ad2e42a8f4-samples-operator-tls") pod "cluster-samples-operator-65db858894-mztld" (UID: "ed62a749-d965-432a-b2c7-d4ad2e42a8f4") : secret "samples-operator-tls" not found Jul 10 13:26:47.466568 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:47.466326 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d13a73e0-bd87-4a7b-b968-34290f15f6f0-cluster-monitoring-operator-tls podName:d13a73e0-bd87-4a7b-b968-34290f15f6f0 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:51.46631591 +0000 UTC m=+64.705647813 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d13a73e0-bd87-4a7b-b968-34290f15f6f0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lbcbj" (UID: "d13a73e0-bd87-4a7b-b968-34290f15f6f0") : secret "cluster-monitoring-operator-tls" not found Jul 10 13:26:47.567063 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:47.567030 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-metrics-certs\") pod \"router-default-7bcdf5f866-j6l87\" (UID: \"e3cb5d91-edc8-4b74-bcb4-464cad827f6f\") " pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:26:47.567214 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:47.567095 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-service-ca-bundle\") pod \"router-default-7bcdf5f866-j6l87\" (UID: \"e3cb5d91-edc8-4b74-bcb4-464cad827f6f\") " pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:26:47.567214 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:47.567205 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 13:26:47.567342 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:47.567257 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-metrics-certs podName:e3cb5d91-edc8-4b74-bcb4-464cad827f6f nodeName:}" failed. No retries permitted until 2026-07-10 13:26:51.567240162 +0000 UTC m=+64.806572072 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-metrics-certs") pod "router-default-7bcdf5f866-j6l87" (UID: "e3cb5d91-edc8-4b74-bcb4-464cad827f6f") : secret "router-metrics-certs-default" not found Jul 10 13:26:47.567342 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:47.567292 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-service-ca-bundle podName:e3cb5d91-edc8-4b74-bcb4-464cad827f6f nodeName:}" failed. No retries permitted until 2026-07-10 13:26:51.567272548 +0000 UTC m=+64.806604453 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-service-ca-bundle") pod "router-default-7bcdf5f866-j6l87" (UID: "e3cb5d91-edc8-4b74-bcb4-464cad827f6f") : configmap references non-existent config key: service-ca.crt Jul 10 13:26:49.551880 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:49.551849 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rpg2g" Jul 10 13:26:50.643628 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:50.643575 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-l4859" event={"ID":"5702eeb0-bcc8-4557-87a8-f25f6e3f46cf","Type":"ContainerStarted","Data":"9bf147e7f76e80f8d9ed3bf2fbdd8019754ce5e272c467d7710572c3da38d991"} Jul 10 13:26:50.645226 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:50.645190 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgxgh" event={"ID":"0676f234-f4cc-452c-9b61-71cf7efdb704","Type":"ContainerStarted","Data":"4fd5621ec39c8ef16623407ec7e1b122b01f8cea96888e3c32c42e45e4a02646"} Jul 10 13:26:50.646700 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:50.646653 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-28dd7" event={"ID":"f479ff22-0215-45f4-aad7-be153e8abb4b","Type":"ContainerStarted","Data":"16b0550ab3b291fcdd61e084c661bdc35d6e6be0bf5796832da208277247659a"} Jul 10 13:26:50.648375 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:50.648347 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cz854" event={"ID":"392e2bbd-a9f3-4032-a0dc-c59f5d4133e0","Type":"ContainerStarted","Data":"3dbf450b1ae950987594c9b96fd0a8b00c3c8e5ec034865c1fb4d56f175ab641"} Jul 10 13:26:50.649926 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:50.649905 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-v5lz8" event={"ID":"ff837081-8b7e-485d-93be-cc8c19a65840","Type":"ContainerStarted","Data":"74980878c6f93cd50d230e5096eeb89bed4a66b4824d1cf0a5b96e30ba169052"} Jul 10 13:26:50.651513 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:50.651495 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hrq6g_63c89ec5-2de9-4855-8fe8-57baaa8e0588/console-operator/0.log" Jul 10 13:26:50.651605 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:50.651530 2575 generic.go:356] "Generic (PLEG): container finished" podID="63c89ec5-2de9-4855-8fe8-57baaa8e0588" containerID="f7ae80159193d8c017f8bfa8d7c244716230dd54d3c7c853caae6193ae97d1b7" exitCode=255 Jul 10 13:26:50.651605 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:50.651557 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-hrq6g" event={"ID":"63c89ec5-2de9-4855-8fe8-57baaa8e0588","Type":"ContainerDied","Data":"f7ae80159193d8c017f8bfa8d7c244716230dd54d3c7c853caae6193ae97d1b7"} Jul 10 13:26:50.651813 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:50.651798 2575 scope.go:117] "RemoveContainer" containerID="f7ae80159193d8c017f8bfa8d7c244716230dd54d3c7c853caae6193ae97d1b7" Jul 10 13:26:50.663819 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:50.663780 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-l4859" podStartSLOduration=2.077771549 podStartE2EDuration="7.663768445s" totalImagesPullingTime="5.585996896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:26:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:26:50.662350387 +0000 UTC m=+63.901682310" watchObservedRunningTime="2026-07-10 13:26:50.663768445 +0000 UTC m=+63.903100344" Jul 10 13:26:50.678723 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:50.678599 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgxgh" podStartSLOduration=2.079153118 podStartE2EDuration="7.678582733s" totalImagesPullingTime="5.599429615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:26:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:26:50.677053166 +0000 UTC m=+63.916385088" watchObservedRunningTime="2026-07-10 13:26:50.678582733 +0000 UTC m=+63.917914654" Jul 10 13:26:50.708435 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:50.708381 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cz854" podStartSLOduration=2.65851068 podStartE2EDuration="7.708361897s" totalImagesPullingTime="5.049851217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:26:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:26:50.707123133 +0000 UTC m=+63.946455055" watchObservedRunningTime="2026-07-10 13:26:50.708361897 +0000 UTC m=+63.947693818" Jul 10 13:26:50.726133 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:50.724817 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-28dd7" podStartSLOduration=2.114992332 podStartE2EDuration="7.724798244s" totalImagesPullingTime="5.609805912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:26:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:26:50.72432233 +0000 UTC m=+63.963654252" watchObservedRunningTime="2026-07-10 13:26:50.724798244 +0000 UTC m=+63.964130166" Jul 10 13:26:50.743353 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:50.743310 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-v5lz8" podStartSLOduration=2.6505264029999998 podStartE2EDuration="7.743296324s" totalImagesPullingTime="5.092769921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:26:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:26:50.741269415 +0000 UTC m=+63.980601336" watchObservedRunningTime="2026-07-10 13:26:50.743296324 +0000 UTC m=+63.982628244" Jul 10 13:26:51.504344 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.504299 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed62a749-d965-432a-b2c7-d4ad2e42a8f4-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mztld\" (UID: \"ed62a749-d965-432a-b2c7-d4ad2e42a8f4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mztld" Jul 10 13:26:51.504576 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.504413 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d13a73e0-bd87-4a7b-b968-34290f15f6f0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lbcbj\" (UID: \"d13a73e0-bd87-4a7b-b968-34290f15f6f0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbcbj" Jul 10 13:26:51.504675 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:51.504587 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 13:26:51.504737 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:51.504688 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d13a73e0-bd87-4a7b-b968-34290f15f6f0-cluster-monitoring-operator-tls podName:d13a73e0-bd87-4a7b-b968-34290f15f6f0 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:59.504666087 +0000 UTC m=+72.743997994 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d13a73e0-bd87-4a7b-b968-34290f15f6f0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lbcbj" (UID: "d13a73e0-bd87-4a7b-b968-34290f15f6f0") : secret "cluster-monitoring-operator-tls" not found Jul 10 13:26:51.505096 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:51.505076 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 13:26:51.505385 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:51.505367 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed62a749-d965-432a-b2c7-d4ad2e42a8f4-samples-operator-tls podName:ed62a749-d965-432a-b2c7-d4ad2e42a8f4 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:59.505349653 +0000 UTC m=+72.744681554 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ed62a749-d965-432a-b2c7-d4ad2e42a8f4-samples-operator-tls") pod "cluster-samples-operator-65db858894-mztld" (UID: "ed62a749-d965-432a-b2c7-d4ad2e42a8f4") : secret "samples-operator-tls" not found Jul 10 13:26:51.526073 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.526039 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ttzgw"] Jul 10 13:26:51.532917 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.532806 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ttzgw" Jul 10 13:26:51.535443 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.535418 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wjzj9\"" Jul 10 13:26:51.535443 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.535433 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 10 13:26:51.535761 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.535740 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 10 13:26:51.543098 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.543067 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ttzgw"] Jul 10 13:26:51.605361 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.605330 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c5d1aad-4935-4a95-8813-2aedd8dc9022-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ttzgw\" (UID: \"0c5d1aad-4935-4a95-8813-2aedd8dc9022\") " pod="openshift-insights/insights-runtime-extractor-ttzgw" Jul 10 13:26:51.605537 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.605420 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-metrics-certs\") pod \"router-default-7bcdf5f866-j6l87\" (UID: \"e3cb5d91-edc8-4b74-bcb4-464cad827f6f\") " pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:26:51.605537 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.605452 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-service-ca-bundle\") pod \"router-default-7bcdf5f866-j6l87\" (UID: \"e3cb5d91-edc8-4b74-bcb4-464cad827f6f\") " pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:26:51.605537 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.605470 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77ktv\" (UniqueName: \"kubernetes.io/projected/0c5d1aad-4935-4a95-8813-2aedd8dc9022-kube-api-access-77ktv\") pod \"insights-runtime-extractor-ttzgw\" (UID: \"0c5d1aad-4935-4a95-8813-2aedd8dc9022\") " pod="openshift-insights/insights-runtime-extractor-ttzgw" Jul 10 13:26:51.605722 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:51.605583 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 13:26:51.605722 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:51.605596 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-service-ca-bundle podName:e3cb5d91-edc8-4b74-bcb4-464cad827f6f nodeName:}" failed. No retries permitted until 2026-07-10 13:26:59.605572851 +0000 UTC m=+72.844904763 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-service-ca-bundle") pod "router-default-7bcdf5f866-j6l87" (UID: "e3cb5d91-edc8-4b74-bcb4-464cad827f6f") : configmap references non-existent config key: service-ca.crt Jul 10 13:26:51.605722 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.605673 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0c5d1aad-4935-4a95-8813-2aedd8dc9022-crio-socket\") pod \"insights-runtime-extractor-ttzgw\" (UID: \"0c5d1aad-4935-4a95-8813-2aedd8dc9022\") " pod="openshift-insights/insights-runtime-extractor-ttzgw" Jul 10 13:26:51.605722 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.605693 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c5d1aad-4935-4a95-8813-2aedd8dc9022-data-volume\") pod \"insights-runtime-extractor-ttzgw\" (UID: \"0c5d1aad-4935-4a95-8813-2aedd8dc9022\") " pod="openshift-insights/insights-runtime-extractor-ttzgw" Jul 10 13:26:51.605922 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:51.605745 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-metrics-certs podName:e3cb5d91-edc8-4b74-bcb4-464cad827f6f nodeName:}" failed. No retries permitted until 2026-07-10 13:26:59.605724378 +0000 UTC m=+72.845056289 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-metrics-certs") pod "router-default-7bcdf5f866-j6l87" (UID: "e3cb5d91-edc8-4b74-bcb4-464cad827f6f") : secret "router-metrics-certs-default" not found Jul 10 13:26:51.605922 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.605803 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c5d1aad-4935-4a95-8813-2aedd8dc9022-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttzgw\" (UID: \"0c5d1aad-4935-4a95-8813-2aedd8dc9022\") " pod="openshift-insights/insights-runtime-extractor-ttzgw" Jul 10 13:26:51.632290 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.632248 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-65skc"] Jul 10 13:26:51.635303 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.635287 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-65skc" Jul 10 13:26:51.638945 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.638924 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 10 13:26:51.638945 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.638924 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 10 13:26:51.639133 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.638993 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-sb5hl\"" Jul 10 13:26:51.648864 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.648842 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-65skc"] Jul 10 13:26:51.655937 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.655920 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hrq6g_63c89ec5-2de9-4855-8fe8-57baaa8e0588/console-operator/1.log" Jul 10 13:26:51.656368 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.656354 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hrq6g_63c89ec5-2de9-4855-8fe8-57baaa8e0588/console-operator/0.log" Jul 10 13:26:51.656431 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.656390 2575 generic.go:356] "Generic (PLEG): container finished" podID="63c89ec5-2de9-4855-8fe8-57baaa8e0588" containerID="770cd49a6f5450d5a420a15d8cc91ff5c11343d16e5057dbddadc53fa5c67e10" exitCode=255 Jul 10 13:26:51.656503 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.656482 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-hrq6g" event={"ID":"63c89ec5-2de9-4855-8fe8-57baaa8e0588","Type":"ContainerDied","Data":"770cd49a6f5450d5a420a15d8cc91ff5c11343d16e5057dbddadc53fa5c67e10"} Jul 10 13:26:51.656544 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.656529 2575 scope.go:117] "RemoveContainer" containerID="f7ae80159193d8c017f8bfa8d7c244716230dd54d3c7c853caae6193ae97d1b7" Jul 10 13:26:51.656679 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.656659 2575 scope.go:117] "RemoveContainer" containerID="770cd49a6f5450d5a420a15d8cc91ff5c11343d16e5057dbddadc53fa5c67e10" Jul 10 13:26:51.656881 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:51.656853 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-hrq6g_openshift-console-operator(63c89ec5-2de9-4855-8fe8-57baaa8e0588)\"" pod="openshift-console-operator/console-operator-7866497494-hrq6g" podUID="63c89ec5-2de9-4855-8fe8-57baaa8e0588" Jul 10 13:26:51.706454 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.706431 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfx9t\" (UniqueName: \"kubernetes.io/projected/a62dfe52-0c00-40b0-86c2-aec4e3135fda-kube-api-access-zfx9t\") pod \"migrator-7f59b54f6c-65skc\" (UID: \"a62dfe52-0c00-40b0-86c2-aec4e3135fda\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-65skc" Jul 10 13:26:51.706681 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.706608 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77ktv\" (UniqueName: \"kubernetes.io/projected/0c5d1aad-4935-4a95-8813-2aedd8dc9022-kube-api-access-77ktv\") pod \"insights-runtime-extractor-ttzgw\" (UID: \"0c5d1aad-4935-4a95-8813-2aedd8dc9022\") " pod="openshift-insights/insights-runtime-extractor-ttzgw" Jul 10 13:26:51.706809 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.706776 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0c5d1aad-4935-4a95-8813-2aedd8dc9022-crio-socket\") pod \"insights-runtime-extractor-ttzgw\" (UID: \"0c5d1aad-4935-4a95-8813-2aedd8dc9022\") " pod="openshift-insights/insights-runtime-extractor-ttzgw" Jul 10 13:26:51.706882 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.706855 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c5d1aad-4935-4a95-8813-2aedd8dc9022-data-volume\") pod \"insights-runtime-extractor-ttzgw\" (UID: \"0c5d1aad-4935-4a95-8813-2aedd8dc9022\") " pod="openshift-insights/insights-runtime-extractor-ttzgw" Jul 10 13:26:51.706936 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.706901 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0c5d1aad-4935-4a95-8813-2aedd8dc9022-crio-socket\") pod \"insights-runtime-extractor-ttzgw\" (UID: \"0c5d1aad-4935-4a95-8813-2aedd8dc9022\") " pod="openshift-insights/insights-runtime-extractor-ttzgw" Jul 10 13:26:51.707038 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.707017 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c5d1aad-4935-4a95-8813-2aedd8dc9022-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttzgw\" (UID: \"0c5d1aad-4935-4a95-8813-2aedd8dc9022\") " pod="openshift-insights/insights-runtime-extractor-ttzgw" Jul 10 13:26:51.707120 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.707110 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c5d1aad-4935-4a95-8813-2aedd8dc9022-data-volume\") pod \"insights-runtime-extractor-ttzgw\" (UID: \"0c5d1aad-4935-4a95-8813-2aedd8dc9022\") " pod="openshift-insights/insights-runtime-extractor-ttzgw" Jul 10 13:26:51.707178 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:51.707145 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 13:26:51.707234 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:51.707219 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c5d1aad-4935-4a95-8813-2aedd8dc9022-insights-runtime-extractor-tls podName:0c5d1aad-4935-4a95-8813-2aedd8dc9022 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:52.207199099 +0000 UTC m=+65.446531032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c5d1aad-4935-4a95-8813-2aedd8dc9022-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ttzgw" (UID: "0c5d1aad-4935-4a95-8813-2aedd8dc9022") : secret "insights-runtime-extractor-tls" not found Jul 10 13:26:51.707298 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.707278 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c5d1aad-4935-4a95-8813-2aedd8dc9022-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ttzgw\" (UID: \"0c5d1aad-4935-4a95-8813-2aedd8dc9022\") " pod="openshift-insights/insights-runtime-extractor-ttzgw" Jul 10 13:26:51.707369 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:51.707353 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 13:26:51.707423 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:51.707401 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c5d1aad-4935-4a95-8813-2aedd8dc9022-kube-rbac-proxy-cm podName:0c5d1aad-4935-4a95-8813-2aedd8dc9022 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:52.207387446 +0000 UTC m=+65.446719346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0c5d1aad-4935-4a95-8813-2aedd8dc9022-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ttzgw" (UID: "0c5d1aad-4935-4a95-8813-2aedd8dc9022") : configmap "kube-rbac-proxy" not found Jul 10 13:26:51.715598 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.715579 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77ktv\" (UniqueName: \"kubernetes.io/projected/0c5d1aad-4935-4a95-8813-2aedd8dc9022-kube-api-access-77ktv\") pod \"insights-runtime-extractor-ttzgw\" (UID: \"0c5d1aad-4935-4a95-8813-2aedd8dc9022\") " pod="openshift-insights/insights-runtime-extractor-ttzgw" Jul 10 13:26:51.808756 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.808682 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfx9t\" (UniqueName: \"kubernetes.io/projected/a62dfe52-0c00-40b0-86c2-aec4e3135fda-kube-api-access-zfx9t\") pod \"migrator-7f59b54f6c-65skc\" (UID: \"a62dfe52-0c00-40b0-86c2-aec4e3135fda\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-65skc" Jul 10 13:26:51.817855 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.817827 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfx9t\" (UniqueName: \"kubernetes.io/projected/a62dfe52-0c00-40b0-86c2-aec4e3135fda-kube-api-access-zfx9t\") pod \"migrator-7f59b54f6c-65skc\" (UID: \"a62dfe52-0c00-40b0-86c2-aec4e3135fda\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-65skc" Jul 10 13:26:51.944371 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:51.944338 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-65skc" Jul 10 13:26:52.067098 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:52.067074 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-65skc"] Jul 10 13:26:52.069394 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:26:52.069358 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda62dfe52_0c00_40b0_86c2_aec4e3135fda.slice/crio-20fddf75beead7d2a3507512f5b7714a8b415a182a338400511f4250981a7c32 WatchSource:0}: Error finding container 20fddf75beead7d2a3507512f5b7714a8b415a182a338400511f4250981a7c32: Status 404 returned error can't find the container with id 20fddf75beead7d2a3507512f5b7714a8b415a182a338400511f4250981a7c32 Jul 10 13:26:52.211806 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:52.211771 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c5d1aad-4935-4a95-8813-2aedd8dc9022-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttzgw\" (UID: \"0c5d1aad-4935-4a95-8813-2aedd8dc9022\") " pod="openshift-insights/insights-runtime-extractor-ttzgw" Jul 10 13:26:52.211973 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:52.211816 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c5d1aad-4935-4a95-8813-2aedd8dc9022-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ttzgw\" (UID: \"0c5d1aad-4935-4a95-8813-2aedd8dc9022\") " pod="openshift-insights/insights-runtime-extractor-ttzgw" Jul 10 13:26:52.211973 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:52.211886 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 13:26:52.211973 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:52.211915 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 13:26:52.211973 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:52.211937 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c5d1aad-4935-4a95-8813-2aedd8dc9022-kube-rbac-proxy-cm podName:0c5d1aad-4935-4a95-8813-2aedd8dc9022 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:53.211923204 +0000 UTC m=+66.451255103 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0c5d1aad-4935-4a95-8813-2aedd8dc9022-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ttzgw" (UID: "0c5d1aad-4935-4a95-8813-2aedd8dc9022") : configmap "kube-rbac-proxy" not found Jul 10 13:26:52.211973 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:52.211966 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c5d1aad-4935-4a95-8813-2aedd8dc9022-insights-runtime-extractor-tls podName:0c5d1aad-4935-4a95-8813-2aedd8dc9022 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:53.211953503 +0000 UTC m=+66.451285402 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c5d1aad-4935-4a95-8813-2aedd8dc9022-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ttzgw" (UID: "0c5d1aad-4935-4a95-8813-2aedd8dc9022") : secret "insights-runtime-extractor-tls" not found Jul 10 13:26:52.515947 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:52.515921 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9rwhx_a3c237cf-7931-4c12-868e-351a7abcdd91/dns-node-resolver/0.log" Jul 10 13:26:52.662244 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:52.662219 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hrq6g_63c89ec5-2de9-4855-8fe8-57baaa8e0588/console-operator/1.log" Jul 10 13:26:52.662711 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:52.662612 2575 scope.go:117] "RemoveContainer" containerID="770cd49a6f5450d5a420a15d8cc91ff5c11343d16e5057dbddadc53fa5c67e10" Jul 10 13:26:52.662861 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:52.662834 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-hrq6g_openshift-console-operator(63c89ec5-2de9-4855-8fe8-57baaa8e0588)\"" pod="openshift-console-operator/console-operator-7866497494-hrq6g" podUID="63c89ec5-2de9-4855-8fe8-57baaa8e0588" Jul 10 13:26:52.663699 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:52.663667 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-65skc" event={"ID":"a62dfe52-0c00-40b0-86c2-aec4e3135fda","Type":"ContainerStarted","Data":"20fddf75beead7d2a3507512f5b7714a8b415a182a338400511f4250981a7c32"} Jul 10 13:26:53.019747 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:53.019710 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b8019d7-b55b-47d7-b875-c93668f52dfc-metrics-certs\") pod \"network-metrics-daemon-rbd82\" (UID: \"7b8019d7-b55b-47d7-b875-c93668f52dfc\") " pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:26:53.019944 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:53.019763 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/633592e9-f523-4eb4-af61-f1da4eb57acc-original-pull-secret\") pod \"global-pull-secret-syncer-hq6lx\" (UID: \"633592e9-f523-4eb4-af61-f1da4eb57acc\") " pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:26:53.021797 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:53.021782 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 13:26:53.021858 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:53.021822 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 13:26:53.030246 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:53.030228 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 10 13:26:53.030335 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:53.030284 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b8019d7-b55b-47d7-b875-c93668f52dfc-metrics-certs podName:7b8019d7-b55b-47d7-b875-c93668f52dfc nodeName:}" failed. No retries permitted until 2026-07-10 13:27:57.030267103 +0000 UTC m=+130.269599002 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b8019d7-b55b-47d7-b875-c93668f52dfc-metrics-certs") pod "network-metrics-daemon-rbd82" (UID: "7b8019d7-b55b-47d7-b875-c93668f52dfc") : secret "metrics-daemon-secret" not found Jul 10 13:26:53.032211 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:53.032195 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/633592e9-f523-4eb4-af61-f1da4eb57acc-original-pull-secret\") pod \"global-pull-secret-syncer-hq6lx\" (UID: \"633592e9-f523-4eb4-af61-f1da4eb57acc\") " pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:26:53.120948 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:53.120917 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxsf6\" (UniqueName: \"kubernetes.io/projected/37bbeacf-a902-4e2a-91f0-df30789f83ec-kube-api-access-jxsf6\") pod \"network-check-target-494zp\" (UID: \"37bbeacf-a902-4e2a-91f0-df30789f83ec\") " pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:26:53.123987 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:53.123956 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxsf6\" (UniqueName: \"kubernetes.io/projected/37bbeacf-a902-4e2a-91f0-df30789f83ec-kube-api-access-jxsf6\") pod \"network-check-target-494zp\" (UID: \"37bbeacf-a902-4e2a-91f0-df30789f83ec\") " pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:26:53.145574 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:53.145545 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lkjb8\"" Jul 10 13:26:53.153450 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:53.153429 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hq6lx" Jul 10 13:26:53.154548 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:53.154528 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:26:53.223257 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:53.222982 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c5d1aad-4935-4a95-8813-2aedd8dc9022-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttzgw\" (UID: \"0c5d1aad-4935-4a95-8813-2aedd8dc9022\") " pod="openshift-insights/insights-runtime-extractor-ttzgw" Jul 10 13:26:53.223257 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:53.223051 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c5d1aad-4935-4a95-8813-2aedd8dc9022-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ttzgw\" (UID: \"0c5d1aad-4935-4a95-8813-2aedd8dc9022\") " pod="openshift-insights/insights-runtime-extractor-ttzgw" Jul 10 13:26:53.223257 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:53.223211 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 13:26:53.223257 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:53.223252 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 13:26:53.223544 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:53.223275 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c5d1aad-4935-4a95-8813-2aedd8dc9022-insights-runtime-extractor-tls podName:0c5d1aad-4935-4a95-8813-2aedd8dc9022 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:55.223256559 +0000 UTC m=+68.462588477 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c5d1aad-4935-4a95-8813-2aedd8dc9022-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ttzgw" (UID: "0c5d1aad-4935-4a95-8813-2aedd8dc9022") : secret "insights-runtime-extractor-tls" not found Jul 10 13:26:53.223544 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:53.223293 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c5d1aad-4935-4a95-8813-2aedd8dc9022-kube-rbac-proxy-cm podName:0c5d1aad-4935-4a95-8813-2aedd8dc9022 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:55.223284544 +0000 UTC m=+68.462616453 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0c5d1aad-4935-4a95-8813-2aedd8dc9022-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ttzgw" (UID: "0c5d1aad-4935-4a95-8813-2aedd8dc9022") : configmap "kube-rbac-proxy" not found Jul 10 13:26:53.299364 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:53.299302 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-494zp"] Jul 10 13:26:53.314252 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:53.314230 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hq6lx"] Jul 10 13:26:53.464214 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:26:53.464183 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37bbeacf_a902_4e2a_91f0_df30789f83ec.slice/crio-678ce5c6c2318b55adf94e788a5e91927646e675c718f07c1cf3f52547e9e51b WatchSource:0}: Error finding container 678ce5c6c2318b55adf94e788a5e91927646e675c718f07c1cf3f52547e9e51b: Status 404 returned error can't find the container with id 678ce5c6c2318b55adf94e788a5e91927646e675c718f07c1cf3f52547e9e51b Jul 10 13:26:53.465046 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:26:53.465019 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod633592e9_f523_4eb4_af61_f1da4eb57acc.slice/crio-3d464d5e7211ba8f8cd04b56eab3e72e01c0e074124b386c48bfd0855bfdc1b7 WatchSource:0}: Error finding container 3d464d5e7211ba8f8cd04b56eab3e72e01c0e074124b386c48bfd0855bfdc1b7: Status 404 returned error can't find the container with id 3d464d5e7211ba8f8cd04b56eab3e72e01c0e074124b386c48bfd0855bfdc1b7 Jul 10 13:26:53.516802 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:53.516588 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bvlcd_7c327241-7b52-4e48-83dc-bb9629af3edc/node-ca/0.log" Jul 10 13:26:53.668444 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:53.668411 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-494zp" event={"ID":"37bbeacf-a902-4e2a-91f0-df30789f83ec","Type":"ContainerStarted","Data":"bf2f3e4e6fce3ffa996af96efa8ab19944c8de7cc118cba6ef8d569325c76b18"} Jul 10 13:26:53.668849 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:53.668486 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-494zp" event={"ID":"37bbeacf-a902-4e2a-91f0-df30789f83ec","Type":"ContainerStarted","Data":"678ce5c6c2318b55adf94e788a5e91927646e675c718f07c1cf3f52547e9e51b"} Jul 10 13:26:53.668849 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:53.668545 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:26:53.669677 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:53.669656 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hq6lx" event={"ID":"633592e9-f523-4eb4-af61-f1da4eb57acc","Type":"ContainerStarted","Data":"3d464d5e7211ba8f8cd04b56eab3e72e01c0e074124b386c48bfd0855bfdc1b7"} Jul 10 13:26:53.671152 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:53.671133 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-65skc" event={"ID":"a62dfe52-0c00-40b0-86c2-aec4e3135fda","Type":"ContainerStarted","Data":"e5db8db12d0155535390adbdb5f37ac33d2478115ea9f0c63b212e9f1fc33ae2"} Jul 10 13:26:53.671234 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:53.671166 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-65skc" event={"ID":"a62dfe52-0c00-40b0-86c2-aec4e3135fda","Type":"ContainerStarted","Data":"acd6d5ce864705bda785ff8dada7e93e93e27aeefacc8144e0dae7037ff00360"} Jul 10 13:26:53.699997 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:53.699952 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-65skc" podStartSLOduration=1.261221147 podStartE2EDuration="2.699940683s" totalImagesPullingTime="1.438719536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:26:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:26:53.699152137 +0000 UTC m=+66.938484058" watchObservedRunningTime="2026-07-10 13:26:53.699940683 +0000 UTC m=+66.939272604" Jul 10 13:26:53.700467 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:53.700441 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-494zp" podStartSLOduration=65.700433639 podStartE2EDuration="1m5.700433639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:25:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:26:53.684791279 +0000 UTC m=+66.924123199" watchObservedRunningTime="2026-07-10 13:26:53.700433639 +0000 UTC m=+66.939765559" Jul 10 13:26:53.929712 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:53.929677 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-registry-tls\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:26:53.929860 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:53.929814 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/051b95cc-7289-4c0c-aa25-98fe724192d6-metrics-tls\") pod \"dns-default-gjkg6\" (UID: \"051b95cc-7289-4c0c-aa25-98fe724192d6\") " pod="openshift-dns/dns-default-gjkg6" Jul 10 13:26:53.929860 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:53.929825 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 13:26:53.929860 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:53.929847 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-849d455874-q76sx: secret "image-registry-tls" not found Jul 10 13:26:53.929978 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:53.929901 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 13:26:53.929978 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:53.929914 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-registry-tls podName:816669aa-a543-4738-9c33-af588b14e4b1 nodeName:}" failed. No retries permitted until 2026-07-10 13:27:25.929897317 +0000 UTC m=+99.169229215 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-registry-tls") pod "image-registry-849d455874-q76sx" (UID: "816669aa-a543-4738-9c33-af588b14e4b1") : secret "image-registry-tls" not found Jul 10 13:26:53.929978 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:53.929940 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/051b95cc-7289-4c0c-aa25-98fe724192d6-metrics-tls podName:051b95cc-7289-4c0c-aa25-98fe724192d6 nodeName:}" failed. No retries permitted until 2026-07-10 13:27:25.929929844 +0000 UTC m=+99.169261743 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/051b95cc-7289-4c0c-aa25-98fe724192d6-metrics-tls") pod "dns-default-gjkg6" (UID: "051b95cc-7289-4c0c-aa25-98fe724192d6") : secret "dns-default-metrics-tls" not found Jul 10 13:26:54.070221 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:54.070180 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-hrq6g" Jul 10 13:26:54.070361 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:54.070242 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-hrq6g" Jul 10 13:26:54.070568 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:54.070556 2575 scope.go:117] "RemoveContainer" containerID="770cd49a6f5450d5a420a15d8cc91ff5c11343d16e5057dbddadc53fa5c67e10" Jul 10 13:26:54.070736 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:54.070719 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-hrq6g_openshift-console-operator(63c89ec5-2de9-4855-8fe8-57baaa8e0588)\"" pod="openshift-console-operator/console-operator-7866497494-hrq6g" podUID="63c89ec5-2de9-4855-8fe8-57baaa8e0588" Jul 10 13:26:54.317909 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:54.317814 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xzm2l_35afbd6c-d5c1-4deb-929d-71dbf71b6d0d/serve-healthcheck-canary/0.log" Jul 10 13:26:55.240956 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:55.240922 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c5d1aad-4935-4a95-8813-2aedd8dc9022-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttzgw\" (UID: \"0c5d1aad-4935-4a95-8813-2aedd8dc9022\") " pod="openshift-insights/insights-runtime-extractor-ttzgw" Jul 10 13:26:55.241322 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:55.240973 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c5d1aad-4935-4a95-8813-2aedd8dc9022-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ttzgw\" (UID: \"0c5d1aad-4935-4a95-8813-2aedd8dc9022\") " pod="openshift-insights/insights-runtime-extractor-ttzgw" Jul 10 13:26:55.241322 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:55.241082 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 13:26:55.241322 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:55.241113 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 13:26:55.241322 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:55.241151 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c5d1aad-4935-4a95-8813-2aedd8dc9022-insights-runtime-extractor-tls podName:0c5d1aad-4935-4a95-8813-2aedd8dc9022 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:59.241135383 +0000 UTC m=+72.480467284 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c5d1aad-4935-4a95-8813-2aedd8dc9022-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ttzgw" (UID: "0c5d1aad-4935-4a95-8813-2aedd8dc9022") : secret "insights-runtime-extractor-tls" not found Jul 10 13:26:55.241322 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:55.241168 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c5d1aad-4935-4a95-8813-2aedd8dc9022-kube-rbac-proxy-cm podName:0c5d1aad-4935-4a95-8813-2aedd8dc9022 nodeName:}" failed. No retries permitted until 2026-07-10 13:26:59.241161424 +0000 UTC m=+72.480493323 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0c5d1aad-4935-4a95-8813-2aedd8dc9022-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ttzgw" (UID: "0c5d1aad-4935-4a95-8813-2aedd8dc9022") : configmap "kube-rbac-proxy" not found Jul 10 13:26:59.276802 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:59.276761 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c5d1aad-4935-4a95-8813-2aedd8dc9022-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ttzgw\" (UID: \"0c5d1aad-4935-4a95-8813-2aedd8dc9022\") " pod="openshift-insights/insights-runtime-extractor-ttzgw" Jul 10 13:26:59.277172 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:59.276901 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 13:26:59.277172 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:59.276919 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c5d1aad-4935-4a95-8813-2aedd8dc9022-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttzgw\" (UID: \"0c5d1aad-4935-4a95-8813-2aedd8dc9022\") " pod="openshift-insights/insights-runtime-extractor-ttzgw" Jul 10 13:26:59.277172 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:59.276969 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c5d1aad-4935-4a95-8813-2aedd8dc9022-kube-rbac-proxy-cm podName:0c5d1aad-4935-4a95-8813-2aedd8dc9022 nodeName:}" failed. No retries permitted until 2026-07-10 13:27:07.276949065 +0000 UTC m=+80.516280966 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0c5d1aad-4935-4a95-8813-2aedd8dc9022-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ttzgw" (UID: "0c5d1aad-4935-4a95-8813-2aedd8dc9022") : configmap "kube-rbac-proxy" not found Jul 10 13:26:59.277172 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:59.277033 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 13:26:59.277172 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:59.277077 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c5d1aad-4935-4a95-8813-2aedd8dc9022-insights-runtime-extractor-tls podName:0c5d1aad-4935-4a95-8813-2aedd8dc9022 nodeName:}" failed. No retries permitted until 2026-07-10 13:27:07.277064845 +0000 UTC m=+80.516396761 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c5d1aad-4935-4a95-8813-2aedd8dc9022-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ttzgw" (UID: "0c5d1aad-4935-4a95-8813-2aedd8dc9022") : secret "insights-runtime-extractor-tls" not found Jul 10 13:26:59.578218 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:59.578126 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed62a749-d965-432a-b2c7-d4ad2e42a8f4-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mztld\" (UID: \"ed62a749-d965-432a-b2c7-d4ad2e42a8f4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mztld" Jul 10 13:26:59.578453 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:59.578228 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d13a73e0-bd87-4a7b-b968-34290f15f6f0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lbcbj\" (UID: \"d13a73e0-bd87-4a7b-b968-34290f15f6f0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbcbj" Jul 10 13:26:59.578453 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:59.578263 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 13:26:59.578453 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:59.578321 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed62a749-d965-432a-b2c7-d4ad2e42a8f4-samples-operator-tls podName:ed62a749-d965-432a-b2c7-d4ad2e42a8f4 nodeName:}" failed. No retries permitted until 2026-07-10 13:27:15.578304274 +0000 UTC m=+88.817636174 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ed62a749-d965-432a-b2c7-d4ad2e42a8f4-samples-operator-tls") pod "cluster-samples-operator-65db858894-mztld" (UID: "ed62a749-d965-432a-b2c7-d4ad2e42a8f4") : secret "samples-operator-tls" not found Jul 10 13:26:59.578453 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:59.578366 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 13:26:59.578453 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:59.578417 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d13a73e0-bd87-4a7b-b968-34290f15f6f0-cluster-monitoring-operator-tls podName:d13a73e0-bd87-4a7b-b968-34290f15f6f0 nodeName:}" failed. No retries permitted until 2026-07-10 13:27:15.57840473 +0000 UTC m=+88.817736629 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d13a73e0-bd87-4a7b-b968-34290f15f6f0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-lbcbj" (UID: "d13a73e0-bd87-4a7b-b968-34290f15f6f0") : secret "cluster-monitoring-operator-tls" not found Jul 10 13:26:59.678933 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:59.678902 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-metrics-certs\") pod \"router-default-7bcdf5f866-j6l87\" (UID: \"e3cb5d91-edc8-4b74-bcb4-464cad827f6f\") " pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:26:59.679050 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:59.678945 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-service-ca-bundle\") pod \"router-default-7bcdf5f866-j6l87\" (UID: \"e3cb5d91-edc8-4b74-bcb4-464cad827f6f\") " pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:26:59.679050 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:59.679024 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 13:26:59.679050 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:59.679037 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-service-ca-bundle podName:e3cb5d91-edc8-4b74-bcb4-464cad827f6f nodeName:}" failed. No retries permitted until 2026-07-10 13:27:15.6790269 +0000 UTC m=+88.918358799 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-service-ca-bundle") pod "router-default-7bcdf5f866-j6l87" (UID: "e3cb5d91-edc8-4b74-bcb4-464cad827f6f") : configmap references non-existent config key: service-ca.crt Jul 10 13:26:59.679162 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:26:59.679067 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-metrics-certs podName:e3cb5d91-edc8-4b74-bcb4-464cad827f6f nodeName:}" failed. No retries permitted until 2026-07-10 13:27:15.679056072 +0000 UTC m=+88.918387970 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-metrics-certs") pod "router-default-7bcdf5f866-j6l87" (UID: "e3cb5d91-edc8-4b74-bcb4-464cad827f6f") : secret "router-metrics-certs-default" not found Jul 10 13:26:59.691812 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:59.691786 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hq6lx" event={"ID":"633592e9-f523-4eb4-af61-f1da4eb57acc","Type":"ContainerStarted","Data":"f0ba56756591b130b6d1b3a63c5a8bf02987bf0d8421e5f07cabfddfed6195f4"} Jul 10 13:26:59.708426 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:26:59.708384 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hq6lx" podStartSLOduration=66.540066968 podStartE2EDuration="1m11.708371407s" totalImagesPullingTime="5.168304439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:26:59.707083001 +0000 UTC m=+72.946414913" watchObservedRunningTime="2026-07-10 13:26:59.708371407 +0000 UTC m=+72.947703327" Jul 10 13:27:05.233151 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:05.233113 2575 scope.go:117] "RemoveContainer" containerID="770cd49a6f5450d5a420a15d8cc91ff5c11343d16e5057dbddadc53fa5c67e10" Jul 10 13:27:05.712011 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:05.711981 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hrq6g_63c89ec5-2de9-4855-8fe8-57baaa8e0588/console-operator/1.log" Jul 10 13:27:05.712175 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:05.712086 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-hrq6g" event={"ID":"63c89ec5-2de9-4855-8fe8-57baaa8e0588","Type":"ContainerStarted","Data":"f49fbdfebb643fa3b83b3d13f57d99e8037991d0f49481a676f2d001f1e9af9f"} Jul 10 13:27:05.712369 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:05.712353 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-hrq6g" Jul 10 13:27:05.730381 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:05.730328 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-hrq6g" podStartSLOduration=17.173765471 podStartE2EDuration="22.730314321s" totalImagesPullingTime="5.55654885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:26:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:27:05.729900149 +0000 UTC m=+78.969232072" watchObservedRunningTime="2026-07-10 13:27:05.730314321 +0000 UTC m=+78.969646223" Jul 10 13:27:05.995649 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:05.995568 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-hrq6g" Jul 10 13:27:07.344303 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:07.344270 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c5d1aad-4935-4a95-8813-2aedd8dc9022-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttzgw\" (UID: \"0c5d1aad-4935-4a95-8813-2aedd8dc9022\") " pod="openshift-insights/insights-runtime-extractor-ttzgw" Jul 10 13:27:07.344731 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:07.344322 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c5d1aad-4935-4a95-8813-2aedd8dc9022-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ttzgw\" (UID: \"0c5d1aad-4935-4a95-8813-2aedd8dc9022\") " pod="openshift-insights/insights-runtime-extractor-ttzgw" Jul 10 13:27:07.344731 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:27:07.344412 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 13:27:07.344731 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:27:07.344469 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c5d1aad-4935-4a95-8813-2aedd8dc9022-insights-runtime-extractor-tls podName:0c5d1aad-4935-4a95-8813-2aedd8dc9022 nodeName:}" failed. No retries permitted until 2026-07-10 13:27:23.344454918 +0000 UTC m=+96.583786821 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0c5d1aad-4935-4a95-8813-2aedd8dc9022-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ttzgw" (UID: "0c5d1aad-4935-4a95-8813-2aedd8dc9022") : secret "insights-runtime-extractor-tls" not found Jul 10 13:27:07.344849 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:07.344835 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c5d1aad-4935-4a95-8813-2aedd8dc9022-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ttzgw\" (UID: \"0c5d1aad-4935-4a95-8813-2aedd8dc9022\") " pod="openshift-insights/insights-runtime-extractor-ttzgw" Jul 10 13:27:14.637571 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:14.637464 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-zdqc6"] Jul 10 13:27:14.641674 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:14.641631 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-zdqc6" Jul 10 13:27:14.643528 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:14.643507 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 10 13:27:14.643528 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:14.643517 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-vfnsq\"" Jul 10 13:27:14.643653 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:14.643517 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 10 13:27:14.656355 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:14.656335 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-zdqc6"] Jul 10 13:27:14.807232 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:14.807202 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz52h\" (UniqueName: \"kubernetes.io/projected/85d4fe9b-fcfe-4796-a866-fb0f316531e1-kube-api-access-cz52h\") pod \"downloads-68c9cbb497-zdqc6\" (UID: \"85d4fe9b-fcfe-4796-a866-fb0f316531e1\") " pod="openshift-console/downloads-68c9cbb497-zdqc6" Jul 10 13:27:14.908661 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:14.908568 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz52h\" (UniqueName: \"kubernetes.io/projected/85d4fe9b-fcfe-4796-a866-fb0f316531e1-kube-api-access-cz52h\") pod \"downloads-68c9cbb497-zdqc6\" (UID: \"85d4fe9b-fcfe-4796-a866-fb0f316531e1\") " pod="openshift-console/downloads-68c9cbb497-zdqc6" Jul 10 13:27:14.919850 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:14.919824 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz52h\" (UniqueName: \"kubernetes.io/projected/85d4fe9b-fcfe-4796-a866-fb0f316531e1-kube-api-access-cz52h\") pod \"downloads-68c9cbb497-zdqc6\" (UID: \"85d4fe9b-fcfe-4796-a866-fb0f316531e1\") " pod="openshift-console/downloads-68c9cbb497-zdqc6" Jul 10 13:27:14.950673 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:14.950629 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-zdqc6" Jul 10 13:27:15.076903 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:15.076864 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-zdqc6"] Jul 10 13:27:15.079613 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:27:15.079586 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85d4fe9b_fcfe_4796_a866_fb0f316531e1.slice/crio-d3daeaf96ed5bc1d74ffda0940fc45b0e0864257717c70f1d6e36b566e6ae34c WatchSource:0}: Error finding container d3daeaf96ed5bc1d74ffda0940fc45b0e0864257717c70f1d6e36b566e6ae34c: Status 404 returned error can't find the container with id d3daeaf96ed5bc1d74ffda0940fc45b0e0864257717c70f1d6e36b566e6ae34c Jul 10 13:27:15.624828 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:15.624793 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed62a749-d965-432a-b2c7-d4ad2e42a8f4-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mztld\" (UID: \"ed62a749-d965-432a-b2c7-d4ad2e42a8f4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mztld" Jul 10 13:27:15.624993 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:15.624949 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d13a73e0-bd87-4a7b-b968-34290f15f6f0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lbcbj\" (UID: \"d13a73e0-bd87-4a7b-b968-34290f15f6f0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbcbj" Jul 10 13:27:15.627673 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:15.627652 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d13a73e0-bd87-4a7b-b968-34290f15f6f0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-lbcbj\" (UID: \"d13a73e0-bd87-4a7b-b968-34290f15f6f0\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbcbj" Jul 10 13:27:15.627673 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:15.627657 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ed62a749-d965-432a-b2c7-d4ad2e42a8f4-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-mztld\" (UID: \"ed62a749-d965-432a-b2c7-d4ad2e42a8f4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mztld" Jul 10 13:27:15.726114 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:15.726082 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-metrics-certs\") pod \"router-default-7bcdf5f866-j6l87\" (UID: \"e3cb5d91-edc8-4b74-bcb4-464cad827f6f\") " pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:27:15.726490 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:15.726133 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-service-ca-bundle\") pod \"router-default-7bcdf5f866-j6l87\" (UID: \"e3cb5d91-edc8-4b74-bcb4-464cad827f6f\") " pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:27:15.726855 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:15.726830 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-service-ca-bundle\") pod \"router-default-7bcdf5f866-j6l87\" (UID: \"e3cb5d91-edc8-4b74-bcb4-464cad827f6f\") " pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:27:15.728737 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:15.728716 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3cb5d91-edc8-4b74-bcb4-464cad827f6f-metrics-certs\") pod \"router-default-7bcdf5f866-j6l87\" (UID: \"e3cb5d91-edc8-4b74-bcb4-464cad827f6f\") " pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:27:15.740481 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:15.740462 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wwrxm\"" Jul 10 13:27:15.744007 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:15.743983 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-zdqc6" event={"ID":"85d4fe9b-fcfe-4796-a866-fb0f316531e1","Type":"ContainerStarted","Data":"d3daeaf96ed5bc1d74ffda0940fc45b0e0864257717c70f1d6e36b566e6ae34c"} Jul 10 13:27:15.745241 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:15.745221 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jfmvw\"" Jul 10 13:27:15.749752 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:15.749734 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbcbj" Jul 10 13:27:15.753681 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:15.753663 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mztld" Jul 10 13:27:15.867249 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:15.867019 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-g5rt8\"" Jul 10 13:27:15.877356 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:15.876732 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:27:15.913259 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:15.913216 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbcbj"] Jul 10 13:27:15.915466 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:27:15.915422 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd13a73e0_bd87_4a7b_b968_34290f15f6f0.slice/crio-b329d7a396e9435f531bbf969a80ee2e9a8b5d99eea4878127dd6ad464bc404a WatchSource:0}: Error finding container b329d7a396e9435f531bbf969a80ee2e9a8b5d99eea4878127dd6ad464bc404a: Status 404 returned error can't find the container with id b329d7a396e9435f531bbf969a80ee2e9a8b5d99eea4878127dd6ad464bc404a Jul 10 13:27:15.957303 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:15.956876 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mztld"] Jul 10 13:27:16.039320 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:16.039293 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7bcdf5f866-j6l87"] Jul 10 13:27:16.042359 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:27:16.042304 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3cb5d91_edc8_4b74_bcb4_464cad827f6f.slice/crio-59b5850118977d77680a8b5e0e871bd3ded2a2abc2a93bd773ca7e49f76c299d WatchSource:0}: Error finding container 59b5850118977d77680a8b5e0e871bd3ded2a2abc2a93bd773ca7e49f76c299d: Status 404 returned error can't find the container with id 59b5850118977d77680a8b5e0e871bd3ded2a2abc2a93bd773ca7e49f76c299d Jul 10 13:27:16.749931 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:16.749879 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7bcdf5f866-j6l87" event={"ID":"e3cb5d91-edc8-4b74-bcb4-464cad827f6f","Type":"ContainerStarted","Data":"6a0e96d24585cb430be1011c115ed4edbef468872c579db796b34119a95309a3"} Jul 10 13:27:16.750386 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:16.749967 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7bcdf5f866-j6l87" event={"ID":"e3cb5d91-edc8-4b74-bcb4-464cad827f6f","Type":"ContainerStarted","Data":"59b5850118977d77680a8b5e0e871bd3ded2a2abc2a93bd773ca7e49f76c299d"} Jul 10 13:27:16.751370 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:16.751342 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mztld" event={"ID":"ed62a749-d965-432a-b2c7-d4ad2e42a8f4","Type":"ContainerStarted","Data":"966adbd77f0a23b10ea31925b1fca6b1c3edbb2900edf45af2b298e96bdbdb84"} Jul 10 13:27:16.752605 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:16.752579 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbcbj" event={"ID":"d13a73e0-bd87-4a7b-b968-34290f15f6f0","Type":"ContainerStarted","Data":"b329d7a396e9435f531bbf969a80ee2e9a8b5d99eea4878127dd6ad464bc404a"} Jul 10 13:27:16.777833 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:16.777778 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7bcdf5f866-j6l87" podStartSLOduration=33.777757029 podStartE2EDuration="33.777757029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:26:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:27:16.776936198 +0000 UTC m=+90.016268120" watchObservedRunningTime="2026-07-10 13:27:16.777757029 +0000 UTC m=+90.017088951" Jul 10 13:27:16.878048 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:16.878021 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:27:16.880628 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:16.880597 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:27:17.756233 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:17.756199 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:27:17.757693 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:17.757668 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7bcdf5f866-j6l87" Jul 10 13:27:19.764491 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:19.764402 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mztld" event={"ID":"ed62a749-d965-432a-b2c7-d4ad2e42a8f4","Type":"ContainerStarted","Data":"a4e8854f1ca496b38a63bef2dc87e279529523bc1af6b642ae1175752b0ec6a7"} Jul 10 13:27:19.764491 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:19.764470 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mztld" event={"ID":"ed62a749-d965-432a-b2c7-d4ad2e42a8f4","Type":"ContainerStarted","Data":"1a6cdadbef1a41e348387f20abeb9c2d3cf2113d1ec42b8c2cb6ad07cdfae529"} Jul 10 13:27:19.765965 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:19.765935 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbcbj" event={"ID":"d13a73e0-bd87-4a7b-b968-34290f15f6f0","Type":"ContainerStarted","Data":"5b7581e100b52230f74b4f95c80d93e3dca7cefc637428fba0e35f1fe5a31e5c"} Jul 10 13:27:19.783550 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:19.783495 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-mztld" podStartSLOduration=33.663184383 podStartE2EDuration="36.783478701s" totalImagesPullingTime="3.120294318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:26:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:27:19.7821648 +0000 UTC m=+93.021496725" watchObservedRunningTime="2026-07-10 13:27:19.783478701 +0000 UTC m=+93.022810622" Jul 10 13:27:19.798058 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:19.798015 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-lbcbj" podStartSLOduration=33.598471981 podStartE2EDuration="36.798002654s" totalImagesPullingTime="3.199530673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:26:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:27:19.797743884 +0000 UTC m=+93.037075802" watchObservedRunningTime="2026-07-10 13:27:19.798002654 +0000 UTC m=+93.037334574" Jul 10 13:27:23.387287 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:23.387251 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c5d1aad-4935-4a95-8813-2aedd8dc9022-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttzgw\" (UID: \"0c5d1aad-4935-4a95-8813-2aedd8dc9022\") " pod="openshift-insights/insights-runtime-extractor-ttzgw" Jul 10 13:27:23.389988 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:23.389952 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c5d1aad-4935-4a95-8813-2aedd8dc9022-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ttzgw\" (UID: \"0c5d1aad-4935-4a95-8813-2aedd8dc9022\") " pod="openshift-insights/insights-runtime-extractor-ttzgw" Jul 10 13:27:23.643004 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:23.642919 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ttzgw" Jul 10 13:27:23.783184 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:23.783142 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ttzgw"] Jul 10 13:27:23.786566 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:27:23.786539 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c5d1aad_4935_4a95_8813_2aedd8dc9022.slice/crio-b73007d6c187f17128bea73161e0cc9060404caa56a9df855c1f204c407bb19d WatchSource:0}: Error finding container b73007d6c187f17128bea73161e0cc9060404caa56a9df855c1f204c407bb19d: Status 404 returned error can't find the container with id b73007d6c187f17128bea73161e0cc9060404caa56a9df855c1f204c407bb19d Jul 10 13:27:24.678110 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:24.678082 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-494zp" Jul 10 13:27:24.787018 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:24.786982 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ttzgw" event={"ID":"0c5d1aad-4935-4a95-8813-2aedd8dc9022","Type":"ContainerStarted","Data":"b73007d6c187f17128bea73161e0cc9060404caa56a9df855c1f204c407bb19d"} Jul 10 13:27:26.008179 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:26.008140 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/051b95cc-7289-4c0c-aa25-98fe724192d6-metrics-tls\") pod \"dns-default-gjkg6\" (UID: \"051b95cc-7289-4c0c-aa25-98fe724192d6\") " pod="openshift-dns/dns-default-gjkg6" Jul 10 13:27:26.008664 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:26.008199 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-registry-tls\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:27:26.011467 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:26.011438 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/051b95cc-7289-4c0c-aa25-98fe724192d6-metrics-tls\") pod \"dns-default-gjkg6\" (UID: \"051b95cc-7289-4c0c-aa25-98fe724192d6\") " pod="openshift-dns/dns-default-gjkg6" Jul 10 13:27:26.011581 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:26.011526 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-registry-tls\") pod \"image-registry-849d455874-q76sx\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:27:26.232355 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:26.232321 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-r7g28\"" Jul 10 13:27:26.240687 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:26.240653 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:27:26.257689 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:26.257663 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sj6cx\"" Jul 10 13:27:26.266343 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:26.266287 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gjkg6" Jul 10 13:27:27.947556 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:27.947540 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-849d455874-q76sx"] Jul 10 13:27:27.950225 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:27:27.949839 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816669aa_a543_4738_9c33_af588b14e4b1.slice/crio-e2ae84b235ff1c13b4d51b3aceb9f9fa97837220a3d9d01c26ca40fdf3418936 WatchSource:0}: Error finding container e2ae84b235ff1c13b4d51b3aceb9f9fa97837220a3d9d01c26ca40fdf3418936: Status 404 returned error can't find the container with id e2ae84b235ff1c13b4d51b3aceb9f9fa97837220a3d9d01c26ca40fdf3418936 Jul 10 13:27:27.966507 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:27.966487 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gjkg6"] Jul 10 13:27:27.969161 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:27:27.969129 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod051b95cc_7289_4c0c_aa25_98fe724192d6.slice/crio-109a95fac595b1ced45fbc4ff4efa0324524d147fdffea837062cab1e6d082e0 WatchSource:0}: Error finding container 109a95fac595b1ced45fbc4ff4efa0324524d147fdffea837062cab1e6d082e0: Status 404 returned error can't find the container with id 109a95fac595b1ced45fbc4ff4efa0324524d147fdffea837062cab1e6d082e0 Jul 10 13:27:28.807784 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:28.807707 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-849d455874-q76sx" event={"ID":"816669aa-a543-4738-9c33-af588b14e4b1","Type":"ContainerStarted","Data":"9820383a93c88cc08d883a26bf6a147dc6654f19db93799062957c66c9ef0a4d"} Jul 10 13:27:28.807784 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:28.807772 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-849d455874-q76sx" event={"ID":"816669aa-a543-4738-9c33-af588b14e4b1","Type":"ContainerStarted","Data":"e2ae84b235ff1c13b4d51b3aceb9f9fa97837220a3d9d01c26ca40fdf3418936"} Jul 10 13:27:28.808025 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:28.807794 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:27:28.809359 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:28.809325 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ttzgw" event={"ID":"0c5d1aad-4935-4a95-8813-2aedd8dc9022","Type":"ContainerStarted","Data":"242d6e5468feedf77ddd44a0da18f8a79fe3e99e06eb8ca972801539b3411e15"} Jul 10 13:27:28.810391 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:28.810369 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gjkg6" event={"ID":"051b95cc-7289-4c0c-aa25-98fe724192d6","Type":"ContainerStarted","Data":"109a95fac595b1ced45fbc4ff4efa0324524d147fdffea837062cab1e6d082e0"} Jul 10 13:27:28.828889 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:28.828850 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-849d455874-q76sx" podStartSLOduration=78.828833413 podStartE2EDuration="1m18.828833413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:26:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:27:28.827242696 +0000 UTC m=+102.066574628" watchObservedRunningTime="2026-07-10 13:27:28.828833413 +0000 UTC m=+102.068165312" Jul 10 13:27:29.818444 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:29.818401 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ttzgw" event={"ID":"0c5d1aad-4935-4a95-8813-2aedd8dc9022","Type":"ContainerStarted","Data":"edd2eda7abc9f2af4b14cffd982f824bed4ed943bc301af6168fc662c9010075"} Jul 10 13:27:32.218518 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.218484 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bjvnw"] Jul 10 13:27:32.223127 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.222417 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:32.226460 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.226430 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 10 13:27:32.226460 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.226453 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 10 13:27:32.226830 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.226808 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 10 13:27:32.226980 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.226863 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7qstg\"" Jul 10 13:27:32.227109 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.227093 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 10 13:27:32.261936 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.261911 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a50b820a-fa62-4685-931d-0aeb4ee47e6a-root\") pod \"node-exporter-bjvnw\" (UID: \"a50b820a-fa62-4685-931d-0aeb4ee47e6a\") " pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:32.262068 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.261949 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a50b820a-fa62-4685-931d-0aeb4ee47e6a-metrics-client-ca\") pod \"node-exporter-bjvnw\" (UID: \"a50b820a-fa62-4685-931d-0aeb4ee47e6a\") " pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:32.262068 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.261972 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a50b820a-fa62-4685-931d-0aeb4ee47e6a-node-exporter-accelerators-collector-config\") pod \"node-exporter-bjvnw\" (UID: \"a50b820a-fa62-4685-931d-0aeb4ee47e6a\") " pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:32.262068 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.262003 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2vlb\" (UniqueName: \"kubernetes.io/projected/a50b820a-fa62-4685-931d-0aeb4ee47e6a-kube-api-access-m2vlb\") pod \"node-exporter-bjvnw\" (UID: \"a50b820a-fa62-4685-931d-0aeb4ee47e6a\") " pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:32.262068 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.262033 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a50b820a-fa62-4685-931d-0aeb4ee47e6a-node-exporter-tls\") pod \"node-exporter-bjvnw\" (UID: \"a50b820a-fa62-4685-931d-0aeb4ee47e6a\") " pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:32.262068 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.262066 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a50b820a-fa62-4685-931d-0aeb4ee47e6a-node-exporter-wtmp\") pod \"node-exporter-bjvnw\" (UID: \"a50b820a-fa62-4685-931d-0aeb4ee47e6a\") " pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:32.262292 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.262089 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a50b820a-fa62-4685-931d-0aeb4ee47e6a-sys\") pod \"node-exporter-bjvnw\" (UID: \"a50b820a-fa62-4685-931d-0aeb4ee47e6a\") " pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:32.262292 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.262111 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a50b820a-fa62-4685-931d-0aeb4ee47e6a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bjvnw\" (UID: \"a50b820a-fa62-4685-931d-0aeb4ee47e6a\") " pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:32.262292 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.262151 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a50b820a-fa62-4685-931d-0aeb4ee47e6a-node-exporter-textfile\") pod \"node-exporter-bjvnw\" (UID: \"a50b820a-fa62-4685-931d-0aeb4ee47e6a\") " pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:32.363284 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.363244 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a50b820a-fa62-4685-931d-0aeb4ee47e6a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bjvnw\" (UID: \"a50b820a-fa62-4685-931d-0aeb4ee47e6a\") " pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:32.363462 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.363328 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a50b820a-fa62-4685-931d-0aeb4ee47e6a-node-exporter-textfile\") pod \"node-exporter-bjvnw\" (UID: \"a50b820a-fa62-4685-931d-0aeb4ee47e6a\") " pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:32.363462 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.363392 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a50b820a-fa62-4685-931d-0aeb4ee47e6a-root\") pod \"node-exporter-bjvnw\" (UID: \"a50b820a-fa62-4685-931d-0aeb4ee47e6a\") " pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:32.363462 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.363432 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a50b820a-fa62-4685-931d-0aeb4ee47e6a-metrics-client-ca\") pod \"node-exporter-bjvnw\" (UID: \"a50b820a-fa62-4685-931d-0aeb4ee47e6a\") " pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:32.363462 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.363456 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a50b820a-fa62-4685-931d-0aeb4ee47e6a-node-exporter-accelerators-collector-config\") pod \"node-exporter-bjvnw\" (UID: \"a50b820a-fa62-4685-931d-0aeb4ee47e6a\") " pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:32.363695 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.363486 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2vlb\" (UniqueName: \"kubernetes.io/projected/a50b820a-fa62-4685-931d-0aeb4ee47e6a-kube-api-access-m2vlb\") pod \"node-exporter-bjvnw\" (UID: \"a50b820a-fa62-4685-931d-0aeb4ee47e6a\") " pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:32.363695 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.363509 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a50b820a-fa62-4685-931d-0aeb4ee47e6a-node-exporter-tls\") pod \"node-exporter-bjvnw\" (UID: \"a50b820a-fa62-4685-931d-0aeb4ee47e6a\") " pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:32.363695 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.363528 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a50b820a-fa62-4685-931d-0aeb4ee47e6a-node-exporter-wtmp\") pod \"node-exporter-bjvnw\" (UID: \"a50b820a-fa62-4685-931d-0aeb4ee47e6a\") " pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:32.363695 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.363532 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a50b820a-fa62-4685-931d-0aeb4ee47e6a-root\") pod \"node-exporter-bjvnw\" (UID: \"a50b820a-fa62-4685-931d-0aeb4ee47e6a\") " pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:32.363695 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.363551 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a50b820a-fa62-4685-931d-0aeb4ee47e6a-sys\") pod \"node-exporter-bjvnw\" (UID: \"a50b820a-fa62-4685-931d-0aeb4ee47e6a\") " pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:32.363695 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.363592 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a50b820a-fa62-4685-931d-0aeb4ee47e6a-sys\") pod \"node-exporter-bjvnw\" (UID: \"a50b820a-fa62-4685-931d-0aeb4ee47e6a\") " pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:32.363934 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.363781 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a50b820a-fa62-4685-931d-0aeb4ee47e6a-node-exporter-textfile\") pod \"node-exporter-bjvnw\" (UID: \"a50b820a-fa62-4685-931d-0aeb4ee47e6a\") " pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:32.364031 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.364010 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a50b820a-fa62-4685-931d-0aeb4ee47e6a-node-exporter-wtmp\") pod \"node-exporter-bjvnw\" (UID: \"a50b820a-fa62-4685-931d-0aeb4ee47e6a\") " pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:32.364203 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.364175 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a50b820a-fa62-4685-931d-0aeb4ee47e6a-node-exporter-accelerators-collector-config\") pod \"node-exporter-bjvnw\" (UID: \"a50b820a-fa62-4685-931d-0aeb4ee47e6a\") " pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:32.364335 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.364242 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a50b820a-fa62-4685-931d-0aeb4ee47e6a-metrics-client-ca\") pod \"node-exporter-bjvnw\" (UID: \"a50b820a-fa62-4685-931d-0aeb4ee47e6a\") " pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:32.366130 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.366109 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a50b820a-fa62-4685-931d-0aeb4ee47e6a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bjvnw\" (UID: \"a50b820a-fa62-4685-931d-0aeb4ee47e6a\") " pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:32.366359 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.366343 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a50b820a-fa62-4685-931d-0aeb4ee47e6a-node-exporter-tls\") pod \"node-exporter-bjvnw\" (UID: \"a50b820a-fa62-4685-931d-0aeb4ee47e6a\") " pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:32.372552 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.372525 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2vlb\" (UniqueName: \"kubernetes.io/projected/a50b820a-fa62-4685-931d-0aeb4ee47e6a-kube-api-access-m2vlb\") pod \"node-exporter-bjvnw\" (UID: \"a50b820a-fa62-4685-931d-0aeb4ee47e6a\") " pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:32.535738 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:32.535660 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bjvnw" Jul 10 13:27:37.004372 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:37.004340 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-849d455874-q76sx"] Jul 10 13:27:38.457488 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:27:38.457449 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda50b820a_fa62_4685_931d_0aeb4ee47e6a.slice/crio-a38543ac788ad4ddaf9743232011baab0e43ddeb8bf8e81d759f289d080a6362 WatchSource:0}: Error finding container a38543ac788ad4ddaf9743232011baab0e43ddeb8bf8e81d759f289d080a6362: Status 404 returned error can't find the container with id a38543ac788ad4ddaf9743232011baab0e43ddeb8bf8e81d759f289d080a6362 Jul 10 13:27:38.753832 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.753764 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fff877fdc-6xs25"] Jul 10 13:27:38.758090 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.758066 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:27:38.759956 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.759935 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 10 13:27:38.760241 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.760220 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 10 13:27:38.760565 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.760550 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lpps9\"" Jul 10 13:27:38.760804 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.760664 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 10 13:27:38.760804 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.760755 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 10 13:27:38.760804 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.760550 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 10 13:27:38.767301 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.766788 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fff877fdc-6xs25"] Jul 10 13:27:38.767424 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.767404 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 10 13:27:38.818619 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.818587 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfcec118-dff5-4427-8547-db1d34c497a2-trusted-ca-bundle\") pod \"console-6fff877fdc-6xs25\" (UID: \"bfcec118-dff5-4427-8547-db1d34c497a2\") " pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:27:38.818794 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.818628 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfcec118-dff5-4427-8547-db1d34c497a2-console-serving-cert\") pod \"console-6fff877fdc-6xs25\" (UID: \"bfcec118-dff5-4427-8547-db1d34c497a2\") " pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:27:38.818794 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.818669 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfcec118-dff5-4427-8547-db1d34c497a2-service-ca\") pod \"console-6fff877fdc-6xs25\" (UID: \"bfcec118-dff5-4427-8547-db1d34c497a2\") " pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:27:38.818794 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.818700 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfcec118-dff5-4427-8547-db1d34c497a2-console-config\") pod \"console-6fff877fdc-6xs25\" (UID: \"bfcec118-dff5-4427-8547-db1d34c497a2\") " pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:27:38.818794 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.818742 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62rtk\" (UniqueName: \"kubernetes.io/projected/bfcec118-dff5-4427-8547-db1d34c497a2-kube-api-access-62rtk\") pod \"console-6fff877fdc-6xs25\" (UID: \"bfcec118-dff5-4427-8547-db1d34c497a2\") " pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:27:38.819004 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.818820 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfcec118-dff5-4427-8547-db1d34c497a2-console-oauth-config\") pod \"console-6fff877fdc-6xs25\" (UID: \"bfcec118-dff5-4427-8547-db1d34c497a2\") " pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:27:38.819004 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.818861 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfcec118-dff5-4427-8547-db1d34c497a2-oauth-serving-cert\") pod \"console-6fff877fdc-6xs25\" (UID: \"bfcec118-dff5-4427-8547-db1d34c497a2\") " pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:27:38.858471 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.858433 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gjkg6" event={"ID":"051b95cc-7289-4c0c-aa25-98fe724192d6","Type":"ContainerStarted","Data":"dae56d552cc617d8c337dc74e778fc7fd5b3da4520b7d4fe7ac6fbc6d98d5d08"} Jul 10 13:27:38.858659 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.858500 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gjkg6" event={"ID":"051b95cc-7289-4c0c-aa25-98fe724192d6","Type":"ContainerStarted","Data":"238187f19b50f599408e38cf26c035dc1da1e49b2df35d4a2caf4acf1358f2ea"} Jul 10 13:27:38.858659 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.858533 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gjkg6" Jul 10 13:27:38.860385 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.860294 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-zdqc6" event={"ID":"85d4fe9b-fcfe-4796-a866-fb0f316531e1","Type":"ContainerStarted","Data":"602705463fd76d0c7aeff46ad5b0c02ee924ef92524d51510f2ed06239abeb93"} Jul 10 13:27:38.860385 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.860353 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-zdqc6" Jul 10 13:27:38.861827 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.861803 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bjvnw" event={"ID":"a50b820a-fa62-4685-931d-0aeb4ee47e6a","Type":"ContainerStarted","Data":"a38543ac788ad4ddaf9743232011baab0e43ddeb8bf8e81d759f289d080a6362"} Jul 10 13:27:38.864174 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.864153 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ttzgw" event={"ID":"0c5d1aad-4935-4a95-8813-2aedd8dc9022","Type":"ContainerStarted","Data":"e0eb78b1277b1d8fa8b27e9feb5c5770cd5685b743d1392f8608ca1a0a6e9e89"} Jul 10 13:27:38.874946 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.874921 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-zdqc6" Jul 10 13:27:38.876487 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.875477 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gjkg6" podStartSLOduration=66.390192921 podStartE2EDuration="1m16.875461046s" totalImagesPullingTime="10.485268125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:27:38.874418094 +0000 UTC m=+112.113750050" watchObservedRunningTime="2026-07-10 13:27:38.875461046 +0000 UTC m=+112.114792967" Jul 10 13:27:38.891105 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.891055 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-zdqc6" podStartSLOduration=1.466124492 podStartE2EDuration="24.891037936s" totalImagesPullingTime="23.424913444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:27:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:27:38.889630157 +0000 UTC m=+112.128962079" watchObservedRunningTime="2026-07-10 13:27:38.891037936 +0000 UTC m=+112.130369858" Jul 10 13:27:38.908335 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.908297 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ttzgw" podStartSLOduration=33.426396451 podStartE2EDuration="47.908284337s" totalImagesPullingTime="14.481887886s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:26:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:27:38.907356385 +0000 UTC m=+112.146688309" watchObservedRunningTime="2026-07-10 13:27:38.908284337 +0000 UTC m=+112.147616259" Jul 10 13:27:38.920326 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.920295 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfcec118-dff5-4427-8547-db1d34c497a2-console-oauth-config\") pod \"console-6fff877fdc-6xs25\" (UID: \"bfcec118-dff5-4427-8547-db1d34c497a2\") " pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:27:38.920444 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.920339 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfcec118-dff5-4427-8547-db1d34c497a2-oauth-serving-cert\") pod \"console-6fff877fdc-6xs25\" (UID: \"bfcec118-dff5-4427-8547-db1d34c497a2\") " pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:27:38.920596 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.920575 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfcec118-dff5-4427-8547-db1d34c497a2-trusted-ca-bundle\") pod \"console-6fff877fdc-6xs25\" (UID: \"bfcec118-dff5-4427-8547-db1d34c497a2\") " pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:27:38.921875 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.921040 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfcec118-dff5-4427-8547-db1d34c497a2-console-serving-cert\") pod \"console-6fff877fdc-6xs25\" (UID: \"bfcec118-dff5-4427-8547-db1d34c497a2\") " pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:27:38.921875 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.921081 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfcec118-dff5-4427-8547-db1d34c497a2-service-ca\") pod \"console-6fff877fdc-6xs25\" (UID: \"bfcec118-dff5-4427-8547-db1d34c497a2\") " pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:27:38.921875 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.921135 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfcec118-dff5-4427-8547-db1d34c497a2-console-config\") pod \"console-6fff877fdc-6xs25\" (UID: \"bfcec118-dff5-4427-8547-db1d34c497a2\") " pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:27:38.921875 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.921182 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62rtk\" (UniqueName: \"kubernetes.io/projected/bfcec118-dff5-4427-8547-db1d34c497a2-kube-api-access-62rtk\") pod \"console-6fff877fdc-6xs25\" (UID: \"bfcec118-dff5-4427-8547-db1d34c497a2\") " pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:27:38.921875 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.921585 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfcec118-dff5-4427-8547-db1d34c497a2-trusted-ca-bundle\") pod \"console-6fff877fdc-6xs25\" (UID: \"bfcec118-dff5-4427-8547-db1d34c497a2\") " pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:27:38.921875 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.921767 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfcec118-dff5-4427-8547-db1d34c497a2-service-ca\") pod \"console-6fff877fdc-6xs25\" (UID: \"bfcec118-dff5-4427-8547-db1d34c497a2\") " pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:27:38.921875 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.921832 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfcec118-dff5-4427-8547-db1d34c497a2-console-config\") pod \"console-6fff877fdc-6xs25\" (UID: \"bfcec118-dff5-4427-8547-db1d34c497a2\") " pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:27:38.922488 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.922396 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfcec118-dff5-4427-8547-db1d34c497a2-oauth-serving-cert\") pod \"console-6fff877fdc-6xs25\" (UID: \"bfcec118-dff5-4427-8547-db1d34c497a2\") " pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:27:38.923394 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.923333 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfcec118-dff5-4427-8547-db1d34c497a2-console-oauth-config\") pod \"console-6fff877fdc-6xs25\" (UID: \"bfcec118-dff5-4427-8547-db1d34c497a2\") " pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:27:38.924392 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.924374 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfcec118-dff5-4427-8547-db1d34c497a2-console-serving-cert\") pod \"console-6fff877fdc-6xs25\" (UID: \"bfcec118-dff5-4427-8547-db1d34c497a2\") " pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:27:38.931086 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:38.931053 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62rtk\" (UniqueName: \"kubernetes.io/projected/bfcec118-dff5-4427-8547-db1d34c497a2-kube-api-access-62rtk\") pod \"console-6fff877fdc-6xs25\" (UID: \"bfcec118-dff5-4427-8547-db1d34c497a2\") " pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:27:39.069522 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:39.069423 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:27:39.241368 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:39.241290 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fff877fdc-6xs25"] Jul 10 13:27:39.869894 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:39.869853 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fff877fdc-6xs25" event={"ID":"bfcec118-dff5-4427-8547-db1d34c497a2","Type":"ContainerStarted","Data":"14156eda4c1bedd55aefe35b00e3f237a7bdaaec40f7623bd658760a79e09f7a"} Jul 10 13:27:39.871855 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:39.871826 2575 generic.go:356] "Generic (PLEG): container finished" podID="a50b820a-fa62-4685-931d-0aeb4ee47e6a" containerID="db62ca39062ec8d7c2023b416f753415551122d932652def2e615a2eeed522fa" exitCode=0 Jul 10 13:27:39.871978 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:39.871947 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bjvnw" event={"ID":"a50b820a-fa62-4685-931d-0aeb4ee47e6a","Type":"ContainerDied","Data":"db62ca39062ec8d7c2023b416f753415551122d932652def2e615a2eeed522fa"} Jul 10 13:27:40.881620 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:40.881585 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bjvnw" event={"ID":"a50b820a-fa62-4685-931d-0aeb4ee47e6a","Type":"ContainerStarted","Data":"72c5ae1fa55b15600044640a611666c0f524404a728a835f16405aca90d6c06e"} Jul 10 13:27:40.882310 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:40.881658 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bjvnw" event={"ID":"a50b820a-fa62-4685-931d-0aeb4ee47e6a","Type":"ContainerStarted","Data":"8f562b5b9fd53482ce38807c275ffde738b2aaa1f747c6dd3150daac617552a6"} Jul 10 13:27:40.904612 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:40.904557 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bjvnw" podStartSLOduration=7.6409670720000005 podStartE2EDuration="8.904532923s" totalImagesPullingTime="1.188265771s" totalInitContainerRuntime="75.30008ms" isStatefulPod=true podCreationTimestamp="2026-07-10 13:27:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:27:40.902619454 +0000 UTC m=+114.141951397" watchObservedRunningTime="2026-07-10 13:27:40.904532923 +0000 UTC m=+114.143864847" Jul 10 13:27:43.898185 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:43.898144 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fff877fdc-6xs25" event={"ID":"bfcec118-dff5-4427-8547-db1d34c497a2","Type":"ContainerStarted","Data":"fd44e4d5755cd43e9a783653827d917fa5ff281a4f1685b871d33a58b06e71ce"} Jul 10 13:27:43.919090 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:43.919046 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fff877fdc-6xs25" podStartSLOduration=2.022354216 podStartE2EDuration="5.919026303s" totalImagesPullingTime="3.896672087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:27:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:27:43.917503868 +0000 UTC m=+117.156835803" watchObservedRunningTime="2026-07-10 13:27:43.919026303 +0000 UTC m=+117.158358225" Jul 10 13:27:47.010966 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:47.010933 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:27:48.874111 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:48.874076 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gjkg6" Jul 10 13:27:49.069606 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:49.069577 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:27:49.069803 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:49.069657 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:27:49.074156 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:49.074134 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:27:49.930524 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:49.930496 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:27:57.074772 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:57.074740 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b8019d7-b55b-47d7-b875-c93668f52dfc-metrics-certs\") pod \"network-metrics-daemon-rbd82\" (UID: \"7b8019d7-b55b-47d7-b875-c93668f52dfc\") " pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:27:57.076952 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:57.076924 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b8019d7-b55b-47d7-b875-c93668f52dfc-metrics-certs\") pod \"network-metrics-daemon-rbd82\" (UID: \"7b8019d7-b55b-47d7-b875-c93668f52dfc\") " pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:27:57.351241 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:57.351174 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4gcrn\"" Jul 10 13:27:57.359892 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:57.359877 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rbd82" Jul 10 13:27:57.592381 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:57.592342 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rbd82"] Jul 10 13:27:57.594931 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:27:57.594904 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b8019d7_b55b_47d7_b875_c93668f52dfc.slice/crio-d0ac7f57b3afda3f43134066c701921083403ef1151a1ef1e738362e42df8d82 WatchSource:0}: Error finding container d0ac7f57b3afda3f43134066c701921083403ef1151a1ef1e738362e42df8d82: Status 404 returned error can't find the container with id d0ac7f57b3afda3f43134066c701921083403ef1151a1ef1e738362e42df8d82 Jul 10 13:27:57.955588 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:57.955556 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rbd82" event={"ID":"7b8019d7-b55b-47d7-b875-c93668f52dfc","Type":"ContainerStarted","Data":"d0ac7f57b3afda3f43134066c701921083403ef1151a1ef1e738362e42df8d82"} Jul 10 13:27:59.965389 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:59.965356 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rbd82" event={"ID":"7b8019d7-b55b-47d7-b875-c93668f52dfc","Type":"ContainerStarted","Data":"3ea7a8a662425343f103a4283dbbbc70abd839873aabe5e5f1e76c3f2e569c56"} Jul 10 13:27:59.965776 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:59.965408 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rbd82" event={"ID":"7b8019d7-b55b-47d7-b875-c93668f52dfc","Type":"ContainerStarted","Data":"f6edae3cb6586746af57b1184a5a2a81908182e582a105f78f683b0c7f969ddb"} Jul 10 13:27:59.984324 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:27:59.984271 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rbd82" podStartSLOduration=130.488145154 podStartE2EDuration="2m11.984255536s" totalImagesPullingTime="1.496110382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:27:59.982890497 +0000 UTC m=+133.222222429" watchObservedRunningTime="2026-07-10 13:27:59.984255536 +0000 UTC m=+133.223587458" Jul 10 13:28:00.970731 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:00.970701 2575 generic.go:356] "Generic (PLEG): container finished" podID="0676f234-f4cc-452c-9b61-71cf7efdb704" containerID="4fd5621ec39c8ef16623407ec7e1b122b01f8cea96888e3c32c42e45e4a02646" exitCode=0 Jul 10 13:28:00.971018 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:00.970779 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgxgh" event={"ID":"0676f234-f4cc-452c-9b61-71cf7efdb704","Type":"ContainerDied","Data":"4fd5621ec39c8ef16623407ec7e1b122b01f8cea96888e3c32c42e45e4a02646"} Jul 10 13:28:00.971211 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:00.971193 2575 scope.go:117] "RemoveContainer" containerID="4fd5621ec39c8ef16623407ec7e1b122b01f8cea96888e3c32c42e45e4a02646" Jul 10 13:28:01.976292 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:01.976259 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-bgxgh" event={"ID":"0676f234-f4cc-452c-9b61-71cf7efdb704","Type":"ContainerStarted","Data":"12d3bfcc3784d4b3900b5e244cccb83e84a650d2701bb25e300f1b2117461488"} Jul 10 13:28:01.977554 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:01.977530 2575 generic.go:356] "Generic (PLEG): container finished" podID="5702eeb0-bcc8-4557-87a8-f25f6e3f46cf" containerID="9bf147e7f76e80f8d9ed3bf2fbdd8019754ce5e272c467d7710572c3da38d991" exitCode=0 Jul 10 13:28:01.977679 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:01.977596 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-l4859" event={"ID":"5702eeb0-bcc8-4557-87a8-f25f6e3f46cf","Type":"ContainerDied","Data":"9bf147e7f76e80f8d9ed3bf2fbdd8019754ce5e272c467d7710572c3da38d991"} Jul 10 13:28:01.977869 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:01.977857 2575 scope.go:117] "RemoveContainer" containerID="9bf147e7f76e80f8d9ed3bf2fbdd8019754ce5e272c467d7710572c3da38d991" Jul 10 13:28:02.027206 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.027159 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-849d455874-q76sx" podUID="816669aa-a543-4738-9c33-af588b14e4b1" containerName="registry" containerID="cri-o://9820383a93c88cc08d883a26bf6a147dc6654f19db93799062957c66c9ef0a4d" gracePeriod=30 Jul 10 13:28:02.307535 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.307506 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:28:02.418189 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.418161 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-registry-tls\") pod \"816669aa-a543-4738-9c33-af588b14e4b1\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " Jul 10 13:28:02.418335 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.418215 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/816669aa-a543-4738-9c33-af588b14e4b1-installation-pull-secrets\") pod \"816669aa-a543-4738-9c33-af588b14e4b1\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " Jul 10 13:28:02.418335 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.418238 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/816669aa-a543-4738-9c33-af588b14e4b1-registry-certificates\") pod \"816669aa-a543-4738-9c33-af588b14e4b1\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " Jul 10 13:28:02.418335 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.418260 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/816669aa-a543-4738-9c33-af588b14e4b1-trusted-ca\") pod \"816669aa-a543-4738-9c33-af588b14e4b1\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " Jul 10 13:28:02.418335 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.418315 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/816669aa-a543-4738-9c33-af588b14e4b1-image-registry-private-configuration\") pod \"816669aa-a543-4738-9c33-af588b14e4b1\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " Jul 10 13:28:02.418548 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.418355 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-bound-sa-token\") pod \"816669aa-a543-4738-9c33-af588b14e4b1\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " Jul 10 13:28:02.418548 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.418393 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qp99\" (UniqueName: \"kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-kube-api-access-5qp99\") pod \"816669aa-a543-4738-9c33-af588b14e4b1\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " Jul 10 13:28:02.418548 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.418428 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/816669aa-a543-4738-9c33-af588b14e4b1-ca-trust-extracted\") pod \"816669aa-a543-4738-9c33-af588b14e4b1\" (UID: \"816669aa-a543-4738-9c33-af588b14e4b1\") " Jul 10 13:28:02.418896 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.418749 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/816669aa-a543-4738-9c33-af588b14e4b1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "816669aa-a543-4738-9c33-af588b14e4b1" (UID: "816669aa-a543-4738-9c33-af588b14e4b1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:28:02.419011 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.418892 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/816669aa-a543-4738-9c33-af588b14e4b1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "816669aa-a543-4738-9c33-af588b14e4b1" (UID: "816669aa-a543-4738-9c33-af588b14e4b1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:28:02.421262 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.421211 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-kube-api-access-5qp99" (OuterVolumeSpecName: "kube-api-access-5qp99") pod "816669aa-a543-4738-9c33-af588b14e4b1" (UID: "816669aa-a543-4738-9c33-af588b14e4b1"). InnerVolumeSpecName "kube-api-access-5qp99". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:28:02.421262 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.421251 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/816669aa-a543-4738-9c33-af588b14e4b1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "816669aa-a543-4738-9c33-af588b14e4b1" (UID: "816669aa-a543-4738-9c33-af588b14e4b1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 13:28:02.421448 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.421371 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "816669aa-a543-4738-9c33-af588b14e4b1" (UID: "816669aa-a543-4738-9c33-af588b14e4b1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:28:02.421448 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.421407 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/816669aa-a543-4738-9c33-af588b14e4b1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "816669aa-a543-4738-9c33-af588b14e4b1" (UID: "816669aa-a543-4738-9c33-af588b14e4b1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 13:28:02.421531 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.421495 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "816669aa-a543-4738-9c33-af588b14e4b1" (UID: "816669aa-a543-4738-9c33-af588b14e4b1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:28:02.427348 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.427328 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/816669aa-a543-4738-9c33-af588b14e4b1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "816669aa-a543-4738-9c33-af588b14e4b1" (UID: "816669aa-a543-4738-9c33-af588b14e4b1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:28:02.519617 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.519589 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/816669aa-a543-4738-9c33-af588b14e4b1-image-registry-private-configuration\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:28:02.519617 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.519614 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-bound-sa-token\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:28:02.519783 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.519627 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qp99\" (UniqueName: \"kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-kube-api-access-5qp99\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:28:02.519783 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.519656 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/816669aa-a543-4738-9c33-af588b14e4b1-ca-trust-extracted\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:28:02.519783 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.519669 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/816669aa-a543-4738-9c33-af588b14e4b1-registry-tls\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:28:02.519783 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.519681 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/816669aa-a543-4738-9c33-af588b14e4b1-installation-pull-secrets\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:28:02.519783 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.519693 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/816669aa-a543-4738-9c33-af588b14e4b1-registry-certificates\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:28:02.519783 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.519704 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/816669aa-a543-4738-9c33-af588b14e4b1-trusted-ca\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:28:02.993446 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.993413 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-l4859" event={"ID":"5702eeb0-bcc8-4557-87a8-f25f6e3f46cf","Type":"ContainerStarted","Data":"b7fae9b4dec3b11efb07542ec0b3ce613cf9a92a177db0559e955303edd21207"} Jul 10 13:28:02.994831 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.994802 2575 generic.go:356] "Generic (PLEG): container finished" podID="816669aa-a543-4738-9c33-af588b14e4b1" containerID="9820383a93c88cc08d883a26bf6a147dc6654f19db93799062957c66c9ef0a4d" exitCode=0 Jul 10 13:28:02.994937 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.994847 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-849d455874-q76sx" Jul 10 13:28:02.994937 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.994866 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-849d455874-q76sx" event={"ID":"816669aa-a543-4738-9c33-af588b14e4b1","Type":"ContainerDied","Data":"9820383a93c88cc08d883a26bf6a147dc6654f19db93799062957c66c9ef0a4d"} Jul 10 13:28:02.994937 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.994903 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-849d455874-q76sx" event={"ID":"816669aa-a543-4738-9c33-af588b14e4b1","Type":"ContainerDied","Data":"e2ae84b235ff1c13b4d51b3aceb9f9fa97837220a3d9d01c26ca40fdf3418936"} Jul 10 13:28:02.994937 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:02.994926 2575 scope.go:117] "RemoveContainer" containerID="9820383a93c88cc08d883a26bf6a147dc6654f19db93799062957c66c9ef0a4d" Jul 10 13:28:03.003711 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:03.003695 2575 scope.go:117] "RemoveContainer" containerID="9820383a93c88cc08d883a26bf6a147dc6654f19db93799062957c66c9ef0a4d" Jul 10 13:28:03.003961 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:28:03.003941 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9820383a93c88cc08d883a26bf6a147dc6654f19db93799062957c66c9ef0a4d\": container with ID starting with 9820383a93c88cc08d883a26bf6a147dc6654f19db93799062957c66c9ef0a4d not found: ID does not exist" containerID="9820383a93c88cc08d883a26bf6a147dc6654f19db93799062957c66c9ef0a4d" Jul 10 13:28:03.004014 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:03.003968 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9820383a93c88cc08d883a26bf6a147dc6654f19db93799062957c66c9ef0a4d"} err="failed to get container status \"9820383a93c88cc08d883a26bf6a147dc6654f19db93799062957c66c9ef0a4d\": rpc error: code = NotFound desc = could not find container \"9820383a93c88cc08d883a26bf6a147dc6654f19db93799062957c66c9ef0a4d\": container with ID starting with 9820383a93c88cc08d883a26bf6a147dc6654f19db93799062957c66c9ef0a4d not found: ID does not exist" Jul 10 13:28:03.029530 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:03.029500 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-849d455874-q76sx"] Jul 10 13:28:03.034238 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:03.034218 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-849d455874-q76sx"] Jul 10 13:28:04.237312 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:04.237281 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="816669aa-a543-4738-9c33-af588b14e4b1" path="/var/lib/kubelet/pods/816669aa-a543-4738-9c33-af588b14e4b1/volumes" Jul 10 13:28:21.070302 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:21.070265 2575 generic.go:356] "Generic (PLEG): container finished" podID="f479ff22-0215-45f4-aad7-be153e8abb4b" containerID="16b0550ab3b291fcdd61e084c661bdc35d6e6be0bf5796832da208277247659a" exitCode=0 Jul 10 13:28:21.070770 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:21.070320 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-28dd7" event={"ID":"f479ff22-0215-45f4-aad7-be153e8abb4b","Type":"ContainerDied","Data":"16b0550ab3b291fcdd61e084c661bdc35d6e6be0bf5796832da208277247659a"} Jul 10 13:28:21.070770 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:21.070614 2575 scope.go:117] "RemoveContainer" containerID="16b0550ab3b291fcdd61e084c661bdc35d6e6be0bf5796832da208277247659a" Jul 10 13:28:22.075533 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:28:22.075498 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-28dd7" event={"ID":"f479ff22-0215-45f4-aad7-be153e8abb4b","Type":"ContainerStarted","Data":"4fa59630c43f6ff3b5ef73a83da25ceb69a641ca47727869face93ea90bdc1cf"} Jul 10 13:29:00.664308 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:00.664278 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cb5f4b445-tgvc2"] Jul 10 13:29:00.665146 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:00.664707 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="816669aa-a543-4738-9c33-af588b14e4b1" containerName="registry" Jul 10 13:29:00.665146 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:00.664725 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="816669aa-a543-4738-9c33-af588b14e4b1" containerName="registry" Jul 10 13:29:00.665146 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:00.664808 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="816669aa-a543-4738-9c33-af588b14e4b1" containerName="registry" Jul 10 13:29:00.667500 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:00.667472 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:29:00.678489 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:00.678463 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cb5f4b445-tgvc2"] Jul 10 13:29:00.744897 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:00.744875 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-console-config\") pod \"console-5cb5f4b445-tgvc2\" (UID: \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\") " pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:29:00.745033 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:00.744906 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-service-ca\") pod \"console-5cb5f4b445-tgvc2\" (UID: \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\") " pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:29:00.745033 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:00.744936 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-trusted-ca-bundle\") pod \"console-5cb5f4b445-tgvc2\" (UID: \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\") " pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:29:00.745033 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:00.744971 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hh6w\" (UniqueName: \"kubernetes.io/projected/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-kube-api-access-4hh6w\") pod \"console-5cb5f4b445-tgvc2\" (UID: \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\") " pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:29:00.745130 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:00.745047 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-console-serving-cert\") pod \"console-5cb5f4b445-tgvc2\" (UID: \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\") " pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:29:00.745130 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:00.745067 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-console-oauth-config\") pod \"console-5cb5f4b445-tgvc2\" (UID: \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\") " pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:29:00.745130 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:00.745080 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-oauth-serving-cert\") pod \"console-5cb5f4b445-tgvc2\" (UID: \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\") " pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:29:00.846097 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:00.846060 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-console-serving-cert\") pod \"console-5cb5f4b445-tgvc2\" (UID: \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\") " pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:29:00.846097 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:00.846103 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-console-oauth-config\") pod \"console-5cb5f4b445-tgvc2\" (UID: \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\") " pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:29:00.846277 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:00.846119 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-oauth-serving-cert\") pod \"console-5cb5f4b445-tgvc2\" (UID: \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\") " pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:29:00.846277 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:00.846149 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-console-config\") pod \"console-5cb5f4b445-tgvc2\" (UID: \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\") " pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:29:00.846277 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:00.846171 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-service-ca\") pod \"console-5cb5f4b445-tgvc2\" (UID: \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\") " pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:29:00.846277 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:00.846193 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-trusted-ca-bundle\") pod \"console-5cb5f4b445-tgvc2\" (UID: \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\") " pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:29:00.846277 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:00.846206 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hh6w\" (UniqueName: \"kubernetes.io/projected/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-kube-api-access-4hh6w\") pod \"console-5cb5f4b445-tgvc2\" (UID: \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\") " pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:29:00.846987 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:00.846961 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-oauth-serving-cert\") pod \"console-5cb5f4b445-tgvc2\" (UID: \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\") " pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:29:00.847112 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:00.847002 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-console-config\") pod \"console-5cb5f4b445-tgvc2\" (UID: \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\") " pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:29:00.847112 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:00.847096 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-trusted-ca-bundle\") pod \"console-5cb5f4b445-tgvc2\" (UID: \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\") " pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:29:00.847296 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:00.847269 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-service-ca\") pod \"console-5cb5f4b445-tgvc2\" (UID: \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\") " pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:29:00.848583 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:00.848561 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-console-oauth-config\") pod \"console-5cb5f4b445-tgvc2\" (UID: \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\") " pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:29:00.848719 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:00.848703 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-console-serving-cert\") pod \"console-5cb5f4b445-tgvc2\" (UID: \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\") " pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:29:00.855570 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:00.855549 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hh6w\" (UniqueName: \"kubernetes.io/projected/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-kube-api-access-4hh6w\") pod \"console-5cb5f4b445-tgvc2\" (UID: \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\") " pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:29:00.978968 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:00.978913 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:29:01.102033 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:01.102001 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cb5f4b445-tgvc2"] Jul 10 13:29:01.105576 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:29:01.105546 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1673915e_e3c3_4d3a_9300_e8d9f14f00cf.slice/crio-46264a1eb91b851da30ce4935f2dfb165c268b178a15017dd8a0adcc1ad6dd6a WatchSource:0}: Error finding container 46264a1eb91b851da30ce4935f2dfb165c268b178a15017dd8a0adcc1ad6dd6a: Status 404 returned error can't find the container with id 46264a1eb91b851da30ce4935f2dfb165c268b178a15017dd8a0adcc1ad6dd6a Jul 10 13:29:01.220753 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:01.220714 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb5f4b445-tgvc2" event={"ID":"1673915e-e3c3-4d3a-9300-e8d9f14f00cf","Type":"ContainerStarted","Data":"7f447b9080ac3d604cd2e7c48a79fb2a716c62f61b194683214f7aa5e218b17c"} Jul 10 13:29:01.220898 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:01.220773 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb5f4b445-tgvc2" event={"ID":"1673915e-e3c3-4d3a-9300-e8d9f14f00cf","Type":"ContainerStarted","Data":"46264a1eb91b851da30ce4935f2dfb165c268b178a15017dd8a0adcc1ad6dd6a"} Jul 10 13:29:01.238412 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:01.238307 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cb5f4b445-tgvc2" podStartSLOduration=1.238292479 podStartE2EDuration="1.238292479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:29:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:29:01.237693087 +0000 UTC m=+194.477025009" watchObservedRunningTime="2026-07-10 13:29:01.238292479 +0000 UTC m=+194.477624400" Jul 10 13:29:10.979621 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:10.979587 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:29:10.980155 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:10.979655 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:29:10.984445 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:10.984420 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:29:11.264264 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:11.264180 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:29:11.316299 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:11.316265 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fff877fdc-6xs25"] Jul 10 13:29:36.346628 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:36.346587 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6fff877fdc-6xs25" podUID="bfcec118-dff5-4427-8547-db1d34c497a2" containerName="console" containerID="cri-o://fd44e4d5755cd43e9a783653827d917fa5ff281a4f1685b871d33a58b06e71ce" gracePeriod=15 Jul 10 13:29:36.586555 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:36.586534 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:29:36.725921 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:36.725889 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfcec118-dff5-4427-8547-db1d34c497a2-oauth-serving-cert\") pod \"bfcec118-dff5-4427-8547-db1d34c497a2\" (UID: \"bfcec118-dff5-4427-8547-db1d34c497a2\") " Jul 10 13:29:36.725921 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:36.725925 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfcec118-dff5-4427-8547-db1d34c497a2-console-oauth-config\") pod \"bfcec118-dff5-4427-8547-db1d34c497a2\" (UID: \"bfcec118-dff5-4427-8547-db1d34c497a2\") " Jul 10 13:29:36.726150 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:36.725944 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62rtk\" (UniqueName: \"kubernetes.io/projected/bfcec118-dff5-4427-8547-db1d34c497a2-kube-api-access-62rtk\") pod \"bfcec118-dff5-4427-8547-db1d34c497a2\" (UID: \"bfcec118-dff5-4427-8547-db1d34c497a2\") " Jul 10 13:29:36.726150 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:36.725985 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfcec118-dff5-4427-8547-db1d34c497a2-trusted-ca-bundle\") pod \"bfcec118-dff5-4427-8547-db1d34c497a2\" (UID: \"bfcec118-dff5-4427-8547-db1d34c497a2\") " Jul 10 13:29:36.726150 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:36.726016 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfcec118-dff5-4427-8547-db1d34c497a2-service-ca\") pod \"bfcec118-dff5-4427-8547-db1d34c497a2\" (UID: \"bfcec118-dff5-4427-8547-db1d34c497a2\") " Jul 10 13:29:36.726150 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:36.726037 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfcec118-dff5-4427-8547-db1d34c497a2-console-config\") pod \"bfcec118-dff5-4427-8547-db1d34c497a2\" (UID: \"bfcec118-dff5-4427-8547-db1d34c497a2\") " Jul 10 13:29:36.726150 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:36.726071 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfcec118-dff5-4427-8547-db1d34c497a2-console-serving-cert\") pod \"bfcec118-dff5-4427-8547-db1d34c497a2\" (UID: \"bfcec118-dff5-4427-8547-db1d34c497a2\") " Jul 10 13:29:36.726446 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:36.726401 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfcec118-dff5-4427-8547-db1d34c497a2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bfcec118-dff5-4427-8547-db1d34c497a2" (UID: "bfcec118-dff5-4427-8547-db1d34c497a2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:29:36.726511 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:36.726469 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfcec118-dff5-4427-8547-db1d34c497a2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bfcec118-dff5-4427-8547-db1d34c497a2" (UID: "bfcec118-dff5-4427-8547-db1d34c497a2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:29:36.726511 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:36.726497 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfcec118-dff5-4427-8547-db1d34c497a2-service-ca" (OuterVolumeSpecName: "service-ca") pod "bfcec118-dff5-4427-8547-db1d34c497a2" (UID: "bfcec118-dff5-4427-8547-db1d34c497a2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:29:36.726597 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:36.726511 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfcec118-dff5-4427-8547-db1d34c497a2-console-config" (OuterVolumeSpecName: "console-config") pod "bfcec118-dff5-4427-8547-db1d34c497a2" (UID: "bfcec118-dff5-4427-8547-db1d34c497a2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:29:36.728364 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:36.728334 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfcec118-dff5-4427-8547-db1d34c497a2-kube-api-access-62rtk" (OuterVolumeSpecName: "kube-api-access-62rtk") pod "bfcec118-dff5-4427-8547-db1d34c497a2" (UID: "bfcec118-dff5-4427-8547-db1d34c497a2"). InnerVolumeSpecName "kube-api-access-62rtk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:29:36.728364 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:36.728342 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfcec118-dff5-4427-8547-db1d34c497a2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bfcec118-dff5-4427-8547-db1d34c497a2" (UID: "bfcec118-dff5-4427-8547-db1d34c497a2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 13:29:36.728503 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:36.728428 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfcec118-dff5-4427-8547-db1d34c497a2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bfcec118-dff5-4427-8547-db1d34c497a2" (UID: "bfcec118-dff5-4427-8547-db1d34c497a2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 13:29:36.827008 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:36.826972 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfcec118-dff5-4427-8547-db1d34c497a2-oauth-serving-cert\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:29:36.827008 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:36.827005 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfcec118-dff5-4427-8547-db1d34c497a2-console-oauth-config\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:29:36.827008 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:36.827014 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62rtk\" (UniqueName: \"kubernetes.io/projected/bfcec118-dff5-4427-8547-db1d34c497a2-kube-api-access-62rtk\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:29:36.827196 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:36.827026 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfcec118-dff5-4427-8547-db1d34c497a2-trusted-ca-bundle\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:29:36.827196 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:36.827035 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfcec118-dff5-4427-8547-db1d34c497a2-service-ca\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:29:36.827196 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:36.827042 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfcec118-dff5-4427-8547-db1d34c497a2-console-config\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:29:36.827196 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:36.827050 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfcec118-dff5-4427-8547-db1d34c497a2-console-serving-cert\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:29:37.352281 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:37.352243 2575 generic.go:356] "Generic (PLEG): container finished" podID="bfcec118-dff5-4427-8547-db1d34c497a2" containerID="fd44e4d5755cd43e9a783653827d917fa5ff281a4f1685b871d33a58b06e71ce" exitCode=0 Jul 10 13:29:37.352687 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:37.352287 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fff877fdc-6xs25" Jul 10 13:29:37.352687 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:37.352288 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fff877fdc-6xs25" event={"ID":"bfcec118-dff5-4427-8547-db1d34c497a2","Type":"ContainerDied","Data":"fd44e4d5755cd43e9a783653827d917fa5ff281a4f1685b871d33a58b06e71ce"} Jul 10 13:29:37.352687 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:37.352345 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fff877fdc-6xs25" event={"ID":"bfcec118-dff5-4427-8547-db1d34c497a2","Type":"ContainerDied","Data":"14156eda4c1bedd55aefe35b00e3f237a7bdaaec40f7623bd658760a79e09f7a"} Jul 10 13:29:37.352687 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:37.352365 2575 scope.go:117] "RemoveContainer" containerID="fd44e4d5755cd43e9a783653827d917fa5ff281a4f1685b871d33a58b06e71ce" Jul 10 13:29:37.360402 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:37.360385 2575 scope.go:117] "RemoveContainer" containerID="fd44e4d5755cd43e9a783653827d917fa5ff281a4f1685b871d33a58b06e71ce" Jul 10 13:29:37.360683 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:29:37.360668 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd44e4d5755cd43e9a783653827d917fa5ff281a4f1685b871d33a58b06e71ce\": container with ID starting with fd44e4d5755cd43e9a783653827d917fa5ff281a4f1685b871d33a58b06e71ce not found: ID does not exist" containerID="fd44e4d5755cd43e9a783653827d917fa5ff281a4f1685b871d33a58b06e71ce" Jul 10 13:29:37.360736 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:37.360691 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd44e4d5755cd43e9a783653827d917fa5ff281a4f1685b871d33a58b06e71ce"} err="failed to get container status \"fd44e4d5755cd43e9a783653827d917fa5ff281a4f1685b871d33a58b06e71ce\": rpc error: code = NotFound desc = could not find container \"fd44e4d5755cd43e9a783653827d917fa5ff281a4f1685b871d33a58b06e71ce\": container with ID starting with fd44e4d5755cd43e9a783653827d917fa5ff281a4f1685b871d33a58b06e71ce not found: ID does not exist" Jul 10 13:29:37.374842 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:37.374818 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fff877fdc-6xs25"] Jul 10 13:29:37.379118 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:37.379094 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fff877fdc-6xs25"] Jul 10 13:29:38.237149 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:29:38.237117 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfcec118-dff5-4427-8547-db1d34c497a2" path="/var/lib/kubelet/pods/bfcec118-dff5-4427-8547-db1d34c497a2/volumes" Jul 10 13:30:47.189231 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:30:47.189204 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hrq6g_63c89ec5-2de9-4855-8fe8-57baaa8e0588/console-operator/1.log" Jul 10 13:30:47.195037 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:30:47.195016 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rpg2g_e7e01989-a0c5-4924-bebf-bad6bf0f0844/ovn-acl-logging/0.log" Jul 10 13:30:47.205220 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:30:47.205106 2575 kubelet.go:1648] "Image garbage collection succeeded" Jul 10 13:30:47.206268 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:30:47.206246 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hrq6g_63c89ec5-2de9-4855-8fe8-57baaa8e0588/console-operator/1.log" Jul 10 13:30:47.212572 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:30:47.212553 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rpg2g_e7e01989-a0c5-4924-bebf-bad6bf0f0844/ovn-acl-logging/0.log" Jul 10 13:31:03.015674 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.015619 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8c56dd4c7-zsqvf"] Jul 10 13:31:03.018058 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.016032 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfcec118-dff5-4427-8547-db1d34c497a2" containerName="console" Jul 10 13:31:03.018058 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.016051 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfcec118-dff5-4427-8547-db1d34c497a2" containerName="console" Jul 10 13:31:03.018058 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.016144 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfcec118-dff5-4427-8547-db1d34c497a2" containerName="console" Jul 10 13:31:03.019027 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.019009 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:31:03.032403 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.032379 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8c56dd4c7-zsqvf"] Jul 10 13:31:03.162960 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.162926 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f018ff7-7e0c-4be9-995c-84a0d28aee97-console-config\") pod \"console-8c56dd4c7-zsqvf\" (UID: \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\") " pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:31:03.163118 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.162966 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9s8w\" (UniqueName: \"kubernetes.io/projected/7f018ff7-7e0c-4be9-995c-84a0d28aee97-kube-api-access-n9s8w\") pod \"console-8c56dd4c7-zsqvf\" (UID: \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\") " pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:31:03.163118 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.162987 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f018ff7-7e0c-4be9-995c-84a0d28aee97-service-ca\") pod \"console-8c56dd4c7-zsqvf\" (UID: \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\") " pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:31:03.163118 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.163021 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f018ff7-7e0c-4be9-995c-84a0d28aee97-oauth-serving-cert\") pod \"console-8c56dd4c7-zsqvf\" (UID: \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\") " pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:31:03.163118 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.163042 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f018ff7-7e0c-4be9-995c-84a0d28aee97-console-serving-cert\") pod \"console-8c56dd4c7-zsqvf\" (UID: \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\") " pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:31:03.163118 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.163057 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f018ff7-7e0c-4be9-995c-84a0d28aee97-trusted-ca-bundle\") pod \"console-8c56dd4c7-zsqvf\" (UID: \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\") " pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:31:03.163118 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.163075 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f018ff7-7e0c-4be9-995c-84a0d28aee97-console-oauth-config\") pod \"console-8c56dd4c7-zsqvf\" (UID: \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\") " pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:31:03.263502 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.263472 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f018ff7-7e0c-4be9-995c-84a0d28aee97-console-serving-cert\") pod \"console-8c56dd4c7-zsqvf\" (UID: \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\") " pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:31:03.263502 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.263503 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f018ff7-7e0c-4be9-995c-84a0d28aee97-trusted-ca-bundle\") pod \"console-8c56dd4c7-zsqvf\" (UID: \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\") " pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:31:03.263702 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.263526 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f018ff7-7e0c-4be9-995c-84a0d28aee97-console-oauth-config\") pod \"console-8c56dd4c7-zsqvf\" (UID: \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\") " pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:31:03.263739 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.263713 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f018ff7-7e0c-4be9-995c-84a0d28aee97-console-config\") pod \"console-8c56dd4c7-zsqvf\" (UID: \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\") " pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:31:03.263791 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.263774 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9s8w\" (UniqueName: \"kubernetes.io/projected/7f018ff7-7e0c-4be9-995c-84a0d28aee97-kube-api-access-n9s8w\") pod \"console-8c56dd4c7-zsqvf\" (UID: \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\") " pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:31:03.263841 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.263820 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f018ff7-7e0c-4be9-995c-84a0d28aee97-service-ca\") pod \"console-8c56dd4c7-zsqvf\" (UID: \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\") " pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:31:03.263884 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.263842 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f018ff7-7e0c-4be9-995c-84a0d28aee97-oauth-serving-cert\") pod \"console-8c56dd4c7-zsqvf\" (UID: \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\") " pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:31:03.264440 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.264410 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f018ff7-7e0c-4be9-995c-84a0d28aee97-console-config\") pod \"console-8c56dd4c7-zsqvf\" (UID: \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\") " pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:31:03.264579 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.264525 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f018ff7-7e0c-4be9-995c-84a0d28aee97-service-ca\") pod \"console-8c56dd4c7-zsqvf\" (UID: \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\") " pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:31:03.264579 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.264546 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f018ff7-7e0c-4be9-995c-84a0d28aee97-trusted-ca-bundle\") pod \"console-8c56dd4c7-zsqvf\" (UID: \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\") " pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:31:03.264579 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.264529 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f018ff7-7e0c-4be9-995c-84a0d28aee97-oauth-serving-cert\") pod \"console-8c56dd4c7-zsqvf\" (UID: \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\") " pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:31:03.266092 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.266044 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f018ff7-7e0c-4be9-995c-84a0d28aee97-console-oauth-config\") pod \"console-8c56dd4c7-zsqvf\" (UID: \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\") " pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:31:03.266182 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.266150 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f018ff7-7e0c-4be9-995c-84a0d28aee97-console-serving-cert\") pod \"console-8c56dd4c7-zsqvf\" (UID: \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\") " pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:31:03.273388 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.273367 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9s8w\" (UniqueName: \"kubernetes.io/projected/7f018ff7-7e0c-4be9-995c-84a0d28aee97-kube-api-access-n9s8w\") pod \"console-8c56dd4c7-zsqvf\" (UID: \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\") " pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:31:03.328396 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.328374 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:31:03.459881 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.459855 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8c56dd4c7-zsqvf"] Jul 10 13:31:03.462209 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:31:03.462182 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f018ff7_7e0c_4be9_995c_84a0d28aee97.slice/crio-81798ed79721f2622aad37ff0acdc9ebc396b4c5d16bf9925e4653749fffcdc8 WatchSource:0}: Error finding container 81798ed79721f2622aad37ff0acdc9ebc396b4c5d16bf9925e4653749fffcdc8: Status 404 returned error can't find the container with id 81798ed79721f2622aad37ff0acdc9ebc396b4c5d16bf9925e4653749fffcdc8 Jul 10 13:31:03.667906 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.667872 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8c56dd4c7-zsqvf" event={"ID":"7f018ff7-7e0c-4be9-995c-84a0d28aee97","Type":"ContainerStarted","Data":"a4cac5a574556b17eed466ec5879720a01d759897797aff1a2db7db3207f3a93"} Jul 10 13:31:03.668088 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.667931 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8c56dd4c7-zsqvf" event={"ID":"7f018ff7-7e0c-4be9-995c-84a0d28aee97","Type":"ContainerStarted","Data":"81798ed79721f2622aad37ff0acdc9ebc396b4c5d16bf9925e4653749fffcdc8"} Jul 10 13:31:03.688038 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:03.687992 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8c56dd4c7-zsqvf" podStartSLOduration=1.6879788150000001 podStartE2EDuration="1.687978815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:31:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:31:03.686708553 +0000 UTC m=+316.926040475" watchObservedRunningTime="2026-07-10 13:31:03.687978815 +0000 UTC m=+316.927310736" Jul 10 13:31:13.329402 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:13.329371 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:31:13.329816 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:13.329441 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:31:13.334095 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:13.334075 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:31:13.706231 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:13.706201 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:31:13.754328 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:13.754297 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cb5f4b445-tgvc2"] Jul 10 13:31:32.269295 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:32.269263 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2"] Jul 10 13:31:32.272645 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:32.272613 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2" Jul 10 13:31:32.275024 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:32.274999 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v9dk4\"" Jul 10 13:31:32.275138 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:32.274999 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 10 13:31:32.275501 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:32.275486 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 10 13:31:32.283298 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:32.283276 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2"] Jul 10 13:31:32.286103 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:32.286082 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3007cca-1afb-45e9-aa48-7899b16af462-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2\" (UID: \"e3007cca-1afb-45e9-aa48-7899b16af462\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2" Jul 10 13:31:32.286196 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:32.286109 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdsp5\" (UniqueName: \"kubernetes.io/projected/e3007cca-1afb-45e9-aa48-7899b16af462-kube-api-access-pdsp5\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2\" (UID: \"e3007cca-1afb-45e9-aa48-7899b16af462\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2" Jul 10 13:31:32.286196 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:32.286137 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3007cca-1afb-45e9-aa48-7899b16af462-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2\" (UID: \"e3007cca-1afb-45e9-aa48-7899b16af462\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2" Jul 10 13:31:32.387325 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:32.387296 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3007cca-1afb-45e9-aa48-7899b16af462-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2\" (UID: \"e3007cca-1afb-45e9-aa48-7899b16af462\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2" Jul 10 13:31:32.387325 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:32.387328 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdsp5\" (UniqueName: \"kubernetes.io/projected/e3007cca-1afb-45e9-aa48-7899b16af462-kube-api-access-pdsp5\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2\" (UID: \"e3007cca-1afb-45e9-aa48-7899b16af462\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2" Jul 10 13:31:32.387506 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:32.387357 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3007cca-1afb-45e9-aa48-7899b16af462-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2\" (UID: \"e3007cca-1afb-45e9-aa48-7899b16af462\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2" Jul 10 13:31:32.387775 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:32.387757 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3007cca-1afb-45e9-aa48-7899b16af462-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2\" (UID: \"e3007cca-1afb-45e9-aa48-7899b16af462\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2" Jul 10 13:31:32.387827 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:32.387812 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3007cca-1afb-45e9-aa48-7899b16af462-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2\" (UID: \"e3007cca-1afb-45e9-aa48-7899b16af462\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2" Jul 10 13:31:32.396930 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:32.396898 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdsp5\" (UniqueName: \"kubernetes.io/projected/e3007cca-1afb-45e9-aa48-7899b16af462-kube-api-access-pdsp5\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2\" (UID: \"e3007cca-1afb-45e9-aa48-7899b16af462\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2" Jul 10 13:31:32.582812 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:32.582721 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2" Jul 10 13:31:32.709083 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:32.709062 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2"] Jul 10 13:31:32.711324 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:31:32.711288 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3007cca_1afb_45e9_aa48_7899b16af462.slice/crio-8ad01e25d81967411f5a70b4edfb0cb039773457f21b5ba9d9be55190a097756 WatchSource:0}: Error finding container 8ad01e25d81967411f5a70b4edfb0cb039773457f21b5ba9d9be55190a097756: Status 404 returned error can't find the container with id 8ad01e25d81967411f5a70b4edfb0cb039773457f21b5ba9d9be55190a097756 Jul 10 13:31:32.713209 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:32.713192 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 13:31:32.776632 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:32.776601 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2" event={"ID":"e3007cca-1afb-45e9-aa48-7899b16af462","Type":"ContainerStarted","Data":"8ad01e25d81967411f5a70b4edfb0cb039773457f21b5ba9d9be55190a097756"} Jul 10 13:31:38.778080 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:38.777993 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cb5f4b445-tgvc2" podUID="1673915e-e3c3-4d3a-9300-e8d9f14f00cf" containerName="console" containerID="cri-o://7f447b9080ac3d604cd2e7c48a79fb2a716c62f61b194683214f7aa5e218b17c" gracePeriod=15 Jul 10 13:31:40.099040 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.099020 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:31:40.155127 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.155105 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-oauth-serving-cert\") pod \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\" (UID: \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\") " Jul 10 13:31:40.155232 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.155140 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-console-oauth-config\") pod \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\" (UID: \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\") " Jul 10 13:31:40.155232 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.155192 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hh6w\" (UniqueName: \"kubernetes.io/projected/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-kube-api-access-4hh6w\") pod \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\" (UID: \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\") " Jul 10 13:31:40.155232 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.155207 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-console-serving-cert\") pod \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\" (UID: \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\") " Jul 10 13:31:40.155381 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.155238 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-service-ca\") pod \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\" (UID: \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\") " Jul 10 13:31:40.155381 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.155258 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-console-config\") pod \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\" (UID: \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\") " Jul 10 13:31:40.155381 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.155286 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-trusted-ca-bundle\") pod \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\" (UID: \"1673915e-e3c3-4d3a-9300-e8d9f14f00cf\") " Jul 10 13:31:40.155623 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.155592 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1673915e-e3c3-4d3a-9300-e8d9f14f00cf" (UID: "1673915e-e3c3-4d3a-9300-e8d9f14f00cf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:31:40.155736 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.155624 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-service-ca" (OuterVolumeSpecName: "service-ca") pod "1673915e-e3c3-4d3a-9300-e8d9f14f00cf" (UID: "1673915e-e3c3-4d3a-9300-e8d9f14f00cf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:31:40.155791 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.155724 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-console-config" (OuterVolumeSpecName: "console-config") pod "1673915e-e3c3-4d3a-9300-e8d9f14f00cf" (UID: "1673915e-e3c3-4d3a-9300-e8d9f14f00cf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:31:40.155846 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.155799 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1673915e-e3c3-4d3a-9300-e8d9f14f00cf" (UID: "1673915e-e3c3-4d3a-9300-e8d9f14f00cf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:31:40.157214 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.157195 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-kube-api-access-4hh6w" (OuterVolumeSpecName: "kube-api-access-4hh6w") pod "1673915e-e3c3-4d3a-9300-e8d9f14f00cf" (UID: "1673915e-e3c3-4d3a-9300-e8d9f14f00cf"). InnerVolumeSpecName "kube-api-access-4hh6w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:31:40.157315 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.157264 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1673915e-e3c3-4d3a-9300-e8d9f14f00cf" (UID: "1673915e-e3c3-4d3a-9300-e8d9f14f00cf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 13:31:40.157315 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.157292 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1673915e-e3c3-4d3a-9300-e8d9f14f00cf" (UID: "1673915e-e3c3-4d3a-9300-e8d9f14f00cf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 13:31:40.256150 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.256127 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-service-ca\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:31:40.256150 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.256149 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-console-config\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:31:40.256319 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.256158 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-trusted-ca-bundle\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:31:40.256319 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.256169 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-oauth-serving-cert\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:31:40.256319 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.256179 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-console-oauth-config\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:31:40.256319 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.256189 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hh6w\" (UniqueName: \"kubernetes.io/projected/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-kube-api-access-4hh6w\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:31:40.256319 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.256197 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1673915e-e3c3-4d3a-9300-e8d9f14f00cf-console-serving-cert\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:31:40.816931 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.816893 2575 generic.go:356] "Generic (PLEG): container finished" podID="1673915e-e3c3-4d3a-9300-e8d9f14f00cf" containerID="7f447b9080ac3d604cd2e7c48a79fb2a716c62f61b194683214f7aa5e218b17c" exitCode=0 Jul 10 13:31:40.816931 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.816940 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cb5f4b445-tgvc2" Jul 10 13:31:40.817169 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.816973 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb5f4b445-tgvc2" event={"ID":"1673915e-e3c3-4d3a-9300-e8d9f14f00cf","Type":"ContainerDied","Data":"7f447b9080ac3d604cd2e7c48a79fb2a716c62f61b194683214f7aa5e218b17c"} Jul 10 13:31:40.817169 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.817042 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cb5f4b445-tgvc2" event={"ID":"1673915e-e3c3-4d3a-9300-e8d9f14f00cf","Type":"ContainerDied","Data":"46264a1eb91b851da30ce4935f2dfb165c268b178a15017dd8a0adcc1ad6dd6a"} Jul 10 13:31:40.817169 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.817090 2575 scope.go:117] "RemoveContainer" containerID="7f447b9080ac3d604cd2e7c48a79fb2a716c62f61b194683214f7aa5e218b17c" Jul 10 13:31:40.818814 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.818785 2575 generic.go:356] "Generic (PLEG): container finished" podID="e3007cca-1afb-45e9-aa48-7899b16af462" containerID="836646fe3ca84e517aefc9d8fb86b35a9f795f1d074b5557657552ed9273e46a" exitCode=0 Jul 10 13:31:40.818927 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.818819 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2" event={"ID":"e3007cca-1afb-45e9-aa48-7899b16af462","Type":"ContainerDied","Data":"836646fe3ca84e517aefc9d8fb86b35a9f795f1d074b5557657552ed9273e46a"} Jul 10 13:31:40.825682 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.825661 2575 scope.go:117] "RemoveContainer" containerID="7f447b9080ac3d604cd2e7c48a79fb2a716c62f61b194683214f7aa5e218b17c" Jul 10 13:31:40.826081 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:31:40.826057 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f447b9080ac3d604cd2e7c48a79fb2a716c62f61b194683214f7aa5e218b17c\": container with ID starting with 7f447b9080ac3d604cd2e7c48a79fb2a716c62f61b194683214f7aa5e218b17c not found: ID does not exist" containerID="7f447b9080ac3d604cd2e7c48a79fb2a716c62f61b194683214f7aa5e218b17c" Jul 10 13:31:40.826146 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.826098 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f447b9080ac3d604cd2e7c48a79fb2a716c62f61b194683214f7aa5e218b17c"} err="failed to get container status \"7f447b9080ac3d604cd2e7c48a79fb2a716c62f61b194683214f7aa5e218b17c\": rpc error: code = NotFound desc = could not find container \"7f447b9080ac3d604cd2e7c48a79fb2a716c62f61b194683214f7aa5e218b17c\": container with ID starting with 7f447b9080ac3d604cd2e7c48a79fb2a716c62f61b194683214f7aa5e218b17c not found: ID does not exist" Jul 10 13:31:40.834936 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.834916 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cb5f4b445-tgvc2"] Jul 10 13:31:40.839354 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:40.839333 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cb5f4b445-tgvc2"] Jul 10 13:31:42.238827 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:42.238792 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1673915e-e3c3-4d3a-9300-e8d9f14f00cf" path="/var/lib/kubelet/pods/1673915e-e3c3-4d3a-9300-e8d9f14f00cf/volumes" Jul 10 13:31:43.836700 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:43.836665 2575 generic.go:356] "Generic (PLEG): container finished" podID="e3007cca-1afb-45e9-aa48-7899b16af462" containerID="42580672f3d79be3914c957d58100de36b2a5afb5fad03dc74454c7a02c59bd5" exitCode=0 Jul 10 13:31:43.837052 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:43.836727 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2" event={"ID":"e3007cca-1afb-45e9-aa48-7899b16af462","Type":"ContainerDied","Data":"42580672f3d79be3914c957d58100de36b2a5afb5fad03dc74454c7a02c59bd5"} Jul 10 13:31:52.877229 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:52.877199 2575 generic.go:356] "Generic (PLEG): container finished" podID="e3007cca-1afb-45e9-aa48-7899b16af462" containerID="3ad6f6afae55c7892790fb7e6e928b4c8b08860f50191e9219dfd95c2d03424f" exitCode=0 Jul 10 13:31:52.877577 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:52.877283 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2" event={"ID":"e3007cca-1afb-45e9-aa48-7899b16af462","Type":"ContainerDied","Data":"3ad6f6afae55c7892790fb7e6e928b4c8b08860f50191e9219dfd95c2d03424f"} Jul 10 13:31:54.006727 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:54.006705 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2" Jul 10 13:31:54.074180 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:54.074155 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdsp5\" (UniqueName: \"kubernetes.io/projected/e3007cca-1afb-45e9-aa48-7899b16af462-kube-api-access-pdsp5\") pod \"e3007cca-1afb-45e9-aa48-7899b16af462\" (UID: \"e3007cca-1afb-45e9-aa48-7899b16af462\") " Jul 10 13:31:54.074306 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:54.074233 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3007cca-1afb-45e9-aa48-7899b16af462-bundle\") pod \"e3007cca-1afb-45e9-aa48-7899b16af462\" (UID: \"e3007cca-1afb-45e9-aa48-7899b16af462\") " Jul 10 13:31:54.074306 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:54.074272 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3007cca-1afb-45e9-aa48-7899b16af462-util\") pod \"e3007cca-1afb-45e9-aa48-7899b16af462\" (UID: \"e3007cca-1afb-45e9-aa48-7899b16af462\") " Jul 10 13:31:54.074919 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:54.074895 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3007cca-1afb-45e9-aa48-7899b16af462-bundle" (OuterVolumeSpecName: "bundle") pod "e3007cca-1afb-45e9-aa48-7899b16af462" (UID: "e3007cca-1afb-45e9-aa48-7899b16af462"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:31:54.076402 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:54.076378 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3007cca-1afb-45e9-aa48-7899b16af462-kube-api-access-pdsp5" (OuterVolumeSpecName: "kube-api-access-pdsp5") pod "e3007cca-1afb-45e9-aa48-7899b16af462" (UID: "e3007cca-1afb-45e9-aa48-7899b16af462"). InnerVolumeSpecName "kube-api-access-pdsp5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:31:54.079799 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:54.079776 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3007cca-1afb-45e9-aa48-7899b16af462-util" (OuterVolumeSpecName: "util") pod "e3007cca-1afb-45e9-aa48-7899b16af462" (UID: "e3007cca-1afb-45e9-aa48-7899b16af462"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:31:54.174765 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:54.174703 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdsp5\" (UniqueName: \"kubernetes.io/projected/e3007cca-1afb-45e9-aa48-7899b16af462-kube-api-access-pdsp5\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:31:54.174765 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:54.174725 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3007cca-1afb-45e9-aa48-7899b16af462-bundle\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:31:54.174765 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:54.174733 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3007cca-1afb-45e9-aa48-7899b16af462-util\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:31:54.886499 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:54.886465 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2" event={"ID":"e3007cca-1afb-45e9-aa48-7899b16af462","Type":"ContainerDied","Data":"8ad01e25d81967411f5a70b4edfb0cb039773457f21b5ba9d9be55190a097756"} Jul 10 13:31:54.886681 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:54.886503 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x7ts2" Jul 10 13:31:54.886681 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:31:54.886521 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ad01e25d81967411f5a70b4edfb0cb039773457f21b5ba9d9be55190a097756" Jul 10 13:32:00.128063 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:00.128027 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ddsdq"] Jul 10 13:32:00.128502 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:00.128317 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3007cca-1afb-45e9-aa48-7899b16af462" containerName="util" Jul 10 13:32:00.128502 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:00.128329 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3007cca-1afb-45e9-aa48-7899b16af462" containerName="util" Jul 10 13:32:00.128502 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:00.128337 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3007cca-1afb-45e9-aa48-7899b16af462" containerName="pull" Jul 10 13:32:00.128502 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:00.128343 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3007cca-1afb-45e9-aa48-7899b16af462" containerName="pull" Jul 10 13:32:00.128502 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:00.128356 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1673915e-e3c3-4d3a-9300-e8d9f14f00cf" containerName="console" Jul 10 13:32:00.128502 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:00.128361 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1673915e-e3c3-4d3a-9300-e8d9f14f00cf" containerName="console" Jul 10 13:32:00.128502 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:00.128369 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3007cca-1afb-45e9-aa48-7899b16af462" containerName="extract" Jul 10 13:32:00.128502 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:00.128375 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3007cca-1afb-45e9-aa48-7899b16af462" containerName="extract" Jul 10 13:32:00.128502 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:00.128425 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1673915e-e3c3-4d3a-9300-e8d9f14f00cf" containerName="console" Jul 10 13:32:00.128502 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:00.128433 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3007cca-1afb-45e9-aa48-7899b16af462" containerName="extract" Jul 10 13:32:00.131477 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:00.131460 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ddsdq" Jul 10 13:32:00.133605 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:00.133586 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 10 13:32:00.133744 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:00.133703 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 10 13:32:00.133744 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:00.133715 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-8x7ht\"" Jul 10 13:32:00.141052 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:00.141032 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ddsdq"] Jul 10 13:32:00.218890 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:00.218851 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7068121d-5bd2-48c9-a962-5872369d027b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ddsdq\" (UID: \"7068121d-5bd2-48c9-a962-5872369d027b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ddsdq" Jul 10 13:32:00.219056 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:00.218905 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h97vs\" (UniqueName: \"kubernetes.io/projected/7068121d-5bd2-48c9-a962-5872369d027b-kube-api-access-h97vs\") pod \"cert-manager-operator-controller-manager-55c444bf86-ddsdq\" (UID: \"7068121d-5bd2-48c9-a962-5872369d027b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ddsdq" Jul 10 13:32:00.319508 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:00.319476 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7068121d-5bd2-48c9-a962-5872369d027b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ddsdq\" (UID: \"7068121d-5bd2-48c9-a962-5872369d027b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ddsdq" Jul 10 13:32:00.319508 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:00.319515 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h97vs\" (UniqueName: \"kubernetes.io/projected/7068121d-5bd2-48c9-a962-5872369d027b-kube-api-access-h97vs\") pod \"cert-manager-operator-controller-manager-55c444bf86-ddsdq\" (UID: \"7068121d-5bd2-48c9-a962-5872369d027b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ddsdq" Jul 10 13:32:00.319898 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:00.319879 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7068121d-5bd2-48c9-a962-5872369d027b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ddsdq\" (UID: \"7068121d-5bd2-48c9-a962-5872369d027b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ddsdq" Jul 10 13:32:00.330499 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:00.330478 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h97vs\" (UniqueName: \"kubernetes.io/projected/7068121d-5bd2-48c9-a962-5872369d027b-kube-api-access-h97vs\") pod \"cert-manager-operator-controller-manager-55c444bf86-ddsdq\" (UID: \"7068121d-5bd2-48c9-a962-5872369d027b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ddsdq" Jul 10 13:32:00.440587 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:00.440524 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ddsdq" Jul 10 13:32:00.566763 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:00.566735 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ddsdq"] Jul 10 13:32:00.570135 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:32:00.570105 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7068121d_5bd2_48c9_a962_5872369d027b.slice/crio-89cda42aebc465343e950a5d18e85bc30f51c1cc4fcebda763dd1f349431092c WatchSource:0}: Error finding container 89cda42aebc465343e950a5d18e85bc30f51c1cc4fcebda763dd1f349431092c: Status 404 returned error can't find the container with id 89cda42aebc465343e950a5d18e85bc30f51c1cc4fcebda763dd1f349431092c Jul 10 13:32:00.909420 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:00.909382 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ddsdq" event={"ID":"7068121d-5bd2-48c9-a962-5872369d027b","Type":"ContainerStarted","Data":"89cda42aebc465343e950a5d18e85bc30f51c1cc4fcebda763dd1f349431092c"} Jul 10 13:32:02.920251 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:02.920218 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ddsdq" event={"ID":"7068121d-5bd2-48c9-a962-5872369d027b","Type":"ContainerStarted","Data":"b778295c43c2760a2b2d7f30d6f37514b37006cd24c46ab54d89266b8ee3bca5"} Jul 10 13:32:02.942624 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:02.942565 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ddsdq" podStartSLOduration=1.146803445 podStartE2EDuration="2.942547324s" totalImagesPullingTime="1.795743879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:32:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:32:02.940580094 +0000 UTC m=+376.179912015" watchObservedRunningTime="2026-07-10 13:32:02.942547324 +0000 UTC m=+376.181879245" Jul 10 13:32:04.166382 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:04.166349 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv"] Jul 10 13:32:04.168496 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:04.168477 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv" Jul 10 13:32:04.170949 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:04.170926 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v9dk4\"" Jul 10 13:32:04.170949 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:04.170946 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 10 13:32:04.171086 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:04.171036 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 10 13:32:04.181073 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:04.181050 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv"] Jul 10 13:32:04.248549 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:04.248524 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce58b675-ebd1-477c-bd04-98f22cf8beb9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv\" (UID: \"ce58b675-ebd1-477c-bd04-98f22cf8beb9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv" Jul 10 13:32:04.248694 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:04.248570 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc4t6\" (UniqueName: \"kubernetes.io/projected/ce58b675-ebd1-477c-bd04-98f22cf8beb9-kube-api-access-mc4t6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv\" (UID: \"ce58b675-ebd1-477c-bd04-98f22cf8beb9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv" Jul 10 13:32:04.248694 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:04.248606 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce58b675-ebd1-477c-bd04-98f22cf8beb9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv\" (UID: \"ce58b675-ebd1-477c-bd04-98f22cf8beb9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv" Jul 10 13:32:04.348924 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:04.348891 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce58b675-ebd1-477c-bd04-98f22cf8beb9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv\" (UID: \"ce58b675-ebd1-477c-bd04-98f22cf8beb9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv" Jul 10 13:32:04.349078 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:04.348951 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc4t6\" (UniqueName: \"kubernetes.io/projected/ce58b675-ebd1-477c-bd04-98f22cf8beb9-kube-api-access-mc4t6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv\" (UID: \"ce58b675-ebd1-477c-bd04-98f22cf8beb9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv" Jul 10 13:32:04.349078 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:04.349001 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce58b675-ebd1-477c-bd04-98f22cf8beb9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv\" (UID: \"ce58b675-ebd1-477c-bd04-98f22cf8beb9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv" Jul 10 13:32:04.349280 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:04.349261 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce58b675-ebd1-477c-bd04-98f22cf8beb9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv\" (UID: \"ce58b675-ebd1-477c-bd04-98f22cf8beb9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv" Jul 10 13:32:04.349346 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:04.349308 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce58b675-ebd1-477c-bd04-98f22cf8beb9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv\" (UID: \"ce58b675-ebd1-477c-bd04-98f22cf8beb9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv" Jul 10 13:32:04.360248 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:04.360219 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc4t6\" (UniqueName: \"kubernetes.io/projected/ce58b675-ebd1-477c-bd04-98f22cf8beb9-kube-api-access-mc4t6\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv\" (UID: \"ce58b675-ebd1-477c-bd04-98f22cf8beb9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv" Jul 10 13:32:04.477365 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:04.477299 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv" Jul 10 13:32:04.603721 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:04.603698 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv"] Jul 10 13:32:04.606111 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:32:04.606072 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce58b675_ebd1_477c_bd04_98f22cf8beb9.slice/crio-374d5ff55df3811fd3dca94a19173b0e287fa46900569ef7bb78675156e75d71 WatchSource:0}: Error finding container 374d5ff55df3811fd3dca94a19173b0e287fa46900569ef7bb78675156e75d71: Status 404 returned error can't find the container with id 374d5ff55df3811fd3dca94a19173b0e287fa46900569ef7bb78675156e75d71 Jul 10 13:32:04.930949 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:04.930918 2575 generic.go:356] "Generic (PLEG): container finished" podID="ce58b675-ebd1-477c-bd04-98f22cf8beb9" containerID="5df3b5d27bf098f320647ec1d0c43471cd7f84bc41d992bf01db2a5e10d77128" exitCode=0 Jul 10 13:32:04.931127 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:04.930957 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv" event={"ID":"ce58b675-ebd1-477c-bd04-98f22cf8beb9","Type":"ContainerDied","Data":"5df3b5d27bf098f320647ec1d0c43471cd7f84bc41d992bf01db2a5e10d77128"} Jul 10 13:32:04.931127 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:04.930992 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv" event={"ID":"ce58b675-ebd1-477c-bd04-98f22cf8beb9","Type":"ContainerStarted","Data":"374d5ff55df3811fd3dca94a19173b0e287fa46900569ef7bb78675156e75d71"} Jul 10 13:32:07.946435 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:07.946400 2575 generic.go:356] "Generic (PLEG): container finished" podID="ce58b675-ebd1-477c-bd04-98f22cf8beb9" containerID="2e858f4a98275b2b8de260678bef4fad035ee1269df80cae878ab36bfff736b5" exitCode=0 Jul 10 13:32:07.946855 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:07.946495 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv" event={"ID":"ce58b675-ebd1-477c-bd04-98f22cf8beb9","Type":"ContainerDied","Data":"2e858f4a98275b2b8de260678bef4fad035ee1269df80cae878ab36bfff736b5"} Jul 10 13:32:08.614768 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:08.614736 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g6mnw"] Jul 10 13:32:08.616534 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:08.616518 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6mnw" Jul 10 13:32:08.618597 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:08.618570 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 10 13:32:08.618750 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:08.618699 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 10 13:32:08.619122 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:08.619104 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-2zwqk\"" Jul 10 13:32:08.629186 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:08.629164 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g6mnw"] Jul 10 13:32:08.786372 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:08.786346 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7869bc2c-e9ff-4096-beba-55fb683b66af-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g6mnw\" (UID: \"7869bc2c-e9ff-4096-beba-55fb683b66af\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6mnw" Jul 10 13:32:08.786560 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:08.786399 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtsgr\" (UniqueName: \"kubernetes.io/projected/7869bc2c-e9ff-4096-beba-55fb683b66af-kube-api-access-gtsgr\") pod \"cert-manager-cainjector-559cdd8c87-g6mnw\" (UID: \"7869bc2c-e9ff-4096-beba-55fb683b66af\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6mnw" Jul 10 13:32:08.886822 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:08.886753 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7869bc2c-e9ff-4096-beba-55fb683b66af-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g6mnw\" (UID: \"7869bc2c-e9ff-4096-beba-55fb683b66af\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6mnw" Jul 10 13:32:08.886822 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:08.886807 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtsgr\" (UniqueName: \"kubernetes.io/projected/7869bc2c-e9ff-4096-beba-55fb683b66af-kube-api-access-gtsgr\") pod \"cert-manager-cainjector-559cdd8c87-g6mnw\" (UID: \"7869bc2c-e9ff-4096-beba-55fb683b66af\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6mnw" Jul 10 13:32:08.895566 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:08.895540 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7869bc2c-e9ff-4096-beba-55fb683b66af-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-g6mnw\" (UID: \"7869bc2c-e9ff-4096-beba-55fb683b66af\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6mnw" Jul 10 13:32:08.895746 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:08.895728 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtsgr\" (UniqueName: \"kubernetes.io/projected/7869bc2c-e9ff-4096-beba-55fb683b66af-kube-api-access-gtsgr\") pod \"cert-manager-cainjector-559cdd8c87-g6mnw\" (UID: \"7869bc2c-e9ff-4096-beba-55fb683b66af\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6mnw" Jul 10 13:32:08.937548 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:08.937526 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6mnw" Jul 10 13:32:08.953252 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:08.953227 2575 generic.go:356] "Generic (PLEG): container finished" podID="ce58b675-ebd1-477c-bd04-98f22cf8beb9" containerID="2fb23bf7bb7ad88793fa3a860fa45a2ef831056a21bb573bdc4c50de8b49894b" exitCode=0 Jul 10 13:32:08.953563 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:08.953297 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv" event={"ID":"ce58b675-ebd1-477c-bd04-98f22cf8beb9","Type":"ContainerDied","Data":"2fb23bf7bb7ad88793fa3a860fa45a2ef831056a21bb573bdc4c50de8b49894b"} Jul 10 13:32:09.061404 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:09.061363 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-g6mnw"] Jul 10 13:32:09.063457 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:32:09.063429 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7869bc2c_e9ff_4096_beba_55fb683b66af.slice/crio-852444d08252df7b18d5c0411ea7c508f6611b164874d06d62c26a9f7ff1056a WatchSource:0}: Error finding container 852444d08252df7b18d5c0411ea7c508f6611b164874d06d62c26a9f7ff1056a: Status 404 returned error can't find the container with id 852444d08252df7b18d5c0411ea7c508f6611b164874d06d62c26a9f7ff1056a Jul 10 13:32:09.958447 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:09.958415 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6mnw" event={"ID":"7869bc2c-e9ff-4096-beba-55fb683b66af","Type":"ContainerStarted","Data":"852444d08252df7b18d5c0411ea7c508f6611b164874d06d62c26a9f7ff1056a"} Jul 10 13:32:10.108112 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:10.108087 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv" Jul 10 13:32:10.196913 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:10.196876 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce58b675-ebd1-477c-bd04-98f22cf8beb9-util\") pod \"ce58b675-ebd1-477c-bd04-98f22cf8beb9\" (UID: \"ce58b675-ebd1-477c-bd04-98f22cf8beb9\") " Jul 10 13:32:10.197070 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:10.196951 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mc4t6\" (UniqueName: \"kubernetes.io/projected/ce58b675-ebd1-477c-bd04-98f22cf8beb9-kube-api-access-mc4t6\") pod \"ce58b675-ebd1-477c-bd04-98f22cf8beb9\" (UID: \"ce58b675-ebd1-477c-bd04-98f22cf8beb9\") " Jul 10 13:32:10.197070 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:10.197007 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce58b675-ebd1-477c-bd04-98f22cf8beb9-bundle\") pod \"ce58b675-ebd1-477c-bd04-98f22cf8beb9\" (UID: \"ce58b675-ebd1-477c-bd04-98f22cf8beb9\") " Jul 10 13:32:10.197549 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:10.197491 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce58b675-ebd1-477c-bd04-98f22cf8beb9-bundle" (OuterVolumeSpecName: "bundle") pod "ce58b675-ebd1-477c-bd04-98f22cf8beb9" (UID: "ce58b675-ebd1-477c-bd04-98f22cf8beb9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:32:10.199336 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:10.199302 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce58b675-ebd1-477c-bd04-98f22cf8beb9-kube-api-access-mc4t6" (OuterVolumeSpecName: "kube-api-access-mc4t6") pod "ce58b675-ebd1-477c-bd04-98f22cf8beb9" (UID: "ce58b675-ebd1-477c-bd04-98f22cf8beb9"). InnerVolumeSpecName "kube-api-access-mc4t6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:32:10.202194 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:10.202140 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce58b675-ebd1-477c-bd04-98f22cf8beb9-util" (OuterVolumeSpecName: "util") pod "ce58b675-ebd1-477c-bd04-98f22cf8beb9" (UID: "ce58b675-ebd1-477c-bd04-98f22cf8beb9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:32:10.298619 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:10.298589 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mc4t6\" (UniqueName: \"kubernetes.io/projected/ce58b675-ebd1-477c-bd04-98f22cf8beb9-kube-api-access-mc4t6\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:32:10.298619 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:10.298619 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce58b675-ebd1-477c-bd04-98f22cf8beb9-bundle\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:32:10.298619 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:10.298628 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce58b675-ebd1-477c-bd04-98f22cf8beb9-util\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:32:10.965283 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:10.965249 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv" event={"ID":"ce58b675-ebd1-477c-bd04-98f22cf8beb9","Type":"ContainerDied","Data":"374d5ff55df3811fd3dca94a19173b0e287fa46900569ef7bb78675156e75d71"} Jul 10 13:32:10.965729 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:10.965302 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="374d5ff55df3811fd3dca94a19173b0e287fa46900569ef7bb78675156e75d71" Jul 10 13:32:10.965729 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:10.965333 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvpblv" Jul 10 13:32:12.974793 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:12.974759 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6mnw" event={"ID":"7869bc2c-e9ff-4096-beba-55fb683b66af","Type":"ContainerStarted","Data":"e1f5c0c2fd2121158a94630d3e95b5fb4a22c187885715b01da105f55a6b7e54"} Jul 10 13:32:12.992181 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:12.992135 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-g6mnw" podStartSLOduration=2.049500111 podStartE2EDuration="4.992120437s" totalImagesPullingTime="2.942620326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:32:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:32:12.990946035 +0000 UTC m=+386.230277957" watchObservedRunningTime="2026-07-10 13:32:12.992120437 +0000 UTC m=+386.231452357" Jul 10 13:32:16.967528 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:16.967493 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gvr6c"] Jul 10 13:32:16.967902 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:16.967792 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce58b675-ebd1-477c-bd04-98f22cf8beb9" containerName="util" Jul 10 13:32:16.967902 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:16.967804 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce58b675-ebd1-477c-bd04-98f22cf8beb9" containerName="util" Jul 10 13:32:16.967902 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:16.967813 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce58b675-ebd1-477c-bd04-98f22cf8beb9" containerName="pull" Jul 10 13:32:16.967902 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:16.967818 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce58b675-ebd1-477c-bd04-98f22cf8beb9" containerName="pull" Jul 10 13:32:16.967902 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:16.967837 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce58b675-ebd1-477c-bd04-98f22cf8beb9" containerName="extract" Jul 10 13:32:16.967902 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:16.967843 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce58b675-ebd1-477c-bd04-98f22cf8beb9" containerName="extract" Jul 10 13:32:16.967902 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:16.967886 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce58b675-ebd1-477c-bd04-98f22cf8beb9" containerName="extract" Jul 10 13:32:16.971853 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:16.971837 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gvr6c" Jul 10 13:32:16.973980 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:16.973953 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-mr9fz\"" Jul 10 13:32:16.974114 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:16.973964 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 10 13:32:16.974447 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:16.974434 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 10 13:32:16.984091 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:16.984067 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gvr6c"] Jul 10 13:32:17.049224 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:17.049186 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zths\" (UniqueName: \"kubernetes.io/projected/3c1ee0a5-d2c3-4257-94d1-b1df268e60b0-kube-api-access-7zths\") pod \"openshift-lws-operator-fd8ccff4c-gvr6c\" (UID: \"3c1ee0a5-d2c3-4257-94d1-b1df268e60b0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gvr6c" Jul 10 13:32:17.049398 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:17.049248 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c1ee0a5-d2c3-4257-94d1-b1df268e60b0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gvr6c\" (UID: \"3c1ee0a5-d2c3-4257-94d1-b1df268e60b0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gvr6c" Jul 10 13:32:17.149751 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:17.149714 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c1ee0a5-d2c3-4257-94d1-b1df268e60b0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gvr6c\" (UID: \"3c1ee0a5-d2c3-4257-94d1-b1df268e60b0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gvr6c" Jul 10 13:32:17.149914 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:17.149792 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zths\" (UniqueName: \"kubernetes.io/projected/3c1ee0a5-d2c3-4257-94d1-b1df268e60b0-kube-api-access-7zths\") pod \"openshift-lws-operator-fd8ccff4c-gvr6c\" (UID: \"3c1ee0a5-d2c3-4257-94d1-b1df268e60b0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gvr6c" Jul 10 13:32:17.150102 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:17.150082 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c1ee0a5-d2c3-4257-94d1-b1df268e60b0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gvr6c\" (UID: \"3c1ee0a5-d2c3-4257-94d1-b1df268e60b0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gvr6c" Jul 10 13:32:17.158990 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:17.158961 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zths\" (UniqueName: \"kubernetes.io/projected/3c1ee0a5-d2c3-4257-94d1-b1df268e60b0-kube-api-access-7zths\") pod \"openshift-lws-operator-fd8ccff4c-gvr6c\" (UID: \"3c1ee0a5-d2c3-4257-94d1-b1df268e60b0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gvr6c" Jul 10 13:32:17.280276 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:17.280208 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gvr6c" Jul 10 13:32:17.415830 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:17.415777 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gvr6c"] Jul 10 13:32:17.418017 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:32:17.417991 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c1ee0a5_d2c3_4257_94d1_b1df268e60b0.slice/crio-40255e2c96a2eacf3511ed734249b454a1cfef03db13c1db9dc93e408de9ef92 WatchSource:0}: Error finding container 40255e2c96a2eacf3511ed734249b454a1cfef03db13c1db9dc93e408de9ef92: Status 404 returned error can't find the container with id 40255e2c96a2eacf3511ed734249b454a1cfef03db13c1db9dc93e408de9ef92 Jul 10 13:32:17.997674 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:17.997630 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gvr6c" event={"ID":"3c1ee0a5-d2c3-4257-94d1-b1df268e60b0","Type":"ContainerStarted","Data":"40255e2c96a2eacf3511ed734249b454a1cfef03db13c1db9dc93e408de9ef92"} Jul 10 13:32:20.010336 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:20.010298 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gvr6c" event={"ID":"3c1ee0a5-d2c3-4257-94d1-b1df268e60b0","Type":"ContainerStarted","Data":"b47a702fb1d61f4a60269844b1d01b4d9b75b0fd8615148b60d518699bbf309a"} Jul 10 13:32:20.027587 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:20.027539 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gvr6c" podStartSLOduration=1.667664625 podStartE2EDuration="4.027525367s" totalImagesPullingTime="2.359860742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:32:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:32:20.026381159 +0000 UTC m=+393.265713082" watchObservedRunningTime="2026-07-10 13:32:20.027525367 +0000 UTC m=+393.266857288" Jul 10 13:32:24.816230 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:24.816197 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m"] Jul 10 13:32:24.837304 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:24.837275 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m"] Jul 10 13:32:24.837443 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:24.837395 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m" Jul 10 13:32:24.840323 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:24.840293 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v9dk4\"" Jul 10 13:32:24.840508 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:24.840484 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 10 13:32:24.840929 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:24.840912 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 10 13:32:24.905910 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:24.905883 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f58ff972-e3d2-4675-9af5-926e91d7ec2c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m\" (UID: \"f58ff972-e3d2-4675-9af5-926e91d7ec2c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m" Jul 10 13:32:24.906020 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:24.905930 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6xjz\" (UniqueName: \"kubernetes.io/projected/f58ff972-e3d2-4675-9af5-926e91d7ec2c-kube-api-access-w6xjz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m\" (UID: \"f58ff972-e3d2-4675-9af5-926e91d7ec2c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m" Jul 10 13:32:24.906020 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:24.906005 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f58ff972-e3d2-4675-9af5-926e91d7ec2c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m\" (UID: \"f58ff972-e3d2-4675-9af5-926e91d7ec2c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m" Jul 10 13:32:25.006630 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:25.006604 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6xjz\" (UniqueName: \"kubernetes.io/projected/f58ff972-e3d2-4675-9af5-926e91d7ec2c-kube-api-access-w6xjz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m\" (UID: \"f58ff972-e3d2-4675-9af5-926e91d7ec2c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m" Jul 10 13:32:25.006788 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:25.006663 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f58ff972-e3d2-4675-9af5-926e91d7ec2c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m\" (UID: \"f58ff972-e3d2-4675-9af5-926e91d7ec2c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m" Jul 10 13:32:25.006788 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:25.006697 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f58ff972-e3d2-4675-9af5-926e91d7ec2c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m\" (UID: \"f58ff972-e3d2-4675-9af5-926e91d7ec2c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m" Jul 10 13:32:25.007043 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:25.007028 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f58ff972-e3d2-4675-9af5-926e91d7ec2c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m\" (UID: \"f58ff972-e3d2-4675-9af5-926e91d7ec2c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m" Jul 10 13:32:25.007082 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:25.007051 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f58ff972-e3d2-4675-9af5-926e91d7ec2c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m\" (UID: \"f58ff972-e3d2-4675-9af5-926e91d7ec2c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m" Jul 10 13:32:25.016142 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:25.016121 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6xjz\" (UniqueName: \"kubernetes.io/projected/f58ff972-e3d2-4675-9af5-926e91d7ec2c-kube-api-access-w6xjz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m\" (UID: \"f58ff972-e3d2-4675-9af5-926e91d7ec2c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m" Jul 10 13:32:25.146313 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:25.146286 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m" Jul 10 13:32:25.277119 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:25.277093 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m"] Jul 10 13:32:25.279110 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:32:25.279082 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf58ff972_e3d2_4675_9af5_926e91d7ec2c.slice/crio-2089100ffa9c87820dae5997f0afe0c093d4019367f8f33e5c460a848a360ad1 WatchSource:0}: Error finding container 2089100ffa9c87820dae5997f0afe0c093d4019367f8f33e5c460a848a360ad1: Status 404 returned error can't find the container with id 2089100ffa9c87820dae5997f0afe0c093d4019367f8f33e5c460a848a360ad1 Jul 10 13:32:26.037690 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:26.037653 2575 generic.go:356] "Generic (PLEG): container finished" podID="f58ff972-e3d2-4675-9af5-926e91d7ec2c" containerID="868a5e011bb2e9ca8a92f72b72e472e7370815764210271d23146c74ccb28d68" exitCode=0 Jul 10 13:32:26.038012 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:26.037682 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m" event={"ID":"f58ff972-e3d2-4675-9af5-926e91d7ec2c","Type":"ContainerDied","Data":"868a5e011bb2e9ca8a92f72b72e472e7370815764210271d23146c74ccb28d68"} Jul 10 13:32:26.038012 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:26.037748 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m" event={"ID":"f58ff972-e3d2-4675-9af5-926e91d7ec2c","Type":"ContainerStarted","Data":"2089100ffa9c87820dae5997f0afe0c093d4019367f8f33e5c460a848a360ad1"} Jul 10 13:32:27.043504 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:27.043418 2575 generic.go:356] "Generic (PLEG): container finished" podID="f58ff972-e3d2-4675-9af5-926e91d7ec2c" containerID="a930f09963cb8bcb7995b4f909375078dc38368734a2609372c32370e4c185ea" exitCode=0 Jul 10 13:32:27.043504 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:27.043491 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m" event={"ID":"f58ff972-e3d2-4675-9af5-926e91d7ec2c","Type":"ContainerDied","Data":"a930f09963cb8bcb7995b4f909375078dc38368734a2609372c32370e4c185ea"} Jul 10 13:32:28.050164 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:28.050126 2575 generic.go:356] "Generic (PLEG): container finished" podID="f58ff972-e3d2-4675-9af5-926e91d7ec2c" containerID="801a6719243ccc5b87c3e588592d6996b65d2594f093333da00daf3420ad846a" exitCode=0 Jul 10 13:32:28.050536 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:28.050208 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m" event={"ID":"f58ff972-e3d2-4675-9af5-926e91d7ec2c","Type":"ContainerDied","Data":"801a6719243ccc5b87c3e588592d6996b65d2594f093333da00daf3420ad846a"} Jul 10 13:32:29.180053 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:29.180028 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m" Jul 10 13:32:29.237238 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:29.237202 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f58ff972-e3d2-4675-9af5-926e91d7ec2c-util\") pod \"f58ff972-e3d2-4675-9af5-926e91d7ec2c\" (UID: \"f58ff972-e3d2-4675-9af5-926e91d7ec2c\") " Jul 10 13:32:29.237369 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:29.237311 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6xjz\" (UniqueName: \"kubernetes.io/projected/f58ff972-e3d2-4675-9af5-926e91d7ec2c-kube-api-access-w6xjz\") pod \"f58ff972-e3d2-4675-9af5-926e91d7ec2c\" (UID: \"f58ff972-e3d2-4675-9af5-926e91d7ec2c\") " Jul 10 13:32:29.237369 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:29.237356 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f58ff972-e3d2-4675-9af5-926e91d7ec2c-bundle\") pod \"f58ff972-e3d2-4675-9af5-926e91d7ec2c\" (UID: \"f58ff972-e3d2-4675-9af5-926e91d7ec2c\") " Jul 10 13:32:29.238087 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:29.238058 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f58ff972-e3d2-4675-9af5-926e91d7ec2c-bundle" (OuterVolumeSpecName: "bundle") pod "f58ff972-e3d2-4675-9af5-926e91d7ec2c" (UID: "f58ff972-e3d2-4675-9af5-926e91d7ec2c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:32:29.239460 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:29.239430 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f58ff972-e3d2-4675-9af5-926e91d7ec2c-kube-api-access-w6xjz" (OuterVolumeSpecName: "kube-api-access-w6xjz") pod "f58ff972-e3d2-4675-9af5-926e91d7ec2c" (UID: "f58ff972-e3d2-4675-9af5-926e91d7ec2c"). InnerVolumeSpecName "kube-api-access-w6xjz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:32:29.243505 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:29.243485 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f58ff972-e3d2-4675-9af5-926e91d7ec2c-util" (OuterVolumeSpecName: "util") pod "f58ff972-e3d2-4675-9af5-926e91d7ec2c" (UID: "f58ff972-e3d2-4675-9af5-926e91d7ec2c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:32:29.338537 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:29.338462 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f58ff972-e3d2-4675-9af5-926e91d7ec2c-util\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:32:29.338537 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:29.338487 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6xjz\" (UniqueName: \"kubernetes.io/projected/f58ff972-e3d2-4675-9af5-926e91d7ec2c-kube-api-access-w6xjz\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:32:29.338537 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:29.338501 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f58ff972-e3d2-4675-9af5-926e91d7ec2c-bundle\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:32:30.060783 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:30.060745 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m" event={"ID":"f58ff972-e3d2-4675-9af5-926e91d7ec2c","Type":"ContainerDied","Data":"2089100ffa9c87820dae5997f0afe0c093d4019367f8f33e5c460a848a360ad1"} Jul 10 13:32:30.060950 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:30.060791 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmnl9m" Jul 10 13:32:30.060950 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:30.060798 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2089100ffa9c87820dae5997f0afe0c093d4019367f8f33e5c460a848a360ad1" Jul 10 13:32:38.534898 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.534861 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4"] Jul 10 13:32:38.535265 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.535144 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f58ff972-e3d2-4675-9af5-926e91d7ec2c" containerName="extract" Jul 10 13:32:38.535265 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.535154 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f58ff972-e3d2-4675-9af5-926e91d7ec2c" containerName="extract" Jul 10 13:32:38.535265 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.535170 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f58ff972-e3d2-4675-9af5-926e91d7ec2c" containerName="util" Jul 10 13:32:38.535265 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.535175 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f58ff972-e3d2-4675-9af5-926e91d7ec2c" containerName="util" Jul 10 13:32:38.535265 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.535190 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f58ff972-e3d2-4675-9af5-926e91d7ec2c" containerName="pull" Jul 10 13:32:38.535265 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.535196 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f58ff972-e3d2-4675-9af5-926e91d7ec2c" containerName="pull" Jul 10 13:32:38.535265 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.535246 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f58ff972-e3d2-4675-9af5-926e91d7ec2c" containerName="extract" Jul 10 13:32:38.537214 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.537195 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4" Jul 10 13:32:38.542428 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.542406 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 10 13:32:38.542570 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.542460 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 10 13:32:38.542570 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.542481 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 10 13:32:38.542695 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.542666 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-66n66\"" Jul 10 13:32:38.542780 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.542759 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 10 13:32:38.558439 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.558418 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4"] Jul 10 13:32:38.608433 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.608404 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bshk8\" (UniqueName: \"kubernetes.io/projected/47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6-kube-api-access-bshk8\") pod \"opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4\" (UID: \"47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4" Jul 10 13:32:38.608564 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.608446 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4\" (UID: \"47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4" Jul 10 13:32:38.608564 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.608511 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6-tmp\") pod \"opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4\" (UID: \"47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4" Jul 10 13:32:38.608564 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.608530 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4\" (UID: \"47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4" Jul 10 13:32:38.608564 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.608556 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6-manifests\") pod \"opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4\" (UID: \"47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4" Jul 10 13:32:38.709185 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.709154 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bshk8\" (UniqueName: \"kubernetes.io/projected/47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6-kube-api-access-bshk8\") pod \"opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4\" (UID: \"47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4" Jul 10 13:32:38.709324 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.709195 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4\" (UID: \"47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4" Jul 10 13:32:38.709324 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.709239 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6-tmp\") pod \"opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4\" (UID: \"47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4" Jul 10 13:32:38.709324 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.709258 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4\" (UID: \"47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4" Jul 10 13:32:38.709324 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.709276 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6-manifests\") pod \"opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4\" (UID: \"47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4" Jul 10 13:32:38.709730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.709703 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6-manifests\") pod \"opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4\" (UID: \"47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4" Jul 10 13:32:38.711705 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.711684 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6-tmp\") pod \"opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4\" (UID: \"47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4" Jul 10 13:32:38.711807 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.711762 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4\" (UID: \"47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4" Jul 10 13:32:38.711807 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.711778 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4\" (UID: \"47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4" Jul 10 13:32:38.725405 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.725379 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bshk8\" (UniqueName: \"kubernetes.io/projected/47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6-kube-api-access-bshk8\") pod \"opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4\" (UID: \"47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4" Jul 10 13:32:38.847036 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.846968 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4" Jul 10 13:32:38.995700 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:38.995672 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4"] Jul 10 13:32:38.997160 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:32:38.997125 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47f4b1c9_4ec5_4fdc_93e0_cc3cb54cb2a6.slice/crio-b02196ba910a01c83431c4e777c5aae6c6521086ccf9743ed6cce7d232fcb13e WatchSource:0}: Error finding container b02196ba910a01c83431c4e777c5aae6c6521086ccf9743ed6cce7d232fcb13e: Status 404 returned error can't find the container with id b02196ba910a01c83431c4e777c5aae6c6521086ccf9743ed6cce7d232fcb13e Jul 10 13:32:39.101531 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:39.101460 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4" event={"ID":"47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6","Type":"ContainerStarted","Data":"b02196ba910a01c83431c4e777c5aae6c6521086ccf9743ed6cce7d232fcb13e"} Jul 10 13:32:42.117797 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:42.117713 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4" event={"ID":"47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6","Type":"ContainerStarted","Data":"dfe38d1bd8604d2625372185cb9c9b16a4ec7fea091345d17743ee092ae7c8df"} Jul 10 13:32:43.124103 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:43.124069 2575 generic.go:356] "Generic (PLEG): container finished" podID="47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6" containerID="dfe38d1bd8604d2625372185cb9c9b16a4ec7fea091345d17743ee092ae7c8df" exitCode=0 Jul 10 13:32:43.124489 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:43.124160 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4" event={"ID":"47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6","Type":"ContainerDied","Data":"dfe38d1bd8604d2625372185cb9c9b16a4ec7fea091345d17743ee092ae7c8df"} Jul 10 13:32:44.130321 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:44.130290 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4" event={"ID":"47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6","Type":"ContainerStarted","Data":"62a763c4ecf6e75eb874b3a15ab04c70fd594f93726d6ef0a70e9938beb2e9f3"} Jul 10 13:32:44.130728 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:44.130384 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4" Jul 10 13:32:44.150781 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:44.150737 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4" podStartSLOduration=1.9490911579999999 podStartE2EDuration="6.15072357s" totalImagesPullingTime="3.191646717s" totalInitContainerRuntime="1.009985695s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:32:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:32:44.150206201 +0000 UTC m=+417.389538122" watchObservedRunningTime="2026-07-10 13:32:44.15072357 +0000 UTC m=+417.390055490" Jul 10 13:32:55.137739 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:55.137703 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4" Jul 10 13:32:56.238134 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:56.238101 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b765fbf76-6pl2m"] Jul 10 13:32:56.245653 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:56.245618 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b765fbf76-6pl2m" Jul 10 13:32:56.248406 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:56.248383 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 10 13:32:56.248406 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:56.248401 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 10 13:32:56.248580 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:56.248422 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 10 13:32:56.248580 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:56.248404 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jtsk2\"" Jul 10 13:32:56.252017 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:56.251995 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b765fbf76-6pl2m"] Jul 10 13:32:56.353231 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:56.353207 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6d537713-2044-4ec2-9435-70eb7e81e317-manager-config\") pod \"lws-controller-manager-7b765fbf76-6pl2m\" (UID: \"6d537713-2044-4ec2-9435-70eb7e81e317\") " pod="openshift-lws-operator/lws-controller-manager-7b765fbf76-6pl2m" Jul 10 13:32:56.353367 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:56.353238 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d537713-2044-4ec2-9435-70eb7e81e317-cert\") pod \"lws-controller-manager-7b765fbf76-6pl2m\" (UID: \"6d537713-2044-4ec2-9435-70eb7e81e317\") " pod="openshift-lws-operator/lws-controller-manager-7b765fbf76-6pl2m" Jul 10 13:32:56.353367 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:56.353260 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5rzh\" (UniqueName: \"kubernetes.io/projected/6d537713-2044-4ec2-9435-70eb7e81e317-kube-api-access-k5rzh\") pod \"lws-controller-manager-7b765fbf76-6pl2m\" (UID: \"6d537713-2044-4ec2-9435-70eb7e81e317\") " pod="openshift-lws-operator/lws-controller-manager-7b765fbf76-6pl2m" Jul 10 13:32:56.353367 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:56.353341 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6d537713-2044-4ec2-9435-70eb7e81e317-metrics-cert\") pod \"lws-controller-manager-7b765fbf76-6pl2m\" (UID: \"6d537713-2044-4ec2-9435-70eb7e81e317\") " pod="openshift-lws-operator/lws-controller-manager-7b765fbf76-6pl2m" Jul 10 13:32:56.453926 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:56.453894 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6d537713-2044-4ec2-9435-70eb7e81e317-manager-config\") pod \"lws-controller-manager-7b765fbf76-6pl2m\" (UID: \"6d537713-2044-4ec2-9435-70eb7e81e317\") " pod="openshift-lws-operator/lws-controller-manager-7b765fbf76-6pl2m" Jul 10 13:32:56.454045 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:56.453934 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d537713-2044-4ec2-9435-70eb7e81e317-cert\") pod \"lws-controller-manager-7b765fbf76-6pl2m\" (UID: \"6d537713-2044-4ec2-9435-70eb7e81e317\") " pod="openshift-lws-operator/lws-controller-manager-7b765fbf76-6pl2m" Jul 10 13:32:56.454045 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:56.453954 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5rzh\" (UniqueName: \"kubernetes.io/projected/6d537713-2044-4ec2-9435-70eb7e81e317-kube-api-access-k5rzh\") pod \"lws-controller-manager-7b765fbf76-6pl2m\" (UID: \"6d537713-2044-4ec2-9435-70eb7e81e317\") " pod="openshift-lws-operator/lws-controller-manager-7b765fbf76-6pl2m" Jul 10 13:32:56.454122 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:56.454072 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6d537713-2044-4ec2-9435-70eb7e81e317-metrics-cert\") pod \"lws-controller-manager-7b765fbf76-6pl2m\" (UID: \"6d537713-2044-4ec2-9435-70eb7e81e317\") " pod="openshift-lws-operator/lws-controller-manager-7b765fbf76-6pl2m" Jul 10 13:32:56.454578 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:56.454559 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6d537713-2044-4ec2-9435-70eb7e81e317-manager-config\") pod \"lws-controller-manager-7b765fbf76-6pl2m\" (UID: \"6d537713-2044-4ec2-9435-70eb7e81e317\") " pod="openshift-lws-operator/lws-controller-manager-7b765fbf76-6pl2m" Jul 10 13:32:56.456411 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:56.456389 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6d537713-2044-4ec2-9435-70eb7e81e317-metrics-cert\") pod \"lws-controller-manager-7b765fbf76-6pl2m\" (UID: \"6d537713-2044-4ec2-9435-70eb7e81e317\") " pod="openshift-lws-operator/lws-controller-manager-7b765fbf76-6pl2m" Jul 10 13:32:56.456501 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:56.456423 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6d537713-2044-4ec2-9435-70eb7e81e317-cert\") pod \"lws-controller-manager-7b765fbf76-6pl2m\" (UID: \"6d537713-2044-4ec2-9435-70eb7e81e317\") " pod="openshift-lws-operator/lws-controller-manager-7b765fbf76-6pl2m" Jul 10 13:32:56.464090 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:56.464069 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5rzh\" (UniqueName: \"kubernetes.io/projected/6d537713-2044-4ec2-9435-70eb7e81e317-kube-api-access-k5rzh\") pod \"lws-controller-manager-7b765fbf76-6pl2m\" (UID: \"6d537713-2044-4ec2-9435-70eb7e81e317\") " pod="openshift-lws-operator/lws-controller-manager-7b765fbf76-6pl2m" Jul 10 13:32:56.557031 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:56.556960 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b765fbf76-6pl2m" Jul 10 13:32:56.687178 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:56.687155 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b765fbf76-6pl2m"] Jul 10 13:32:56.689391 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:32:56.689362 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d537713_2044_4ec2_9435_70eb7e81e317.slice/crio-d018800dd3751c9d051cbfcb331553478ad563a4f475ce890ab14db8d6ac7868 WatchSource:0}: Error finding container d018800dd3751c9d051cbfcb331553478ad563a4f475ce890ab14db8d6ac7868: Status 404 returned error can't find the container with id d018800dd3751c9d051cbfcb331553478ad563a4f475ce890ab14db8d6ac7868 Jul 10 13:32:57.190764 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:57.190728 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b765fbf76-6pl2m" event={"ID":"6d537713-2044-4ec2-9435-70eb7e81e317","Type":"ContainerStarted","Data":"d018800dd3751c9d051cbfcb331553478ad563a4f475ce890ab14db8d6ac7868"} Jul 10 13:32:59.201843 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:59.201811 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b765fbf76-6pl2m" event={"ID":"6d537713-2044-4ec2-9435-70eb7e81e317","Type":"ContainerStarted","Data":"5189867be588a25bb4441d21f6f9ff27896841e6307713deab63b94218ceeeed"} Jul 10 13:32:59.202283 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:59.201884 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7b765fbf76-6pl2m" Jul 10 13:32:59.222282 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:32:59.222236 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7b765fbf76-6pl2m" podStartSLOduration=1.589132768 podStartE2EDuration="3.2222218s" totalImagesPullingTime="1.633089032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:32:59.221558379 +0000 UTC m=+432.460890319" watchObservedRunningTime="2026-07-10 13:32:59.2222218 +0000 UTC m=+432.461553721" Jul 10 13:33:06.609938 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.609908 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q"] Jul 10 13:33:06.614237 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.614220 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.617157 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.617135 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-n5b9n\"" Jul 10 13:33:06.617558 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.617542 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 10 13:33:06.640218 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.640195 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q"] Jul 10 13:33:06.743796 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.743764 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d301a6f7-d8e0-4f96-8950-09a560e00a9e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xjk9q\" (UID: \"d301a6f7-d8e0-4f96-8950-09a560e00a9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.743959 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.743821 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t57zs\" (UniqueName: \"kubernetes.io/projected/d301a6f7-d8e0-4f96-8950-09a560e00a9e-kube-api-access-t57zs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xjk9q\" (UID: \"d301a6f7-d8e0-4f96-8950-09a560e00a9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.743959 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.743906 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d301a6f7-d8e0-4f96-8950-09a560e00a9e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xjk9q\" (UID: \"d301a6f7-d8e0-4f96-8950-09a560e00a9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.743959 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.743933 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d301a6f7-d8e0-4f96-8950-09a560e00a9e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xjk9q\" (UID: \"d301a6f7-d8e0-4f96-8950-09a560e00a9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.743959 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.743957 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d301a6f7-d8e0-4f96-8950-09a560e00a9e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xjk9q\" (UID: \"d301a6f7-d8e0-4f96-8950-09a560e00a9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.744094 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.744019 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d301a6f7-d8e0-4f96-8950-09a560e00a9e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xjk9q\" (UID: \"d301a6f7-d8e0-4f96-8950-09a560e00a9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.744094 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.744041 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d301a6f7-d8e0-4f96-8950-09a560e00a9e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xjk9q\" (UID: \"d301a6f7-d8e0-4f96-8950-09a560e00a9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.744094 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.744067 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d301a6f7-d8e0-4f96-8950-09a560e00a9e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xjk9q\" (UID: \"d301a6f7-d8e0-4f96-8950-09a560e00a9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.744094 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.744085 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d301a6f7-d8e0-4f96-8950-09a560e00a9e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xjk9q\" (UID: \"d301a6f7-d8e0-4f96-8950-09a560e00a9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.777306 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.777274 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q"] Jul 10 13:33:06.780383 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.780368 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" Jul 10 13:33:06.786083 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.786058 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 10 13:33:06.786210 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.786192 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 10 13:33:06.786794 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.786774 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gp66z\"" Jul 10 13:33:06.788354 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.788332 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 10 13:33:06.801119 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.801098 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q"] Jul 10 13:33:06.845224 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.845201 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d301a6f7-d8e0-4f96-8950-09a560e00a9e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xjk9q\" (UID: \"d301a6f7-d8e0-4f96-8950-09a560e00a9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.845375 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.845231 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d301a6f7-d8e0-4f96-8950-09a560e00a9e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xjk9q\" (UID: \"d301a6f7-d8e0-4f96-8950-09a560e00a9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.845375 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.845252 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d301a6f7-d8e0-4f96-8950-09a560e00a9e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xjk9q\" (UID: \"d301a6f7-d8e0-4f96-8950-09a560e00a9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.845375 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.845273 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d301a6f7-d8e0-4f96-8950-09a560e00a9e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xjk9q\" (UID: \"d301a6f7-d8e0-4f96-8950-09a560e00a9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.845375 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.845298 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d301a6f7-d8e0-4f96-8950-09a560e00a9e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xjk9q\" (UID: \"d301a6f7-d8e0-4f96-8950-09a560e00a9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.845581 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.845428 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d301a6f7-d8e0-4f96-8950-09a560e00a9e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xjk9q\" (UID: \"d301a6f7-d8e0-4f96-8950-09a560e00a9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.845581 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.845462 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d301a6f7-d8e0-4f96-8950-09a560e00a9e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xjk9q\" (UID: \"d301a6f7-d8e0-4f96-8950-09a560e00a9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.845581 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.845494 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d301a6f7-d8e0-4f96-8950-09a560e00a9e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xjk9q\" (UID: \"d301a6f7-d8e0-4f96-8950-09a560e00a9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.845581 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.845560 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t57zs\" (UniqueName: \"kubernetes.io/projected/d301a6f7-d8e0-4f96-8950-09a560e00a9e-kube-api-access-t57zs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xjk9q\" (UID: \"d301a6f7-d8e0-4f96-8950-09a560e00a9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.845818 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.845739 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d301a6f7-d8e0-4f96-8950-09a560e00a9e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xjk9q\" (UID: \"d301a6f7-d8e0-4f96-8950-09a560e00a9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.845818 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.845761 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d301a6f7-d8e0-4f96-8950-09a560e00a9e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xjk9q\" (UID: \"d301a6f7-d8e0-4f96-8950-09a560e00a9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.845934 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.845845 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d301a6f7-d8e0-4f96-8950-09a560e00a9e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xjk9q\" (UID: \"d301a6f7-d8e0-4f96-8950-09a560e00a9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.846086 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.846065 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d301a6f7-d8e0-4f96-8950-09a560e00a9e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xjk9q\" (UID: \"d301a6f7-d8e0-4f96-8950-09a560e00a9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.846323 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.846304 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d301a6f7-d8e0-4f96-8950-09a560e00a9e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xjk9q\" (UID: \"d301a6f7-d8e0-4f96-8950-09a560e00a9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.847519 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.847499 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d301a6f7-d8e0-4f96-8950-09a560e00a9e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xjk9q\" (UID: \"d301a6f7-d8e0-4f96-8950-09a560e00a9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.847870 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.847851 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d301a6f7-d8e0-4f96-8950-09a560e00a9e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xjk9q\" (UID: \"d301a6f7-d8e0-4f96-8950-09a560e00a9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.856497 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.856478 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d301a6f7-d8e0-4f96-8950-09a560e00a9e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xjk9q\" (UID: \"d301a6f7-d8e0-4f96-8950-09a560e00a9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.861587 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.861529 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t57zs\" (UniqueName: \"kubernetes.io/projected/d301a6f7-d8e0-4f96-8950-09a560e00a9e-kube-api-access-t57zs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xjk9q\" (UID: \"d301a6f7-d8e0-4f96-8950-09a560e00a9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.924873 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.924853 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:06.946189 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.946159 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/11f0e6b9-439c-4987-9cb2-8d9c736b24f1-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-n2q8q\" (UID: \"11f0e6b9-439c-4987-9cb2-8d9c736b24f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" Jul 10 13:33:06.946295 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.946206 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/11f0e6b9-439c-4987-9cb2-8d9c736b24f1-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-n2q8q\" (UID: \"11f0e6b9-439c-4987-9cb2-8d9c736b24f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" Jul 10 13:33:06.946295 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.946229 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/11f0e6b9-439c-4987-9cb2-8d9c736b24f1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-n2q8q\" (UID: \"11f0e6b9-439c-4987-9cb2-8d9c736b24f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" Jul 10 13:33:06.946295 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.946253 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpvb6\" (UniqueName: \"kubernetes.io/projected/11f0e6b9-439c-4987-9cb2-8d9c736b24f1-kube-api-access-xpvb6\") pod \"istiod-openshift-gateway-94bb8fbfd-n2q8q\" (UID: \"11f0e6b9-439c-4987-9cb2-8d9c736b24f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" Jul 10 13:33:06.946469 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.946336 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11f0e6b9-439c-4987-9cb2-8d9c736b24f1-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-n2q8q\" (UID: \"11f0e6b9-439c-4987-9cb2-8d9c736b24f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" Jul 10 13:33:06.946469 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.946366 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/11f0e6b9-439c-4987-9cb2-8d9c736b24f1-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-n2q8q\" (UID: \"11f0e6b9-439c-4987-9cb2-8d9c736b24f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" Jul 10 13:33:06.946469 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:06.946395 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/11f0e6b9-439c-4987-9cb2-8d9c736b24f1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-n2q8q\" (UID: \"11f0e6b9-439c-4987-9cb2-8d9c736b24f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" Jul 10 13:33:07.047276 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:07.047244 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/11f0e6b9-439c-4987-9cb2-8d9c736b24f1-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-n2q8q\" (UID: \"11f0e6b9-439c-4987-9cb2-8d9c736b24f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" Jul 10 13:33:07.047442 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:07.047281 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/11f0e6b9-439c-4987-9cb2-8d9c736b24f1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-n2q8q\" (UID: \"11f0e6b9-439c-4987-9cb2-8d9c736b24f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" Jul 10 13:33:07.047442 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:07.047298 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpvb6\" (UniqueName: \"kubernetes.io/projected/11f0e6b9-439c-4987-9cb2-8d9c736b24f1-kube-api-access-xpvb6\") pod \"istiod-openshift-gateway-94bb8fbfd-n2q8q\" (UID: \"11f0e6b9-439c-4987-9cb2-8d9c736b24f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" Jul 10 13:33:07.047442 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:07.047335 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11f0e6b9-439c-4987-9cb2-8d9c736b24f1-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-n2q8q\" (UID: \"11f0e6b9-439c-4987-9cb2-8d9c736b24f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" Jul 10 13:33:07.047442 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:07.047352 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/11f0e6b9-439c-4987-9cb2-8d9c736b24f1-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-n2q8q\" (UID: \"11f0e6b9-439c-4987-9cb2-8d9c736b24f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" Jul 10 13:33:07.047442 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:07.047371 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/11f0e6b9-439c-4987-9cb2-8d9c736b24f1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-n2q8q\" (UID: \"11f0e6b9-439c-4987-9cb2-8d9c736b24f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" Jul 10 13:33:07.047442 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:07.047418 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/11f0e6b9-439c-4987-9cb2-8d9c736b24f1-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-n2q8q\" (UID: \"11f0e6b9-439c-4987-9cb2-8d9c736b24f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" Jul 10 13:33:07.048264 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:07.048233 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/11f0e6b9-439c-4987-9cb2-8d9c736b24f1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-n2q8q\" (UID: \"11f0e6b9-439c-4987-9cb2-8d9c736b24f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" Jul 10 13:33:07.049614 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:07.049589 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/11f0e6b9-439c-4987-9cb2-8d9c736b24f1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-n2q8q\" (UID: \"11f0e6b9-439c-4987-9cb2-8d9c736b24f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" Jul 10 13:33:07.049738 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:07.049592 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/11f0e6b9-439c-4987-9cb2-8d9c736b24f1-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-n2q8q\" (UID: \"11f0e6b9-439c-4987-9cb2-8d9c736b24f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" Jul 10 13:33:07.049738 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:07.049659 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/11f0e6b9-439c-4987-9cb2-8d9c736b24f1-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-n2q8q\" (UID: \"11f0e6b9-439c-4987-9cb2-8d9c736b24f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" Jul 10 13:33:07.049809 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:07.049767 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/11f0e6b9-439c-4987-9cb2-8d9c736b24f1-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-n2q8q\" (UID: \"11f0e6b9-439c-4987-9cb2-8d9c736b24f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" Jul 10 13:33:07.069722 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:07.069698 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q"] Jul 10 13:33:07.070580 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:07.070562 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11f0e6b9-439c-4987-9cb2-8d9c736b24f1-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-n2q8q\" (UID: \"11f0e6b9-439c-4987-9cb2-8d9c736b24f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" Jul 10 13:33:07.070669 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:07.070581 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpvb6\" (UniqueName: \"kubernetes.io/projected/11f0e6b9-439c-4987-9cb2-8d9c736b24f1-kube-api-access-xpvb6\") pod \"istiod-openshift-gateway-94bb8fbfd-n2q8q\" (UID: \"11f0e6b9-439c-4987-9cb2-8d9c736b24f1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" Jul 10 13:33:07.073867 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:33:07.073838 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd301a6f7_d8e0_4f96_8950_09a560e00a9e.slice/crio-dac625e59e99f00e5d31ffb4d0f3e88f181fdc6fcd6bfc8b44d45902146e6944 WatchSource:0}: Error finding container dac625e59e99f00e5d31ffb4d0f3e88f181fdc6fcd6bfc8b44d45902146e6944: Status 404 returned error can't find the container with id dac625e59e99f00e5d31ffb4d0f3e88f181fdc6fcd6bfc8b44d45902146e6944 Jul 10 13:33:07.090378 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:07.090359 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" Jul 10 13:33:07.232930 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:07.232899 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q"] Jul 10 13:33:07.234043 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:33:07.234014 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f0e6b9_439c_4987_9cb2_8d9c736b24f1.slice/crio-9029f61f8eb472e123b7fc577770704a73e4b1f8ff8023000eed452ba78c382d WatchSource:0}: Error finding container 9029f61f8eb472e123b7fc577770704a73e4b1f8ff8023000eed452ba78c382d: Status 404 returned error can't find the container with id 9029f61f8eb472e123b7fc577770704a73e4b1f8ff8023000eed452ba78c382d Jul 10 13:33:07.245708 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:07.245675 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" event={"ID":"11f0e6b9-439c-4987-9cb2-8d9c736b24f1","Type":"ContainerStarted","Data":"9029f61f8eb472e123b7fc577770704a73e4b1f8ff8023000eed452ba78c382d"} Jul 10 13:33:07.246832 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:07.246809 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" event={"ID":"d301a6f7-d8e0-4f96-8950-09a560e00a9e","Type":"ContainerStarted","Data":"dac625e59e99f00e5d31ffb4d0f3e88f181fdc6fcd6bfc8b44d45902146e6944"} Jul 10 13:33:10.209952 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:10.209878 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7b765fbf76-6pl2m" Jul 10 13:33:10.874499 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:10.874328 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:33:10.874499 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:10.874444 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:33:10.874499 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:10.874479 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:33:10.876770 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:10.876738 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:33:10.876871 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:10.876789 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:33:11.276706 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:11.276577 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" event={"ID":"11f0e6b9-439c-4987-9cb2-8d9c736b24f1","Type":"ContainerStarted","Data":"3ea41b3b9eb9306e3ccd6528cff157475e3a11954749b7ff06f66cda232ec792"} Jul 10 13:33:11.277155 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:11.276774 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" Jul 10 13:33:11.278476 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:11.278451 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" event={"ID":"d301a6f7-d8e0-4f96-8950-09a560e00a9e","Type":"ContainerStarted","Data":"6d3277d860fccc694ed0126f89be6d229f3e26eaff99f0b1fab463e35a9e3b56"} Jul 10 13:33:11.278710 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:11.278690 2575 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-n2q8q container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 10 13:33:11.278792 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:11.278733 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" podUID="11f0e6b9-439c-4987-9cb2-8d9c736b24f1" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 13:33:11.331330 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:11.331275 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" podStartSLOduration=1.690954882 podStartE2EDuration="5.331260364s" totalImagesPullingTime="3.640305482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:33:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:33:11.326950476 +0000 UTC m=+444.566282419" watchObservedRunningTime="2026-07-10 13:33:11.331260364 +0000 UTC m=+444.570592285" Jul 10 13:33:11.363565 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:11.363505 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" podStartSLOduration=1.5653372970000001 podStartE2EDuration="5.363487876s" totalImagesPullingTime="3.798150579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:33:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:33:11.362517101 +0000 UTC m=+444.601849058" watchObservedRunningTime="2026-07-10 13:33:11.363487876 +0000 UTC m=+444.602819800" Jul 10 13:33:11.925319 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:11.925283 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:11.929986 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:11.929959 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:12.282723 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:12.282619 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:33:12.283188 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:12.283171 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-n2q8q" Jul 10 13:33:12.283513 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:33:12.283497 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xjk9q" Jul 10 13:34:14.653716 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:14.653682 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8"] Jul 10 13:34:14.657153 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:14.657136 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8" Jul 10 13:34:14.659485 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:14.659462 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 10 13:34:14.659615 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:14.659460 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 10 13:34:14.659965 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:14.659947 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vwzg9\"" Jul 10 13:34:14.666940 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:14.666923 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8"] Jul 10 13:34:14.787731 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:14.787703 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxrgz\" (UniqueName: \"kubernetes.io/projected/352c4002-0fb8-4f24-840c-36325935cd7e-kube-api-access-dxrgz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8\" (UID: \"352c4002-0fb8-4f24-840c-36325935cd7e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8" Jul 10 13:34:14.787864 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:14.787742 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/352c4002-0fb8-4f24-840c-36325935cd7e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8\" (UID: \"352c4002-0fb8-4f24-840c-36325935cd7e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8" Jul 10 13:34:14.787864 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:14.787780 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/352c4002-0fb8-4f24-840c-36325935cd7e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8\" (UID: \"352c4002-0fb8-4f24-840c-36325935cd7e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8" Jul 10 13:34:14.889023 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:14.888995 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/352c4002-0fb8-4f24-840c-36325935cd7e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8\" (UID: \"352c4002-0fb8-4f24-840c-36325935cd7e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8" Jul 10 13:34:14.889139 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:14.889046 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxrgz\" (UniqueName: \"kubernetes.io/projected/352c4002-0fb8-4f24-840c-36325935cd7e-kube-api-access-dxrgz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8\" (UID: \"352c4002-0fb8-4f24-840c-36325935cd7e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8" Jul 10 13:34:14.889139 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:14.889091 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/352c4002-0fb8-4f24-840c-36325935cd7e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8\" (UID: \"352c4002-0fb8-4f24-840c-36325935cd7e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8" Jul 10 13:34:14.889449 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:14.889430 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/352c4002-0fb8-4f24-840c-36325935cd7e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8\" (UID: \"352c4002-0fb8-4f24-840c-36325935cd7e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8" Jul 10 13:34:14.889490 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:14.889443 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/352c4002-0fb8-4f24-840c-36325935cd7e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8\" (UID: \"352c4002-0fb8-4f24-840c-36325935cd7e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8" Jul 10 13:34:14.898826 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:14.898801 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxrgz\" (UniqueName: \"kubernetes.io/projected/352c4002-0fb8-4f24-840c-36325935cd7e-kube-api-access-dxrgz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8\" (UID: \"352c4002-0fb8-4f24-840c-36325935cd7e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8" Jul 10 13:34:14.966862 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:14.966804 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8" Jul 10 13:34:15.098239 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.098216 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8"] Jul 10 13:34:15.100328 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:34:15.100303 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod352c4002_0fb8_4f24_840c_36325935cd7e.slice/crio-6d7ab682680bbe34de0172d7e86f5e1bde30b0a597b505ade2516b697cc1be0e WatchSource:0}: Error finding container 6d7ab682680bbe34de0172d7e86f5e1bde30b0a597b505ade2516b697cc1be0e: Status 404 returned error can't find the container with id 6d7ab682680bbe34de0172d7e86f5e1bde30b0a597b505ade2516b697cc1be0e Jul 10 13:34:15.256774 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.256708 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv"] Jul 10 13:34:15.260062 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.260044 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv" Jul 10 13:34:15.269622 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.269598 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv"] Jul 10 13:34:15.394779 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.394751 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ce05209-1333-4826-a604-38aa7ababb5f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv\" (UID: \"1ce05209-1333-4826-a604-38aa7ababb5f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv" Jul 10 13:34:15.394779 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.394782 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ce05209-1333-4826-a604-38aa7ababb5f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv\" (UID: \"1ce05209-1333-4826-a604-38aa7ababb5f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv" Jul 10 13:34:15.394957 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.394801 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58dpw\" (UniqueName: \"kubernetes.io/projected/1ce05209-1333-4826-a604-38aa7ababb5f-kube-api-access-58dpw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv\" (UID: \"1ce05209-1333-4826-a604-38aa7ababb5f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv" Jul 10 13:34:15.496059 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.496020 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ce05209-1333-4826-a604-38aa7ababb5f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv\" (UID: \"1ce05209-1333-4826-a604-38aa7ababb5f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv" Jul 10 13:34:15.496059 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.496059 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ce05209-1333-4826-a604-38aa7ababb5f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv\" (UID: \"1ce05209-1333-4826-a604-38aa7ababb5f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv" Jul 10 13:34:15.496224 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.496075 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58dpw\" (UniqueName: \"kubernetes.io/projected/1ce05209-1333-4826-a604-38aa7ababb5f-kube-api-access-58dpw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv\" (UID: \"1ce05209-1333-4826-a604-38aa7ababb5f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv" Jul 10 13:34:15.496385 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.496367 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ce05209-1333-4826-a604-38aa7ababb5f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv\" (UID: \"1ce05209-1333-4826-a604-38aa7ababb5f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv" Jul 10 13:34:15.496460 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.496437 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ce05209-1333-4826-a604-38aa7ababb5f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv\" (UID: \"1ce05209-1333-4826-a604-38aa7ababb5f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv" Jul 10 13:34:15.505926 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.505909 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58dpw\" (UniqueName: \"kubernetes.io/projected/1ce05209-1333-4826-a604-38aa7ababb5f-kube-api-access-58dpw\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv\" (UID: \"1ce05209-1333-4826-a604-38aa7ababb5f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv" Jul 10 13:34:15.568198 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.568130 2575 generic.go:356] "Generic (PLEG): container finished" podID="352c4002-0fb8-4f24-840c-36325935cd7e" containerID="63f79983afc635efd76988c931fe4d47e0752bd898a0e03bb736c5fd5782135b" exitCode=0 Jul 10 13:34:15.568298 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.568196 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8" event={"ID":"352c4002-0fb8-4f24-840c-36325935cd7e","Type":"ContainerDied","Data":"63f79983afc635efd76988c931fe4d47e0752bd898a0e03bb736c5fd5782135b"} Jul 10 13:34:15.568298 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.568236 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8" event={"ID":"352c4002-0fb8-4f24-840c-36325935cd7e","Type":"ContainerStarted","Data":"6d7ab682680bbe34de0172d7e86f5e1bde30b0a597b505ade2516b697cc1be0e"} Jul 10 13:34:15.574937 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.574916 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv" Jul 10 13:34:15.652131 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.652099 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2"] Jul 10 13:34:15.655840 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.655724 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2" Jul 10 13:34:15.665167 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.665084 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2"] Jul 10 13:34:15.706450 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.706392 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv"] Jul 10 13:34:15.708448 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:34:15.708424 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ce05209_1333_4826_a604_38aa7ababb5f.slice/crio-1cb8aa4f4a427bb0f1f29440234e6dcc208645a92e89cf43a67dd77cb8781982 WatchSource:0}: Error finding container 1cb8aa4f4a427bb0f1f29440234e6dcc208645a92e89cf43a67dd77cb8781982: Status 404 returned error can't find the container with id 1cb8aa4f4a427bb0f1f29440234e6dcc208645a92e89cf43a67dd77cb8781982 Jul 10 13:34:15.798365 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.798330 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/414b6d0b-817b-4b71-8b74-54ba02cd9ad2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2\" (UID: \"414b6d0b-817b-4b71-8b74-54ba02cd9ad2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2" Jul 10 13:34:15.798505 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.798455 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqgbd\" (UniqueName: \"kubernetes.io/projected/414b6d0b-817b-4b71-8b74-54ba02cd9ad2-kube-api-access-cqgbd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2\" (UID: \"414b6d0b-817b-4b71-8b74-54ba02cd9ad2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2" Jul 10 13:34:15.798505 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.798492 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/414b6d0b-817b-4b71-8b74-54ba02cd9ad2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2\" (UID: \"414b6d0b-817b-4b71-8b74-54ba02cd9ad2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2" Jul 10 13:34:15.899702 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.899662 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqgbd\" (UniqueName: \"kubernetes.io/projected/414b6d0b-817b-4b71-8b74-54ba02cd9ad2-kube-api-access-cqgbd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2\" (UID: \"414b6d0b-817b-4b71-8b74-54ba02cd9ad2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2" Jul 10 13:34:15.899860 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.899711 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/414b6d0b-817b-4b71-8b74-54ba02cd9ad2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2\" (UID: \"414b6d0b-817b-4b71-8b74-54ba02cd9ad2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2" Jul 10 13:34:15.899860 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.899765 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/414b6d0b-817b-4b71-8b74-54ba02cd9ad2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2\" (UID: \"414b6d0b-817b-4b71-8b74-54ba02cd9ad2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2" Jul 10 13:34:15.900104 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.900083 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/414b6d0b-817b-4b71-8b74-54ba02cd9ad2-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2\" (UID: \"414b6d0b-817b-4b71-8b74-54ba02cd9ad2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2" Jul 10 13:34:15.900163 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.900112 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/414b6d0b-817b-4b71-8b74-54ba02cd9ad2-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2\" (UID: \"414b6d0b-817b-4b71-8b74-54ba02cd9ad2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2" Jul 10 13:34:15.909838 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.909818 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqgbd\" (UniqueName: \"kubernetes.io/projected/414b6d0b-817b-4b71-8b74-54ba02cd9ad2-kube-api-access-cqgbd\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2\" (UID: \"414b6d0b-817b-4b71-8b74-54ba02cd9ad2\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2" Jul 10 13:34:15.967820 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:15.967788 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2" Jul 10 13:34:16.049686 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:16.049658 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9"] Jul 10 13:34:16.054083 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:16.054060 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9" Jul 10 13:34:16.066029 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:16.065966 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9"] Jul 10 13:34:16.104694 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:16.104670 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2"] Jul 10 13:34:16.107106 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:34:16.107077 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod414b6d0b_817b_4b71_8b74_54ba02cd9ad2.slice/crio-9d3f918908b8aa24483dd78848bc145b52dbc1f5951210dd5f2cd1fafc613702 WatchSource:0}: Error finding container 9d3f918908b8aa24483dd78848bc145b52dbc1f5951210dd5f2cd1fafc613702: Status 404 returned error can't find the container with id 9d3f918908b8aa24483dd78848bc145b52dbc1f5951210dd5f2cd1fafc613702 Jul 10 13:34:16.201888 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:16.201842 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f426abc4-d0d1-4c70-9900-5c761fd79b4b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9\" (UID: \"f426abc4-d0d1-4c70-9900-5c761fd79b4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9" Jul 10 13:34:16.202023 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:16.201927 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckb9w\" (UniqueName: \"kubernetes.io/projected/f426abc4-d0d1-4c70-9900-5c761fd79b4b-kube-api-access-ckb9w\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9\" (UID: \"f426abc4-d0d1-4c70-9900-5c761fd79b4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9" Jul 10 13:34:16.202069 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:16.202024 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f426abc4-d0d1-4c70-9900-5c761fd79b4b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9\" (UID: \"f426abc4-d0d1-4c70-9900-5c761fd79b4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9" Jul 10 13:34:16.303101 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:16.303071 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f426abc4-d0d1-4c70-9900-5c761fd79b4b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9\" (UID: \"f426abc4-d0d1-4c70-9900-5c761fd79b4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9" Jul 10 13:34:16.303258 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:16.303112 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckb9w\" (UniqueName: \"kubernetes.io/projected/f426abc4-d0d1-4c70-9900-5c761fd79b4b-kube-api-access-ckb9w\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9\" (UID: \"f426abc4-d0d1-4c70-9900-5c761fd79b4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9" Jul 10 13:34:16.303258 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:16.303175 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f426abc4-d0d1-4c70-9900-5c761fd79b4b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9\" (UID: \"f426abc4-d0d1-4c70-9900-5c761fd79b4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9" Jul 10 13:34:16.303511 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:16.303486 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f426abc4-d0d1-4c70-9900-5c761fd79b4b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9\" (UID: \"f426abc4-d0d1-4c70-9900-5c761fd79b4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9" Jul 10 13:34:16.303593 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:16.303496 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f426abc4-d0d1-4c70-9900-5c761fd79b4b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9\" (UID: \"f426abc4-d0d1-4c70-9900-5c761fd79b4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9" Jul 10 13:34:16.313116 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:16.313094 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckb9w\" (UniqueName: \"kubernetes.io/projected/f426abc4-d0d1-4c70-9900-5c761fd79b4b-kube-api-access-ckb9w\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9\" (UID: \"f426abc4-d0d1-4c70-9900-5c761fd79b4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9" Jul 10 13:34:16.369855 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:16.369827 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9" Jul 10 13:34:16.528496 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:16.528459 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9"] Jul 10 13:34:16.540422 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:34:16.540396 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf426abc4_d0d1_4c70_9900_5c761fd79b4b.slice/crio-b2e7cdca9de89f1842e8b9a40def1018494e0eaa7e02fb5123c0892381c4aa55 WatchSource:0}: Error finding container b2e7cdca9de89f1842e8b9a40def1018494e0eaa7e02fb5123c0892381c4aa55: Status 404 returned error can't find the container with id b2e7cdca9de89f1842e8b9a40def1018494e0eaa7e02fb5123c0892381c4aa55 Jul 10 13:34:16.574006 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:16.573973 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9" event={"ID":"f426abc4-d0d1-4c70-9900-5c761fd79b4b","Type":"ContainerStarted","Data":"b2e7cdca9de89f1842e8b9a40def1018494e0eaa7e02fb5123c0892381c4aa55"} Jul 10 13:34:16.575501 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:16.575479 2575 generic.go:356] "Generic (PLEG): container finished" podID="414b6d0b-817b-4b71-8b74-54ba02cd9ad2" containerID="a2b5f9eee231019a3b34e39182d404f0391e671b5658aab39cc3e73f58df3aa5" exitCode=0 Jul 10 13:34:16.575616 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:16.575561 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2" event={"ID":"414b6d0b-817b-4b71-8b74-54ba02cd9ad2","Type":"ContainerDied","Data":"a2b5f9eee231019a3b34e39182d404f0391e671b5658aab39cc3e73f58df3aa5"} Jul 10 13:34:16.575695 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:16.575614 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2" event={"ID":"414b6d0b-817b-4b71-8b74-54ba02cd9ad2","Type":"ContainerStarted","Data":"9d3f918908b8aa24483dd78848bc145b52dbc1f5951210dd5f2cd1fafc613702"} Jul 10 13:34:16.577192 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:16.577165 2575 generic.go:356] "Generic (PLEG): container finished" podID="1ce05209-1333-4826-a604-38aa7ababb5f" containerID="3aedc6fc830a5361360dec97cad20f556e9cba22ec7516df67c9414d75b79db5" exitCode=0 Jul 10 13:34:16.577297 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:16.577191 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv" event={"ID":"1ce05209-1333-4826-a604-38aa7ababb5f","Type":"ContainerDied","Data":"3aedc6fc830a5361360dec97cad20f556e9cba22ec7516df67c9414d75b79db5"} Jul 10 13:34:16.577297 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:16.577226 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv" event={"ID":"1ce05209-1333-4826-a604-38aa7ababb5f","Type":"ContainerStarted","Data":"1cb8aa4f4a427bb0f1f29440234e6dcc208645a92e89cf43a67dd77cb8781982"} Jul 10 13:34:16.579446 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:16.579431 2575 generic.go:356] "Generic (PLEG): container finished" podID="352c4002-0fb8-4f24-840c-36325935cd7e" containerID="a11ce35c28b4794e119776b3986ea8343b84ea8d37998f7b224f12d9bd25153f" exitCode=0 Jul 10 13:34:16.579512 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:16.579466 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8" event={"ID":"352c4002-0fb8-4f24-840c-36325935cd7e","Type":"ContainerDied","Data":"a11ce35c28b4794e119776b3986ea8343b84ea8d37998f7b224f12d9bd25153f"} Jul 10 13:34:17.586314 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:17.586282 2575 generic.go:356] "Generic (PLEG): container finished" podID="352c4002-0fb8-4f24-840c-36325935cd7e" containerID="0535c07471fce9a23eb0ee9a1a3fcfb0e2093c1c65a958d757763e3aa67488b6" exitCode=0 Jul 10 13:34:17.586730 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:17.586366 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8" event={"ID":"352c4002-0fb8-4f24-840c-36325935cd7e","Type":"ContainerDied","Data":"0535c07471fce9a23eb0ee9a1a3fcfb0e2093c1c65a958d757763e3aa67488b6"} Jul 10 13:34:17.587763 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:17.587741 2575 generic.go:356] "Generic (PLEG): container finished" podID="f426abc4-d0d1-4c70-9900-5c761fd79b4b" containerID="efa5da7c26cd953f6e90b8584ee8794520d58245d21a94635eb765154eab2709" exitCode=0 Jul 10 13:34:17.587882 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:17.587820 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9" event={"ID":"f426abc4-d0d1-4c70-9900-5c761fd79b4b","Type":"ContainerDied","Data":"efa5da7c26cd953f6e90b8584ee8794520d58245d21a94635eb765154eab2709"} Jul 10 13:34:17.589560 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:17.589542 2575 generic.go:356] "Generic (PLEG): container finished" podID="414b6d0b-817b-4b71-8b74-54ba02cd9ad2" containerID="023941b8609490799c8dbb21931a89173ff87b87ed64409203717e1745f752f4" exitCode=0 Jul 10 13:34:17.589651 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:17.589571 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2" event={"ID":"414b6d0b-817b-4b71-8b74-54ba02cd9ad2","Type":"ContainerDied","Data":"023941b8609490799c8dbb21931a89173ff87b87ed64409203717e1745f752f4"} Jul 10 13:34:18.175247 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:18.175159 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8c56dd4c7-zsqvf"] Jul 10 13:34:18.467959 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:34:18.467929 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf426abc4_d0d1_4c70_9900_5c761fd79b4b.slice/crio-12ccf6ddcea74d05c0d07e0cbb7f6cd2c7511410e839dfae15fbb65d5a847636.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf426abc4_d0d1_4c70_9900_5c761fd79b4b.slice/crio-conmon-12ccf6ddcea74d05c0d07e0cbb7f6cd2c7511410e839dfae15fbb65d5a847636.scope\": RecentStats: unable to find data in memory cache]" Jul 10 13:34:18.596768 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:18.596723 2575 generic.go:356] "Generic (PLEG): container finished" podID="414b6d0b-817b-4b71-8b74-54ba02cd9ad2" containerID="749fb90b904388c6f2222cc00483f5ea9dd6fcc4f74151102900423e062f3eef" exitCode=0 Jul 10 13:34:18.597176 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:18.596817 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2" event={"ID":"414b6d0b-817b-4b71-8b74-54ba02cd9ad2","Type":"ContainerDied","Data":"749fb90b904388c6f2222cc00483f5ea9dd6fcc4f74151102900423e062f3eef"} Jul 10 13:34:18.598619 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:18.598590 2575 generic.go:356] "Generic (PLEG): container finished" podID="1ce05209-1333-4826-a604-38aa7ababb5f" containerID="d8446d3e70ba690facc78bd861e8a68700486f2e772af35b83061b9894cfb437" exitCode=0 Jul 10 13:34:18.598764 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:18.598678 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv" event={"ID":"1ce05209-1333-4826-a604-38aa7ababb5f","Type":"ContainerDied","Data":"d8446d3e70ba690facc78bd861e8a68700486f2e772af35b83061b9894cfb437"} Jul 10 13:34:18.600458 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:18.600434 2575 generic.go:356] "Generic (PLEG): container finished" podID="f426abc4-d0d1-4c70-9900-5c761fd79b4b" containerID="12ccf6ddcea74d05c0d07e0cbb7f6cd2c7511410e839dfae15fbb65d5a847636" exitCode=0 Jul 10 13:34:18.600570 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:18.600507 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9" event={"ID":"f426abc4-d0d1-4c70-9900-5c761fd79b4b","Type":"ContainerDied","Data":"12ccf6ddcea74d05c0d07e0cbb7f6cd2c7511410e839dfae15fbb65d5a847636"} Jul 10 13:34:18.729808 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:18.729786 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8" Jul 10 13:34:18.824865 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:18.824838 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/352c4002-0fb8-4f24-840c-36325935cd7e-util\") pod \"352c4002-0fb8-4f24-840c-36325935cd7e\" (UID: \"352c4002-0fb8-4f24-840c-36325935cd7e\") " Jul 10 13:34:18.824962 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:18.824893 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxrgz\" (UniqueName: \"kubernetes.io/projected/352c4002-0fb8-4f24-840c-36325935cd7e-kube-api-access-dxrgz\") pod \"352c4002-0fb8-4f24-840c-36325935cd7e\" (UID: \"352c4002-0fb8-4f24-840c-36325935cd7e\") " Jul 10 13:34:18.824962 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:18.824915 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/352c4002-0fb8-4f24-840c-36325935cd7e-bundle\") pod \"352c4002-0fb8-4f24-840c-36325935cd7e\" (UID: \"352c4002-0fb8-4f24-840c-36325935cd7e\") " Jul 10 13:34:18.825322 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:18.825296 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/352c4002-0fb8-4f24-840c-36325935cd7e-bundle" (OuterVolumeSpecName: "bundle") pod "352c4002-0fb8-4f24-840c-36325935cd7e" (UID: "352c4002-0fb8-4f24-840c-36325935cd7e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:34:18.826896 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:18.826875 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/352c4002-0fb8-4f24-840c-36325935cd7e-kube-api-access-dxrgz" (OuterVolumeSpecName: "kube-api-access-dxrgz") pod "352c4002-0fb8-4f24-840c-36325935cd7e" (UID: "352c4002-0fb8-4f24-840c-36325935cd7e"). InnerVolumeSpecName "kube-api-access-dxrgz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:34:18.830604 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:18.830572 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/352c4002-0fb8-4f24-840c-36325935cd7e-util" (OuterVolumeSpecName: "util") pod "352c4002-0fb8-4f24-840c-36325935cd7e" (UID: "352c4002-0fb8-4f24-840c-36325935cd7e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:34:18.926064 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:18.926038 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/352c4002-0fb8-4f24-840c-36325935cd7e-util\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:34:18.926064 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:18.926062 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxrgz\" (UniqueName: \"kubernetes.io/projected/352c4002-0fb8-4f24-840c-36325935cd7e-kube-api-access-dxrgz\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:34:18.926189 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:18.926073 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/352c4002-0fb8-4f24-840c-36325935cd7e-bundle\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:34:19.609546 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:19.609515 2575 generic.go:356] "Generic (PLEG): container finished" podID="1ce05209-1333-4826-a604-38aa7ababb5f" containerID="0403a7de84facd08e40ecd63ee56ec54c91b8aef11d859f87b688f1b29ee9d32" exitCode=0 Jul 10 13:34:19.610005 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:19.609598 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv" event={"ID":"1ce05209-1333-4826-a604-38aa7ababb5f","Type":"ContainerDied","Data":"0403a7de84facd08e40ecd63ee56ec54c91b8aef11d859f87b688f1b29ee9d32"} Jul 10 13:34:19.611390 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:19.611372 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8" Jul 10 13:34:19.611512 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:19.611390 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8" event={"ID":"352c4002-0fb8-4f24-840c-36325935cd7e","Type":"ContainerDied","Data":"6d7ab682680bbe34de0172d7e86f5e1bde30b0a597b505ade2516b697cc1be0e"} Jul 10 13:34:19.611512 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:19.611431 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d7ab682680bbe34de0172d7e86f5e1bde30b0a597b505ade2516b697cc1be0e" Jul 10 13:34:19.613582 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:19.613559 2575 generic.go:356] "Generic (PLEG): container finished" podID="f426abc4-d0d1-4c70-9900-5c761fd79b4b" containerID="7523cd7103a7f1c48b8fcfccf058b0b5f3d9367c3ace77e99c781ba6599af903" exitCode=0 Jul 10 13:34:19.613714 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:19.613655 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9" event={"ID":"f426abc4-d0d1-4c70-9900-5c761fd79b4b","Type":"ContainerDied","Data":"7523cd7103a7f1c48b8fcfccf058b0b5f3d9367c3ace77e99c781ba6599af903"} Jul 10 13:34:19.754990 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:19.754970 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2" Jul 10 13:34:19.832760 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:19.832730 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqgbd\" (UniqueName: \"kubernetes.io/projected/414b6d0b-817b-4b71-8b74-54ba02cd9ad2-kube-api-access-cqgbd\") pod \"414b6d0b-817b-4b71-8b74-54ba02cd9ad2\" (UID: \"414b6d0b-817b-4b71-8b74-54ba02cd9ad2\") " Jul 10 13:34:19.832873 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:19.832769 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/414b6d0b-817b-4b71-8b74-54ba02cd9ad2-util\") pod \"414b6d0b-817b-4b71-8b74-54ba02cd9ad2\" (UID: \"414b6d0b-817b-4b71-8b74-54ba02cd9ad2\") " Jul 10 13:34:19.832873 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:19.832796 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/414b6d0b-817b-4b71-8b74-54ba02cd9ad2-bundle\") pod \"414b6d0b-817b-4b71-8b74-54ba02cd9ad2\" (UID: \"414b6d0b-817b-4b71-8b74-54ba02cd9ad2\") " Jul 10 13:34:19.833263 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:19.833235 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/414b6d0b-817b-4b71-8b74-54ba02cd9ad2-bundle" (OuterVolumeSpecName: "bundle") pod "414b6d0b-817b-4b71-8b74-54ba02cd9ad2" (UID: "414b6d0b-817b-4b71-8b74-54ba02cd9ad2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:34:19.834824 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:19.834798 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/414b6d0b-817b-4b71-8b74-54ba02cd9ad2-kube-api-access-cqgbd" (OuterVolumeSpecName: "kube-api-access-cqgbd") pod "414b6d0b-817b-4b71-8b74-54ba02cd9ad2" (UID: "414b6d0b-817b-4b71-8b74-54ba02cd9ad2"). InnerVolumeSpecName "kube-api-access-cqgbd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:34:19.837565 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:19.837545 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/414b6d0b-817b-4b71-8b74-54ba02cd9ad2-util" (OuterVolumeSpecName: "util") pod "414b6d0b-817b-4b71-8b74-54ba02cd9ad2" (UID: "414b6d0b-817b-4b71-8b74-54ba02cd9ad2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:34:19.933581 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:19.933517 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqgbd\" (UniqueName: \"kubernetes.io/projected/414b6d0b-817b-4b71-8b74-54ba02cd9ad2-kube-api-access-cqgbd\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:34:19.933581 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:19.933540 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/414b6d0b-817b-4b71-8b74-54ba02cd9ad2-util\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:34:19.933581 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:19.933550 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/414b6d0b-817b-4b71-8b74-54ba02cd9ad2-bundle\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:34:20.620023 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:20.620000 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2" Jul 10 13:34:20.620481 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:20.620032 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2" event={"ID":"414b6d0b-817b-4b71-8b74-54ba02cd9ad2","Type":"ContainerDied","Data":"9d3f918908b8aa24483dd78848bc145b52dbc1f5951210dd5f2cd1fafc613702"} Jul 10 13:34:20.620481 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:20.620071 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d3f918908b8aa24483dd78848bc145b52dbc1f5951210dd5f2cd1fafc613702" Jul 10 13:34:20.754885 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:20.754860 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv" Jul 10 13:34:20.779390 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:20.779369 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9" Jul 10 13:34:20.841922 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:20.841892 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58dpw\" (UniqueName: \"kubernetes.io/projected/1ce05209-1333-4826-a604-38aa7ababb5f-kube-api-access-58dpw\") pod \"1ce05209-1333-4826-a604-38aa7ababb5f\" (UID: \"1ce05209-1333-4826-a604-38aa7ababb5f\") " Jul 10 13:34:20.842076 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:20.841955 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ce05209-1333-4826-a604-38aa7ababb5f-bundle\") pod \"1ce05209-1333-4826-a604-38aa7ababb5f\" (UID: \"1ce05209-1333-4826-a604-38aa7ababb5f\") " Jul 10 13:34:20.842076 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:20.842024 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ce05209-1333-4826-a604-38aa7ababb5f-util\") pod \"1ce05209-1333-4826-a604-38aa7ababb5f\" (UID: \"1ce05209-1333-4826-a604-38aa7ababb5f\") " Jul 10 13:34:20.842449 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:20.842427 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ce05209-1333-4826-a604-38aa7ababb5f-bundle" (OuterVolumeSpecName: "bundle") pod "1ce05209-1333-4826-a604-38aa7ababb5f" (UID: "1ce05209-1333-4826-a604-38aa7ababb5f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:34:20.843966 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:20.843946 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ce05209-1333-4826-a604-38aa7ababb5f-kube-api-access-58dpw" (OuterVolumeSpecName: "kube-api-access-58dpw") pod "1ce05209-1333-4826-a604-38aa7ababb5f" (UID: "1ce05209-1333-4826-a604-38aa7ababb5f"). InnerVolumeSpecName "kube-api-access-58dpw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:34:20.847252 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:20.847231 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ce05209-1333-4826-a604-38aa7ababb5f-util" (OuterVolumeSpecName: "util") pod "1ce05209-1333-4826-a604-38aa7ababb5f" (UID: "1ce05209-1333-4826-a604-38aa7ababb5f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:34:20.943056 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:20.942998 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f426abc4-d0d1-4c70-9900-5c761fd79b4b-util\") pod \"f426abc4-d0d1-4c70-9900-5c761fd79b4b\" (UID: \"f426abc4-d0d1-4c70-9900-5c761fd79b4b\") " Jul 10 13:34:20.943056 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:20.943042 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f426abc4-d0d1-4c70-9900-5c761fd79b4b-bundle\") pod \"f426abc4-d0d1-4c70-9900-5c761fd79b4b\" (UID: \"f426abc4-d0d1-4c70-9900-5c761fd79b4b\") " Jul 10 13:34:20.943231 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:20.943109 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckb9w\" (UniqueName: \"kubernetes.io/projected/f426abc4-d0d1-4c70-9900-5c761fd79b4b-kube-api-access-ckb9w\") pod \"f426abc4-d0d1-4c70-9900-5c761fd79b4b\" (UID: \"f426abc4-d0d1-4c70-9900-5c761fd79b4b\") " Jul 10 13:34:20.943231 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:20.943228 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58dpw\" (UniqueName: \"kubernetes.io/projected/1ce05209-1333-4826-a604-38aa7ababb5f-kube-api-access-58dpw\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:34:20.943343 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:20.943238 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ce05209-1333-4826-a604-38aa7ababb5f-bundle\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:34:20.943343 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:20.943246 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ce05209-1333-4826-a604-38aa7ababb5f-util\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:34:20.943610 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:20.943589 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f426abc4-d0d1-4c70-9900-5c761fd79b4b-bundle" (OuterVolumeSpecName: "bundle") pod "f426abc4-d0d1-4c70-9900-5c761fd79b4b" (UID: "f426abc4-d0d1-4c70-9900-5c761fd79b4b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:34:20.945115 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:20.945094 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f426abc4-d0d1-4c70-9900-5c761fd79b4b-kube-api-access-ckb9w" (OuterVolumeSpecName: "kube-api-access-ckb9w") pod "f426abc4-d0d1-4c70-9900-5c761fd79b4b" (UID: "f426abc4-d0d1-4c70-9900-5c761fd79b4b"). InnerVolumeSpecName "kube-api-access-ckb9w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:34:20.948913 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:20.948891 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f426abc4-d0d1-4c70-9900-5c761fd79b4b-util" (OuterVolumeSpecName: "util") pod "f426abc4-d0d1-4c70-9900-5c761fd79b4b" (UID: "f426abc4-d0d1-4c70-9900-5c761fd79b4b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:34:21.043574 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:21.043547 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckb9w\" (UniqueName: \"kubernetes.io/projected/f426abc4-d0d1-4c70-9900-5c761fd79b4b-kube-api-access-ckb9w\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:34:21.043574 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:21.043572 2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f426abc4-d0d1-4c70-9900-5c761fd79b4b-util\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:34:21.043761 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:21.043585 2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f426abc4-d0d1-4c70-9900-5c761fd79b4b-bundle\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:34:21.626339 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:21.626309 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv" Jul 10 13:34:21.626764 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:21.626306 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv" event={"ID":"1ce05209-1333-4826-a604-38aa7ababb5f","Type":"ContainerDied","Data":"1cb8aa4f4a427bb0f1f29440234e6dcc208645a92e89cf43a67dd77cb8781982"} Jul 10 13:34:21.626764 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:21.626425 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1cb8aa4f4a427bb0f1f29440234e6dcc208645a92e89cf43a67dd77cb8781982" Jul 10 13:34:21.628178 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:21.628156 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9" Jul 10 13:34:21.628258 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:21.628186 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9" event={"ID":"f426abc4-d0d1-4c70-9900-5c761fd79b4b","Type":"ContainerDied","Data":"b2e7cdca9de89f1842e8b9a40def1018494e0eaa7e02fb5123c0892381c4aa55"} Jul 10 13:34:21.628258 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:21.628228 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2e7cdca9de89f1842e8b9a40def1018494e0eaa7e02fb5123c0892381c4aa55" Jul 10 13:34:43.198553 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.198463 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8c56dd4c7-zsqvf" podUID="7f018ff7-7e0c-4be9-995c-84a0d28aee97" containerName="console" containerID="cri-o://a4cac5a574556b17eed466ec5879720a01d759897797aff1a2db7db3207f3a93" gracePeriod=15 Jul 10 13:34:43.454831 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.454775 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:34:43.526278 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.526244 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f018ff7-7e0c-4be9-995c-84a0d28aee97-console-config\") pod \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\" (UID: \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\") " Jul 10 13:34:43.526278 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.526282 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9s8w\" (UniqueName: \"kubernetes.io/projected/7f018ff7-7e0c-4be9-995c-84a0d28aee97-kube-api-access-n9s8w\") pod \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\" (UID: \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\") " Jul 10 13:34:43.526526 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.526314 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f018ff7-7e0c-4be9-995c-84a0d28aee97-console-serving-cert\") pod \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\" (UID: \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\") " Jul 10 13:34:43.526526 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.526357 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f018ff7-7e0c-4be9-995c-84a0d28aee97-service-ca\") pod \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\" (UID: \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\") " Jul 10 13:34:43.526526 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.526390 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f018ff7-7e0c-4be9-995c-84a0d28aee97-oauth-serving-cert\") pod \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\" (UID: \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\") " Jul 10 13:34:43.526526 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.526428 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f018ff7-7e0c-4be9-995c-84a0d28aee97-console-oauth-config\") pod \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\" (UID: \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\") " Jul 10 13:34:43.526526 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.526472 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f018ff7-7e0c-4be9-995c-84a0d28aee97-trusted-ca-bundle\") pod \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\" (UID: \"7f018ff7-7e0c-4be9-995c-84a0d28aee97\") " Jul 10 13:34:43.526807 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.526593 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f018ff7-7e0c-4be9-995c-84a0d28aee97-console-config" (OuterVolumeSpecName: "console-config") pod "7f018ff7-7e0c-4be9-995c-84a0d28aee97" (UID: "7f018ff7-7e0c-4be9-995c-84a0d28aee97"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:34:43.526807 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.526737 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f018ff7-7e0c-4be9-995c-84a0d28aee97-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7f018ff7-7e0c-4be9-995c-84a0d28aee97" (UID: "7f018ff7-7e0c-4be9-995c-84a0d28aee97"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:34:43.526807 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.526759 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f018ff7-7e0c-4be9-995c-84a0d28aee97-console-config\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:34:43.526960 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.526775 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f018ff7-7e0c-4be9-995c-84a0d28aee97-service-ca" (OuterVolumeSpecName: "service-ca") pod "7f018ff7-7e0c-4be9-995c-84a0d28aee97" (UID: "7f018ff7-7e0c-4be9-995c-84a0d28aee97"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:34:43.527010 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.526972 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f018ff7-7e0c-4be9-995c-84a0d28aee97-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7f018ff7-7e0c-4be9-995c-84a0d28aee97" (UID: "7f018ff7-7e0c-4be9-995c-84a0d28aee97"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:34:43.528513 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.528493 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f018ff7-7e0c-4be9-995c-84a0d28aee97-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7f018ff7-7e0c-4be9-995c-84a0d28aee97" (UID: "7f018ff7-7e0c-4be9-995c-84a0d28aee97"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 13:34:43.528513 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.528513 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f018ff7-7e0c-4be9-995c-84a0d28aee97-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7f018ff7-7e0c-4be9-995c-84a0d28aee97" (UID: "7f018ff7-7e0c-4be9-995c-84a0d28aee97"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 13:34:43.528630 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.528562 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f018ff7-7e0c-4be9-995c-84a0d28aee97-kube-api-access-n9s8w" (OuterVolumeSpecName: "kube-api-access-n9s8w") pod "7f018ff7-7e0c-4be9-995c-84a0d28aee97" (UID: "7f018ff7-7e0c-4be9-995c-84a0d28aee97"). InnerVolumeSpecName "kube-api-access-n9s8w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:34:43.627342 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.627315 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f018ff7-7e0c-4be9-995c-84a0d28aee97-trusted-ca-bundle\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:34:43.627342 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.627339 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9s8w\" (UniqueName: \"kubernetes.io/projected/7f018ff7-7e0c-4be9-995c-84a0d28aee97-kube-api-access-n9s8w\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:34:43.627501 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.627350 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f018ff7-7e0c-4be9-995c-84a0d28aee97-console-serving-cert\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:34:43.627501 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.627360 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f018ff7-7e0c-4be9-995c-84a0d28aee97-service-ca\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:34:43.627501 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.627368 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f018ff7-7e0c-4be9-995c-84a0d28aee97-oauth-serving-cert\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:34:43.627501 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.627376 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f018ff7-7e0c-4be9-995c-84a0d28aee97-console-oauth-config\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:34:43.736305 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.736213 2575 generic.go:356] "Generic (PLEG): container finished" podID="7f018ff7-7e0c-4be9-995c-84a0d28aee97" containerID="a4cac5a574556b17eed466ec5879720a01d759897797aff1a2db7db3207f3a93" exitCode=0 Jul 10 13:34:43.736305 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.736253 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8c56dd4c7-zsqvf" Jul 10 13:34:43.736483 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.736307 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8c56dd4c7-zsqvf" event={"ID":"7f018ff7-7e0c-4be9-995c-84a0d28aee97","Type":"ContainerDied","Data":"a4cac5a574556b17eed466ec5879720a01d759897797aff1a2db7db3207f3a93"} Jul 10 13:34:43.736483 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.736353 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8c56dd4c7-zsqvf" event={"ID":"7f018ff7-7e0c-4be9-995c-84a0d28aee97","Type":"ContainerDied","Data":"81798ed79721f2622aad37ff0acdc9ebc396b4c5d16bf9925e4653749fffcdc8"} Jul 10 13:34:43.736483 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.736374 2575 scope.go:117] "RemoveContainer" containerID="a4cac5a574556b17eed466ec5879720a01d759897797aff1a2db7db3207f3a93" Jul 10 13:34:43.745257 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.745242 2575 scope.go:117] "RemoveContainer" containerID="a4cac5a574556b17eed466ec5879720a01d759897797aff1a2db7db3207f3a93" Jul 10 13:34:43.745483 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:34:43.745466 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4cac5a574556b17eed466ec5879720a01d759897797aff1a2db7db3207f3a93\": container with ID starting with a4cac5a574556b17eed466ec5879720a01d759897797aff1a2db7db3207f3a93 not found: ID does not exist" containerID="a4cac5a574556b17eed466ec5879720a01d759897797aff1a2db7db3207f3a93" Jul 10 13:34:43.745548 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.745489 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4cac5a574556b17eed466ec5879720a01d759897797aff1a2db7db3207f3a93"} err="failed to get container status \"a4cac5a574556b17eed466ec5879720a01d759897797aff1a2db7db3207f3a93\": rpc error: code = NotFound desc = could not find container \"a4cac5a574556b17eed466ec5879720a01d759897797aff1a2db7db3207f3a93\": container with ID starting with a4cac5a574556b17eed466ec5879720a01d759897797aff1a2db7db3207f3a93 not found: ID does not exist" Jul 10 13:34:43.761141 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.761118 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8c56dd4c7-zsqvf"] Jul 10 13:34:43.770843 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:43.770820 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8c56dd4c7-zsqvf"] Jul 10 13:34:44.238296 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:34:44.238264 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f018ff7-7e0c-4be9-995c-84a0d28aee97" path="/var/lib/kubelet/pods/7f018ff7-7e0c-4be9-995c-84a0d28aee97/volumes" Jul 10 13:35:31.278313 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278283 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz"] Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278596 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="414b6d0b-817b-4b71-8b74-54ba02cd9ad2" containerName="extract" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278606 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="414b6d0b-817b-4b71-8b74-54ba02cd9ad2" containerName="extract" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278615 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ce05209-1333-4826-a604-38aa7ababb5f" containerName="pull" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278620 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ce05209-1333-4826-a604-38aa7ababb5f" containerName="pull" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278629 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="352c4002-0fb8-4f24-840c-36325935cd7e" containerName="util" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278653 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="352c4002-0fb8-4f24-840c-36325935cd7e" containerName="util" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278664 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f426abc4-d0d1-4c70-9900-5c761fd79b4b" containerName="pull" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278672 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f426abc4-d0d1-4c70-9900-5c761fd79b4b" containerName="pull" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278679 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f426abc4-d0d1-4c70-9900-5c761fd79b4b" containerName="extract" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278684 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f426abc4-d0d1-4c70-9900-5c761fd79b4b" containerName="extract" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278695 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="414b6d0b-817b-4b71-8b74-54ba02cd9ad2" containerName="util" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278700 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="414b6d0b-817b-4b71-8b74-54ba02cd9ad2" containerName="util" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278706 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ce05209-1333-4826-a604-38aa7ababb5f" containerName="util" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278711 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ce05209-1333-4826-a604-38aa7ababb5f" containerName="util" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278719 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="352c4002-0fb8-4f24-840c-36325935cd7e" containerName="pull" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278723 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="352c4002-0fb8-4f24-840c-36325935cd7e" containerName="pull" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278729 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="414b6d0b-817b-4b71-8b74-54ba02cd9ad2" containerName="pull" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278734 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="414b6d0b-817b-4b71-8b74-54ba02cd9ad2" containerName="pull" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278741 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f018ff7-7e0c-4be9-995c-84a0d28aee97" containerName="console" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278746 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f018ff7-7e0c-4be9-995c-84a0d28aee97" containerName="console" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278751 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f426abc4-d0d1-4c70-9900-5c761fd79b4b" containerName="util" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278756 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f426abc4-d0d1-4c70-9900-5c761fd79b4b" containerName="util" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278764 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="352c4002-0fb8-4f24-840c-36325935cd7e" containerName="extract" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278769 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="352c4002-0fb8-4f24-840c-36325935cd7e" containerName="extract" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278775 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ce05209-1333-4826-a604-38aa7ababb5f" containerName="extract" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278780 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ce05209-1333-4826-a604-38aa7ababb5f" containerName="extract" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278829 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f426abc4-d0d1-4c70-9900-5c761fd79b4b" containerName="extract" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278838 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f018ff7-7e0c-4be9-995c-84a0d28aee97" containerName="console" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278848 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="414b6d0b-817b-4b71-8b74-54ba02cd9ad2" containerName="extract" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278856 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="352c4002-0fb8-4f24-840c-36325935cd7e" containerName="extract" Jul 10 13:35:31.278985 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.278862 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ce05209-1333-4826-a604-38aa7ababb5f" containerName="extract" Jul 10 13:35:31.281715 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.281698 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.283721 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.283699 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-j4chg\"" Jul 10 13:35:31.294317 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.294294 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz"] Jul 10 13:35:31.412050 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.412019 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c551fb1b-c385-4ff6-8ae3-cb51c9361856-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hwkz\" (UID: \"c551fb1b-c385-4ff6-8ae3-cb51c9361856\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.412050 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.412057 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c551fb1b-c385-4ff6-8ae3-cb51c9361856-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hwkz\" (UID: \"c551fb1b-c385-4ff6-8ae3-cb51c9361856\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.412303 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.412094 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c551fb1b-c385-4ff6-8ae3-cb51c9361856-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hwkz\" (UID: \"c551fb1b-c385-4ff6-8ae3-cb51c9361856\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.412303 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.412111 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c551fb1b-c385-4ff6-8ae3-cb51c9361856-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hwkz\" (UID: \"c551fb1b-c385-4ff6-8ae3-cb51c9361856\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.412303 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.412126 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dqht\" (UniqueName: \"kubernetes.io/projected/c551fb1b-c385-4ff6-8ae3-cb51c9361856-kube-api-access-6dqht\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hwkz\" (UID: \"c551fb1b-c385-4ff6-8ae3-cb51c9361856\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.412303 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.412144 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c551fb1b-c385-4ff6-8ae3-cb51c9361856-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hwkz\" (UID: \"c551fb1b-c385-4ff6-8ae3-cb51c9361856\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.412303 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.412164 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c551fb1b-c385-4ff6-8ae3-cb51c9361856-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hwkz\" (UID: \"c551fb1b-c385-4ff6-8ae3-cb51c9361856\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.412303 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.412218 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c551fb1b-c385-4ff6-8ae3-cb51c9361856-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hwkz\" (UID: \"c551fb1b-c385-4ff6-8ae3-cb51c9361856\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.412303 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.412243 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c551fb1b-c385-4ff6-8ae3-cb51c9361856-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hwkz\" (UID: \"c551fb1b-c385-4ff6-8ae3-cb51c9361856\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.512797 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.512758 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c551fb1b-c385-4ff6-8ae3-cb51c9361856-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hwkz\" (UID: \"c551fb1b-c385-4ff6-8ae3-cb51c9361856\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.512970 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.512816 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c551fb1b-c385-4ff6-8ae3-cb51c9361856-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hwkz\" (UID: \"c551fb1b-c385-4ff6-8ae3-cb51c9361856\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.512970 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.512843 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c551fb1b-c385-4ff6-8ae3-cb51c9361856-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hwkz\" (UID: \"c551fb1b-c385-4ff6-8ae3-cb51c9361856\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.512970 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.512860 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c551fb1b-c385-4ff6-8ae3-cb51c9361856-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hwkz\" (UID: \"c551fb1b-c385-4ff6-8ae3-cb51c9361856\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.512970 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.512877 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c551fb1b-c385-4ff6-8ae3-cb51c9361856-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hwkz\" (UID: \"c551fb1b-c385-4ff6-8ae3-cb51c9361856\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.512970 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.512895 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dqht\" (UniqueName: \"kubernetes.io/projected/c551fb1b-c385-4ff6-8ae3-cb51c9361856-kube-api-access-6dqht\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hwkz\" (UID: \"c551fb1b-c385-4ff6-8ae3-cb51c9361856\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.512970 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.512926 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c551fb1b-c385-4ff6-8ae3-cb51c9361856-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hwkz\" (UID: \"c551fb1b-c385-4ff6-8ae3-cb51c9361856\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.512970 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.512957 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c551fb1b-c385-4ff6-8ae3-cb51c9361856-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hwkz\" (UID: \"c551fb1b-c385-4ff6-8ae3-cb51c9361856\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.513355 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.512990 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c551fb1b-c385-4ff6-8ae3-cb51c9361856-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hwkz\" (UID: \"c551fb1b-c385-4ff6-8ae3-cb51c9361856\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.513447 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.513420 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c551fb1b-c385-4ff6-8ae3-cb51c9361856-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hwkz\" (UID: \"c551fb1b-c385-4ff6-8ae3-cb51c9361856\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.513512 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.513485 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c551fb1b-c385-4ff6-8ae3-cb51c9361856-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hwkz\" (UID: \"c551fb1b-c385-4ff6-8ae3-cb51c9361856\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.513565 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.513518 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c551fb1b-c385-4ff6-8ae3-cb51c9361856-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hwkz\" (UID: \"c551fb1b-c385-4ff6-8ae3-cb51c9361856\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.513724 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.513697 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c551fb1b-c385-4ff6-8ae3-cb51c9361856-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hwkz\" (UID: \"c551fb1b-c385-4ff6-8ae3-cb51c9361856\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.513812 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.513744 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c551fb1b-c385-4ff6-8ae3-cb51c9361856-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hwkz\" (UID: \"c551fb1b-c385-4ff6-8ae3-cb51c9361856\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.515481 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.515425 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c551fb1b-c385-4ff6-8ae3-cb51c9361856-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hwkz\" (UID: \"c551fb1b-c385-4ff6-8ae3-cb51c9361856\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.515988 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.515968 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c551fb1b-c385-4ff6-8ae3-cb51c9361856-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hwkz\" (UID: \"c551fb1b-c385-4ff6-8ae3-cb51c9361856\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.522368 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.522347 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c551fb1b-c385-4ff6-8ae3-cb51c9361856-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hwkz\" (UID: \"c551fb1b-c385-4ff6-8ae3-cb51c9361856\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.522531 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.522512 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dqht\" (UniqueName: \"kubernetes.io/projected/c551fb1b-c385-4ff6-8ae3-cb51c9361856-kube-api-access-6dqht\") pod \"maas-default-gateway-openshift-default-56654dcf7-8hwkz\" (UID: \"c551fb1b-c385-4ff6-8ae3-cb51c9361856\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.591775 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.591719 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:31.725773 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.725746 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz"] Jul 10 13:35:31.727396 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:35:31.727367 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc551fb1b_c385_4ff6_8ae3_cb51c9361856.slice/crio-929ec9788b8049f86a136edea167359a3b0ba6a3febb18b3831d3b88ac5d28dc WatchSource:0}: Error finding container 929ec9788b8049f86a136edea167359a3b0ba6a3febb18b3831d3b88ac5d28dc: Status 404 returned error can't find the container with id 929ec9788b8049f86a136edea167359a3b0ba6a3febb18b3831d3b88ac5d28dc Jul 10 13:35:31.729518 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.729484 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:35:31.729599 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.729548 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:35:31.729599 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.729577 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:35:31.974901 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.974866 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" event={"ID":"c551fb1b-c385-4ff6-8ae3-cb51c9361856","Type":"ContainerStarted","Data":"f5ea4cab52d808fee85649236c04e33023f2ed27dcb7f13dcca674d373a6ac21"} Jul 10 13:35:31.975172 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.974957 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" event={"ID":"c551fb1b-c385-4ff6-8ae3-cb51c9361856","Type":"ContainerStarted","Data":"929ec9788b8049f86a136edea167359a3b0ba6a3febb18b3831d3b88ac5d28dc"} Jul 10 13:35:31.996620 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:31.996571 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" podStartSLOduration=0.996558119 podStartE2EDuration="996.558119ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:35:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:35:31.993736529 +0000 UTC m=+585.233068460" watchObservedRunningTime="2026-07-10 13:35:31.996558119 +0000 UTC m=+585.235890039" Jul 10 13:35:32.591912 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:32.591878 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:32.596519 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:32.596497 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:32.979699 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:32.979668 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:32.980561 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:32.980544 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:35:47.228572 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:47.228539 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hrq6g_63c89ec5-2de9-4855-8fe8-57baaa8e0588/console-operator/1.log" Jul 10 13:35:47.234426 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:47.234404 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rpg2g_e7e01989-a0c5-4924-bebf-bad6bf0f0844/ovn-acl-logging/0.log" Jul 10 13:35:47.238067 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:47.238049 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hrq6g_63c89ec5-2de9-4855-8fe8-57baaa8e0588/console-operator/1.log" Jul 10 13:35:47.243117 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:35:47.243099 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rpg2g_e7e01989-a0c5-4924-bebf-bad6bf0f0844/ovn-acl-logging/0.log" Jul 10 13:36:47.610767 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:47.610735 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-bgcqj"] Jul 10 13:36:47.613820 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:47.613803 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-bgcqj" Jul 10 13:36:47.615899 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:47.615872 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-wprdk\"" Jul 10 13:36:47.616017 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:47.615874 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 10 13:36:47.622975 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:47.622947 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-bgcqj"] Jul 10 13:36:47.677128 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:47.677102 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/553fdd38-810e-41cb-bb75-aec8da5d90af-plugins-config-volume\") pod \"payload-processing-58f86c7798-bgcqj\" (UID: \"553fdd38-810e-41cb-bb75-aec8da5d90af\") " pod="openshift-ingress/payload-processing-58f86c7798-bgcqj" Jul 10 13:36:47.677249 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:47.677138 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgznf\" (UniqueName: \"kubernetes.io/projected/553fdd38-810e-41cb-bb75-aec8da5d90af-kube-api-access-wgznf\") pod \"payload-processing-58f86c7798-bgcqj\" (UID: \"553fdd38-810e-41cb-bb75-aec8da5d90af\") " pod="openshift-ingress/payload-processing-58f86c7798-bgcqj" Jul 10 13:36:47.778563 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:47.778533 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/553fdd38-810e-41cb-bb75-aec8da5d90af-plugins-config-volume\") pod \"payload-processing-58f86c7798-bgcqj\" (UID: \"553fdd38-810e-41cb-bb75-aec8da5d90af\") " pod="openshift-ingress/payload-processing-58f86c7798-bgcqj" Jul 10 13:36:47.778563 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:47.778574 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgznf\" (UniqueName: \"kubernetes.io/projected/553fdd38-810e-41cb-bb75-aec8da5d90af-kube-api-access-wgznf\") pod \"payload-processing-58f86c7798-bgcqj\" (UID: \"553fdd38-810e-41cb-bb75-aec8da5d90af\") " pod="openshift-ingress/payload-processing-58f86c7798-bgcqj" Jul 10 13:36:47.779461 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:47.779434 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/553fdd38-810e-41cb-bb75-aec8da5d90af-plugins-config-volume\") pod \"payload-processing-58f86c7798-bgcqj\" (UID: \"553fdd38-810e-41cb-bb75-aec8da5d90af\") " pod="openshift-ingress/payload-processing-58f86c7798-bgcqj" Jul 10 13:36:47.788489 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:47.788466 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgznf\" (UniqueName: \"kubernetes.io/projected/553fdd38-810e-41cb-bb75-aec8da5d90af-kube-api-access-wgznf\") pod \"payload-processing-58f86c7798-bgcqj\" (UID: \"553fdd38-810e-41cb-bb75-aec8da5d90af\") " pod="openshift-ingress/payload-processing-58f86c7798-bgcqj" Jul 10 13:36:47.925706 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:47.925598 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-bgcqj" Jul 10 13:36:48.061536 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:48.061512 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-bgcqj"] Jul 10 13:36:48.062807 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:36:48.062779 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod553fdd38_810e_41cb_bb75_aec8da5d90af.slice/crio-1773510633f5ab4b0baedfd6d078a45860bba15a1218abe8143b729017e6a2b4 WatchSource:0}: Error finding container 1773510633f5ab4b0baedfd6d078a45860bba15a1218abe8143b729017e6a2b4: Status 404 returned error can't find the container with id 1773510633f5ab4b0baedfd6d078a45860bba15a1218abe8143b729017e6a2b4 Jul 10 13:36:48.064906 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:48.064887 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 13:36:48.340110 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:48.340003 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-bgcqj" event={"ID":"553fdd38-810e-41cb-bb75-aec8da5d90af","Type":"ContainerStarted","Data":"1773510633f5ab4b0baedfd6d078a45860bba15a1218abe8143b729017e6a2b4"} Jul 10 13:36:50.358879 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:50.358837 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-bgcqj" event={"ID":"553fdd38-810e-41cb-bb75-aec8da5d90af","Type":"ContainerStarted","Data":"ad92041224c87b09b321ba35f14d33c465242c024ad9490eba13199e401c566f"} Jul 10 13:36:50.359242 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:50.358982 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-bgcqj" Jul 10 13:36:50.376118 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:50.376066 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-bgcqj" podStartSLOduration=1.7387246109999999 podStartE2EDuration="3.376048337s" totalImagesPullingTime="1.637323726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:36:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:36:50.374828805 +0000 UTC m=+663.614160728" watchObservedRunningTime="2026-07-10 13:36:50.376048337 +0000 UTC m=+663.615380263" Jul 10 13:36:55.385998 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:55.385926 2575 generic.go:356] "Generic (PLEG): container finished" podID="c551fb1b-c385-4ff6-8ae3-cb51c9361856" containerID="f5ea4cab52d808fee85649236c04e33023f2ed27dcb7f13dcca674d373a6ac21" exitCode=0 Jul 10 13:36:55.386485 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:55.386005 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" event={"ID":"c551fb1b-c385-4ff6-8ae3-cb51c9361856","Type":"ContainerDied","Data":"f5ea4cab52d808fee85649236c04e33023f2ed27dcb7f13dcca674d373a6ac21"} Jul 10 13:36:55.386485 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:55.386444 2575 scope.go:117] "RemoveContainer" containerID="f5ea4cab52d808fee85649236c04e33023f2ed27dcb7f13dcca674d373a6ac21" Jul 10 13:36:55.387461 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:55.387433 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:36:55.387568 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:55.387537 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:36:55.387628 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:55.387584 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:36:56.394037 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:56.393999 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" event={"ID":"c551fb1b-c385-4ff6-8ae3-cb51c9361856","Type":"ContainerStarted","Data":"e9b7dc00423c5c1a198361deecfaf5970b0eb7be73c780a95c0296d594bb0830"} Jul 10 13:36:56.592339 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:56.592305 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:36:56.592551 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:56.592510 2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8hwkz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jul 10 13:36:56.592630 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:56.592569 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" podUID="c551fb1b-c385-4ff6-8ae3-cb51c9361856" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jul 10 13:36:57.592728 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:57.592695 2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8hwkz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jul 10 13:36:57.593077 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:57.592760 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" podUID="c551fb1b-c385-4ff6-8ae3-cb51c9361856" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jul 10 13:36:58.592370 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:58.592331 2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8hwkz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jul 10 13:36:58.592578 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:58.592400 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" podUID="c551fb1b-c385-4ff6-8ae3-cb51c9361856" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jul 10 13:36:59.592922 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:59.592884 2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8hwkz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jul 10 13:36:59.593303 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:36:59.592948 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" podUID="c551fb1b-c385-4ff6-8ae3-cb51c9361856" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jul 10 13:37:00.595879 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:00.595846 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:37:00.596243 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:00.596120 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:37:00.596742 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:00.596723 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8hwkz" Jul 10 13:37:01.365820 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:01.365785 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-bgcqj" Jul 10 13:37:22.120290 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:22.120259 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx"] Jul 10 13:37:22.123619 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:22.123599 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx" Jul 10 13:37:22.126375 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:22.126353 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ctsr9\"" Jul 10 13:37:22.126487 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:22.126359 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 10 13:37:22.126487 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:22.126359 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 10 13:37:22.126487 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:22.126411 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 10 13:37:22.140314 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:22.140291 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx"] Jul 10 13:37:22.273281 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:22.273252 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0336c8b-ab20-474f-abda-3501970ca92f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vvzdx\" (UID: \"d0336c8b-ab20-474f-abda-3501970ca92f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx" Jul 10 13:37:22.273421 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:22.273292 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0336c8b-ab20-474f-abda-3501970ca92f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vvzdx\" (UID: \"d0336c8b-ab20-474f-abda-3501970ca92f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx" Jul 10 13:37:22.273421 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:22.273319 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0336c8b-ab20-474f-abda-3501970ca92f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vvzdx\" (UID: \"d0336c8b-ab20-474f-abda-3501970ca92f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx" Jul 10 13:37:22.273421 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:22.273388 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgdwm\" (UniqueName: \"kubernetes.io/projected/d0336c8b-ab20-474f-abda-3501970ca92f-kube-api-access-qgdwm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vvzdx\" (UID: \"d0336c8b-ab20-474f-abda-3501970ca92f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx" Jul 10 13:37:22.273518 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:22.273426 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0336c8b-ab20-474f-abda-3501970ca92f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vvzdx\" (UID: \"d0336c8b-ab20-474f-abda-3501970ca92f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx" Jul 10 13:37:22.273518 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:22.273468 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0336c8b-ab20-474f-abda-3501970ca92f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vvzdx\" (UID: \"d0336c8b-ab20-474f-abda-3501970ca92f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx" Jul 10 13:37:22.374323 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:22.374247 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0336c8b-ab20-474f-abda-3501970ca92f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vvzdx\" (UID: \"d0336c8b-ab20-474f-abda-3501970ca92f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx" Jul 10 13:37:22.374323 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:22.374287 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0336c8b-ab20-474f-abda-3501970ca92f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vvzdx\" (UID: \"d0336c8b-ab20-474f-abda-3501970ca92f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx" Jul 10 13:37:22.374323 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:22.374313 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0336c8b-ab20-474f-abda-3501970ca92f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vvzdx\" (UID: \"d0336c8b-ab20-474f-abda-3501970ca92f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx" Jul 10 13:37:22.374581 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:22.374341 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgdwm\" (UniqueName: \"kubernetes.io/projected/d0336c8b-ab20-474f-abda-3501970ca92f-kube-api-access-qgdwm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vvzdx\" (UID: \"d0336c8b-ab20-474f-abda-3501970ca92f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx" Jul 10 13:37:22.374581 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:22.374364 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0336c8b-ab20-474f-abda-3501970ca92f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vvzdx\" (UID: \"d0336c8b-ab20-474f-abda-3501970ca92f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx" Jul 10 13:37:22.374581 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:22.374422 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0336c8b-ab20-474f-abda-3501970ca92f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vvzdx\" (UID: \"d0336c8b-ab20-474f-abda-3501970ca92f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx" Jul 10 13:37:22.374770 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:22.374715 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0336c8b-ab20-474f-abda-3501970ca92f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vvzdx\" (UID: \"d0336c8b-ab20-474f-abda-3501970ca92f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx" Jul 10 13:37:22.375009 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:22.374986 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0336c8b-ab20-474f-abda-3501970ca92f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vvzdx\" (UID: \"d0336c8b-ab20-474f-abda-3501970ca92f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx" Jul 10 13:37:22.375085 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:22.375001 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0336c8b-ab20-474f-abda-3501970ca92f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vvzdx\" (UID: \"d0336c8b-ab20-474f-abda-3501970ca92f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx" Jul 10 13:37:22.376758 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:22.376738 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0336c8b-ab20-474f-abda-3501970ca92f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vvzdx\" (UID: \"d0336c8b-ab20-474f-abda-3501970ca92f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx" Jul 10 13:37:22.376968 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:22.376953 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0336c8b-ab20-474f-abda-3501970ca92f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vvzdx\" (UID: \"d0336c8b-ab20-474f-abda-3501970ca92f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx" Jul 10 13:37:22.384399 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:22.384379 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgdwm\" (UniqueName: \"kubernetes.io/projected/d0336c8b-ab20-474f-abda-3501970ca92f-kube-api-access-qgdwm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vvzdx\" (UID: \"d0336c8b-ab20-474f-abda-3501970ca92f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx" Jul 10 13:37:22.438220 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:22.438198 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx" Jul 10 13:37:22.568150 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:22.568120 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx"] Jul 10 13:37:22.569286 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:37:22.569257 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0336c8b_ab20_474f_abda_3501970ca92f.slice/crio-a2fb327679bfa5516e1238ebe17ef599f173fa6c2393b0a91296b52447ae48a7 WatchSource:0}: Error finding container a2fb327679bfa5516e1238ebe17ef599f173fa6c2393b0a91296b52447ae48a7: Status 404 returned error can't find the container with id a2fb327679bfa5516e1238ebe17ef599f173fa6c2393b0a91296b52447ae48a7 Jul 10 13:37:23.533076 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:23.533033 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx" event={"ID":"d0336c8b-ab20-474f-abda-3501970ca92f","Type":"ContainerStarted","Data":"a2fb327679bfa5516e1238ebe17ef599f173fa6c2393b0a91296b52447ae48a7"} Jul 10 13:37:24.539487 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:24.539445 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx" event={"ID":"d0336c8b-ab20-474f-abda-3501970ca92f","Type":"ContainerStarted","Data":"a101f7aabb172f43e1cb15a01b7d480cbce5db5881a17350dc2b19d0485ed605"} Jul 10 13:37:24.561813 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:24.561757 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx" podStartSLOduration=1.532676344 podStartE2EDuration="2.561741499s" totalImagesPullingTime="1.029065155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:37:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:37:24.559482436 +0000 UTC m=+697.798814380" watchObservedRunningTime="2026-07-10 13:37:24.561741499 +0000 UTC m=+697.801073420" Jul 10 13:37:32.438536 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:32.438493 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx" Jul 10 13:37:32.439047 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:32.438557 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx" Jul 10 13:37:32.451215 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:32.451190 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx" Jul 10 13:37:32.595715 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:37:32.595692 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vvzdx" Jul 10 13:38:00.109793 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:00.109755 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch"] Jul 10 13:38:00.116486 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:00.116464 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch" Jul 10 13:38:00.118888 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:00.118864 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 10 13:38:00.126717 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:00.126695 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch"] Jul 10 13:38:00.193951 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:00.193923 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30889ed1-f060-4491-bff6-d4ffb8492423-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch\" (UID: \"30889ed1-f060-4491-bff6-d4ffb8492423\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch" Jul 10 13:38:00.194091 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:00.193958 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s79x5\" (UniqueName: \"kubernetes.io/projected/30889ed1-f060-4491-bff6-d4ffb8492423-kube-api-access-s79x5\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch\" (UID: \"30889ed1-f060-4491-bff6-d4ffb8492423\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch" Jul 10 13:38:00.194091 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:00.194057 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30889ed1-f060-4491-bff6-d4ffb8492423-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch\" (UID: \"30889ed1-f060-4491-bff6-d4ffb8492423\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch" Jul 10 13:38:00.194165 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:00.194122 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30889ed1-f060-4491-bff6-d4ffb8492423-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch\" (UID: \"30889ed1-f060-4491-bff6-d4ffb8492423\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch" Jul 10 13:38:00.194202 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:00.194163 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30889ed1-f060-4491-bff6-d4ffb8492423-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch\" (UID: \"30889ed1-f060-4491-bff6-d4ffb8492423\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch" Jul 10 13:38:00.194202 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:00.194181 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30889ed1-f060-4491-bff6-d4ffb8492423-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch\" (UID: \"30889ed1-f060-4491-bff6-d4ffb8492423\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch" Jul 10 13:38:00.294872 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:00.294829 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30889ed1-f060-4491-bff6-d4ffb8492423-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch\" (UID: \"30889ed1-f060-4491-bff6-d4ffb8492423\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch" Jul 10 13:38:00.294872 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:00.294885 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30889ed1-f060-4491-bff6-d4ffb8492423-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch\" (UID: \"30889ed1-f060-4491-bff6-d4ffb8492423\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch" Jul 10 13:38:00.295132 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:00.294904 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30889ed1-f060-4491-bff6-d4ffb8492423-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch\" (UID: \"30889ed1-f060-4491-bff6-d4ffb8492423\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch" Jul 10 13:38:00.295132 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:00.294926 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30889ed1-f060-4491-bff6-d4ffb8492423-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch\" (UID: \"30889ed1-f060-4491-bff6-d4ffb8492423\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch" Jul 10 13:38:00.295132 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:00.294944 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s79x5\" (UniqueName: \"kubernetes.io/projected/30889ed1-f060-4491-bff6-d4ffb8492423-kube-api-access-s79x5\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch\" (UID: \"30889ed1-f060-4491-bff6-d4ffb8492423\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch" Jul 10 13:38:00.295132 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:00.294978 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30889ed1-f060-4491-bff6-d4ffb8492423-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch\" (UID: \"30889ed1-f060-4491-bff6-d4ffb8492423\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch" Jul 10 13:38:00.295344 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:00.295290 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30889ed1-f060-4491-bff6-d4ffb8492423-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch\" (UID: \"30889ed1-f060-4491-bff6-d4ffb8492423\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch" Jul 10 13:38:00.295441 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:00.295372 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30889ed1-f060-4491-bff6-d4ffb8492423-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch\" (UID: \"30889ed1-f060-4491-bff6-d4ffb8492423\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch" Jul 10 13:38:00.295441 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:00.295368 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30889ed1-f060-4491-bff6-d4ffb8492423-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch\" (UID: \"30889ed1-f060-4491-bff6-d4ffb8492423\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch" Jul 10 13:38:00.297221 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:00.297202 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30889ed1-f060-4491-bff6-d4ffb8492423-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch\" (UID: \"30889ed1-f060-4491-bff6-d4ffb8492423\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch" Jul 10 13:38:00.297328 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:00.297311 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30889ed1-f060-4491-bff6-d4ffb8492423-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch\" (UID: \"30889ed1-f060-4491-bff6-d4ffb8492423\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch" Jul 10 13:38:00.305229 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:00.305206 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s79x5\" (UniqueName: \"kubernetes.io/projected/30889ed1-f060-4491-bff6-d4ffb8492423-kube-api-access-s79x5\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch\" (UID: \"30889ed1-f060-4491-bff6-d4ffb8492423\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch" Jul 10 13:38:00.425387 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:00.425315 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch" Jul 10 13:38:00.557069 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:00.557044 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch"] Jul 10 13:38:00.558617 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:38:00.558595 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30889ed1_f060_4491_bff6_d4ffb8492423.slice/crio-bb93080bf27059f69787679c4d28ed0f366cb90d21d7c6270fac0dd4ff4b96a5 WatchSource:0}: Error finding container bb93080bf27059f69787679c4d28ed0f366cb90d21d7c6270fac0dd4ff4b96a5: Status 404 returned error can't find the container with id bb93080bf27059f69787679c4d28ed0f366cb90d21d7c6270fac0dd4ff4b96a5 Jul 10 13:38:00.728213 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:00.728135 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch" event={"ID":"30889ed1-f060-4491-bff6-d4ffb8492423","Type":"ContainerStarted","Data":"bb93080bf27059f69787679c4d28ed0f366cb90d21d7c6270fac0dd4ff4b96a5"} Jul 10 13:38:01.734733 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:01.734698 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch" event={"ID":"30889ed1-f060-4491-bff6-d4ffb8492423","Type":"ContainerStarted","Data":"9acfd20bf8343dba84bb9196ee5e83becd2a5a61dff9e0c28dad81fb052a87f9"} Jul 10 13:38:01.755167 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:01.755117 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch" podStartSLOduration=1.569253808 podStartE2EDuration="1.755102734s" totalImagesPullingTime="185.848926ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:38:01.753869685 +0000 UTC m=+734.993201606" watchObservedRunningTime="2026-07-10 13:38:01.755102734 +0000 UTC m=+734.994434655" Jul 10 13:38:10.425917 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:10.425883 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch" Jul 10 13:38:10.426313 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:10.425933 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch" Jul 10 13:38:10.438736 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:10.438711 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch" Jul 10 13:38:10.792416 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:38:10.792331 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch" Jul 10 13:40:47.269314 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:40:47.269238 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hrq6g_63c89ec5-2de9-4855-8fe8-57baaa8e0588/console-operator/1.log" Jul 10 13:40:47.275417 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:40:47.275394 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rpg2g_e7e01989-a0c5-4924-bebf-bad6bf0f0844/ovn-acl-logging/0.log" Jul 10 13:40:47.275562 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:40:47.275472 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hrq6g_63c89ec5-2de9-4855-8fe8-57baaa8e0588/console-operator/1.log" Jul 10 13:40:47.280972 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:40:47.280954 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rpg2g_e7e01989-a0c5-4924-bebf-bad6bf0f0844/ovn-acl-logging/0.log" Jul 10 13:45:47.305615 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:45:47.305580 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hrq6g_63c89ec5-2de9-4855-8fe8-57baaa8e0588/console-operator/1.log" Jul 10 13:45:47.308694 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:45:47.308666 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hrq6g_63c89ec5-2de9-4855-8fe8-57baaa8e0588/console-operator/1.log" Jul 10 13:45:47.311533 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:45:47.311511 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rpg2g_e7e01989-a0c5-4924-bebf-bad6bf0f0844/ovn-acl-logging/0.log" Jul 10 13:45:47.314197 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:45:47.314178 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rpg2g_e7e01989-a0c5-4924-bebf-bad6bf0f0844/ovn-acl-logging/0.log" Jul 10 13:50:47.341123 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:50:47.341092 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hrq6g_63c89ec5-2de9-4855-8fe8-57baaa8e0588/console-operator/1.log" Jul 10 13:50:47.341722 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:50:47.341194 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hrq6g_63c89ec5-2de9-4855-8fe8-57baaa8e0588/console-operator/1.log" Jul 10 13:50:47.346548 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:50:47.346527 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rpg2g_e7e01989-a0c5-4924-bebf-bad6bf0f0844/ovn-acl-logging/0.log" Jul 10 13:50:47.346673 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:50:47.346534 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rpg2g_e7e01989-a0c5-4924-bebf-bad6bf0f0844/ovn-acl-logging/0.log" Jul 10 13:52:12.472781 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.472754 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w"] Jul 10 13:52:12.476015 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.475996 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.478186 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.478167 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-283dfe49-openshift-default-dockercfg-vtv6g\"" Jul 10 13:52:12.495103 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.495075 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w"] Jul 10 13:52:12.603790 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.603760 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-workload-socket\") pod \"e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.603951 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.603858 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-istio-data\") pod \"e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.603951 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.603878 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0261240e-282e-4212-ba59-1ed73f61e61a-istiod-ca-cert\") pod \"e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.603951 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.603897 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-istio-envoy\") pod \"e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.604056 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.603954 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0261240e-282e-4212-ba59-1ed73f61e61a-istio-token\") pod \"e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.604056 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.603982 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0261240e-282e-4212-ba59-1ed73f61e61a-istio-podinfo\") pod \"e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.604056 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.604000 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv89g\" (UniqueName: \"kubernetes.io/projected/0261240e-282e-4212-ba59-1ed73f61e61a-kube-api-access-qv89g\") pod \"e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.604147 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.604068 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-credential-socket\") pod \"e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.604147 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.604102 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-workload-certs\") pod \"e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.705278 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.705246 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-istio-data\") pod \"e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.705278 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.705278 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0261240e-282e-4212-ba59-1ed73f61e61a-istiod-ca-cert\") pod \"e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.705495 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.705299 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-istio-envoy\") pod \"e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.705495 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.705322 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0261240e-282e-4212-ba59-1ed73f61e61a-istio-token\") pod \"e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.705495 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.705340 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0261240e-282e-4212-ba59-1ed73f61e61a-istio-podinfo\") pod \"e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.705495 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.705356 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv89g\" (UniqueName: \"kubernetes.io/projected/0261240e-282e-4212-ba59-1ed73f61e61a-kube-api-access-qv89g\") pod \"e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.705495 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.705379 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-credential-socket\") pod \"e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.705495 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.705395 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-workload-certs\") pod \"e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.705495 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.705415 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-workload-socket\") pod \"e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.705868 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.705819 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-workload-socket\") pod \"e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.705938 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.705913 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-workload-certs\") pod \"e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.705992 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.705934 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-istio-data\") pod \"e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.706029 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.706003 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-credential-socket\") pod \"e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.706077 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.706063 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0261240e-282e-4212-ba59-1ed73f61e61a-istiod-ca-cert\") pod \"e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.707677 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.707655 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-istio-envoy\") pod \"e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.708161 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.708142 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0261240e-282e-4212-ba59-1ed73f61e61a-istio-podinfo\") pod \"e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.717321 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.717301 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv89g\" (UniqueName: \"kubernetes.io/projected/0261240e-282e-4212-ba59-1ed73f61e61a-kube-api-access-qv89g\") pod \"e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.717607 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.717591 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0261240e-282e-4212-ba59-1ed73f61e61a-istio-token\") pod \"e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.787718 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.787660 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:12.923194 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.923166 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w"] Jul 10 13:52:12.924412 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:52:12.924386 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0261240e_282e_4212_ba59_1ed73f61e61a.slice/crio-2496b9906d0c3412f1e6ec1e2e6687ca2ef50c726a20c0ff3ccd09de327514de WatchSource:0}: Error finding container 2496b9906d0c3412f1e6ec1e2e6687ca2ef50c726a20c0ff3ccd09de327514de: Status 404 returned error can't find the container with id 2496b9906d0c3412f1e6ec1e2e6687ca2ef50c726a20c0ff3ccd09de327514de Jul 10 13:52:12.926417 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.926379 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:52:12.926487 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.926446 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:52:12.926487 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.926475 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:52:12.997700 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.997671 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" event={"ID":"0261240e-282e-4212-ba59-1ed73f61e61a","Type":"ContainerStarted","Data":"f313744b96560c794a7ab6069ecaff4324c2e3fd0c64835eb693a5e570a218a7"} Jul 10 13:52:12.997784 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:12.997748 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" event={"ID":"0261240e-282e-4212-ba59-1ed73f61e61a","Type":"ContainerStarted","Data":"2496b9906d0c3412f1e6ec1e2e6687ca2ef50c726a20c0ff3ccd09de327514de"} Jul 10 13:52:13.017452 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:13.017388 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" podStartSLOduration=1.017369382 podStartE2EDuration="1.017369382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:52:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:52:13.016499421 +0000 UTC m=+1586.255831341" watchObservedRunningTime="2026-07-10 13:52:13.017369382 +0000 UTC m=+1586.256701307" Jul 10 13:52:13.788334 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:13.788302 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:13.793225 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:13.793194 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:14.003060 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:14.003021 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:14.003979 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:14.003958 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:19.015820 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:19.015787 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w"] Jul 10 13:52:19.016356 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:19.015963 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" podUID="0261240e-282e-4212-ba59-1ed73f61e61a" containerName="istio-proxy" containerID="cri-o://f313744b96560c794a7ab6069ecaff4324c2e3fd0c64835eb693a5e570a218a7" gracePeriod=30 Jul 10 13:52:24.369556 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:24.369528 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:24.406148 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:24.406087 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-istio-data\") pod \"0261240e-282e-4212-ba59-1ed73f61e61a\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " Jul 10 13:52:24.406285 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:24.406181 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-credential-socket\") pod \"0261240e-282e-4212-ba59-1ed73f61e61a\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " Jul 10 13:52:24.406285 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:24.406205 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-istio-envoy\") pod \"0261240e-282e-4212-ba59-1ed73f61e61a\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " Jul 10 13:52:24.406285 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:24.406224 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0261240e-282e-4212-ba59-1ed73f61e61a-istiod-ca-cert\") pod \"0261240e-282e-4212-ba59-1ed73f61e61a\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " Jul 10 13:52:24.406285 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:24.406244 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0261240e-282e-4212-ba59-1ed73f61e61a-istio-podinfo\") pod \"0261240e-282e-4212-ba59-1ed73f61e61a\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " Jul 10 13:52:24.406285 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:24.406268 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qv89g\" (UniqueName: \"kubernetes.io/projected/0261240e-282e-4212-ba59-1ed73f61e61a-kube-api-access-qv89g\") pod \"0261240e-282e-4212-ba59-1ed73f61e61a\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " Jul 10 13:52:24.406559 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:24.406313 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0261240e-282e-4212-ba59-1ed73f61e61a-istio-token\") pod \"0261240e-282e-4212-ba59-1ed73f61e61a\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " Jul 10 13:52:24.406559 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:24.406350 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-workload-socket\") pod \"0261240e-282e-4212-ba59-1ed73f61e61a\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " Jul 10 13:52:24.406559 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:24.406421 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-workload-certs\") pod \"0261240e-282e-4212-ba59-1ed73f61e61a\" (UID: \"0261240e-282e-4212-ba59-1ed73f61e61a\") " Jul 10 13:52:24.407034 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:24.406834 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0261240e-282e-4212-ba59-1ed73f61e61a" (UID: "0261240e-282e-4212-ba59-1ed73f61e61a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:52:24.407034 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:24.406903 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0261240e-282e-4212-ba59-1ed73f61e61a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0261240e-282e-4212-ba59-1ed73f61e61a" (UID: "0261240e-282e-4212-ba59-1ed73f61e61a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:52:24.407034 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:24.406962 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-istio-data" (OuterVolumeSpecName: "istio-data") pod "0261240e-282e-4212-ba59-1ed73f61e61a" (UID: "0261240e-282e-4212-ba59-1ed73f61e61a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:52:24.407209 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:24.407069 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0261240e-282e-4212-ba59-1ed73f61e61a" (UID: "0261240e-282e-4212-ba59-1ed73f61e61a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:52:24.407209 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:24.407192 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0261240e-282e-4212-ba59-1ed73f61e61a" (UID: "0261240e-282e-4212-ba59-1ed73f61e61a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:52:24.408994 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:24.408927 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0261240e-282e-4212-ba59-1ed73f61e61a" (UID: "0261240e-282e-4212-ba59-1ed73f61e61a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:52:24.408994 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:24.408946 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0261240e-282e-4212-ba59-1ed73f61e61a-kube-api-access-qv89g" (OuterVolumeSpecName: "kube-api-access-qv89g") pod "0261240e-282e-4212-ba59-1ed73f61e61a" (UID: "0261240e-282e-4212-ba59-1ed73f61e61a"). InnerVolumeSpecName "kube-api-access-qv89g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:52:24.409168 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:24.409063 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0261240e-282e-4212-ba59-1ed73f61e61a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0261240e-282e-4212-ba59-1ed73f61e61a" (UID: "0261240e-282e-4212-ba59-1ed73f61e61a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 13:52:24.409354 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:24.409321 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0261240e-282e-4212-ba59-1ed73f61e61a-istio-token" (OuterVolumeSpecName: "istio-token") pod "0261240e-282e-4212-ba59-1ed73f61e61a" (UID: "0261240e-282e-4212-ba59-1ed73f61e61a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:52:24.507509 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:24.507447 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-workload-certs\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:52:24.507509 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:24.507471 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-istio-data\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:52:24.507509 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:24.507480 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-credential-socket\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:52:24.507509 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:24.507488 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-istio-envoy\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:52:24.507509 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:24.507497 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0261240e-282e-4212-ba59-1ed73f61e61a-istiod-ca-cert\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:52:24.507509 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:24.507505 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0261240e-282e-4212-ba59-1ed73f61e61a-istio-podinfo\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:52:24.507509 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:24.507513 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qv89g\" (UniqueName: \"kubernetes.io/projected/0261240e-282e-4212-ba59-1ed73f61e61a-kube-api-access-qv89g\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:52:24.507828 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:24.507521 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0261240e-282e-4212-ba59-1ed73f61e61a-istio-token\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:52:24.507828 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:24.507530 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0261240e-282e-4212-ba59-1ed73f61e61a-workload-socket\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:52:25.075468 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:25.075430 2575 generic.go:356] "Generic (PLEG): container finished" podID="0261240e-282e-4212-ba59-1ed73f61e61a" containerID="f313744b96560c794a7ab6069ecaff4324c2e3fd0c64835eb693a5e570a218a7" exitCode=0 Jul 10 13:52:25.075663 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:25.075477 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" Jul 10 13:52:25.075663 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:25.075496 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" event={"ID":"0261240e-282e-4212-ba59-1ed73f61e61a","Type":"ContainerDied","Data":"f313744b96560c794a7ab6069ecaff4324c2e3fd0c64835eb693a5e570a218a7"} Jul 10 13:52:25.075663 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:25.075547 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w" event={"ID":"0261240e-282e-4212-ba59-1ed73f61e61a","Type":"ContainerDied","Data":"2496b9906d0c3412f1e6ec1e2e6687ca2ef50c726a20c0ff3ccd09de327514de"} Jul 10 13:52:25.075663 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:25.075576 2575 scope.go:117] "RemoveContainer" containerID="f313744b96560c794a7ab6069ecaff4324c2e3fd0c64835eb693a5e570a218a7" Jul 10 13:52:25.084907 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:25.084885 2575 scope.go:117] "RemoveContainer" containerID="f313744b96560c794a7ab6069ecaff4324c2e3fd0c64835eb693a5e570a218a7" Jul 10 13:52:25.085141 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:52:25.085123 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f313744b96560c794a7ab6069ecaff4324c2e3fd0c64835eb693a5e570a218a7\": container with ID starting with f313744b96560c794a7ab6069ecaff4324c2e3fd0c64835eb693a5e570a218a7 not found: ID does not exist" containerID="f313744b96560c794a7ab6069ecaff4324c2e3fd0c64835eb693a5e570a218a7" Jul 10 13:52:25.085191 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:25.085148 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f313744b96560c794a7ab6069ecaff4324c2e3fd0c64835eb693a5e570a218a7"} err="failed to get container status \"f313744b96560c794a7ab6069ecaff4324c2e3fd0c64835eb693a5e570a218a7\": rpc error: code = NotFound desc = could not find container \"f313744b96560c794a7ab6069ecaff4324c2e3fd0c64835eb693a5e570a218a7\": container with ID starting with f313744b96560c794a7ab6069ecaff4324c2e3fd0c64835eb693a5e570a218a7 not found: ID does not exist" Jul 10 13:52:25.098586 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:25.098564 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w"] Jul 10 13:52:25.103814 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:25.103793 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-283dfe49-openshift-default-5bdb698bb9-jgf4w"] Jul 10 13:52:26.043080 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.043045 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h"] Jul 10 13:52:26.043508 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.043485 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0261240e-282e-4212-ba59-1ed73f61e61a" containerName="istio-proxy" Jul 10 13:52:26.043508 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.043507 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0261240e-282e-4212-ba59-1ed73f61e61a" containerName="istio-proxy" Jul 10 13:52:26.043661 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.043611 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0261240e-282e-4212-ba59-1ed73f61e61a" containerName="istio-proxy" Jul 10 13:52:26.048345 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.048324 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.052251 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.052225 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f2237c2f-openshift-default-dockercfg-7462k\"" Jul 10 13:52:26.059327 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.059308 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h"] Jul 10 13:52:26.123033 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.123004 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/971dc6c1-c354-4554-b8d7-035cb21fea27-istiod-ca-cert\") pod \"e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.123158 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.123040 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-workload-certs\") pod \"e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.123158 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.123129 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-workload-socket\") pod \"e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.123236 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.123171 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/971dc6c1-c354-4554-b8d7-035cb21fea27-istio-podinfo\") pod \"e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.123236 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.123195 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/971dc6c1-c354-4554-b8d7-035cb21fea27-istio-token\") pod \"e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.123236 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.123212 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-credential-socket\") pod \"e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.123236 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.123229 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-istio-envoy\") pod \"e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.123429 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.123312 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-istio-data\") pod \"e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.123429 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.123361 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb6s2\" (UniqueName: \"kubernetes.io/projected/971dc6c1-c354-4554-b8d7-035cb21fea27-kube-api-access-mb6s2\") pod \"e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.224680 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.224622 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-workload-socket\") pod \"e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.224680 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.224682 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/971dc6c1-c354-4554-b8d7-035cb21fea27-istio-podinfo\") pod \"e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.224902 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.224707 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/971dc6c1-c354-4554-b8d7-035cb21fea27-istio-token\") pod \"e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.224902 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.224728 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-credential-socket\") pod \"e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.224902 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.224743 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-istio-envoy\") pod \"e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.224902 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.224767 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-istio-data\") pod \"e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.224902 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.224802 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb6s2\" (UniqueName: \"kubernetes.io/projected/971dc6c1-c354-4554-b8d7-035cb21fea27-kube-api-access-mb6s2\") pod \"e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.224902 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.224843 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/971dc6c1-c354-4554-b8d7-035cb21fea27-istiod-ca-cert\") pod \"e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.224902 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.224873 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-workload-certs\") pod \"e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.225268 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.225116 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-workload-socket\") pod \"e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.225268 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.225144 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-credential-socket\") pod \"e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.225268 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.225221 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-istio-data\") pod \"e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.225371 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.225308 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-workload-certs\") pod \"e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.225663 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.225619 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/971dc6c1-c354-4554-b8d7-035cb21fea27-istiod-ca-cert\") pod \"e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.227554 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.227532 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-istio-envoy\") pod \"e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.227818 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.227799 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/971dc6c1-c354-4554-b8d7-035cb21fea27-istio-podinfo\") pod \"e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.234072 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.234046 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/971dc6c1-c354-4554-b8d7-035cb21fea27-istio-token\") pod \"e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.234261 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.234241 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb6s2\" (UniqueName: \"kubernetes.io/projected/971dc6c1-c354-4554-b8d7-035cb21fea27-kube-api-access-mb6s2\") pod \"e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.238748 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.238721 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0261240e-282e-4212-ba59-1ed73f61e61a" path="/var/lib/kubelet/pods/0261240e-282e-4212-ba59-1ed73f61e61a/volumes" Jul 10 13:52:26.364187 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.364161 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:26.498387 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.498361 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h"] Jul 10 13:52:26.499580 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:52:26.499549 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod971dc6c1_c354_4554_b8d7_035cb21fea27.slice/crio-c627655e258deaa784cb35d45e67f6f0fe9c63ae36ea0ac56872044953344811 WatchSource:0}: Error finding container c627655e258deaa784cb35d45e67f6f0fe9c63ae36ea0ac56872044953344811: Status 404 returned error can't find the container with id c627655e258deaa784cb35d45e67f6f0fe9c63ae36ea0ac56872044953344811 Jul 10 13:52:26.501832 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.501793 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:52:26.501932 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.501878 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:52:26.502013 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:26.501936 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:52:27.089448 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:27.089399 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" event={"ID":"971dc6c1-c354-4554-b8d7-035cb21fea27","Type":"ContainerStarted","Data":"69082edff241c56a17839acb288400757ce2a220ab231bbf357e297618a9ba0c"} Jul 10 13:52:27.089842 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:27.089455 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" event={"ID":"971dc6c1-c354-4554-b8d7-035cb21fea27","Type":"ContainerStarted","Data":"c627655e258deaa784cb35d45e67f6f0fe9c63ae36ea0ac56872044953344811"} Jul 10 13:52:27.113304 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:27.113263 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" podStartSLOduration=1.113248247 podStartE2EDuration="1.113248247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:52:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:52:27.110820281 +0000 UTC m=+1600.350152202" watchObservedRunningTime="2026-07-10 13:52:27.113248247 +0000 UTC m=+1600.352580168" Jul 10 13:52:27.364689 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:27.364627 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:27.369135 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:27.369111 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:28.095023 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:28.094996 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:28.095904 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:28.095883 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:38.151529 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:38.151490 2575 generic.go:356] "Generic (PLEG): container finished" podID="971dc6c1-c354-4554-b8d7-035cb21fea27" containerID="69082edff241c56a17839acb288400757ce2a220ab231bbf357e297618a9ba0c" exitCode=0 Jul 10 13:52:38.151987 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:38.151562 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" event={"ID":"971dc6c1-c354-4554-b8d7-035cb21fea27","Type":"ContainerDied","Data":"69082edff241c56a17839acb288400757ce2a220ab231bbf357e297618a9ba0c"} Jul 10 13:52:38.151987 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:38.151946 2575 scope.go:117] "RemoveContainer" containerID="69082edff241c56a17839acb288400757ce2a220ab231bbf357e297618a9ba0c" Jul 10 13:52:38.152904 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:38.152876 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:52:38.153010 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:38.152953 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:52:38.153074 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:38.153021 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:52:38.513920 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:38.513885 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h"] Jul 10 13:52:39.159094 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:39.159046 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" event={"ID":"971dc6c1-c354-4554-b8d7-035cb21fea27","Type":"ContainerStarted","Data":"e490c4b75ba90b131a7b45352ceb0e22ca8f5fcf3988ad36295da75514b830d2"} Jul 10 13:52:39.159094 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:39.159071 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" podUID="971dc6c1-c354-4554-b8d7-035cb21fea27" containerName="istio-proxy" containerID="cri-o://e490c4b75ba90b131a7b45352ceb0e22ca8f5fcf3988ad36295da75514b830d2" gracePeriod=30 Jul 10 13:52:43.095512 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:43.095480 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:44.420069 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:44.420012 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:44.489540 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:44.489512 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/971dc6c1-c354-4554-b8d7-035cb21fea27-istiod-ca-cert\") pod \"971dc6c1-c354-4554-b8d7-035cb21fea27\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " Jul 10 13:52:44.489697 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:44.489591 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/971dc6c1-c354-4554-b8d7-035cb21fea27-istio-podinfo\") pod \"971dc6c1-c354-4554-b8d7-035cb21fea27\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " Jul 10 13:52:44.489760 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:44.489742 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mb6s2\" (UniqueName: \"kubernetes.io/projected/971dc6c1-c354-4554-b8d7-035cb21fea27-kube-api-access-mb6s2\") pod \"971dc6c1-c354-4554-b8d7-035cb21fea27\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " Jul 10 13:52:44.489802 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:44.489781 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-workload-socket\") pod \"971dc6c1-c354-4554-b8d7-035cb21fea27\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " Jul 10 13:52:44.489852 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:44.489809 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/971dc6c1-c354-4554-b8d7-035cb21fea27-istio-token\") pod \"971dc6c1-c354-4554-b8d7-035cb21fea27\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " Jul 10 13:52:44.489852 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:44.489836 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-credential-socket\") pod \"971dc6c1-c354-4554-b8d7-035cb21fea27\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " Jul 10 13:52:44.489957 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:44.489904 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/971dc6c1-c354-4554-b8d7-035cb21fea27-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "971dc6c1-c354-4554-b8d7-035cb21fea27" (UID: "971dc6c1-c354-4554-b8d7-035cb21fea27"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:52:44.489957 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:44.489920 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-istio-data\") pod \"971dc6c1-c354-4554-b8d7-035cb21fea27\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " Jul 10 13:52:44.490070 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:44.489979 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-istio-envoy\") pod \"971dc6c1-c354-4554-b8d7-035cb21fea27\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " Jul 10 13:52:44.490070 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:44.490006 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-workload-certs\") pod \"971dc6c1-c354-4554-b8d7-035cb21fea27\" (UID: \"971dc6c1-c354-4554-b8d7-035cb21fea27\") " Jul 10 13:52:44.490070 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:44.490049 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "971dc6c1-c354-4554-b8d7-035cb21fea27" (UID: "971dc6c1-c354-4554-b8d7-035cb21fea27"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:52:44.490224 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:44.490158 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "971dc6c1-c354-4554-b8d7-035cb21fea27" (UID: "971dc6c1-c354-4554-b8d7-035cb21fea27"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:52:44.490391 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:44.490357 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-workload-socket\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:52:44.490391 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:44.490370 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "971dc6c1-c354-4554-b8d7-035cb21fea27" (UID: "971dc6c1-c354-4554-b8d7-035cb21fea27"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:52:44.490391 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:44.490379 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-credential-socket\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:52:44.490560 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:44.490411 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/971dc6c1-c354-4554-b8d7-035cb21fea27-istiod-ca-cert\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:52:44.490935 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:44.490912 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-istio-data" (OuterVolumeSpecName: "istio-data") pod "971dc6c1-c354-4554-b8d7-035cb21fea27" (UID: "971dc6c1-c354-4554-b8d7-035cb21fea27"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:52:44.491804 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:44.491781 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/971dc6c1-c354-4554-b8d7-035cb21fea27-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "971dc6c1-c354-4554-b8d7-035cb21fea27" (UID: "971dc6c1-c354-4554-b8d7-035cb21fea27"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 13:52:44.491956 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:44.491934 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/971dc6c1-c354-4554-b8d7-035cb21fea27-istio-token" (OuterVolumeSpecName: "istio-token") pod "971dc6c1-c354-4554-b8d7-035cb21fea27" (UID: "971dc6c1-c354-4554-b8d7-035cb21fea27"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:52:44.492238 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:44.492215 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "971dc6c1-c354-4554-b8d7-035cb21fea27" (UID: "971dc6c1-c354-4554-b8d7-035cb21fea27"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:52:44.492340 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:44.492248 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/971dc6c1-c354-4554-b8d7-035cb21fea27-kube-api-access-mb6s2" (OuterVolumeSpecName: "kube-api-access-mb6s2") pod "971dc6c1-c354-4554-b8d7-035cb21fea27" (UID: "971dc6c1-c354-4554-b8d7-035cb21fea27"). InnerVolumeSpecName "kube-api-access-mb6s2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:52:44.591850 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:44.591819 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-istio-envoy\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:52:44.591850 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:44.591844 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-workload-certs\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:52:44.591850 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:44.591852 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/971dc6c1-c354-4554-b8d7-035cb21fea27-istio-podinfo\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:52:44.592063 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:44.591860 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mb6s2\" (UniqueName: \"kubernetes.io/projected/971dc6c1-c354-4554-b8d7-035cb21fea27-kube-api-access-mb6s2\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:52:44.592063 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:44.591870 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/971dc6c1-c354-4554-b8d7-035cb21fea27-istio-token\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:52:44.592063 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:44.591879 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/971dc6c1-c354-4554-b8d7-035cb21fea27-istio-data\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:52:45.195965 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.195926 2575 generic.go:356] "Generic (PLEG): container finished" podID="971dc6c1-c354-4554-b8d7-035cb21fea27" containerID="e490c4b75ba90b131a7b45352ceb0e22ca8f5fcf3988ad36295da75514b830d2" exitCode=0 Jul 10 13:52:45.196143 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.195985 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" Jul 10 13:52:45.196143 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.196012 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" event={"ID":"971dc6c1-c354-4554-b8d7-035cb21fea27","Type":"ContainerDied","Data":"e490c4b75ba90b131a7b45352ceb0e22ca8f5fcf3988ad36295da75514b830d2"} Jul 10 13:52:45.196143 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.196093 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h" event={"ID":"971dc6c1-c354-4554-b8d7-035cb21fea27","Type":"ContainerDied","Data":"c627655e258deaa784cb35d45e67f6f0fe9c63ae36ea0ac56872044953344811"} Jul 10 13:52:45.196143 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.196135 2575 scope.go:117] "RemoveContainer" containerID="e490c4b75ba90b131a7b45352ceb0e22ca8f5fcf3988ad36295da75514b830d2" Jul 10 13:52:45.196381 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.196305 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm"] Jul 10 13:52:45.196820 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.196785 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="971dc6c1-c354-4554-b8d7-035cb21fea27" containerName="istio-proxy" Jul 10 13:52:45.196820 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.196807 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="971dc6c1-c354-4554-b8d7-035cb21fea27" containerName="istio-proxy" Jul 10 13:52:45.197027 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.196845 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="971dc6c1-c354-4554-b8d7-035cb21fea27" containerName="istio-proxy" Jul 10 13:52:45.197027 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.196853 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="971dc6c1-c354-4554-b8d7-035cb21fea27" containerName="istio-proxy" Jul 10 13:52:45.197027 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.196939 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="971dc6c1-c354-4554-b8d7-035cb21fea27" containerName="istio-proxy" Jul 10 13:52:45.201459 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.201437 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.203539 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.203519 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-d5a86b34-openshift-default-dockercfg-wql6x\"" Jul 10 13:52:45.209067 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.208535 2575 scope.go:117] "RemoveContainer" containerID="69082edff241c56a17839acb288400757ce2a220ab231bbf357e297618a9ba0c" Jul 10 13:52:45.211715 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.211692 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm"] Jul 10 13:52:45.220610 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.220595 2575 scope.go:117] "RemoveContainer" containerID="e490c4b75ba90b131a7b45352ceb0e22ca8f5fcf3988ad36295da75514b830d2" Jul 10 13:52:45.220870 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:52:45.220853 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e490c4b75ba90b131a7b45352ceb0e22ca8f5fcf3988ad36295da75514b830d2\": container with ID starting with e490c4b75ba90b131a7b45352ceb0e22ca8f5fcf3988ad36295da75514b830d2 not found: ID does not exist" containerID="e490c4b75ba90b131a7b45352ceb0e22ca8f5fcf3988ad36295da75514b830d2" Jul 10 13:52:45.220938 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.220877 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e490c4b75ba90b131a7b45352ceb0e22ca8f5fcf3988ad36295da75514b830d2"} err="failed to get container status \"e490c4b75ba90b131a7b45352ceb0e22ca8f5fcf3988ad36295da75514b830d2\": rpc error: code = NotFound desc = could not find container \"e490c4b75ba90b131a7b45352ceb0e22ca8f5fcf3988ad36295da75514b830d2\": container with ID starting with e490c4b75ba90b131a7b45352ceb0e22ca8f5fcf3988ad36295da75514b830d2 not found: ID does not exist" Jul 10 13:52:45.220938 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.220894 2575 scope.go:117] "RemoveContainer" containerID="69082edff241c56a17839acb288400757ce2a220ab231bbf357e297618a9ba0c" Jul 10 13:52:45.221104 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:52:45.221090 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69082edff241c56a17839acb288400757ce2a220ab231bbf357e297618a9ba0c\": container with ID starting with 69082edff241c56a17839acb288400757ce2a220ab231bbf357e297618a9ba0c not found: ID does not exist" containerID="69082edff241c56a17839acb288400757ce2a220ab231bbf357e297618a9ba0c" Jul 10 13:52:45.221140 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.221108 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69082edff241c56a17839acb288400757ce2a220ab231bbf357e297618a9ba0c"} err="failed to get container status \"69082edff241c56a17839acb288400757ce2a220ab231bbf357e297618a9ba0c\": rpc error: code = NotFound desc = could not find container \"69082edff241c56a17839acb288400757ce2a220ab231bbf357e297618a9ba0c\": container with ID starting with 69082edff241c56a17839acb288400757ce2a220ab231bbf357e297618a9ba0c not found: ID does not exist" Jul 10 13:52:45.250952 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.250922 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h"] Jul 10 13:52:45.256844 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.256825 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f2237c2f-openshift-default-74dc78fdc7-zrl9h"] Jul 10 13:52:45.297768 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.297733 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-istio-data\") pod \"e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.297932 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.297790 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-workload-certs\") pod \"e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.297932 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.297866 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf57855d-a566-4df5-a6ef-ee18457a8df6-istio-token\") pod \"e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.297932 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.297919 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz257\" (UniqueName: \"kubernetes.io/projected/cf57855d-a566-4df5-a6ef-ee18457a8df6-kube-api-access-mz257\") pod \"e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.298095 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.298002 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf57855d-a566-4df5-a6ef-ee18457a8df6-istiod-ca-cert\") pod \"e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.298095 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.298041 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-credential-socket\") pod \"e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.298095 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.298073 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf57855d-a566-4df5-a6ef-ee18457a8df6-istio-podinfo\") pod \"e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.298253 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.298118 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-workload-socket\") pod \"e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.298253 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.298152 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-istio-envoy\") pod \"e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.399381 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.399352 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-credential-socket\") pod \"e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.399536 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.399384 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf57855d-a566-4df5-a6ef-ee18457a8df6-istio-podinfo\") pod \"e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.399536 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.399406 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-workload-socket\") pod \"e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.399536 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.399423 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-istio-envoy\") pod \"e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.399536 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.399484 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-istio-data\") pod \"e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.399536 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.399522 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-workload-certs\") pod \"e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.400187 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.399555 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf57855d-a566-4df5-a6ef-ee18457a8df6-istio-token\") pod \"e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.400187 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.399591 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz257\" (UniqueName: \"kubernetes.io/projected/cf57855d-a566-4df5-a6ef-ee18457a8df6-kube-api-access-mz257\") pod \"e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.400187 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.399621 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf57855d-a566-4df5-a6ef-ee18457a8df6-istiod-ca-cert\") pod \"e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.400187 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.399888 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-workload-socket\") pod \"e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.400187 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.399903 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-credential-socket\") pod \"e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.400187 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.399931 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-istio-data\") pod \"e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.400187 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.400032 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-workload-certs\") pod \"e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.400409 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.400317 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf57855d-a566-4df5-a6ef-ee18457a8df6-istiod-ca-cert\") pod \"e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.401831 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.401806 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-istio-envoy\") pod \"e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.402004 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.401987 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf57855d-a566-4df5-a6ef-ee18457a8df6-istio-podinfo\") pod \"e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.408539 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.408507 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf57855d-a566-4df5-a6ef-ee18457a8df6-istio-token\") pod \"e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.408768 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.408750 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz257\" (UniqueName: \"kubernetes.io/projected/cf57855d-a566-4df5-a6ef-ee18457a8df6-kube-api-access-mz257\") pod \"e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.517239 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.517169 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:45.658464 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.658437 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm"] Jul 10 13:52:45.659903 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:52:45.659879 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf57855d_a566_4df5_a6ef_ee18457a8df6.slice/crio-649610a2f82265a27b46de5ab674d80e55f71c76d2ac59882eae75fe34925b1a WatchSource:0}: Error finding container 649610a2f82265a27b46de5ab674d80e55f71c76d2ac59882eae75fe34925b1a: Status 404 returned error can't find the container with id 649610a2f82265a27b46de5ab674d80e55f71c76d2ac59882eae75fe34925b1a Jul 10 13:52:45.662015 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.661985 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:52:45.662102 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.662046 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:52:45.662102 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:45.662075 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:52:46.203452 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:46.203402 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" event={"ID":"cf57855d-a566-4df5-a6ef-ee18457a8df6","Type":"ContainerStarted","Data":"d9fd175d299e91a345e6d5c247318ecdc96a3cc2123ff44cfbc4b9807fae5f33"} Jul 10 13:52:46.203679 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:46.203474 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" event={"ID":"cf57855d-a566-4df5-a6ef-ee18457a8df6","Type":"ContainerStarted","Data":"649610a2f82265a27b46de5ab674d80e55f71c76d2ac59882eae75fe34925b1a"} Jul 10 13:52:46.227497 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:46.227453 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" podStartSLOduration=1.227438068 podStartE2EDuration="1.227438068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:52:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:52:46.224345921 +0000 UTC m=+1619.463677841" watchObservedRunningTime="2026-07-10 13:52:46.227438068 +0000 UTC m=+1619.466769989" Jul 10 13:52:46.237933 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:46.237908 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="971dc6c1-c354-4554-b8d7-035cb21fea27" path="/var/lib/kubelet/pods/971dc6c1-c354-4554-b8d7-035cb21fea27/volumes" Jul 10 13:52:46.518249 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:46.518174 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:46.519411 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:46.519386 2575 patch_prober.go:28] interesting pod/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body= Jul 10 13:52:46.519515 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:46.519447 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" podUID="cf57855d-a566-4df5-a6ef-ee18457a8df6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" Jul 10 13:52:47.522377 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:47.522343 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:48.215466 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:48.215438 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:48.216424 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:48.216401 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:50.964892 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:50.964860 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm"] Jul 10 13:52:51.236262 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:51.236148 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" podUID="cf57855d-a566-4df5-a6ef-ee18457a8df6" containerName="istio-proxy" containerID="cri-o://d9fd175d299e91a345e6d5c247318ecdc96a3cc2123ff44cfbc4b9807fae5f33" gracePeriod=30 Jul 10 13:52:56.986511 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:56.986489 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:57.003661 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.003625 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-credential-socket\") pod \"cf57855d-a566-4df5-a6ef-ee18457a8df6\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " Jul 10 13:52:57.003762 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.003699 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-workload-socket\") pod \"cf57855d-a566-4df5-a6ef-ee18457a8df6\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " Jul 10 13:52:57.003762 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.003731 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf57855d-a566-4df5-a6ef-ee18457a8df6-istio-podinfo\") pod \"cf57855d-a566-4df5-a6ef-ee18457a8df6\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " Jul 10 13:52:57.003843 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.003760 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mz257\" (UniqueName: \"kubernetes.io/projected/cf57855d-a566-4df5-a6ef-ee18457a8df6-kube-api-access-mz257\") pod \"cf57855d-a566-4df5-a6ef-ee18457a8df6\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " Jul 10 13:52:57.003843 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.003800 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-istio-data\") pod \"cf57855d-a566-4df5-a6ef-ee18457a8df6\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " Jul 10 13:52:57.003969 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.003839 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf57855d-a566-4df5-a6ef-ee18457a8df6-istiod-ca-cert\") pod \"cf57855d-a566-4df5-a6ef-ee18457a8df6\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " Jul 10 13:52:57.003969 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.003891 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-istio-envoy\") pod \"cf57855d-a566-4df5-a6ef-ee18457a8df6\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " Jul 10 13:52:57.003969 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.003907 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cf57855d-a566-4df5-a6ef-ee18457a8df6" (UID: "cf57855d-a566-4df5-a6ef-ee18457a8df6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:52:57.003969 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.003921 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf57855d-a566-4df5-a6ef-ee18457a8df6-istio-token\") pod \"cf57855d-a566-4df5-a6ef-ee18457a8df6\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " Jul 10 13:52:57.004174 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.004012 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cf57855d-a566-4df5-a6ef-ee18457a8df6" (UID: "cf57855d-a566-4df5-a6ef-ee18457a8df6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:52:57.004174 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.004146 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-workload-certs\") pod \"cf57855d-a566-4df5-a6ef-ee18457a8df6\" (UID: \"cf57855d-a566-4df5-a6ef-ee18457a8df6\") " Jul 10 13:52:57.004272 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.004236 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf57855d-a566-4df5-a6ef-ee18457a8df6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cf57855d-a566-4df5-a6ef-ee18457a8df6" (UID: "cf57855d-a566-4df5-a6ef-ee18457a8df6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:52:57.004531 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.004463 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-credential-socket\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:52:57.004531 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.004486 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-workload-socket\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:52:57.004531 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.004491 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cf57855d-a566-4df5-a6ef-ee18457a8df6" (UID: "cf57855d-a566-4df5-a6ef-ee18457a8df6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:52:57.004531 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.004499 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf57855d-a566-4df5-a6ef-ee18457a8df6-istiod-ca-cert\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:52:57.005084 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.005059 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-istio-data" (OuterVolumeSpecName: "istio-data") pod "cf57855d-a566-4df5-a6ef-ee18457a8df6" (UID: "cf57855d-a566-4df5-a6ef-ee18457a8df6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:52:57.006042 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.006016 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf57855d-a566-4df5-a6ef-ee18457a8df6-istio-token" (OuterVolumeSpecName: "istio-token") pod "cf57855d-a566-4df5-a6ef-ee18457a8df6" (UID: "cf57855d-a566-4df5-a6ef-ee18457a8df6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:52:57.006250 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.006233 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cf57855d-a566-4df5-a6ef-ee18457a8df6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cf57855d-a566-4df5-a6ef-ee18457a8df6" (UID: "cf57855d-a566-4df5-a6ef-ee18457a8df6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 13:52:57.006357 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.006336 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cf57855d-a566-4df5-a6ef-ee18457a8df6" (UID: "cf57855d-a566-4df5-a6ef-ee18457a8df6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:52:57.006414 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.006339 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf57855d-a566-4df5-a6ef-ee18457a8df6-kube-api-access-mz257" (OuterVolumeSpecName: "kube-api-access-mz257") pod "cf57855d-a566-4df5-a6ef-ee18457a8df6" (UID: "cf57855d-a566-4df5-a6ef-ee18457a8df6"). InnerVolumeSpecName "kube-api-access-mz257". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:52:57.104991 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.104972 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf57855d-a566-4df5-a6ef-ee18457a8df6-istio-podinfo\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:52:57.105115 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.104994 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mz257\" (UniqueName: \"kubernetes.io/projected/cf57855d-a566-4df5-a6ef-ee18457a8df6-kube-api-access-mz257\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:52:57.105115 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.105003 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-istio-data\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:52:57.105115 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.105011 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-istio-envoy\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:52:57.105115 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.105019 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf57855d-a566-4df5-a6ef-ee18457a8df6-istio-token\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:52:57.105115 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.105026 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf57855d-a566-4df5-a6ef-ee18457a8df6-workload-certs\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:52:57.271286 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.271252 2575 generic.go:356] "Generic (PLEG): container finished" podID="cf57855d-a566-4df5-a6ef-ee18457a8df6" containerID="d9fd175d299e91a345e6d5c247318ecdc96a3cc2123ff44cfbc4b9807fae5f33" exitCode=0 Jul 10 13:52:57.271460 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.271305 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" Jul 10 13:52:57.271460 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.271321 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" event={"ID":"cf57855d-a566-4df5-a6ef-ee18457a8df6","Type":"ContainerDied","Data":"d9fd175d299e91a345e6d5c247318ecdc96a3cc2123ff44cfbc4b9807fae5f33"} Jul 10 13:52:57.271460 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.271360 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm" event={"ID":"cf57855d-a566-4df5-a6ef-ee18457a8df6","Type":"ContainerDied","Data":"649610a2f82265a27b46de5ab674d80e55f71c76d2ac59882eae75fe34925b1a"} Jul 10 13:52:57.271460 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.271380 2575 scope.go:117] "RemoveContainer" containerID="d9fd175d299e91a345e6d5c247318ecdc96a3cc2123ff44cfbc4b9807fae5f33" Jul 10 13:52:57.281024 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.281009 2575 scope.go:117] "RemoveContainer" containerID="d9fd175d299e91a345e6d5c247318ecdc96a3cc2123ff44cfbc4b9807fae5f33" Jul 10 13:52:57.281273 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:52:57.281254 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9fd175d299e91a345e6d5c247318ecdc96a3cc2123ff44cfbc4b9807fae5f33\": container with ID starting with d9fd175d299e91a345e6d5c247318ecdc96a3cc2123ff44cfbc4b9807fae5f33 not found: ID does not exist" containerID="d9fd175d299e91a345e6d5c247318ecdc96a3cc2123ff44cfbc4b9807fae5f33" Jul 10 13:52:57.281345 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.281279 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9fd175d299e91a345e6d5c247318ecdc96a3cc2123ff44cfbc4b9807fae5f33"} err="failed to get container status \"d9fd175d299e91a345e6d5c247318ecdc96a3cc2123ff44cfbc4b9807fae5f33\": rpc error: code = NotFound desc = could not find container \"d9fd175d299e91a345e6d5c247318ecdc96a3cc2123ff44cfbc4b9807fae5f33\": container with ID starting with d9fd175d299e91a345e6d5c247318ecdc96a3cc2123ff44cfbc4b9807fae5f33 not found: ID does not exist" Jul 10 13:52:57.293495 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.293469 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm"] Jul 10 13:52:57.298345 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:57.298326 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-d5a86b34-openshift-default-7cb5558cf5-s9mrm"] Jul 10 13:52:58.238077 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:52:58.238044 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf57855d-a566-4df5-a6ef-ee18457a8df6" path="/var/lib/kubelet/pods/cf57855d-a566-4df5-a6ef-ee18457a8df6/volumes" Jul 10 13:54:38.434143 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.434111 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv"] Jul 10 13:54:38.434553 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.434464 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf57855d-a566-4df5-a6ef-ee18457a8df6" containerName="istio-proxy" Jul 10 13:54:38.434553 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.434477 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf57855d-a566-4df5-a6ef-ee18457a8df6" containerName="istio-proxy" Jul 10 13:54:38.434553 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.434536 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf57855d-a566-4df5-a6ef-ee18457a8df6" containerName="istio-proxy" Jul 10 13:54:38.434553 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.434545 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="971dc6c1-c354-4554-b8d7-035cb21fea27" containerName="istio-proxy" Jul 10 13:54:38.437484 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.437468 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.439661 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.439615 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-d792a168-openshift-default-dockercfg-rwvdv\"" Jul 10 13:54:38.455914 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.455892 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv"] Jul 10 13:54:38.471868 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.471836 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef50912d-43ab-4562-9827-f2b17ac6b13f-istio-token\") pod \"e2e-mt-d792a168-openshift-default-684967b86c-rm9cv\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.472025 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.471911 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-credential-socket\") pod \"e2e-mt-d792a168-openshift-default-684967b86c-rm9cv\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.472025 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.471988 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-istio-data\") pod \"e2e-mt-d792a168-openshift-default-684967b86c-rm9cv\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.472132 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.472024 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-workload-certs\") pod \"e2e-mt-d792a168-openshift-default-684967b86c-rm9cv\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.472132 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.472050 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef50912d-43ab-4562-9827-f2b17ac6b13f-istio-podinfo\") pod \"e2e-mt-d792a168-openshift-default-684967b86c-rm9cv\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.472132 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.472089 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5vw2\" (UniqueName: \"kubernetes.io/projected/ef50912d-43ab-4562-9827-f2b17ac6b13f-kube-api-access-j5vw2\") pod \"e2e-mt-d792a168-openshift-default-684967b86c-rm9cv\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.472259 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.472135 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-workload-socket\") pod \"e2e-mt-d792a168-openshift-default-684967b86c-rm9cv\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.472259 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.472167 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-istio-envoy\") pod \"e2e-mt-d792a168-openshift-default-684967b86c-rm9cv\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.472259 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.472229 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef50912d-43ab-4562-9827-f2b17ac6b13f-istiod-ca-cert\") pod \"e2e-mt-d792a168-openshift-default-684967b86c-rm9cv\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.573298 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.573264 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-workload-socket\") pod \"e2e-mt-d792a168-openshift-default-684967b86c-rm9cv\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.573475 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.573306 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-istio-envoy\") pod \"e2e-mt-d792a168-openshift-default-684967b86c-rm9cv\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.573475 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.573338 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef50912d-43ab-4562-9827-f2b17ac6b13f-istiod-ca-cert\") pod \"e2e-mt-d792a168-openshift-default-684967b86c-rm9cv\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.573475 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.573412 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef50912d-43ab-4562-9827-f2b17ac6b13f-istio-token\") pod \"e2e-mt-d792a168-openshift-default-684967b86c-rm9cv\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.573475 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.573458 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-credential-socket\") pod \"e2e-mt-d792a168-openshift-default-684967b86c-rm9cv\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.573751 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.573485 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-istio-data\") pod \"e2e-mt-d792a168-openshift-default-684967b86c-rm9cv\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.573751 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.573508 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-workload-certs\") pod \"e2e-mt-d792a168-openshift-default-684967b86c-rm9cv\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.573751 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.573529 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef50912d-43ab-4562-9827-f2b17ac6b13f-istio-podinfo\") pod \"e2e-mt-d792a168-openshift-default-684967b86c-rm9cv\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.573921 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.573825 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-workload-socket\") pod \"e2e-mt-d792a168-openshift-default-684967b86c-rm9cv\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.573921 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.573829 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5vw2\" (UniqueName: \"kubernetes.io/projected/ef50912d-43ab-4562-9827-f2b17ac6b13f-kube-api-access-j5vw2\") pod \"e2e-mt-d792a168-openshift-default-684967b86c-rm9cv\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.573921 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.573859 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-credential-socket\") pod \"e2e-mt-d792a168-openshift-default-684967b86c-rm9cv\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.573921 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.573880 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-istio-data\") pod \"e2e-mt-d792a168-openshift-default-684967b86c-rm9cv\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.574157 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.573948 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-workload-certs\") pod \"e2e-mt-d792a168-openshift-default-684967b86c-rm9cv\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.574493 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.574471 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef50912d-43ab-4562-9827-f2b17ac6b13f-istiod-ca-cert\") pod \"e2e-mt-d792a168-openshift-default-684967b86c-rm9cv\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.575707 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.575676 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-istio-envoy\") pod \"e2e-mt-d792a168-openshift-default-684967b86c-rm9cv\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.576184 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.576166 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef50912d-43ab-4562-9827-f2b17ac6b13f-istio-podinfo\") pod \"e2e-mt-d792a168-openshift-default-684967b86c-rm9cv\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.582297 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.582278 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef50912d-43ab-4562-9827-f2b17ac6b13f-istio-token\") pod \"e2e-mt-d792a168-openshift-default-684967b86c-rm9cv\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.582506 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.582485 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5vw2\" (UniqueName: \"kubernetes.io/projected/ef50912d-43ab-4562-9827-f2b17ac6b13f-kube-api-access-j5vw2\") pod \"e2e-mt-d792a168-openshift-default-684967b86c-rm9cv\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.748083 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.748003 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:38.885151 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.885128 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv"] Jul 10 13:54:38.886834 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:54:38.886808 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef50912d_43ab_4562_9827_f2b17ac6b13f.slice/crio-2b7ed27fb59aad8557ec79200f0732d1081663bafc3b236ca6dbbc43048a3b63 WatchSource:0}: Error finding container 2b7ed27fb59aad8557ec79200f0732d1081663bafc3b236ca6dbbc43048a3b63: Status 404 returned error can't find the container with id 2b7ed27fb59aad8557ec79200f0732d1081663bafc3b236ca6dbbc43048a3b63 Jul 10 13:54:38.889352 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.889310 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:54:38.889454 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.889386 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:54:38.889454 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:38.889435 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:54:39.777276 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:39.777239 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" event={"ID":"ef50912d-43ab-4562-9827-f2b17ac6b13f","Type":"ContainerStarted","Data":"8f4e6402a64a038ed27a4f131f22ac3d6a12fe3a55abb1ec3213f0f90a53a38c"} Jul 10 13:54:39.777677 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:39.777294 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" event={"ID":"ef50912d-43ab-4562-9827-f2b17ac6b13f","Type":"ContainerStarted","Data":"2b7ed27fb59aad8557ec79200f0732d1081663bafc3b236ca6dbbc43048a3b63"} Jul 10 13:54:39.797700 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:39.797660 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" podStartSLOduration=1.797628062 podStartE2EDuration="1.797628062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:54:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:54:39.796991793 +0000 UTC m=+1733.036323716" watchObservedRunningTime="2026-07-10 13:54:39.797628062 +0000 UTC m=+1733.036959986" Jul 10 13:54:40.748813 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:40.748779 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:40.753737 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:40.753711 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:40.782008 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:40.781956 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:40.782794 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:40.782775 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:54.867403 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:54.867368 2575 generic.go:356] "Generic (PLEG): container finished" podID="ef50912d-43ab-4562-9827-f2b17ac6b13f" containerID="8f4e6402a64a038ed27a4f131f22ac3d6a12fe3a55abb1ec3213f0f90a53a38c" exitCode=0 Jul 10 13:54:54.867919 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:54.867439 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" event={"ID":"ef50912d-43ab-4562-9827-f2b17ac6b13f","Type":"ContainerDied","Data":"8f4e6402a64a038ed27a4f131f22ac3d6a12fe3a55abb1ec3213f0f90a53a38c"} Jul 10 13:54:54.867919 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:54.867874 2575 scope.go:117] "RemoveContainer" containerID="8f4e6402a64a038ed27a4f131f22ac3d6a12fe3a55abb1ec3213f0f90a53a38c" Jul 10 13:54:54.868926 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:54.868896 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:54:54.869030 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:54.868981 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:54:54.869091 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:54.869032 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:54:55.782729 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:55.782695 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:55.874678 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:55.874617 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" event={"ID":"ef50912d-43ab-4562-9827-f2b17ac6b13f","Type":"ContainerStarted","Data":"808d0e59bb163da09cb8766b822d0a22528f0f08b0035bb4817b961ebc2ec989"} Jul 10 13:54:56.748223 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:56.748189 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:56.749478 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:56.749452 2575 patch_prober.go:28] interesting pod/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 10 13:54:56.749624 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:56.749505 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" podUID="ef50912d-43ab-4562-9827-f2b17ac6b13f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 10 13:54:57.748663 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:57.748614 2575 patch_prober.go:28] interesting pod/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 10 13:54:57.749174 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:57.748685 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" podUID="ef50912d-43ab-4562-9827-f2b17ac6b13f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 10 13:54:58.749175 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:58.749136 2575 patch_prober.go:28] interesting pod/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 10 13:54:58.749568 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:58.749192 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" podUID="ef50912d-43ab-4562-9827-f2b17ac6b13f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 10 13:54:59.752505 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:59.752474 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:59.752913 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:59.752756 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:54:59.753425 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:54:59.753404 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:55:01.689459 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:01.689431 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv"] Jul 10 13:55:01.904971 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:01.904932 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" podUID="ef50912d-43ab-4562-9827-f2b17ac6b13f" containerName="istio-proxy" containerID="cri-o://808d0e59bb163da09cb8766b822d0a22528f0f08b0035bb4817b961ebc2ec989" gracePeriod=30 Jul 10 13:55:07.154266 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.154236 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:55:07.234564 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.234493 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef50912d-43ab-4562-9827-f2b17ac6b13f-istio-podinfo\") pod \"ef50912d-43ab-4562-9827-f2b17ac6b13f\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " Jul 10 13:55:07.234564 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.234533 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-workload-certs\") pod \"ef50912d-43ab-4562-9827-f2b17ac6b13f\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " Jul 10 13:55:07.234564 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.234552 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef50912d-43ab-4562-9827-f2b17ac6b13f-istiod-ca-cert\") pod \"ef50912d-43ab-4562-9827-f2b17ac6b13f\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " Jul 10 13:55:07.234840 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.234589 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-istio-envoy\") pod \"ef50912d-43ab-4562-9827-f2b17ac6b13f\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " Jul 10 13:55:07.234840 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.234612 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-credential-socket\") pod \"ef50912d-43ab-4562-9827-f2b17ac6b13f\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " Jul 10 13:55:07.234840 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.234631 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef50912d-43ab-4562-9827-f2b17ac6b13f-istio-token\") pod \"ef50912d-43ab-4562-9827-f2b17ac6b13f\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " Jul 10 13:55:07.234840 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.234705 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-istio-data\") pod \"ef50912d-43ab-4562-9827-f2b17ac6b13f\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " Jul 10 13:55:07.234840 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.234728 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5vw2\" (UniqueName: \"kubernetes.io/projected/ef50912d-43ab-4562-9827-f2b17ac6b13f-kube-api-access-j5vw2\") pod \"ef50912d-43ab-4562-9827-f2b17ac6b13f\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " Jul 10 13:55:07.234840 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.234773 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-workload-socket\") pod \"ef50912d-43ab-4562-9827-f2b17ac6b13f\" (UID: \"ef50912d-43ab-4562-9827-f2b17ac6b13f\") " Jul 10 13:55:07.235143 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.234855 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ef50912d-43ab-4562-9827-f2b17ac6b13f" (UID: "ef50912d-43ab-4562-9827-f2b17ac6b13f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:55:07.235143 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.234953 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ef50912d-43ab-4562-9827-f2b17ac6b13f" (UID: "ef50912d-43ab-4562-9827-f2b17ac6b13f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:55:07.235143 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.235068 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ef50912d-43ab-4562-9827-f2b17ac6b13f" (UID: "ef50912d-43ab-4562-9827-f2b17ac6b13f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:55:07.235143 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.235077 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-workload-certs\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:55:07.235143 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.235128 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-credential-socket\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:55:07.235396 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.235087 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef50912d-43ab-4562-9827-f2b17ac6b13f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ef50912d-43ab-4562-9827-f2b17ac6b13f" (UID: "ef50912d-43ab-4562-9827-f2b17ac6b13f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:55:07.235665 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.235618 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-istio-data" (OuterVolumeSpecName: "istio-data") pod "ef50912d-43ab-4562-9827-f2b17ac6b13f" (UID: "ef50912d-43ab-4562-9827-f2b17ac6b13f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:55:07.236825 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.236805 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ef50912d-43ab-4562-9827-f2b17ac6b13f" (UID: "ef50912d-43ab-4562-9827-f2b17ac6b13f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:55:07.237026 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.237007 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef50912d-43ab-4562-9827-f2b17ac6b13f-kube-api-access-j5vw2" (OuterVolumeSpecName: "kube-api-access-j5vw2") pod "ef50912d-43ab-4562-9827-f2b17ac6b13f" (UID: "ef50912d-43ab-4562-9827-f2b17ac6b13f"). InnerVolumeSpecName "kube-api-access-j5vw2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:55:07.237126 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.237099 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ef50912d-43ab-4562-9827-f2b17ac6b13f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ef50912d-43ab-4562-9827-f2b17ac6b13f" (UID: "ef50912d-43ab-4562-9827-f2b17ac6b13f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 13:55:07.237224 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.237208 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef50912d-43ab-4562-9827-f2b17ac6b13f-istio-token" (OuterVolumeSpecName: "istio-token") pod "ef50912d-43ab-4562-9827-f2b17ac6b13f" (UID: "ef50912d-43ab-4562-9827-f2b17ac6b13f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:55:07.335800 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.335767 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-istio-data\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:55:07.335800 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.335791 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5vw2\" (UniqueName: \"kubernetes.io/projected/ef50912d-43ab-4562-9827-f2b17ac6b13f-kube-api-access-j5vw2\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:55:07.335800 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.335800 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-workload-socket\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:55:07.335800 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.335810 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef50912d-43ab-4562-9827-f2b17ac6b13f-istio-podinfo\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:55:07.336062 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.335818 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef50912d-43ab-4562-9827-f2b17ac6b13f-istiod-ca-cert\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:55:07.336062 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.335825 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef50912d-43ab-4562-9827-f2b17ac6b13f-istio-envoy\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:55:07.336062 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.335832 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef50912d-43ab-4562-9827-f2b17ac6b13f-istio-token\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:55:07.936273 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.936239 2575 generic.go:356] "Generic (PLEG): container finished" podID="ef50912d-43ab-4562-9827-f2b17ac6b13f" containerID="808d0e59bb163da09cb8766b822d0a22528f0f08b0035bb4817b961ebc2ec989" exitCode=0 Jul 10 13:55:07.936444 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.936286 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" Jul 10 13:55:07.936444 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.936328 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" event={"ID":"ef50912d-43ab-4562-9827-f2b17ac6b13f","Type":"ContainerDied","Data":"808d0e59bb163da09cb8766b822d0a22528f0f08b0035bb4817b961ebc2ec989"} Jul 10 13:55:07.936444 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.936379 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv" event={"ID":"ef50912d-43ab-4562-9827-f2b17ac6b13f","Type":"ContainerDied","Data":"2b7ed27fb59aad8557ec79200f0732d1081663bafc3b236ca6dbbc43048a3b63"} Jul 10 13:55:07.936444 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.936402 2575 scope.go:117] "RemoveContainer" containerID="808d0e59bb163da09cb8766b822d0a22528f0f08b0035bb4817b961ebc2ec989" Jul 10 13:55:07.945672 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.945632 2575 scope.go:117] "RemoveContainer" containerID="8f4e6402a64a038ed27a4f131f22ac3d6a12fe3a55abb1ec3213f0f90a53a38c" Jul 10 13:55:07.953380 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.953358 2575 scope.go:117] "RemoveContainer" containerID="808d0e59bb163da09cb8766b822d0a22528f0f08b0035bb4817b961ebc2ec989" Jul 10 13:55:07.953617 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:55:07.953600 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"808d0e59bb163da09cb8766b822d0a22528f0f08b0035bb4817b961ebc2ec989\": container with ID starting with 808d0e59bb163da09cb8766b822d0a22528f0f08b0035bb4817b961ebc2ec989 not found: ID does not exist" containerID="808d0e59bb163da09cb8766b822d0a22528f0f08b0035bb4817b961ebc2ec989" Jul 10 13:55:07.953771 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.953624 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"808d0e59bb163da09cb8766b822d0a22528f0f08b0035bb4817b961ebc2ec989"} err="failed to get container status \"808d0e59bb163da09cb8766b822d0a22528f0f08b0035bb4817b961ebc2ec989\": rpc error: code = NotFound desc = could not find container \"808d0e59bb163da09cb8766b822d0a22528f0f08b0035bb4817b961ebc2ec989\": container with ID starting with 808d0e59bb163da09cb8766b822d0a22528f0f08b0035bb4817b961ebc2ec989 not found: ID does not exist" Jul 10 13:55:07.953771 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.953667 2575 scope.go:117] "RemoveContainer" containerID="8f4e6402a64a038ed27a4f131f22ac3d6a12fe3a55abb1ec3213f0f90a53a38c" Jul 10 13:55:07.953936 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:55:07.953918 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f4e6402a64a038ed27a4f131f22ac3d6a12fe3a55abb1ec3213f0f90a53a38c\": container with ID starting with 8f4e6402a64a038ed27a4f131f22ac3d6a12fe3a55abb1ec3213f0f90a53a38c not found: ID does not exist" containerID="8f4e6402a64a038ed27a4f131f22ac3d6a12fe3a55abb1ec3213f0f90a53a38c" Jul 10 13:55:07.953992 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.953945 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f4e6402a64a038ed27a4f131f22ac3d6a12fe3a55abb1ec3213f0f90a53a38c"} err="failed to get container status \"8f4e6402a64a038ed27a4f131f22ac3d6a12fe3a55abb1ec3213f0f90a53a38c\": rpc error: code = NotFound desc = could not find container \"8f4e6402a64a038ed27a4f131f22ac3d6a12fe3a55abb1ec3213f0f90a53a38c\": container with ID starting with 8f4e6402a64a038ed27a4f131f22ac3d6a12fe3a55abb1ec3213f0f90a53a38c not found: ID does not exist" Jul 10 13:55:07.958544 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.958521 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv"] Jul 10 13:55:07.963986 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:07.963963 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-d792a168-openshift-default-684967b86c-rm9cv"] Jul 10 13:55:08.238529 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:08.238434 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef50912d-43ab-4562-9827-f2b17ac6b13f" path="/var/lib/kubelet/pods/ef50912d-43ab-4562-9827-f2b17ac6b13f/volumes" Jul 10 13:55:24.783387 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:24.783354 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv"] Jul 10 13:55:24.783839 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:24.783773 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef50912d-43ab-4562-9827-f2b17ac6b13f" containerName="istio-proxy" Jul 10 13:55:24.783839 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:24.783786 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef50912d-43ab-4562-9827-f2b17ac6b13f" containerName="istio-proxy" Jul 10 13:55:24.783839 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:24.783805 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef50912d-43ab-4562-9827-f2b17ac6b13f" containerName="istio-proxy" Jul 10 13:55:24.783839 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:24.783810 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef50912d-43ab-4562-9827-f2b17ac6b13f" containerName="istio-proxy" Jul 10 13:55:24.784038 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:24.783866 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef50912d-43ab-4562-9827-f2b17ac6b13f" containerName="istio-proxy" Jul 10 13:55:24.784038 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:24.783874 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef50912d-43ab-4562-9827-f2b17ac6b13f" containerName="istio-proxy" Jul 10 13:55:24.786770 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:24.786749 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:24.788974 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:24.788951 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-1a15ffa7-openshift-default-dockercfg-gqjqk\"" Jul 10 13:55:24.798152 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:24.798119 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv"] Jul 10 13:55:24.982094 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:24.982056 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-workload-certs\") pod \"e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:24.982094 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:24.982091 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bbng\" (UniqueName: \"kubernetes.io/projected/572f0324-4635-49bf-a82c-a76d7c323a03-kube-api-access-5bbng\") pod \"e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:24.982319 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:24.982123 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-credential-socket\") pod \"e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:24.982319 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:24.982198 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/572f0324-4635-49bf-a82c-a76d7c323a03-istio-podinfo\") pod \"e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:24.982319 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:24.982230 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/572f0324-4635-49bf-a82c-a76d7c323a03-istiod-ca-cert\") pod \"e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:24.982319 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:24.982249 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-workload-socket\") pod \"e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:24.982319 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:24.982268 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-istio-envoy\") pod \"e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:24.982493 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:24.982333 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/572f0324-4635-49bf-a82c-a76d7c323a03-istio-token\") pod \"e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:24.982493 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:24.982404 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-istio-data\") pod \"e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:25.082886 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:25.082810 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-istio-data\") pod \"e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:25.082886 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:25.082859 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-workload-certs\") pod \"e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:25.082886 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:25.082876 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bbng\" (UniqueName: \"kubernetes.io/projected/572f0324-4635-49bf-a82c-a76d7c323a03-kube-api-access-5bbng\") pod \"e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:25.083152 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:25.082903 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-credential-socket\") pod \"e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:25.083152 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:25.082931 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/572f0324-4635-49bf-a82c-a76d7c323a03-istio-podinfo\") pod \"e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:25.083152 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:25.082948 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/572f0324-4635-49bf-a82c-a76d7c323a03-istiod-ca-cert\") pod \"e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:25.083152 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:25.082971 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-workload-socket\") pod \"e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:25.083152 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:25.082999 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-istio-envoy\") pod \"e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:25.083152 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:25.083027 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/572f0324-4635-49bf-a82c-a76d7c323a03-istio-token\") pod \"e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:25.083521 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:25.083247 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-workload-certs\") pod \"e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:25.083521 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:25.083342 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-credential-socket\") pod \"e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:25.083521 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:25.083367 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-istio-data\") pod \"e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:25.083521 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:25.083449 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-workload-socket\") pod \"e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:25.083778 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:25.083761 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/572f0324-4635-49bf-a82c-a76d7c323a03-istiod-ca-cert\") pod \"e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:25.085262 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:25.085242 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-istio-envoy\") pod \"e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:25.085584 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:25.085562 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/572f0324-4635-49bf-a82c-a76d7c323a03-istio-podinfo\") pod \"e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:25.097566 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:25.097545 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/572f0324-4635-49bf-a82c-a76d7c323a03-istio-token\") pod \"e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:25.098280 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:25.098259 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bbng\" (UniqueName: \"kubernetes.io/projected/572f0324-4635-49bf-a82c-a76d7c323a03-kube-api-access-5bbng\") pod \"e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:25.397810 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:25.397765 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:25.534616 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:25.534593 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv"] Jul 10 13:55:25.536401 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:55:25.536376 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod572f0324_4635_49bf_a82c_a76d7c323a03.slice/crio-f8be40d5683c4bcc953e406836618a622fead5f13445c874d882ba955f098b64 WatchSource:0}: Error finding container f8be40d5683c4bcc953e406836618a622fead5f13445c874d882ba955f098b64: Status 404 returned error can't find the container with id f8be40d5683c4bcc953e406836618a622fead5f13445c874d882ba955f098b64 Jul 10 13:55:25.538495 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:25.538465 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:55:25.538563 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:25.538529 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:55:25.538563 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:25.538555 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:55:26.026631 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:26.026598 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" event={"ID":"572f0324-4635-49bf-a82c-a76d7c323a03","Type":"ContainerStarted","Data":"9227a135b98c6c430a301ab4c4df6c1800701b2a09585eb465d63ce17e0edb62"} Jul 10 13:55:26.027130 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:26.026682 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" event={"ID":"572f0324-4635-49bf-a82c-a76d7c323a03","Type":"ContainerStarted","Data":"f8be40d5683c4bcc953e406836618a622fead5f13445c874d882ba955f098b64"} Jul 10 13:55:26.047151 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:26.047103 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" podStartSLOduration=2.047087713 podStartE2EDuration="2.047087713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:55:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:55:26.04495962 +0000 UTC m=+1779.284291542" watchObservedRunningTime="2026-07-10 13:55:26.047087713 +0000 UTC m=+1779.286419634" Jul 10 13:55:26.398426 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:26.398391 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:26.399893 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:26.399866 2575 patch_prober.go:28] interesting pod/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 10 13:55:26.400016 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:26.399911 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" podUID="572f0324-4635-49bf-a82c-a76d7c323a03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 10 13:55:27.402420 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:27.402392 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:28.037490 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:28.037461 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:28.038430 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:28.038411 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:42.110351 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:42.110319 2575 generic.go:356] "Generic (PLEG): container finished" podID="572f0324-4635-49bf-a82c-a76d7c323a03" containerID="9227a135b98c6c430a301ab4c4df6c1800701b2a09585eb465d63ce17e0edb62" exitCode=0 Jul 10 13:55:42.110760 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:42.110385 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" event={"ID":"572f0324-4635-49bf-a82c-a76d7c323a03","Type":"ContainerDied","Data":"9227a135b98c6c430a301ab4c4df6c1800701b2a09585eb465d63ce17e0edb62"} Jul 10 13:55:42.110831 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:42.110814 2575 scope.go:117] "RemoveContainer" containerID="9227a135b98c6c430a301ab4c4df6c1800701b2a09585eb465d63ce17e0edb62" Jul 10 13:55:42.111822 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:42.111789 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:55:42.111936 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:42.111859 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:55:42.111936 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:42.111889 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:55:43.038103 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:43.038052 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:43.117525 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:43.117492 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" event={"ID":"572f0324-4635-49bf-a82c-a76d7c323a03","Type":"ContainerStarted","Data":"002ecaf74f715c065e3e54fd0987eacc5bbb706898cd9566ae5cefb6961fdf11"} Jul 10 13:55:43.398074 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:43.398047 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:43.399186 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:43.399164 2575 patch_prober.go:28] interesting pod/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 10 13:55:43.399310 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:43.399237 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" podUID="572f0324-4635-49bf-a82c-a76d7c323a03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 10 13:55:44.398837 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:44.398799 2575 patch_prober.go:28] interesting pod/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 10 13:55:44.399329 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:44.398877 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" podUID="572f0324-4635-49bf-a82c-a76d7c323a03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 10 13:55:45.398361 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:45.398329 2575 patch_prober.go:28] interesting pod/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 10 13:55:45.398512 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:45.398379 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" podUID="572f0324-4635-49bf-a82c-a76d7c323a03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 10 13:55:46.398308 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:46.398266 2575 patch_prober.go:28] interesting pod/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 10 13:55:46.398711 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:46.398325 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" podUID="572f0324-4635-49bf-a82c-a76d7c323a03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 10 13:55:47.375780 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:47.375753 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hrq6g_63c89ec5-2de9-4855-8fe8-57baaa8e0588/console-operator/1.log" Jul 10 13:55:47.376163 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:47.376147 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hrq6g_63c89ec5-2de9-4855-8fe8-57baaa8e0588/console-operator/1.log" Jul 10 13:55:47.381140 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:47.381115 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rpg2g_e7e01989-a0c5-4924-bebf-bad6bf0f0844/ovn-acl-logging/0.log" Jul 10 13:55:47.381497 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:47.381482 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rpg2g_e7e01989-a0c5-4924-bebf-bad6bf0f0844/ovn-acl-logging/0.log" Jul 10 13:55:47.401939 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:47.401919 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:47.402356 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:47.402341 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:55:47.403109 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:55:47.403084 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:57:06.218095 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:06.218062 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv"] Jul 10 13:57:06.218593 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:06.218301 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" podUID="572f0324-4635-49bf-a82c-a76d7c323a03" containerName="istio-proxy" containerID="cri-o://002ecaf74f715c065e3e54fd0987eacc5bbb706898cd9566ae5cefb6961fdf11" gracePeriod=30 Jul 10 13:57:11.477220 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.477189 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:57:11.569343 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.569257 2575 generic.go:356] "Generic (PLEG): container finished" podID="572f0324-4635-49bf-a82c-a76d7c323a03" containerID="002ecaf74f715c065e3e54fd0987eacc5bbb706898cd9566ae5cefb6961fdf11" exitCode=0 Jul 10 13:57:11.569343 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.569303 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" Jul 10 13:57:11.569525 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.569342 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" event={"ID":"572f0324-4635-49bf-a82c-a76d7c323a03","Type":"ContainerDied","Data":"002ecaf74f715c065e3e54fd0987eacc5bbb706898cd9566ae5cefb6961fdf11"} Jul 10 13:57:11.569525 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.569397 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv" event={"ID":"572f0324-4635-49bf-a82c-a76d7c323a03","Type":"ContainerDied","Data":"f8be40d5683c4bcc953e406836618a622fead5f13445c874d882ba955f098b64"} Jul 10 13:57:11.569525 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.569427 2575 scope.go:117] "RemoveContainer" containerID="002ecaf74f715c065e3e54fd0987eacc5bbb706898cd9566ae5cefb6961fdf11" Jul 10 13:57:11.578889 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.578871 2575 scope.go:117] "RemoveContainer" containerID="9227a135b98c6c430a301ab4c4df6c1800701b2a09585eb465d63ce17e0edb62" Jul 10 13:57:11.586908 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.586892 2575 scope.go:117] "RemoveContainer" containerID="002ecaf74f715c065e3e54fd0987eacc5bbb706898cd9566ae5cefb6961fdf11" Jul 10 13:57:11.587153 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:57:11.587136 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"002ecaf74f715c065e3e54fd0987eacc5bbb706898cd9566ae5cefb6961fdf11\": container with ID starting with 002ecaf74f715c065e3e54fd0987eacc5bbb706898cd9566ae5cefb6961fdf11 not found: ID does not exist" containerID="002ecaf74f715c065e3e54fd0987eacc5bbb706898cd9566ae5cefb6961fdf11" Jul 10 13:57:11.587197 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.587162 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"002ecaf74f715c065e3e54fd0987eacc5bbb706898cd9566ae5cefb6961fdf11"} err="failed to get container status \"002ecaf74f715c065e3e54fd0987eacc5bbb706898cd9566ae5cefb6961fdf11\": rpc error: code = NotFound desc = could not find container \"002ecaf74f715c065e3e54fd0987eacc5bbb706898cd9566ae5cefb6961fdf11\": container with ID starting with 002ecaf74f715c065e3e54fd0987eacc5bbb706898cd9566ae5cefb6961fdf11 not found: ID does not exist" Jul 10 13:57:11.587197 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.587181 2575 scope.go:117] "RemoveContainer" containerID="9227a135b98c6c430a301ab4c4df6c1800701b2a09585eb465d63ce17e0edb62" Jul 10 13:57:11.587398 ip-10-0-128-57 kubenswrapper[2575]: E0710 13:57:11.587382 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9227a135b98c6c430a301ab4c4df6c1800701b2a09585eb465d63ce17e0edb62\": container with ID starting with 9227a135b98c6c430a301ab4c4df6c1800701b2a09585eb465d63ce17e0edb62 not found: ID does not exist" containerID="9227a135b98c6c430a301ab4c4df6c1800701b2a09585eb465d63ce17e0edb62" Jul 10 13:57:11.587446 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.587403 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9227a135b98c6c430a301ab4c4df6c1800701b2a09585eb465d63ce17e0edb62"} err="failed to get container status \"9227a135b98c6c430a301ab4c4df6c1800701b2a09585eb465d63ce17e0edb62\": rpc error: code = NotFound desc = could not find container \"9227a135b98c6c430a301ab4c4df6c1800701b2a09585eb465d63ce17e0edb62\": container with ID starting with 9227a135b98c6c430a301ab4c4df6c1800701b2a09585eb465d63ce17e0edb62 not found: ID does not exist" Jul 10 13:57:11.599849 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.599828 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/572f0324-4635-49bf-a82c-a76d7c323a03-istiod-ca-cert\") pod \"572f0324-4635-49bf-a82c-a76d7c323a03\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " Jul 10 13:57:11.599937 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.599855 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-istio-envoy\") pod \"572f0324-4635-49bf-a82c-a76d7c323a03\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " Jul 10 13:57:11.599937 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.599871 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-workload-socket\") pod \"572f0324-4635-49bf-a82c-a76d7c323a03\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " Jul 10 13:57:11.599937 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.599931 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-istio-data\") pod \"572f0324-4635-49bf-a82c-a76d7c323a03\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " Jul 10 13:57:11.600042 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.599972 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-workload-certs\") pod \"572f0324-4635-49bf-a82c-a76d7c323a03\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " Jul 10 13:57:11.600078 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.600044 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/572f0324-4635-49bf-a82c-a76d7c323a03-istio-podinfo\") pod \"572f0324-4635-49bf-a82c-a76d7c323a03\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " Jul 10 13:57:11.600135 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.600116 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bbng\" (UniqueName: \"kubernetes.io/projected/572f0324-4635-49bf-a82c-a76d7c323a03-kube-api-access-5bbng\") pod \"572f0324-4635-49bf-a82c-a76d7c323a03\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " Jul 10 13:57:11.600250 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.600146 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/572f0324-4635-49bf-a82c-a76d7c323a03-istio-token\") pod \"572f0324-4635-49bf-a82c-a76d7c323a03\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " Jul 10 13:57:11.600250 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.600179 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-credential-socket\") pod \"572f0324-4635-49bf-a82c-a76d7c323a03\" (UID: \"572f0324-4635-49bf-a82c-a76d7c323a03\") " Jul 10 13:57:11.600359 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.600240 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "572f0324-4635-49bf-a82c-a76d7c323a03" (UID: "572f0324-4635-49bf-a82c-a76d7c323a03"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:57:11.600359 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.600292 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "572f0324-4635-49bf-a82c-a76d7c323a03" (UID: "572f0324-4635-49bf-a82c-a76d7c323a03"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:57:11.600359 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.600309 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/572f0324-4635-49bf-a82c-a76d7c323a03-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "572f0324-4635-49bf-a82c-a76d7c323a03" (UID: "572f0324-4635-49bf-a82c-a76d7c323a03"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 13:57:11.600530 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.600512 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "572f0324-4635-49bf-a82c-a76d7c323a03" (UID: "572f0324-4635-49bf-a82c-a76d7c323a03"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:57:11.600599 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.600518 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/572f0324-4635-49bf-a82c-a76d7c323a03-istiod-ca-cert\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:57:11.600599 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.600553 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-workload-socket\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:57:11.600599 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.600565 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-workload-certs\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:57:11.601067 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.601034 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-istio-data" (OuterVolumeSpecName: "istio-data") pod "572f0324-4635-49bf-a82c-a76d7c323a03" (UID: "572f0324-4635-49bf-a82c-a76d7c323a03"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:57:11.602080 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.602045 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "572f0324-4635-49bf-a82c-a76d7c323a03" (UID: "572f0324-4635-49bf-a82c-a76d7c323a03"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 13:57:11.602317 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.602299 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/572f0324-4635-49bf-a82c-a76d7c323a03-kube-api-access-5bbng" (OuterVolumeSpecName: "kube-api-access-5bbng") pod "572f0324-4635-49bf-a82c-a76d7c323a03" (UID: "572f0324-4635-49bf-a82c-a76d7c323a03"). InnerVolumeSpecName "kube-api-access-5bbng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:57:11.602317 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.602305 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/572f0324-4635-49bf-a82c-a76d7c323a03-istio-token" (OuterVolumeSpecName: "istio-token") pod "572f0324-4635-49bf-a82c-a76d7c323a03" (UID: "572f0324-4635-49bf-a82c-a76d7c323a03"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 13:57:11.602418 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.602372 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/572f0324-4635-49bf-a82c-a76d7c323a03-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "572f0324-4635-49bf-a82c-a76d7c323a03" (UID: "572f0324-4635-49bf-a82c-a76d7c323a03"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 13:57:11.701312 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.701273 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-istio-envoy\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:57:11.701312 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.701302 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-istio-data\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:57:11.701312 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.701314 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/572f0324-4635-49bf-a82c-a76d7c323a03-istio-podinfo\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:57:11.701548 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.701326 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bbng\" (UniqueName: \"kubernetes.io/projected/572f0324-4635-49bf-a82c-a76d7c323a03-kube-api-access-5bbng\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:57:11.701548 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.701338 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/572f0324-4635-49bf-a82c-a76d7c323a03-istio-token\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:57:11.701548 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.701349 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/572f0324-4635-49bf-a82c-a76d7c323a03-credential-socket\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 13:57:11.893311 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.893278 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv"] Jul 10 13:57:11.901515 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:11.901487 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-1a15ffa7-openshift-default-7568fdd655-nptpv"] Jul 10 13:57:12.238229 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:57:12.238139 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="572f0324-4635-49bf-a82c-a76d7c323a03" path="/var/lib/kubelet/pods/572f0324-4635-49bf-a82c-a76d7c323a03/volumes" Jul 10 13:58:03.164343 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.164309 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht"] Jul 10 13:58:03.164761 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.164625 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="572f0324-4635-49bf-a82c-a76d7c323a03" containerName="istio-proxy" Jul 10 13:58:03.164761 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.164650 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="572f0324-4635-49bf-a82c-a76d7c323a03" containerName="istio-proxy" Jul 10 13:58:03.164761 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.164717 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="572f0324-4635-49bf-a82c-a76d7c323a03" containerName="istio-proxy" Jul 10 13:58:03.164761 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.164723 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="572f0324-4635-49bf-a82c-a76d7c323a03" containerName="istio-proxy" Jul 10 13:58:03.167582 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.167567 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.169819 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.169798 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-6c6c27-openshift-default-dockercfg-bjc96\"" Jul 10 13:58:03.180689 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.180671 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht"] Jul 10 13:58:03.232157 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.232131 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-credential-socket\") pod \"e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.232273 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.232160 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a111b1b6-72f7-4015-bf88-db01b066f85d-istio-podinfo\") pod \"e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.232273 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.232198 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-workload-certs\") pod \"e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.232273 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.232246 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a111b1b6-72f7-4015-bf88-db01b066f85d-istio-token\") pod \"e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.232392 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.232279 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-workload-socket\") pod \"e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.232392 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.232301 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a111b1b6-72f7-4015-bf88-db01b066f85d-istiod-ca-cert\") pod \"e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.232392 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.232321 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-istio-data\") pod \"e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.232392 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.232359 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zzjq\" (UniqueName: \"kubernetes.io/projected/a111b1b6-72f7-4015-bf88-db01b066f85d-kube-api-access-4zzjq\") pod \"e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.232518 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.232440 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-istio-envoy\") pod \"e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.333326 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.333291 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-workload-certs\") pod \"e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.333588 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.333567 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a111b1b6-72f7-4015-bf88-db01b066f85d-istio-token\") pod \"e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.333788 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.333763 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-workload-socket\") pod \"e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.333900 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.333803 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a111b1b6-72f7-4015-bf88-db01b066f85d-istiod-ca-cert\") pod \"e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.333900 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.333834 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-istio-data\") pod \"e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.333900 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.333860 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zzjq\" (UniqueName: \"kubernetes.io/projected/a111b1b6-72f7-4015-bf88-db01b066f85d-kube-api-access-4zzjq\") pod \"e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.334075 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.333981 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-istio-envoy\") pod \"e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.334075 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.334015 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-credential-socket\") pod \"e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.334075 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.334042 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a111b1b6-72f7-4015-bf88-db01b066f85d-istio-podinfo\") pod \"e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.334361 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.334337 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-istio-data\") pod \"e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.334427 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.334382 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-workload-certs\") pod \"e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.334502 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.334464 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-credential-socket\") pod \"e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.334664 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.334623 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-workload-socket\") pod \"e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.334763 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.334663 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a111b1b6-72f7-4015-bf88-db01b066f85d-istiod-ca-cert\") pod \"e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.336411 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.336388 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-istio-envoy\") pod \"e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.336491 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.336451 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a111b1b6-72f7-4015-bf88-db01b066f85d-istio-podinfo\") pod \"e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.342884 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.342862 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a111b1b6-72f7-4015-bf88-db01b066f85d-istio-token\") pod \"e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.343093 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.343076 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zzjq\" (UniqueName: \"kubernetes.io/projected/a111b1b6-72f7-4015-bf88-db01b066f85d-kube-api-access-4zzjq\") pod \"e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.476982 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.476910 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:03.610283 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.610254 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht"] Jul 10 13:58:03.612038 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:58:03.612003 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda111b1b6_72f7_4015_bf88_db01b066f85d.slice/crio-47cc0c7ae165427b356d5e2e820be60b82acca1a8017c491d3b77998464a14fb WatchSource:0}: Error finding container 47cc0c7ae165427b356d5e2e820be60b82acca1a8017c491d3b77998464a14fb: Status 404 returned error can't find the container with id 47cc0c7ae165427b356d5e2e820be60b82acca1a8017c491d3b77998464a14fb Jul 10 13:58:03.614181 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.614148 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:58:03.614283 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.614211 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:58:03.614283 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.614237 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:58:03.841594 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.841500 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" event={"ID":"a111b1b6-72f7-4015-bf88-db01b066f85d","Type":"ContainerStarted","Data":"e20d57ea189a8cbfd09f5d8995fc78392e4cb5ac57d51f3d1d4ca65625d7a80e"} Jul 10 13:58:03.841594 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.841551 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" event={"ID":"a111b1b6-72f7-4015-bf88-db01b066f85d","Type":"ContainerStarted","Data":"47cc0c7ae165427b356d5e2e820be60b82acca1a8017c491d3b77998464a14fb"} Jul 10 13:58:03.860816 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:03.860727 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" podStartSLOduration=0.860706691 podStartE2EDuration="860.706691ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:58:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:58:03.860498191 +0000 UTC m=+1937.099830112" watchObservedRunningTime="2026-07-10 13:58:03.860706691 +0000 UTC m=+1937.100038612" Jul 10 13:58:04.477310 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:04.477279 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:04.482693 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:04.482669 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:04.846544 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:04.846466 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:04.847319 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:04.847300 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:11.047233 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.047194 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr"] Jul 10 13:58:11.047725 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.047709 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="572f0324-4635-49bf-a82c-a76d7c323a03" containerName="istio-proxy" Jul 10 13:58:11.047825 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.047727 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="572f0324-4635-49bf-a82c-a76d7c323a03" containerName="istio-proxy" Jul 10 13:58:11.058831 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.058805 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.061076 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.061055 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-5cb1b4-openshift-default-dockercfg-vpvg5\"" Jul 10 13:58:11.063050 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.063029 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr"] Jul 10 13:58:11.203533 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.203497 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-workload-certs\") pod \"e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.203737 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.203571 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-istio-data\") pod \"e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.203737 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.203623 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svh6h\" (UniqueName: \"kubernetes.io/projected/10f1f044-9615-4d6b-a9d9-1988c6aee163-kube-api-access-svh6h\") pod \"e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.203737 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.203680 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-workload-socket\") pod \"e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.203737 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.203706 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10f1f044-9615-4d6b-a9d9-1988c6aee163-istio-token\") pod \"e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.203737 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.203725 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-credential-socket\") pod \"e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.203991 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.203747 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-istio-envoy\") pod \"e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.203991 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.203835 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10f1f044-9615-4d6b-a9d9-1988c6aee163-istio-podinfo\") pod \"e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.203991 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.203876 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10f1f044-9615-4d6b-a9d9-1988c6aee163-istiod-ca-cert\") pod \"e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.304558 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.304453 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-credential-socket\") pod \"e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.304558 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.304512 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-istio-envoy\") pod \"e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.304558 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.304545 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10f1f044-9615-4d6b-a9d9-1988c6aee163-istio-podinfo\") pod \"e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.304941 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.304574 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10f1f044-9615-4d6b-a9d9-1988c6aee163-istiod-ca-cert\") pod \"e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.304941 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.304603 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-workload-certs\") pod \"e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.304941 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.304736 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-istio-data\") pod \"e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.304941 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.304769 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svh6h\" (UniqueName: \"kubernetes.io/projected/10f1f044-9615-4d6b-a9d9-1988c6aee163-kube-api-access-svh6h\") pod \"e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.304941 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.304797 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-workload-socket\") pod \"e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.304941 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.304832 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10f1f044-9615-4d6b-a9d9-1988c6aee163-istio-token\") pod \"e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.305221 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.305059 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-credential-socket\") pod \"e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.305282 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.305227 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-workload-certs\") pod \"e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.305342 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.305288 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-istio-data\") pod \"e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.305465 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.305446 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-workload-socket\") pod \"e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.305524 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.305508 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10f1f044-9615-4d6b-a9d9-1988c6aee163-istiod-ca-cert\") pod \"e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.306881 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.306858 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-istio-envoy\") pod \"e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.307010 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.306994 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10f1f044-9615-4d6b-a9d9-1988c6aee163-istio-podinfo\") pod \"e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.316581 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.316554 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svh6h\" (UniqueName: \"kubernetes.io/projected/10f1f044-9615-4d6b-a9d9-1988c6aee163-kube-api-access-svh6h\") pod \"e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.319515 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.319485 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10f1f044-9615-4d6b-a9d9-1988c6aee163-istio-token\") pod \"e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.370851 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.370826 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:11.509628 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.509600 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr"] Jul 10 13:58:11.511975 ip-10-0-128-57 kubenswrapper[2575]: W0710 13:58:11.511940 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10f1f044_9615_4d6b_a9d9_1988c6aee163.slice/crio-ddc97385d268d2250db1be8e2a299b3c2e0922966a5d4475984fd413b68a78a1 WatchSource:0}: Error finding container ddc97385d268d2250db1be8e2a299b3c2e0922966a5d4475984fd413b68a78a1: Status 404 returned error can't find the container with id ddc97385d268d2250db1be8e2a299b3c2e0922966a5d4475984fd413b68a78a1 Jul 10 13:58:11.513896 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.513863 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:58:11.513997 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.513932 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:58:11.513997 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.513965 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:58:11.883323 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.883284 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" event={"ID":"10f1f044-9615-4d6b-a9d9-1988c6aee163","Type":"ContainerStarted","Data":"eab25ab3f1c45527be7075c3833774b8fa24c10150c658939de1e6f6ce12ef19"} Jul 10 13:58:11.883505 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.883339 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" event={"ID":"10f1f044-9615-4d6b-a9d9-1988c6aee163","Type":"ContainerStarted","Data":"ddc97385d268d2250db1be8e2a299b3c2e0922966a5d4475984fd413b68a78a1"} Jul 10 13:58:11.907386 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:11.907342 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" podStartSLOduration=0.907326806 podStartE2EDuration="907.326806ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:58:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:58:11.90585777 +0000 UTC m=+1945.145189691" watchObservedRunningTime="2026-07-10 13:58:11.907326806 +0000 UTC m=+1945.146658727" Jul 10 13:58:12.371488 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:12.371460 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:12.376078 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:12.376055 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:12.888046 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:12.888019 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:12.888802 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:12.888786 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:20.887796 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:20.887752 2575 patch_prober.go:28] interesting pod/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 10 13:58:20.888242 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:20.887822 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" podUID="a111b1b6-72f7-4015-bf88-db01b066f85d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 10 13:58:21.940588 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:21.940542 2575 generic.go:356] "Generic (PLEG): container finished" podID="a111b1b6-72f7-4015-bf88-db01b066f85d" containerID="e20d57ea189a8cbfd09f5d8995fc78392e4cb5ac57d51f3d1d4ca65625d7a80e" exitCode=0 Jul 10 13:58:21.941153 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:21.940732 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" event={"ID":"a111b1b6-72f7-4015-bf88-db01b066f85d","Type":"ContainerDied","Data":"e20d57ea189a8cbfd09f5d8995fc78392e4cb5ac57d51f3d1d4ca65625d7a80e"} Jul 10 13:58:21.941242 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:21.941214 2575 scope.go:117] "RemoveContainer" containerID="e20d57ea189a8cbfd09f5d8995fc78392e4cb5ac57d51f3d1d4ca65625d7a80e" Jul 10 13:58:21.942566 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:21.942522 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:58:21.942683 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:21.942624 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:58:21.942770 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:21.942695 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:58:22.951736 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:22.951699 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" event={"ID":"a111b1b6-72f7-4015-bf88-db01b066f85d","Type":"ContainerStarted","Data":"131e508bda7e80732ce5de68211d08986cfa969cb7e4a9474777b01f9a31235f"} Jul 10 13:58:23.477585 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:23.477547 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:23.477801 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:23.477681 2575 patch_prober.go:28] interesting pod/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 10 13:58:23.477801 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:23.477723 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" podUID="a111b1b6-72f7-4015-bf88-db01b066f85d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 10 13:58:24.478112 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:24.478073 2575 patch_prober.go:28] interesting pod/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 10 13:58:24.478534 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:24.478140 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" podUID="a111b1b6-72f7-4015-bf88-db01b066f85d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 10 13:58:25.477949 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:25.477900 2575 patch_prober.go:28] interesting pod/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 10 13:58:25.478145 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:25.477962 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" podUID="a111b1b6-72f7-4015-bf88-db01b066f85d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 10 13:58:26.478285 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:26.478250 2575 patch_prober.go:28] interesting pod/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 10 13:58:26.478765 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:26.478328 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" podUID="a111b1b6-72f7-4015-bf88-db01b066f85d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 10 13:58:27.480453 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:27.480426 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:27.480936 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:27.480752 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:27.481401 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:27.481384 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 13:58:28.641060 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:28.639824 2575 patch_prober.go:28] interesting pod/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": read tcp 10.132.0.2:50820->10.132.0.48:15021: read: connection reset by peer" start-of-body= Jul 10 13:58:28.641060 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:28.639883 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" podUID="10f1f044-9615-4d6b-a9d9-1988c6aee163" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": read tcp 10.132.0.2:50820->10.132.0.48:15021: read: connection reset by peer" Jul 10 13:58:28.991143 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:28.991055 2575 generic.go:356] "Generic (PLEG): container finished" podID="10f1f044-9615-4d6b-a9d9-1988c6aee163" containerID="eab25ab3f1c45527be7075c3833774b8fa24c10150c658939de1e6f6ce12ef19" exitCode=0 Jul 10 13:58:28.991143 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:28.991128 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" event={"ID":"10f1f044-9615-4d6b-a9d9-1988c6aee163","Type":"ContainerDied","Data":"eab25ab3f1c45527be7075c3833774b8fa24c10150c658939de1e6f6ce12ef19"} Jul 10 13:58:28.991628 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:28.991610 2575 scope.go:117] "RemoveContainer" containerID="eab25ab3f1c45527be7075c3833774b8fa24c10150c658939de1e6f6ce12ef19" Jul 10 13:58:28.992617 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:28.992590 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:58:28.992710 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:28.992681 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:58:28.992758 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:28.992714 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 13:58:29.998174 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:29.998140 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" event={"ID":"10f1f044-9615-4d6b-a9d9-1988c6aee163","Type":"ContainerStarted","Data":"fd5c741e872055f11dee3c16461b742ff10cbe834dac368cd6d0ee42e7ad4f1f"} Jul 10 13:58:30.371986 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:30.371953 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:30.372187 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:30.372164 2575 patch_prober.go:28] interesting pod/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 10 13:58:30.372256 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:30.372212 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" podUID="10f1f044-9615-4d6b-a9d9-1988c6aee163" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 10 13:58:31.371392 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:31.371357 2575 patch_prober.go:28] interesting pod/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 10 13:58:31.371803 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:31.371407 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" podUID="10f1f044-9615-4d6b-a9d9-1988c6aee163" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 10 13:58:32.371201 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:32.371167 2575 patch_prober.go:28] interesting pod/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 10 13:58:32.371378 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:32.371231 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" podUID="10f1f044-9615-4d6b-a9d9-1988c6aee163" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 10 13:58:33.371429 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:33.371393 2575 patch_prober.go:28] interesting pod/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 10 13:58:33.371845 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:33.371451 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" podUID="10f1f044-9615-4d6b-a9d9-1988c6aee163" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 10 13:58:34.375233 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:34.375206 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:34.375606 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:34.375543 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 13:58:34.376335 ip-10-0-128-57 kubenswrapper[2575]: I0710 13:58:34.376314 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 14:00:01.716258 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:01.716224 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht"] Jul 10 14:00:01.716847 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:01.716487 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" podUID="a111b1b6-72f7-4015-bf88-db01b066f85d" containerName="istio-proxy" containerID="cri-o://131e508bda7e80732ce5de68211d08986cfa969cb7e4a9474777b01f9a31235f" gracePeriod=30 Jul 10 14:00:06.972043 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:06.972014 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 14:00:07.107656 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.107610 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a111b1b6-72f7-4015-bf88-db01b066f85d-istio-podinfo\") pod \"a111b1b6-72f7-4015-bf88-db01b066f85d\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " Jul 10 14:00:07.107809 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.107669 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a111b1b6-72f7-4015-bf88-db01b066f85d-istio-token\") pod \"a111b1b6-72f7-4015-bf88-db01b066f85d\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " Jul 10 14:00:07.107809 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.107688 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-istio-envoy\") pod \"a111b1b6-72f7-4015-bf88-db01b066f85d\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " Jul 10 14:00:07.107809 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.107727 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-workload-certs\") pod \"a111b1b6-72f7-4015-bf88-db01b066f85d\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " Jul 10 14:00:07.107809 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.107748 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-istio-data\") pod \"a111b1b6-72f7-4015-bf88-db01b066f85d\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " Jul 10 14:00:07.107994 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.107811 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-credential-socket\") pod \"a111b1b6-72f7-4015-bf88-db01b066f85d\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " Jul 10 14:00:07.107994 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.107835 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-workload-socket\") pod \"a111b1b6-72f7-4015-bf88-db01b066f85d\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " Jul 10 14:00:07.107994 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.107867 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a111b1b6-72f7-4015-bf88-db01b066f85d-istiod-ca-cert\") pod \"a111b1b6-72f7-4015-bf88-db01b066f85d\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " Jul 10 14:00:07.108153 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.108053 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a111b1b6-72f7-4015-bf88-db01b066f85d" (UID: "a111b1b6-72f7-4015-bf88-db01b066f85d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:00:07.108153 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.108128 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a111b1b6-72f7-4015-bf88-db01b066f85d" (UID: "a111b1b6-72f7-4015-bf88-db01b066f85d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:00:07.108249 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.108144 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a111b1b6-72f7-4015-bf88-db01b066f85d" (UID: "a111b1b6-72f7-4015-bf88-db01b066f85d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:00:07.108249 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.108195 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zzjq\" (UniqueName: \"kubernetes.io/projected/a111b1b6-72f7-4015-bf88-db01b066f85d-kube-api-access-4zzjq\") pod \"a111b1b6-72f7-4015-bf88-db01b066f85d\" (UID: \"a111b1b6-72f7-4015-bf88-db01b066f85d\") " Jul 10 14:00:07.108516 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.108491 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a111b1b6-72f7-4015-bf88-db01b066f85d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a111b1b6-72f7-4015-bf88-db01b066f85d" (UID: "a111b1b6-72f7-4015-bf88-db01b066f85d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:00:07.108675 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.108579 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-credential-socket\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:07.108675 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.108598 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-workload-socket\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:07.108675 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.108614 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a111b1b6-72f7-4015-bf88-db01b066f85d-istiod-ca-cert\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:07.108675 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.108627 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-workload-certs\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:07.108904 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.108849 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-istio-data" (OuterVolumeSpecName: "istio-data") pod "a111b1b6-72f7-4015-bf88-db01b066f85d" (UID: "a111b1b6-72f7-4015-bf88-db01b066f85d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:00:07.110018 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.109992 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a111b1b6-72f7-4015-bf88-db01b066f85d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a111b1b6-72f7-4015-bf88-db01b066f85d" (UID: "a111b1b6-72f7-4015-bf88-db01b066f85d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 14:00:07.110121 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.110031 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a111b1b6-72f7-4015-bf88-db01b066f85d-istio-token" (OuterVolumeSpecName: "istio-token") pod "a111b1b6-72f7-4015-bf88-db01b066f85d" (UID: "a111b1b6-72f7-4015-bf88-db01b066f85d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:00:07.110121 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.110097 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a111b1b6-72f7-4015-bf88-db01b066f85d" (UID: "a111b1b6-72f7-4015-bf88-db01b066f85d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:00:07.110300 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.110277 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a111b1b6-72f7-4015-bf88-db01b066f85d-kube-api-access-4zzjq" (OuterVolumeSpecName: "kube-api-access-4zzjq") pod "a111b1b6-72f7-4015-bf88-db01b066f85d" (UID: "a111b1b6-72f7-4015-bf88-db01b066f85d"). InnerVolumeSpecName "kube-api-access-4zzjq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:00:07.209323 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.209294 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zzjq\" (UniqueName: \"kubernetes.io/projected/a111b1b6-72f7-4015-bf88-db01b066f85d-kube-api-access-4zzjq\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:07.209323 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.209320 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a111b1b6-72f7-4015-bf88-db01b066f85d-istio-podinfo\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:07.209323 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.209329 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a111b1b6-72f7-4015-bf88-db01b066f85d-istio-token\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:07.209528 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.209339 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-istio-envoy\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:07.209528 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.209346 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a111b1b6-72f7-4015-bf88-db01b066f85d-istio-data\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:07.509684 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.509584 2575 generic.go:356] "Generic (PLEG): container finished" podID="a111b1b6-72f7-4015-bf88-db01b066f85d" containerID="131e508bda7e80732ce5de68211d08986cfa969cb7e4a9474777b01f9a31235f" exitCode=0 Jul 10 14:00:07.509684 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.509632 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" Jul 10 14:00:07.509684 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.509675 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" event={"ID":"a111b1b6-72f7-4015-bf88-db01b066f85d","Type":"ContainerDied","Data":"131e508bda7e80732ce5de68211d08986cfa969cb7e4a9474777b01f9a31235f"} Jul 10 14:00:07.509938 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.509732 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht" event={"ID":"a111b1b6-72f7-4015-bf88-db01b066f85d","Type":"ContainerDied","Data":"47cc0c7ae165427b356d5e2e820be60b82acca1a8017c491d3b77998464a14fb"} Jul 10 14:00:07.509938 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.509756 2575 scope.go:117] "RemoveContainer" containerID="131e508bda7e80732ce5de68211d08986cfa969cb7e4a9474777b01f9a31235f" Jul 10 14:00:07.519430 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.519418 2575 scope.go:117] "RemoveContainer" containerID="e20d57ea189a8cbfd09f5d8995fc78392e4cb5ac57d51f3d1d4ca65625d7a80e" Jul 10 14:00:07.527450 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.527431 2575 scope.go:117] "RemoveContainer" containerID="131e508bda7e80732ce5de68211d08986cfa969cb7e4a9474777b01f9a31235f" Jul 10 14:00:07.527711 ip-10-0-128-57 kubenswrapper[2575]: E0710 14:00:07.527684 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"131e508bda7e80732ce5de68211d08986cfa969cb7e4a9474777b01f9a31235f\": container with ID starting with 131e508bda7e80732ce5de68211d08986cfa969cb7e4a9474777b01f9a31235f not found: ID does not exist" containerID="131e508bda7e80732ce5de68211d08986cfa969cb7e4a9474777b01f9a31235f" Jul 10 14:00:07.527802 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.527716 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"131e508bda7e80732ce5de68211d08986cfa969cb7e4a9474777b01f9a31235f"} err="failed to get container status \"131e508bda7e80732ce5de68211d08986cfa969cb7e4a9474777b01f9a31235f\": rpc error: code = NotFound desc = could not find container \"131e508bda7e80732ce5de68211d08986cfa969cb7e4a9474777b01f9a31235f\": container with ID starting with 131e508bda7e80732ce5de68211d08986cfa969cb7e4a9474777b01f9a31235f not found: ID does not exist" Jul 10 14:00:07.527802 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.527732 2575 scope.go:117] "RemoveContainer" containerID="e20d57ea189a8cbfd09f5d8995fc78392e4cb5ac57d51f3d1d4ca65625d7a80e" Jul 10 14:00:07.527963 ip-10-0-128-57 kubenswrapper[2575]: E0710 14:00:07.527947 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e20d57ea189a8cbfd09f5d8995fc78392e4cb5ac57d51f3d1d4ca65625d7a80e\": container with ID starting with e20d57ea189a8cbfd09f5d8995fc78392e4cb5ac57d51f3d1d4ca65625d7a80e not found: ID does not exist" containerID="e20d57ea189a8cbfd09f5d8995fc78392e4cb5ac57d51f3d1d4ca65625d7a80e" Jul 10 14:00:07.528012 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.527969 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e20d57ea189a8cbfd09f5d8995fc78392e4cb5ac57d51f3d1d4ca65625d7a80e"} err="failed to get container status \"e20d57ea189a8cbfd09f5d8995fc78392e4cb5ac57d51f3d1d4ca65625d7a80e\": rpc error: code = NotFound desc = could not find container \"e20d57ea189a8cbfd09f5d8995fc78392e4cb5ac57d51f3d1d4ca65625d7a80e\": container with ID starting with e20d57ea189a8cbfd09f5d8995fc78392e4cb5ac57d51f3d1d4ca65625d7a80e not found: ID does not exist" Jul 10 14:00:07.532718 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.532700 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht"] Jul 10 14:00:07.537196 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:07.537176 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-6c6c27-openshift-default-6d4d8969c9-qqhht"] Jul 10 14:00:08.238981 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:08.238950 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a111b1b6-72f7-4015-bf88-db01b066f85d" path="/var/lib/kubelet/pods/a111b1b6-72f7-4015-bf88-db01b066f85d/volumes" Jul 10 14:00:09.467158 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:09.467120 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr"] Jul 10 14:00:09.467530 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:09.467400 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" podUID="10f1f044-9615-4d6b-a9d9-1988c6aee163" containerName="istio-proxy" containerID="cri-o://fd5c741e872055f11dee3c16461b742ff10cbe834dac368cd6d0ee42e7ad4f1f" gracePeriod=30 Jul 10 14:00:10.395088 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.395055 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6"] Jul 10 14:00:10.395417 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.395405 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a111b1b6-72f7-4015-bf88-db01b066f85d" containerName="istio-proxy" Jul 10 14:00:10.395466 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.395419 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a111b1b6-72f7-4015-bf88-db01b066f85d" containerName="istio-proxy" Jul 10 14:00:10.395498 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.395492 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a111b1b6-72f7-4015-bf88-db01b066f85d" containerName="istio-proxy" Jul 10 14:00:10.395536 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.395501 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a111b1b6-72f7-4015-bf88-db01b066f85d" containerName="istio-proxy" Jul 10 14:00:10.399858 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.399839 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.401910 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.401890 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-1667f3-openshift-default-dockercfg-ddjh7\"" Jul 10 14:00:10.417765 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.417743 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6"] Jul 10 14:00:10.536406 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.536378 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-workload-socket\") pod \"e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.536883 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.536417 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-workload-certs\") pod \"e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.536883 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.536442 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-istio-envoy\") pod \"e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.536883 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.536465 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-istio-data\") pod \"e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.536883 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.536488 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b009cc5-e71f-4522-9992-d8657d8275e4-istiod-ca-cert\") pod \"e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.536883 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.536554 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-credential-socket\") pod \"e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.536883 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.536587 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b009cc5-e71f-4522-9992-d8657d8275e4-istio-podinfo\") pod \"e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.536883 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.536617 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b009cc5-e71f-4522-9992-d8657d8275e4-istio-token\") pod \"e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.536883 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.536658 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f95j\" (UniqueName: \"kubernetes.io/projected/1b009cc5-e71f-4522-9992-d8657d8275e4-kube-api-access-8f95j\") pod \"e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.637808 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.637778 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-workload-socket\") pod \"e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.638006 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.637811 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-workload-certs\") pod \"e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.638006 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.637829 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-istio-envoy\") pod \"e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.638006 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.637848 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-istio-data\") pod \"e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.638006 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.637969 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b009cc5-e71f-4522-9992-d8657d8275e4-istiod-ca-cert\") pod \"e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.638227 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.638023 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-credential-socket\") pod \"e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.638227 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.638059 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b009cc5-e71f-4522-9992-d8657d8275e4-istio-podinfo\") pod \"e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.638227 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.638092 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b009cc5-e71f-4522-9992-d8657d8275e4-istio-token\") pod \"e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.638227 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.638116 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f95j\" (UniqueName: \"kubernetes.io/projected/1b009cc5-e71f-4522-9992-d8657d8275e4-kube-api-access-8f95j\") pod \"e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.638415 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.638273 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-workload-socket\") pod \"e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.638415 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.638333 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-workload-certs\") pod \"e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.638501 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.638447 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-credential-socket\") pod \"e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.638831 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.638805 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b009cc5-e71f-4522-9992-d8657d8275e4-istiod-ca-cert\") pod \"e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.638928 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.638822 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-istio-data\") pod \"e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.640084 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.640063 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-istio-envoy\") pod \"e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.640375 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.640356 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b009cc5-e71f-4522-9992-d8657d8275e4-istio-podinfo\") pod \"e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.646590 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.646533 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b009cc5-e71f-4522-9992-d8657d8275e4-istio-token\") pod \"e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.646825 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.646801 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f95j\" (UniqueName: \"kubernetes.io/projected/1b009cc5-e71f-4522-9992-d8657d8275e4-kube-api-access-8f95j\") pod \"e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.709961 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.709934 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:10.850050 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.850026 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6"] Jul 10 14:00:10.851956 ip-10-0-128-57 kubenswrapper[2575]: W0710 14:00:10.851929 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b009cc5_e71f_4522_9992_d8657d8275e4.slice/crio-e5ba0f689009067b5eec97a9f223710ede971f2ac88b090b7b5ccd9e9abc82da WatchSource:0}: Error finding container e5ba0f689009067b5eec97a9f223710ede971f2ac88b090b7b5ccd9e9abc82da: Status 404 returned error can't find the container with id e5ba0f689009067b5eec97a9f223710ede971f2ac88b090b7b5ccd9e9abc82da Jul 10 14:00:10.854087 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.854058 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 14:00:10.854152 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.854117 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 14:00:10.854152 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:10.854144 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 14:00:11.534047 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:11.534006 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" event={"ID":"1b009cc5-e71f-4522-9992-d8657d8275e4","Type":"ContainerStarted","Data":"dbb087d92fae27ad068c18e54a37e596bc211d77ce53d6cd5579ed07e883798a"} Jul 10 14:00:11.534254 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:11.534067 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" event={"ID":"1b009cc5-e71f-4522-9992-d8657d8275e4","Type":"ContainerStarted","Data":"e5ba0f689009067b5eec97a9f223710ede971f2ac88b090b7b5ccd9e9abc82da"} Jul 10 14:00:11.556345 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:11.556296 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" podStartSLOduration=1.556280257 podStartE2EDuration="1.556280257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:00:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:00:11.555099018 +0000 UTC m=+2064.794430959" watchObservedRunningTime="2026-07-10 14:00:11.556280257 +0000 UTC m=+2064.795612178" Jul 10 14:00:11.711105 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:11.711069 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:11.716017 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:11.715992 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:12.539656 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:12.539603 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:12.540575 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:12.540551 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:14.710509 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:14.710486 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 14:00:14.774583 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:14.774516 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svh6h\" (UniqueName: \"kubernetes.io/projected/10f1f044-9615-4d6b-a9d9-1988c6aee163-kube-api-access-svh6h\") pod \"10f1f044-9615-4d6b-a9d9-1988c6aee163\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " Jul 10 14:00:14.774583 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:14.774549 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-credential-socket\") pod \"10f1f044-9615-4d6b-a9d9-1988c6aee163\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " Jul 10 14:00:14.774583 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:14.774582 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10f1f044-9615-4d6b-a9d9-1988c6aee163-istio-token\") pod \"10f1f044-9615-4d6b-a9d9-1988c6aee163\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " Jul 10 14:00:14.774886 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:14.774700 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-workload-socket\") pod \"10f1f044-9615-4d6b-a9d9-1988c6aee163\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " Jul 10 14:00:14.774886 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:14.774740 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10f1f044-9615-4d6b-a9d9-1988c6aee163-istio-podinfo\") pod \"10f1f044-9615-4d6b-a9d9-1988c6aee163\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " Jul 10 14:00:14.774886 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:14.774803 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10f1f044-9615-4d6b-a9d9-1988c6aee163-istiod-ca-cert\") pod \"10f1f044-9615-4d6b-a9d9-1988c6aee163\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " Jul 10 14:00:14.774886 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:14.774840 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-workload-certs\") pod \"10f1f044-9615-4d6b-a9d9-1988c6aee163\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " Jul 10 14:00:14.774886 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:14.774861 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-istio-data\") pod \"10f1f044-9615-4d6b-a9d9-1988c6aee163\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " Jul 10 14:00:14.774886 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:14.774869 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "10f1f044-9615-4d6b-a9d9-1988c6aee163" (UID: "10f1f044-9615-4d6b-a9d9-1988c6aee163"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:00:14.775196 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:14.774902 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-istio-envoy\") pod \"10f1f044-9615-4d6b-a9d9-1988c6aee163\" (UID: \"10f1f044-9615-4d6b-a9d9-1988c6aee163\") " Jul 10 14:00:14.775196 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:14.774951 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "10f1f044-9615-4d6b-a9d9-1988c6aee163" (UID: "10f1f044-9615-4d6b-a9d9-1988c6aee163"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:00:14.775196 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:14.775098 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "10f1f044-9615-4d6b-a9d9-1988c6aee163" (UID: "10f1f044-9615-4d6b-a9d9-1988c6aee163"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:00:14.775389 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:14.775212 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-credential-socket\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:14.775389 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:14.775231 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-workload-socket\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:14.775389 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:14.775246 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-workload-certs\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:14.775389 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:14.775273 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10f1f044-9615-4d6b-a9d9-1988c6aee163-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "10f1f044-9615-4d6b-a9d9-1988c6aee163" (UID: "10f1f044-9615-4d6b-a9d9-1988c6aee163"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:00:14.775820 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:14.775796 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-istio-data" (OuterVolumeSpecName: "istio-data") pod "10f1f044-9615-4d6b-a9d9-1988c6aee163" (UID: "10f1f044-9615-4d6b-a9d9-1988c6aee163"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:00:14.776821 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:14.776794 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10f1f044-9615-4d6b-a9d9-1988c6aee163-istio-token" (OuterVolumeSpecName: "istio-token") pod "10f1f044-9615-4d6b-a9d9-1988c6aee163" (UID: "10f1f044-9615-4d6b-a9d9-1988c6aee163"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:00:14.776917 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:14.776835 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10f1f044-9615-4d6b-a9d9-1988c6aee163-kube-api-access-svh6h" (OuterVolumeSpecName: "kube-api-access-svh6h") pod "10f1f044-9615-4d6b-a9d9-1988c6aee163" (UID: "10f1f044-9615-4d6b-a9d9-1988c6aee163"). InnerVolumeSpecName "kube-api-access-svh6h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:00:14.777319 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:14.777302 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "10f1f044-9615-4d6b-a9d9-1988c6aee163" (UID: "10f1f044-9615-4d6b-a9d9-1988c6aee163"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:00:14.777319 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:14.777306 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/10f1f044-9615-4d6b-a9d9-1988c6aee163-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "10f1f044-9615-4d6b-a9d9-1988c6aee163" (UID: "10f1f044-9615-4d6b-a9d9-1988c6aee163"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 14:00:14.876066 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:14.876043 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10f1f044-9615-4d6b-a9d9-1988c6aee163-istiod-ca-cert\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:14.876066 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:14.876063 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-istio-data\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:14.876066 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:14.876072 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10f1f044-9615-4d6b-a9d9-1988c6aee163-istio-envoy\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:14.876269 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:14.876081 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svh6h\" (UniqueName: \"kubernetes.io/projected/10f1f044-9615-4d6b-a9d9-1988c6aee163-kube-api-access-svh6h\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:14.876269 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:14.876089 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10f1f044-9615-4d6b-a9d9-1988c6aee163-istio-token\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:14.876269 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:14.876099 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10f1f044-9615-4d6b-a9d9-1988c6aee163-istio-podinfo\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:15.555826 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:15.555790 2575 generic.go:356] "Generic (PLEG): container finished" podID="10f1f044-9615-4d6b-a9d9-1988c6aee163" containerID="fd5c741e872055f11dee3c16461b742ff10cbe834dac368cd6d0ee42e7ad4f1f" exitCode=0 Jul 10 14:00:15.555995 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:15.555837 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" Jul 10 14:00:15.555995 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:15.555860 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" event={"ID":"10f1f044-9615-4d6b-a9d9-1988c6aee163","Type":"ContainerDied","Data":"fd5c741e872055f11dee3c16461b742ff10cbe834dac368cd6d0ee42e7ad4f1f"} Jul 10 14:00:15.555995 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:15.555909 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr" event={"ID":"10f1f044-9615-4d6b-a9d9-1988c6aee163","Type":"ContainerDied","Data":"ddc97385d268d2250db1be8e2a299b3c2e0922966a5d4475984fd413b68a78a1"} Jul 10 14:00:15.555995 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:15.555933 2575 scope.go:117] "RemoveContainer" containerID="fd5c741e872055f11dee3c16461b742ff10cbe834dac368cd6d0ee42e7ad4f1f" Jul 10 14:00:15.565952 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:15.565928 2575 scope.go:117] "RemoveContainer" containerID="eab25ab3f1c45527be7075c3833774b8fa24c10150c658939de1e6f6ce12ef19" Jul 10 14:00:15.577414 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:15.577397 2575 scope.go:117] "RemoveContainer" containerID="fd5c741e872055f11dee3c16461b742ff10cbe834dac368cd6d0ee42e7ad4f1f" Jul 10 14:00:15.577670 ip-10-0-128-57 kubenswrapper[2575]: E0710 14:00:15.577647 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd5c741e872055f11dee3c16461b742ff10cbe834dac368cd6d0ee42e7ad4f1f\": container with ID starting with fd5c741e872055f11dee3c16461b742ff10cbe834dac368cd6d0ee42e7ad4f1f not found: ID does not exist" containerID="fd5c741e872055f11dee3c16461b742ff10cbe834dac368cd6d0ee42e7ad4f1f" Jul 10 14:00:15.577743 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:15.577679 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd5c741e872055f11dee3c16461b742ff10cbe834dac368cd6d0ee42e7ad4f1f"} err="failed to get container status \"fd5c741e872055f11dee3c16461b742ff10cbe834dac368cd6d0ee42e7ad4f1f\": rpc error: code = NotFound desc = could not find container \"fd5c741e872055f11dee3c16461b742ff10cbe834dac368cd6d0ee42e7ad4f1f\": container with ID starting with fd5c741e872055f11dee3c16461b742ff10cbe834dac368cd6d0ee42e7ad4f1f not found: ID does not exist" Jul 10 14:00:15.577743 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:15.577697 2575 scope.go:117] "RemoveContainer" containerID="eab25ab3f1c45527be7075c3833774b8fa24c10150c658939de1e6f6ce12ef19" Jul 10 14:00:15.577940 ip-10-0-128-57 kubenswrapper[2575]: E0710 14:00:15.577923 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eab25ab3f1c45527be7075c3833774b8fa24c10150c658939de1e6f6ce12ef19\": container with ID starting with eab25ab3f1c45527be7075c3833774b8fa24c10150c658939de1e6f6ce12ef19 not found: ID does not exist" containerID="eab25ab3f1c45527be7075c3833774b8fa24c10150c658939de1e6f6ce12ef19" Jul 10 14:00:15.577990 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:15.577946 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eab25ab3f1c45527be7075c3833774b8fa24c10150c658939de1e6f6ce12ef19"} err="failed to get container status \"eab25ab3f1c45527be7075c3833774b8fa24c10150c658939de1e6f6ce12ef19\": rpc error: code = NotFound desc = could not find container \"eab25ab3f1c45527be7075c3833774b8fa24c10150c658939de1e6f6ce12ef19\": container with ID starting with eab25ab3f1c45527be7075c3833774b8fa24c10150c658939de1e6f6ce12ef19 not found: ID does not exist" Jul 10 14:00:15.583056 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:15.583036 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr"] Jul 10 14:00:15.590560 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:15.590540 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-5cb1b4-openshift-default-79688b964f-wnddr"] Jul 10 14:00:16.238024 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:16.237992 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10f1f044-9615-4d6b-a9d9-1988c6aee163" path="/var/lib/kubelet/pods/10f1f044-9615-4d6b-a9d9-1988c6aee163/volumes" Jul 10 14:00:18.821704 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:18.821668 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh"] Jul 10 14:00:18.822080 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:18.822020 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10f1f044-9615-4d6b-a9d9-1988c6aee163" containerName="istio-proxy" Jul 10 14:00:18.822080 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:18.822032 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="10f1f044-9615-4d6b-a9d9-1988c6aee163" containerName="istio-proxy" Jul 10 14:00:18.822080 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:18.822039 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10f1f044-9615-4d6b-a9d9-1988c6aee163" containerName="istio-proxy" Jul 10 14:00:18.822080 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:18.822045 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="10f1f044-9615-4d6b-a9d9-1988c6aee163" containerName="istio-proxy" Jul 10 14:00:18.822080 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:18.822051 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a111b1b6-72f7-4015-bf88-db01b066f85d" containerName="istio-proxy" Jul 10 14:00:18.822080 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:18.822058 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a111b1b6-72f7-4015-bf88-db01b066f85d" containerName="istio-proxy" Jul 10 14:00:18.822296 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:18.822106 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="10f1f044-9615-4d6b-a9d9-1988c6aee163" containerName="istio-proxy" Jul 10 14:00:18.826816 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:18.826795 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:18.828814 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:18.828793 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-5da7f6-openshift-default-dockercfg-r9hpk\"" Jul 10 14:00:18.838719 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:18.838696 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh"] Jul 10 14:00:18.912458 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:18.912424 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-credential-socket\") pod \"e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:18.912608 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:18.912464 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-workload-socket\") pod \"e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:18.912608 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:18.912490 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/192f5e98-9f65-4c45-ba8a-dd7590a10036-istio-token\") pod \"e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:18.912608 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:18.912570 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-workload-certs\") pod \"e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:18.912608 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:18.912597 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/192f5e98-9f65-4c45-ba8a-dd7590a10036-istio-podinfo\") pod \"e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:18.912825 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:18.912630 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-istio-data\") pod \"e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:18.912825 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:18.912678 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/192f5e98-9f65-4c45-ba8a-dd7590a10036-istiod-ca-cert\") pod \"e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:18.912825 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:18.912698 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-istio-envoy\") pod \"e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:18.912825 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:18.912715 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnnhl\" (UniqueName: \"kubernetes.io/projected/192f5e98-9f65-4c45-ba8a-dd7590a10036-kube-api-access-dnnhl\") pod \"e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:19.014092 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:19.014064 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-credential-socket\") pod \"e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:19.014092 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:19.014095 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-workload-socket\") pod \"e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:19.014325 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:19.014115 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/192f5e98-9f65-4c45-ba8a-dd7590a10036-istio-token\") pod \"e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:19.014325 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:19.014235 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-workload-certs\") pod \"e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:19.014325 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:19.014266 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/192f5e98-9f65-4c45-ba8a-dd7590a10036-istio-podinfo\") pod \"e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:19.014325 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:19.014307 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-istio-data\") pod \"e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:19.014558 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:19.014339 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/192f5e98-9f65-4c45-ba8a-dd7590a10036-istiod-ca-cert\") pod \"e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:19.014558 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:19.014372 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-istio-envoy\") pod \"e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:19.014558 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:19.014396 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnnhl\" (UniqueName: \"kubernetes.io/projected/192f5e98-9f65-4c45-ba8a-dd7590a10036-kube-api-access-dnnhl\") pod \"e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:19.014558 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:19.014493 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-workload-socket\") pod \"e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:19.014800 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:19.014591 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-workload-certs\") pod \"e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:19.014800 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:19.014695 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-istio-data\") pod \"e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:19.014901 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:19.014849 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-credential-socket\") pod \"e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:19.015095 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:19.015075 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/192f5e98-9f65-4c45-ba8a-dd7590a10036-istiod-ca-cert\") pod \"e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:19.016605 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:19.016585 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-istio-envoy\") pod \"e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:19.016766 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:19.016749 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/192f5e98-9f65-4c45-ba8a-dd7590a10036-istio-podinfo\") pod \"e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:19.022888 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:19.022869 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/192f5e98-9f65-4c45-ba8a-dd7590a10036-istio-token\") pod \"e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:19.023240 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:19.023219 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnnhl\" (UniqueName: \"kubernetes.io/projected/192f5e98-9f65-4c45-ba8a-dd7590a10036-kube-api-access-dnnhl\") pod \"e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:19.137264 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:19.137238 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:19.278502 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:19.278473 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh"] Jul 10 14:00:19.281174 ip-10-0-128-57 kubenswrapper[2575]: W0710 14:00:19.281141 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod192f5e98_9f65_4c45_ba8a_dd7590a10036.slice/crio-7d27ec0d36544b1113f845e2fbec210c276bb762bfb96d441a29812ecf3f0003 WatchSource:0}: Error finding container 7d27ec0d36544b1113f845e2fbec210c276bb762bfb96d441a29812ecf3f0003: Status 404 returned error can't find the container with id 7d27ec0d36544b1113f845e2fbec210c276bb762bfb96d441a29812ecf3f0003 Jul 10 14:00:19.283623 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:19.283587 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 14:00:19.283731 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:19.283667 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 14:00:19.283731 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:19.283695 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 14:00:19.578224 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:19.578142 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" event={"ID":"192f5e98-9f65-4c45-ba8a-dd7590a10036","Type":"ContainerStarted","Data":"e3ab6b0db6f0c51a607d2448ae99472c040a61ba73d9b01fdda1239eb270baf9"} Jul 10 14:00:19.578224 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:19.578195 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" event={"ID":"192f5e98-9f65-4c45-ba8a-dd7590a10036","Type":"ContainerStarted","Data":"7d27ec0d36544b1113f845e2fbec210c276bb762bfb96d441a29812ecf3f0003"} Jul 10 14:00:19.599147 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:19.599095 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" podStartSLOduration=1.599079267 podStartE2EDuration="1.599079267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:00:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:00:19.596709468 +0000 UTC m=+2072.836041393" watchObservedRunningTime="2026-07-10 14:00:19.599079267 +0000 UTC m=+2072.838411187" Jul 10 14:00:20.137973 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:20.137939 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:20.142462 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:20.142440 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:20.585259 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:20.585173 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:20.587313 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:20.587282 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:28.580838 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:28.580793 2575 patch_prober.go:28] interesting pod/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 10 14:00:28.581229 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:28.580875 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" podUID="1b009cc5-e71f-4522-9992-d8657d8275e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 10 14:00:29.638302 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:29.638258 2575 generic.go:356] "Generic (PLEG): container finished" podID="1b009cc5-e71f-4522-9992-d8657d8275e4" containerID="dbb087d92fae27ad068c18e54a37e596bc211d77ce53d6cd5579ed07e883798a" exitCode=0 Jul 10 14:00:29.638875 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:29.638399 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" event={"ID":"1b009cc5-e71f-4522-9992-d8657d8275e4","Type":"ContainerDied","Data":"dbb087d92fae27ad068c18e54a37e596bc211d77ce53d6cd5579ed07e883798a"} Jul 10 14:00:29.638951 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:29.638899 2575 scope.go:117] "RemoveContainer" containerID="dbb087d92fae27ad068c18e54a37e596bc211d77ce53d6cd5579ed07e883798a" Jul 10 14:00:29.640496 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:29.640457 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 14:00:29.640596 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:29.640574 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 14:00:29.640676 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:29.640623 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 14:00:30.649599 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:30.649564 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" event={"ID":"1b009cc5-e71f-4522-9992-d8657d8275e4","Type":"ContainerStarted","Data":"0bace8040c094bf30d0719675a0ddd4ab0415dc7131ed3486e8fc95092b47afe"} Jul 10 14:00:30.710709 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:30.710681 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:30.710931 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:30.710861 2575 patch_prober.go:28] interesting pod/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 10 14:00:30.711048 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:30.711032 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" podUID="1b009cc5-e71f-4522-9992-d8657d8275e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 10 14:00:31.710767 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:31.710737 2575 patch_prober.go:28] interesting pod/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 10 14:00:31.711216 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:31.711191 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" podUID="1b009cc5-e71f-4522-9992-d8657d8275e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 10 14:00:32.710335 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:32.710245 2575 patch_prober.go:28] interesting pod/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 10 14:00:32.710335 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:32.710305 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" podUID="1b009cc5-e71f-4522-9992-d8657d8275e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 10 14:00:33.711268 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:33.711235 2575 patch_prober.go:28] interesting pod/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 10 14:00:33.711682 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:33.711288 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" podUID="1b009cc5-e71f-4522-9992-d8657d8275e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 10 14:00:34.713983 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:34.713945 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:34.714469 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:34.714257 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:34.714938 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:34.714917 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:35.586591 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:35.586484 2575 patch_prober.go:28] interesting pod/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 10 14:00:35.586830 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:35.586585 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" podUID="192f5e98-9f65-4c45-ba8a-dd7590a10036" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 10 14:00:35.683217 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:35.683179 2575 generic.go:356] "Generic (PLEG): container finished" podID="192f5e98-9f65-4c45-ba8a-dd7590a10036" containerID="e3ab6b0db6f0c51a607d2448ae99472c040a61ba73d9b01fdda1239eb270baf9" exitCode=0 Jul 10 14:00:35.683418 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:35.683253 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" event={"ID":"192f5e98-9f65-4c45-ba8a-dd7590a10036","Type":"ContainerDied","Data":"e3ab6b0db6f0c51a607d2448ae99472c040a61ba73d9b01fdda1239eb270baf9"} Jul 10 14:00:35.683778 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:35.683754 2575 scope.go:117] "RemoveContainer" containerID="e3ab6b0db6f0c51a607d2448ae99472c040a61ba73d9b01fdda1239eb270baf9" Jul 10 14:00:35.684716 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:35.684689 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 14:00:35.684822 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:35.684764 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 14:00:35.684822 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:35.684810 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 14:00:36.690913 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:36.690878 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" event={"ID":"192f5e98-9f65-4c45-ba8a-dd7590a10036","Type":"ContainerStarted","Data":"3f2ed0f2fb1c07163936e3c33d58c47a141d7ac9d55b4ca1f41d1c5086699829"} Jul 10 14:00:37.138298 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:37.138260 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:37.138685 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:37.138661 2575 patch_prober.go:28] interesting pod/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 10 14:00:37.138902 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:37.138877 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" podUID="192f5e98-9f65-4c45-ba8a-dd7590a10036" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 10 14:00:38.138662 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:38.138594 2575 patch_prober.go:28] interesting pod/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 10 14:00:38.139244 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:38.139211 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" podUID="192f5e98-9f65-4c45-ba8a-dd7590a10036" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 10 14:00:39.138584 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:39.138538 2575 patch_prober.go:28] interesting pod/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 10 14:00:39.138806 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:39.138605 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" podUID="192f5e98-9f65-4c45-ba8a-dd7590a10036" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 10 14:00:40.138242 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:40.138202 2575 patch_prober.go:28] interesting pod/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 10 14:00:40.138452 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:40.138273 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" podUID="192f5e98-9f65-4c45-ba8a-dd7590a10036" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 10 14:00:41.141804 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:41.141759 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:41.142256 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:41.142047 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:41.142693 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:41.142677 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:41.893042 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:41.893010 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6"] Jul 10 14:00:41.893237 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:41.893212 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" podUID="1b009cc5-e71f-4522-9992-d8657d8275e4" containerName="istio-proxy" containerID="cri-o://0bace8040c094bf30d0719675a0ddd4ab0415dc7131ed3486e8fc95092b47afe" gracePeriod=30 Jul 10 14:00:47.145068 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.145044 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:47.276058 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.275985 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-istio-envoy\") pod \"1b009cc5-e71f-4522-9992-d8657d8275e4\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " Jul 10 14:00:47.276058 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.276018 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-credential-socket\") pod \"1b009cc5-e71f-4522-9992-d8657d8275e4\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " Jul 10 14:00:47.276286 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.276081 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b009cc5-e71f-4522-9992-d8657d8275e4-istio-token\") pod \"1b009cc5-e71f-4522-9992-d8657d8275e4\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " Jul 10 14:00:47.276286 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.276117 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-workload-certs\") pod \"1b009cc5-e71f-4522-9992-d8657d8275e4\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " Jul 10 14:00:47.276286 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.276140 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-istio-data\") pod \"1b009cc5-e71f-4522-9992-d8657d8275e4\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " Jul 10 14:00:47.276286 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.276272 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b009cc5-e71f-4522-9992-d8657d8275e4-istio-podinfo\") pod \"1b009cc5-e71f-4522-9992-d8657d8275e4\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " Jul 10 14:00:47.276497 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.276318 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b009cc5-e71f-4522-9992-d8657d8275e4-istiod-ca-cert\") pod \"1b009cc5-e71f-4522-9992-d8657d8275e4\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " Jul 10 14:00:47.276497 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.276347 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-workload-socket\") pod \"1b009cc5-e71f-4522-9992-d8657d8275e4\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " Jul 10 14:00:47.276497 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.276378 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8f95j\" (UniqueName: \"kubernetes.io/projected/1b009cc5-e71f-4522-9992-d8657d8275e4-kube-api-access-8f95j\") pod \"1b009cc5-e71f-4522-9992-d8657d8275e4\" (UID: \"1b009cc5-e71f-4522-9992-d8657d8275e4\") " Jul 10 14:00:47.276497 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.276407 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1b009cc5-e71f-4522-9992-d8657d8275e4" (UID: "1b009cc5-e71f-4522-9992-d8657d8275e4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:00:47.276497 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.276423 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1b009cc5-e71f-4522-9992-d8657d8275e4" (UID: "1b009cc5-e71f-4522-9992-d8657d8275e4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:00:47.276793 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.276595 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b009cc5-e71f-4522-9992-d8657d8275e4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1b009cc5-e71f-4522-9992-d8657d8275e4" (UID: "1b009cc5-e71f-4522-9992-d8657d8275e4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:00:47.276793 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.276609 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1b009cc5-e71f-4522-9992-d8657d8275e4" (UID: "1b009cc5-e71f-4522-9992-d8657d8275e4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:00:47.276793 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.276741 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-credential-socket\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:47.276793 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.276762 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-workload-certs\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:47.276793 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.276778 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b009cc5-e71f-4522-9992-d8657d8275e4-istiod-ca-cert\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:47.276793 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.276791 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-workload-socket\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:47.277109 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.277083 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-istio-data" (OuterVolumeSpecName: "istio-data") pod "1b009cc5-e71f-4522-9992-d8657d8275e4" (UID: "1b009cc5-e71f-4522-9992-d8657d8275e4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:00:47.278255 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.278235 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1b009cc5-e71f-4522-9992-d8657d8275e4" (UID: "1b009cc5-e71f-4522-9992-d8657d8275e4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:00:47.278255 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.278246 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b009cc5-e71f-4522-9992-d8657d8275e4-istio-token" (OuterVolumeSpecName: "istio-token") pod "1b009cc5-e71f-4522-9992-d8657d8275e4" (UID: "1b009cc5-e71f-4522-9992-d8657d8275e4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:00:47.278597 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.278565 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1b009cc5-e71f-4522-9992-d8657d8275e4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1b009cc5-e71f-4522-9992-d8657d8275e4" (UID: "1b009cc5-e71f-4522-9992-d8657d8275e4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 14:00:47.278597 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.278571 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b009cc5-e71f-4522-9992-d8657d8275e4-kube-api-access-8f95j" (OuterVolumeSpecName: "kube-api-access-8f95j") pod "1b009cc5-e71f-4522-9992-d8657d8275e4" (UID: "1b009cc5-e71f-4522-9992-d8657d8275e4"). InnerVolumeSpecName "kube-api-access-8f95j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:00:47.377224 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.377195 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b009cc5-e71f-4522-9992-d8657d8275e4-istio-token\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:47.377224 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.377218 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-istio-data\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:47.377224 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.377227 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b009cc5-e71f-4522-9992-d8657d8275e4-istio-podinfo\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:47.377432 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.377235 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8f95j\" (UniqueName: \"kubernetes.io/projected/1b009cc5-e71f-4522-9992-d8657d8275e4-kube-api-access-8f95j\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:47.377432 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.377245 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b009cc5-e71f-4522-9992-d8657d8275e4-istio-envoy\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:47.409175 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.409153 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hrq6g_63c89ec5-2de9-4855-8fe8-57baaa8e0588/console-operator/1.log" Jul 10 14:00:47.410818 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.410793 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hrq6g_63c89ec5-2de9-4855-8fe8-57baaa8e0588/console-operator/1.log" Jul 10 14:00:47.414736 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.414716 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rpg2g_e7e01989-a0c5-4924-bebf-bad6bf0f0844/ovn-acl-logging/0.log" Jul 10 14:00:47.416170 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.416149 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rpg2g_e7e01989-a0c5-4924-bebf-bad6bf0f0844/ovn-acl-logging/0.log" Jul 10 14:00:47.749265 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.749228 2575 generic.go:356] "Generic (PLEG): container finished" podID="1b009cc5-e71f-4522-9992-d8657d8275e4" containerID="0bace8040c094bf30d0719675a0ddd4ab0415dc7131ed3486e8fc95092b47afe" exitCode=0 Jul 10 14:00:47.749440 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.749274 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" Jul 10 14:00:47.749440 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.749321 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" event={"ID":"1b009cc5-e71f-4522-9992-d8657d8275e4","Type":"ContainerDied","Data":"0bace8040c094bf30d0719675a0ddd4ab0415dc7131ed3486e8fc95092b47afe"} Jul 10 14:00:47.749440 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.749376 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6" event={"ID":"1b009cc5-e71f-4522-9992-d8657d8275e4","Type":"ContainerDied","Data":"e5ba0f689009067b5eec97a9f223710ede971f2ac88b090b7b5ccd9e9abc82da"} Jul 10 14:00:47.749440 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.749402 2575 scope.go:117] "RemoveContainer" containerID="0bace8040c094bf30d0719675a0ddd4ab0415dc7131ed3486e8fc95092b47afe" Jul 10 14:00:47.758764 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.758751 2575 scope.go:117] "RemoveContainer" containerID="dbb087d92fae27ad068c18e54a37e596bc211d77ce53d6cd5579ed07e883798a" Jul 10 14:00:47.766699 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.766683 2575 scope.go:117] "RemoveContainer" containerID="0bace8040c094bf30d0719675a0ddd4ab0415dc7131ed3486e8fc95092b47afe" Jul 10 14:00:47.766950 ip-10-0-128-57 kubenswrapper[2575]: E0710 14:00:47.766931 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bace8040c094bf30d0719675a0ddd4ab0415dc7131ed3486e8fc95092b47afe\": container with ID starting with 0bace8040c094bf30d0719675a0ddd4ab0415dc7131ed3486e8fc95092b47afe not found: ID does not exist" containerID="0bace8040c094bf30d0719675a0ddd4ab0415dc7131ed3486e8fc95092b47afe" Jul 10 14:00:47.767008 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.766958 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bace8040c094bf30d0719675a0ddd4ab0415dc7131ed3486e8fc95092b47afe"} err="failed to get container status \"0bace8040c094bf30d0719675a0ddd4ab0415dc7131ed3486e8fc95092b47afe\": rpc error: code = NotFound desc = could not find container \"0bace8040c094bf30d0719675a0ddd4ab0415dc7131ed3486e8fc95092b47afe\": container with ID starting with 0bace8040c094bf30d0719675a0ddd4ab0415dc7131ed3486e8fc95092b47afe not found: ID does not exist" Jul 10 14:00:47.767008 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.766974 2575 scope.go:117] "RemoveContainer" containerID="dbb087d92fae27ad068c18e54a37e596bc211d77ce53d6cd5579ed07e883798a" Jul 10 14:00:47.767189 ip-10-0-128-57 kubenswrapper[2575]: E0710 14:00:47.767173 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbb087d92fae27ad068c18e54a37e596bc211d77ce53d6cd5579ed07e883798a\": container with ID starting with dbb087d92fae27ad068c18e54a37e596bc211d77ce53d6cd5579ed07e883798a not found: ID does not exist" containerID="dbb087d92fae27ad068c18e54a37e596bc211d77ce53d6cd5579ed07e883798a" Jul 10 14:00:47.767242 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.767197 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbb087d92fae27ad068c18e54a37e596bc211d77ce53d6cd5579ed07e883798a"} err="failed to get container status \"dbb087d92fae27ad068c18e54a37e596bc211d77ce53d6cd5579ed07e883798a\": rpc error: code = NotFound desc = could not find container \"dbb087d92fae27ad068c18e54a37e596bc211d77ce53d6cd5579ed07e883798a\": container with ID starting with dbb087d92fae27ad068c18e54a37e596bc211d77ce53d6cd5579ed07e883798a not found: ID does not exist" Jul 10 14:00:47.772735 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.772714 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6"] Jul 10 14:00:47.777765 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:47.777747 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-1667f3-openshift-default-5c869764bf-48xs6"] Jul 10 14:00:48.238457 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:48.238427 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b009cc5-e71f-4522-9992-d8657d8275e4" path="/var/lib/kubelet/pods/1b009cc5-e71f-4522-9992-d8657d8275e4/volumes" Jul 10 14:00:49.797222 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:49.797179 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh"] Jul 10 14:00:49.797596 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:49.797460 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" podUID="192f5e98-9f65-4c45-ba8a-dd7590a10036" containerName="istio-proxy" containerID="cri-o://3f2ed0f2fb1c07163936e3c33d58c47a141d7ac9d55b4ca1f41d1c5086699829" gracePeriod=30 Jul 10 14:00:50.708097 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.708066 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h"] Jul 10 14:00:50.708397 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.708386 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b009cc5-e71f-4522-9992-d8657d8275e4" containerName="istio-proxy" Jul 10 14:00:50.708443 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.708399 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b009cc5-e71f-4522-9992-d8657d8275e4" containerName="istio-proxy" Jul 10 14:00:50.708476 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.708469 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b009cc5-e71f-4522-9992-d8657d8275e4" containerName="istio-proxy" Jul 10 14:00:50.708517 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.708478 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b009cc5-e71f-4522-9992-d8657d8275e4" containerName="istio-proxy" Jul 10 14:00:50.708517 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.708487 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="10f1f044-9615-4d6b-a9d9-1988c6aee163" containerName="istio-proxy" Jul 10 14:00:50.711316 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.711299 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:50.713121 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.713103 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-ffeadb-openshift-default-dockercfg-bkdpl\"" Jul 10 14:00:50.722950 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.722928 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h"] Jul 10 14:00:50.808287 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.808248 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5120a5b-3e9e-4aa0-9345-e8352c408983-istio-podinfo\") pod \"e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:50.808287 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.808286 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5120a5b-3e9e-4aa0-9345-e8352c408983-istio-token\") pod \"e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:50.808727 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.808337 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-workload-socket\") pod \"e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:50.808727 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.808371 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-istio-envoy\") pod \"e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:50.808727 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.808394 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-workload-certs\") pod \"e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:50.808727 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.808413 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbvrn\" (UniqueName: \"kubernetes.io/projected/c5120a5b-3e9e-4aa0-9345-e8352c408983-kube-api-access-dbvrn\") pod \"e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:50.808727 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.808464 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-credential-socket\") pod \"e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:50.808727 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.808523 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5120a5b-3e9e-4aa0-9345-e8352c408983-istiod-ca-cert\") pod \"e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:50.808727 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.808574 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-istio-data\") pod \"e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:50.909347 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.909317 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5120a5b-3e9e-4aa0-9345-e8352c408983-istio-podinfo\") pod \"e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:50.909347 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.909352 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5120a5b-3e9e-4aa0-9345-e8352c408983-istio-token\") pod \"e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:50.909607 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.909376 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-workload-socket\") pod \"e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:50.909607 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.909401 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-istio-envoy\") pod \"e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:50.909607 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.909429 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-workload-certs\") pod \"e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:50.909607 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.909447 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbvrn\" (UniqueName: \"kubernetes.io/projected/c5120a5b-3e9e-4aa0-9345-e8352c408983-kube-api-access-dbvrn\") pod \"e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:50.909607 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.909504 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-credential-socket\") pod \"e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:50.909607 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.909533 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5120a5b-3e9e-4aa0-9345-e8352c408983-istiod-ca-cert\") pod \"e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:50.909607 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.909567 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-istio-data\") pod \"e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:50.910028 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.909937 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-workload-socket\") pod \"e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:50.910028 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.909994 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-workload-certs\") pod \"e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:50.910028 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.910024 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-credential-socket\") pod \"e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:50.910232 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.910216 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-istio-data\") pod \"e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:50.910395 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.910376 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5120a5b-3e9e-4aa0-9345-e8352c408983-istiod-ca-cert\") pod \"e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:50.912292 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.912264 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-istio-envoy\") pod \"e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:50.912406 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.912373 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5120a5b-3e9e-4aa0-9345-e8352c408983-istio-podinfo\") pod \"e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:50.918268 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.918247 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5120a5b-3e9e-4aa0-9345-e8352c408983-istio-token\") pod \"e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:50.918365 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:50.918252 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbvrn\" (UniqueName: \"kubernetes.io/projected/c5120a5b-3e9e-4aa0-9345-e8352c408983-kube-api-access-dbvrn\") pod \"e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:51.022675 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:51.022576 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:51.157205 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:51.157184 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h"] Jul 10 14:00:51.158716 ip-10-0-128-57 kubenswrapper[2575]: W0710 14:00:51.158690 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5120a5b_3e9e_4aa0_9345_e8352c408983.slice/crio-2c616ec774df0832c606ff3ff7b09e296c5ac06d18eee6d0fc65ebd52233e0ce WatchSource:0}: Error finding container 2c616ec774df0832c606ff3ff7b09e296c5ac06d18eee6d0fc65ebd52233e0ce: Status 404 returned error can't find the container with id 2c616ec774df0832c606ff3ff7b09e296c5ac06d18eee6d0fc65ebd52233e0ce Jul 10 14:00:51.161140 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:51.161111 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 14:00:51.161221 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:51.161176 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 14:00:51.161221 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:51.161206 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 14:00:51.774768 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:51.774731 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" event={"ID":"c5120a5b-3e9e-4aa0-9345-e8352c408983","Type":"ContainerStarted","Data":"101d4fe2604800488fb2862f2aefc0798ffb66da4215a6a19186e26b60f1d8e5"} Jul 10 14:00:51.774944 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:51.774794 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" event={"ID":"c5120a5b-3e9e-4aa0-9345-e8352c408983","Type":"ContainerStarted","Data":"2c616ec774df0832c606ff3ff7b09e296c5ac06d18eee6d0fc65ebd52233e0ce"} Jul 10 14:00:51.795293 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:51.795248 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" podStartSLOduration=1.795232635 podStartE2EDuration="1.795232635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:00:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:00:51.792681624 +0000 UTC m=+2105.032013548" watchObservedRunningTime="2026-07-10 14:00:51.795232635 +0000 UTC m=+2105.034564556" Jul 10 14:00:52.023389 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:52.023358 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:52.028117 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:52.028050 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:52.779955 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:52.779922 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:52.780994 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:52.780971 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:00:55.048784 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.048763 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:55.146843 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.146819 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/192f5e98-9f65-4c45-ba8a-dd7590a10036-istio-podinfo\") pod \"192f5e98-9f65-4c45-ba8a-dd7590a10036\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " Jul 10 14:00:55.147033 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.146865 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-istio-envoy\") pod \"192f5e98-9f65-4c45-ba8a-dd7590a10036\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " Jul 10 14:00:55.147033 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.146910 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-workload-socket\") pod \"192f5e98-9f65-4c45-ba8a-dd7590a10036\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " Jul 10 14:00:55.147164 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.147064 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnnhl\" (UniqueName: \"kubernetes.io/projected/192f5e98-9f65-4c45-ba8a-dd7590a10036-kube-api-access-dnnhl\") pod \"192f5e98-9f65-4c45-ba8a-dd7590a10036\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " Jul 10 14:00:55.147164 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.147100 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-istio-data\") pod \"192f5e98-9f65-4c45-ba8a-dd7590a10036\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " Jul 10 14:00:55.147164 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.147136 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-credential-socket\") pod \"192f5e98-9f65-4c45-ba8a-dd7590a10036\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " Jul 10 14:00:55.147164 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.147156 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-workload-certs\") pod \"192f5e98-9f65-4c45-ba8a-dd7590a10036\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " Jul 10 14:00:55.147375 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.147171 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "192f5e98-9f65-4c45-ba8a-dd7590a10036" (UID: "192f5e98-9f65-4c45-ba8a-dd7590a10036"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:00:55.147375 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.147202 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/192f5e98-9f65-4c45-ba8a-dd7590a10036-istiod-ca-cert\") pod \"192f5e98-9f65-4c45-ba8a-dd7590a10036\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " Jul 10 14:00:55.147375 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.147232 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/192f5e98-9f65-4c45-ba8a-dd7590a10036-istio-token\") pod \"192f5e98-9f65-4c45-ba8a-dd7590a10036\" (UID: \"192f5e98-9f65-4c45-ba8a-dd7590a10036\") " Jul 10 14:00:55.147524 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.147391 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "192f5e98-9f65-4c45-ba8a-dd7590a10036" (UID: "192f5e98-9f65-4c45-ba8a-dd7590a10036"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:00:55.147524 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.147436 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "192f5e98-9f65-4c45-ba8a-dd7590a10036" (UID: "192f5e98-9f65-4c45-ba8a-dd7590a10036"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:00:55.147524 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.147503 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/192f5e98-9f65-4c45-ba8a-dd7590a10036-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "192f5e98-9f65-4c45-ba8a-dd7590a10036" (UID: "192f5e98-9f65-4c45-ba8a-dd7590a10036"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:00:55.147677 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.147620 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-workload-socket\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:55.147677 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.147665 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-credential-socket\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:55.147758 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.147680 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-workload-certs\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:55.147758 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.147695 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/192f5e98-9f65-4c45-ba8a-dd7590a10036-istiod-ca-cert\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:55.148626 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.148599 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-istio-data" (OuterVolumeSpecName: "istio-data") pod "192f5e98-9f65-4c45-ba8a-dd7590a10036" (UID: "192f5e98-9f65-4c45-ba8a-dd7590a10036"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:00:55.149238 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.149215 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/192f5e98-9f65-4c45-ba8a-dd7590a10036-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "192f5e98-9f65-4c45-ba8a-dd7590a10036" (UID: "192f5e98-9f65-4c45-ba8a-dd7590a10036"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 14:00:55.149347 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.149323 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/192f5e98-9f65-4c45-ba8a-dd7590a10036-istio-token" (OuterVolumeSpecName: "istio-token") pod "192f5e98-9f65-4c45-ba8a-dd7590a10036" (UID: "192f5e98-9f65-4c45-ba8a-dd7590a10036"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:00:55.149410 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.149379 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "192f5e98-9f65-4c45-ba8a-dd7590a10036" (UID: "192f5e98-9f65-4c45-ba8a-dd7590a10036"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:00:55.149410 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.149394 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/192f5e98-9f65-4c45-ba8a-dd7590a10036-kube-api-access-dnnhl" (OuterVolumeSpecName: "kube-api-access-dnnhl") pod "192f5e98-9f65-4c45-ba8a-dd7590a10036" (UID: "192f5e98-9f65-4c45-ba8a-dd7590a10036"). InnerVolumeSpecName "kube-api-access-dnnhl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:00:55.248958 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.248926 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/192f5e98-9f65-4c45-ba8a-dd7590a10036-istio-podinfo\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:55.248958 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.248955 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-istio-envoy\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:55.249153 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.248967 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnnhl\" (UniqueName: \"kubernetes.io/projected/192f5e98-9f65-4c45-ba8a-dd7590a10036-kube-api-access-dnnhl\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:55.249153 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.248979 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/192f5e98-9f65-4c45-ba8a-dd7590a10036-istio-data\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:55.249153 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.248990 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/192f5e98-9f65-4c45-ba8a-dd7590a10036-istio-token\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:00:55.796920 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.796883 2575 generic.go:356] "Generic (PLEG): container finished" podID="192f5e98-9f65-4c45-ba8a-dd7590a10036" containerID="3f2ed0f2fb1c07163936e3c33d58c47a141d7ac9d55b4ca1f41d1c5086699829" exitCode=0 Jul 10 14:00:55.797111 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.796934 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" Jul 10 14:00:55.797111 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.796969 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" event={"ID":"192f5e98-9f65-4c45-ba8a-dd7590a10036","Type":"ContainerDied","Data":"3f2ed0f2fb1c07163936e3c33d58c47a141d7ac9d55b4ca1f41d1c5086699829"} Jul 10 14:00:55.797111 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.797021 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh" event={"ID":"192f5e98-9f65-4c45-ba8a-dd7590a10036","Type":"ContainerDied","Data":"7d27ec0d36544b1113f845e2fbec210c276bb762bfb96d441a29812ecf3f0003"} Jul 10 14:00:55.797111 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.797051 2575 scope.go:117] "RemoveContainer" containerID="3f2ed0f2fb1c07163936e3c33d58c47a141d7ac9d55b4ca1f41d1c5086699829" Jul 10 14:00:55.807015 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.806999 2575 scope.go:117] "RemoveContainer" containerID="e3ab6b0db6f0c51a607d2448ae99472c040a61ba73d9b01fdda1239eb270baf9" Jul 10 14:00:55.815254 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.815238 2575 scope.go:117] "RemoveContainer" containerID="3f2ed0f2fb1c07163936e3c33d58c47a141d7ac9d55b4ca1f41d1c5086699829" Jul 10 14:00:55.815517 ip-10-0-128-57 kubenswrapper[2575]: E0710 14:00:55.815500 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f2ed0f2fb1c07163936e3c33d58c47a141d7ac9d55b4ca1f41d1c5086699829\": container with ID starting with 3f2ed0f2fb1c07163936e3c33d58c47a141d7ac9d55b4ca1f41d1c5086699829 not found: ID does not exist" containerID="3f2ed0f2fb1c07163936e3c33d58c47a141d7ac9d55b4ca1f41d1c5086699829" Jul 10 14:00:55.815562 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.815528 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f2ed0f2fb1c07163936e3c33d58c47a141d7ac9d55b4ca1f41d1c5086699829"} err="failed to get container status \"3f2ed0f2fb1c07163936e3c33d58c47a141d7ac9d55b4ca1f41d1c5086699829\": rpc error: code = NotFound desc = could not find container \"3f2ed0f2fb1c07163936e3c33d58c47a141d7ac9d55b4ca1f41d1c5086699829\": container with ID starting with 3f2ed0f2fb1c07163936e3c33d58c47a141d7ac9d55b4ca1f41d1c5086699829 not found: ID does not exist" Jul 10 14:00:55.815562 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.815547 2575 scope.go:117] "RemoveContainer" containerID="e3ab6b0db6f0c51a607d2448ae99472c040a61ba73d9b01fdda1239eb270baf9" Jul 10 14:00:55.815801 ip-10-0-128-57 kubenswrapper[2575]: E0710 14:00:55.815785 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3ab6b0db6f0c51a607d2448ae99472c040a61ba73d9b01fdda1239eb270baf9\": container with ID starting with e3ab6b0db6f0c51a607d2448ae99472c040a61ba73d9b01fdda1239eb270baf9 not found: ID does not exist" containerID="e3ab6b0db6f0c51a607d2448ae99472c040a61ba73d9b01fdda1239eb270baf9" Jul 10 14:00:55.815849 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.815806 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3ab6b0db6f0c51a607d2448ae99472c040a61ba73d9b01fdda1239eb270baf9"} err="failed to get container status \"e3ab6b0db6f0c51a607d2448ae99472c040a61ba73d9b01fdda1239eb270baf9\": rpc error: code = NotFound desc = could not find container \"e3ab6b0db6f0c51a607d2448ae99472c040a61ba73d9b01fdda1239eb270baf9\": container with ID starting with e3ab6b0db6f0c51a607d2448ae99472c040a61ba73d9b01fdda1239eb270baf9 not found: ID does not exist" Jul 10 14:00:55.820869 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.820845 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh"] Jul 10 14:00:55.826062 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:55.826044 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-5da7f6-openshift-default-68977d94dc-dfzkh"] Jul 10 14:00:56.238572 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:56.238502 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="192f5e98-9f65-4c45-ba8a-dd7590a10036" path="/var/lib/kubelet/pods/192f5e98-9f65-4c45-ba8a-dd7590a10036/volumes" Jul 10 14:00:58.967417 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:58.967385 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4"] Jul 10 14:00:58.967785 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:58.967723 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="192f5e98-9f65-4c45-ba8a-dd7590a10036" containerName="istio-proxy" Jul 10 14:00:58.967785 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:58.967734 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="192f5e98-9f65-4c45-ba8a-dd7590a10036" containerName="istio-proxy" Jul 10 14:00:58.967785 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:58.967748 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b009cc5-e71f-4522-9992-d8657d8275e4" containerName="istio-proxy" Jul 10 14:00:58.967785 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:58.967753 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b009cc5-e71f-4522-9992-d8657d8275e4" containerName="istio-proxy" Jul 10 14:00:58.967785 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:58.967765 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="192f5e98-9f65-4c45-ba8a-dd7590a10036" containerName="istio-proxy" Jul 10 14:00:58.967785 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:58.967770 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="192f5e98-9f65-4c45-ba8a-dd7590a10036" containerName="istio-proxy" Jul 10 14:00:58.967986 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:58.967828 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="192f5e98-9f65-4c45-ba8a-dd7590a10036" containerName="istio-proxy" Jul 10 14:00:58.967986 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:58.967838 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="192f5e98-9f65-4c45-ba8a-dd7590a10036" containerName="istio-proxy" Jul 10 14:00:58.972354 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:58.972335 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:58.974276 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:58.974254 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-c21824-openshift-default-dockercfg-pnvcq\"" Jul 10 14:00:58.982160 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:58.982137 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4"] Jul 10 14:00:59.082804 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.082758 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76047017-7d67-4aec-87ef-524af41b1d50-istiod-ca-cert\") pod \"e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:59.082997 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.082840 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-istio-data\") pod \"e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:59.082997 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.082864 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzrc5\" (UniqueName: \"kubernetes.io/projected/76047017-7d67-4aec-87ef-524af41b1d50-kube-api-access-wzrc5\") pod \"e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:59.082997 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.082907 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-credential-socket\") pod \"e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:59.082997 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.082951 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-istio-envoy\") pod \"e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:59.082997 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.082971 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76047017-7d67-4aec-87ef-524af41b1d50-istio-token\") pod \"e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:59.082997 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.082993 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-workload-certs\") pod \"e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:59.083242 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.083058 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76047017-7d67-4aec-87ef-524af41b1d50-istio-podinfo\") pod \"e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:59.083242 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.083120 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-workload-socket\") pod \"e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:59.184484 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.184454 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76047017-7d67-4aec-87ef-524af41b1d50-istiod-ca-cert\") pod \"e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:59.184664 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.184505 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-istio-data\") pod \"e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:59.184664 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.184530 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzrc5\" (UniqueName: \"kubernetes.io/projected/76047017-7d67-4aec-87ef-524af41b1d50-kube-api-access-wzrc5\") pod \"e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:59.184664 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.184574 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-credential-socket\") pod \"e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:59.184664 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.184600 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-istio-envoy\") pod \"e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:59.184922 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.184737 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76047017-7d67-4aec-87ef-524af41b1d50-istio-token\") pod \"e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:59.184922 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.184780 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-workload-certs\") pod \"e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:59.184922 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.184810 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76047017-7d67-4aec-87ef-524af41b1d50-istio-podinfo\") pod \"e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:59.184922 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.184849 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-workload-socket\") pod \"e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:59.185129 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.184956 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-istio-data\") pod \"e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:59.185129 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.184991 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-credential-socket\") pod \"e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:59.185234 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.185224 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-workload-socket\") pod \"e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:59.185317 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.185224 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-workload-certs\") pod \"e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:59.185547 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.185527 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76047017-7d67-4aec-87ef-524af41b1d50-istiod-ca-cert\") pod \"e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:59.187261 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.187238 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-istio-envoy\") pod \"e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:59.187342 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.187242 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76047017-7d67-4aec-87ef-524af41b1d50-istio-podinfo\") pod \"e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:59.193199 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.193180 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76047017-7d67-4aec-87ef-524af41b1d50-istio-token\") pod \"e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:59.193544 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.193524 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzrc5\" (UniqueName: \"kubernetes.io/projected/76047017-7d67-4aec-87ef-524af41b1d50-kube-api-access-wzrc5\") pod \"e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:59.282834 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.282749 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:00:59.423888 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.423850 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4"] Jul 10 14:00:59.425143 ip-10-0-128-57 kubenswrapper[2575]: W0710 14:00:59.425114 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76047017_7d67_4aec_87ef_524af41b1d50.slice/crio-74264bdc91c845f52ff9d014851b740b6d8778e6c21d4952087414a6ec535bcf WatchSource:0}: Error finding container 74264bdc91c845f52ff9d014851b740b6d8778e6c21d4952087414a6ec535bcf: Status 404 returned error can't find the container with id 74264bdc91c845f52ff9d014851b740b6d8778e6c21d4952087414a6ec535bcf Jul 10 14:00:59.427199 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.427153 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 14:00:59.427280 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.427240 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 14:00:59.427324 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.427307 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 14:00:59.821895 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.821857 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" event={"ID":"76047017-7d67-4aec-87ef-524af41b1d50","Type":"ContainerStarted","Data":"4a2f29520ef67018e659bd494586cab5c06ae9f0439c0ef52322a4d945b8f4b9"} Jul 10 14:00:59.822067 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.821914 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" event={"ID":"76047017-7d67-4aec-87ef-524af41b1d50","Type":"ContainerStarted","Data":"74264bdc91c845f52ff9d014851b740b6d8778e6c21d4952087414a6ec535bcf"} Jul 10 14:00:59.844301 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:00:59.844256 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" podStartSLOduration=1.8442409899999999 podStartE2EDuration="1.84424099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:00:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:00:59.843967326 +0000 UTC m=+2113.083299247" watchObservedRunningTime="2026-07-10 14:00:59.84424099 +0000 UTC m=+2113.083572910" Jul 10 14:01:00.283408 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:00.283379 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:01:00.288152 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:00.288130 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:01:00.830485 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:00.830452 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:01:00.835230 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:00.835182 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:01:07.921914 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:07.920120 2575 patch_prober.go:28] interesting pod/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": read tcp 10.132.0.2:35048->10.132.0.51:15021: read: connection reset by peer" start-of-body= Jul 10 14:01:07.921914 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:07.920179 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" podUID="c5120a5b-3e9e-4aa0-9345-e8352c408983" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": read tcp 10.132.0.2:35048->10.132.0.51:15021: read: connection reset by peer" Jul 10 14:01:08.880568 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:08.880534 2575 generic.go:356] "Generic (PLEG): container finished" podID="c5120a5b-3e9e-4aa0-9345-e8352c408983" containerID="101d4fe2604800488fb2862f2aefc0798ffb66da4215a6a19186e26b60f1d8e5" exitCode=0 Jul 10 14:01:08.880759 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:08.880603 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" event={"ID":"c5120a5b-3e9e-4aa0-9345-e8352c408983","Type":"ContainerDied","Data":"101d4fe2604800488fb2862f2aefc0798ffb66da4215a6a19186e26b60f1d8e5"} Jul 10 14:01:08.881064 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:08.881047 2575 scope.go:117] "RemoveContainer" containerID="101d4fe2604800488fb2862f2aefc0798ffb66da4215a6a19186e26b60f1d8e5" Jul 10 14:01:08.882101 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:08.882067 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 14:01:08.882214 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:08.882149 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 14:01:08.882214 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:08.882179 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 14:01:09.888028 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:09.887997 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" event={"ID":"c5120a5b-3e9e-4aa0-9345-e8352c408983","Type":"ContainerStarted","Data":"1c64d411ba7473966849de721c83633da004200f115d6213291a339589c79d60"} Jul 10 14:01:10.023169 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:10.023125 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:01:10.023369 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:10.023279 2575 patch_prober.go:28] interesting pod/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 10 14:01:10.023369 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:10.023323 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" podUID="c5120a5b-3e9e-4aa0-9345-e8352c408983" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 10 14:01:11.023372 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:11.023330 2575 patch_prober.go:28] interesting pod/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 10 14:01:11.023866 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:11.023393 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" podUID="c5120a5b-3e9e-4aa0-9345-e8352c408983" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 10 14:01:12.023020 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:12.022977 2575 patch_prober.go:28] interesting pod/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 10 14:01:12.023225 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:12.023052 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" podUID="c5120a5b-3e9e-4aa0-9345-e8352c408983" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 10 14:01:13.023572 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:13.023536 2575 patch_prober.go:28] interesting pod/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 10 14:01:13.024181 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:13.024128 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" podUID="c5120a5b-3e9e-4aa0-9345-e8352c408983" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 10 14:01:14.027402 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:14.027370 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:01:14.027849 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:14.027754 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:01:14.028512 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:14.028491 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:01:14.924175 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:14.924140 2575 generic.go:356] "Generic (PLEG): container finished" podID="76047017-7d67-4aec-87ef-524af41b1d50" containerID="4a2f29520ef67018e659bd494586cab5c06ae9f0439c0ef52322a4d945b8f4b9" exitCode=0 Jul 10 14:01:14.924392 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:14.924213 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" event={"ID":"76047017-7d67-4aec-87ef-524af41b1d50","Type":"ContainerDied","Data":"4a2f29520ef67018e659bd494586cab5c06ae9f0439c0ef52322a4d945b8f4b9"} Jul 10 14:01:14.924741 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:14.924718 2575 scope.go:117] "RemoveContainer" containerID="4a2f29520ef67018e659bd494586cab5c06ae9f0439c0ef52322a4d945b8f4b9" Jul 10 14:01:14.925750 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:14.925719 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 14:01:14.925819 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:14.925808 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 14:01:14.925872 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:14.925856 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 14:01:15.830660 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:15.830603 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:01:15.941108 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:15.941061 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" event={"ID":"76047017-7d67-4aec-87ef-524af41b1d50","Type":"ContainerStarted","Data":"2fa6aff9edca9b5e05e5e9e6d4a35d7a51516cd691779ac3d84724de0f96d5c3"} Jul 10 14:01:16.283059 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:16.283025 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:01:16.284236 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:16.284208 2575 patch_prober.go:28] interesting pod/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 10 14:01:16.284367 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:16.284256 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" podUID="76047017-7d67-4aec-87ef-524af41b1d50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 10 14:01:17.283765 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:17.283729 2575 patch_prober.go:28] interesting pod/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 10 14:01:17.284167 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:17.283779 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" podUID="76047017-7d67-4aec-87ef-524af41b1d50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 10 14:01:18.283556 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:18.283525 2575 patch_prober.go:28] interesting pod/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 10 14:01:18.283764 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:18.283577 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" podUID="76047017-7d67-4aec-87ef-524af41b1d50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 10 14:01:19.283392 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:19.283359 2575 patch_prober.go:28] interesting pod/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 10 14:01:19.283802 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:19.283410 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" podUID="76047017-7d67-4aec-87ef-524af41b1d50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 10 14:01:20.287493 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:20.287462 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:01:20.287972 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:20.287819 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:01:20.288452 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:01:20.288436 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:05:47.442283 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:05:47.442256 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hrq6g_63c89ec5-2de9-4855-8fe8-57baaa8e0588/console-operator/1.log" Jul 10 14:05:47.444817 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:05:47.444792 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hrq6g_63c89ec5-2de9-4855-8fe8-57baaa8e0588/console-operator/1.log" Jul 10 14:05:47.447473 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:05:47.447455 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rpg2g_e7e01989-a0c5-4924-bebf-bad6bf0f0844/ovn-acl-logging/0.log" Jul 10 14:05:47.456039 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:05:47.456020 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rpg2g_e7e01989-a0c5-4924-bebf-bad6bf0f0844/ovn-acl-logging/0.log" Jul 10 14:08:01.316445 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:01.316408 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h"] Jul 10 14:08:01.316998 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:01.316622 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" podUID="c5120a5b-3e9e-4aa0-9345-e8352c408983" containerName="istio-proxy" containerID="cri-o://1c64d411ba7473966849de721c83633da004200f115d6213291a339589c79d60" gracePeriod=30 Jul 10 14:08:06.568116 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:06.568092 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:08:06.708572 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:06.708530 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-istio-envoy\") pod \"c5120a5b-3e9e-4aa0-9345-e8352c408983\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " Jul 10 14:08:06.708572 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:06.708576 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-istio-data\") pod \"c5120a5b-3e9e-4aa0-9345-e8352c408983\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " Jul 10 14:08:06.708832 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:06.708593 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5120a5b-3e9e-4aa0-9345-e8352c408983-istiod-ca-cert\") pod \"c5120a5b-3e9e-4aa0-9345-e8352c408983\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " Jul 10 14:08:06.708832 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:06.708629 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-workload-certs\") pod \"c5120a5b-3e9e-4aa0-9345-e8352c408983\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " Jul 10 14:08:06.708832 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:06.708676 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-workload-socket\") pod \"c5120a5b-3e9e-4aa0-9345-e8352c408983\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " Jul 10 14:08:06.708832 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:06.708696 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbvrn\" (UniqueName: \"kubernetes.io/projected/c5120a5b-3e9e-4aa0-9345-e8352c408983-kube-api-access-dbvrn\") pod \"c5120a5b-3e9e-4aa0-9345-e8352c408983\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " Jul 10 14:08:06.708832 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:06.708775 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5120a5b-3e9e-4aa0-9345-e8352c408983-istio-podinfo\") pod \"c5120a5b-3e9e-4aa0-9345-e8352c408983\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " Jul 10 14:08:06.708832 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:06.708791 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-credential-socket\") pod \"c5120a5b-3e9e-4aa0-9345-e8352c408983\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " Jul 10 14:08:06.709185 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:06.708874 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5120a5b-3e9e-4aa0-9345-e8352c408983-istio-token\") pod \"c5120a5b-3e9e-4aa0-9345-e8352c408983\" (UID: \"c5120a5b-3e9e-4aa0-9345-e8352c408983\") " Jul 10 14:08:06.709185 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:06.708993 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c5120a5b-3e9e-4aa0-9345-e8352c408983" (UID: "c5120a5b-3e9e-4aa0-9345-e8352c408983"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:08:06.709185 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:06.709005 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c5120a5b-3e9e-4aa0-9345-e8352c408983" (UID: "c5120a5b-3e9e-4aa0-9345-e8352c408983"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:08:06.709185 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:06.709022 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5120a5b-3e9e-4aa0-9345-e8352c408983-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c5120a5b-3e9e-4aa0-9345-e8352c408983" (UID: "c5120a5b-3e9e-4aa0-9345-e8352c408983"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:08:06.709376 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:06.709217 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c5120a5b-3e9e-4aa0-9345-e8352c408983" (UID: "c5120a5b-3e9e-4aa0-9345-e8352c408983"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:08:06.709376 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:06.709351 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5120a5b-3e9e-4aa0-9345-e8352c408983-istiod-ca-cert\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:08:06.709376 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:06.709371 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-workload-certs\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:08:06.709535 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:06.709384 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-workload-socket\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:08:06.709659 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:06.709603 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-istio-data" (OuterVolumeSpecName: "istio-data") pod "c5120a5b-3e9e-4aa0-9345-e8352c408983" (UID: "c5120a5b-3e9e-4aa0-9345-e8352c408983"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:08:06.710867 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:06.710846 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c5120a5b-3e9e-4aa0-9345-e8352c408983" (UID: "c5120a5b-3e9e-4aa0-9345-e8352c408983"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:08:06.711080 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:06.711045 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5120a5b-3e9e-4aa0-9345-e8352c408983-kube-api-access-dbvrn" (OuterVolumeSpecName: "kube-api-access-dbvrn") pod "c5120a5b-3e9e-4aa0-9345-e8352c408983" (UID: "c5120a5b-3e9e-4aa0-9345-e8352c408983"). InnerVolumeSpecName "kube-api-access-dbvrn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:08:06.711178 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:06.711127 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5120a5b-3e9e-4aa0-9345-e8352c408983-istio-token" (OuterVolumeSpecName: "istio-token") pod "c5120a5b-3e9e-4aa0-9345-e8352c408983" (UID: "c5120a5b-3e9e-4aa0-9345-e8352c408983"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:08:06.711178 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:06.711130 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c5120a5b-3e9e-4aa0-9345-e8352c408983-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c5120a5b-3e9e-4aa0-9345-e8352c408983" (UID: "c5120a5b-3e9e-4aa0-9345-e8352c408983"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 14:08:06.810378 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:06.810350 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5120a5b-3e9e-4aa0-9345-e8352c408983-istio-podinfo\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:08:06.810378 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:06.810374 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-credential-socket\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:08:06.810378 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:06.810383 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5120a5b-3e9e-4aa0-9345-e8352c408983-istio-token\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:08:06.810571 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:06.810392 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-istio-envoy\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:08:06.810571 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:06.810400 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5120a5b-3e9e-4aa0-9345-e8352c408983-istio-data\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:08:06.810571 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:06.810407 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbvrn\" (UniqueName: \"kubernetes.io/projected/c5120a5b-3e9e-4aa0-9345-e8352c408983-kube-api-access-dbvrn\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:08:07.071727 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:07.071619 2575 generic.go:356] "Generic (PLEG): container finished" podID="c5120a5b-3e9e-4aa0-9345-e8352c408983" containerID="1c64d411ba7473966849de721c83633da004200f115d6213291a339589c79d60" exitCode=0 Jul 10 14:08:07.071727 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:07.071671 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" event={"ID":"c5120a5b-3e9e-4aa0-9345-e8352c408983","Type":"ContainerDied","Data":"1c64d411ba7473966849de721c83633da004200f115d6213291a339589c79d60"} Jul 10 14:08:07.071929 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:07.071731 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" event={"ID":"c5120a5b-3e9e-4aa0-9345-e8352c408983","Type":"ContainerDied","Data":"2c616ec774df0832c606ff3ff7b09e296c5ac06d18eee6d0fc65ebd52233e0ce"} Jul 10 14:08:07.071929 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:07.071755 2575 scope.go:117] "RemoveContainer" containerID="1c64d411ba7473966849de721c83633da004200f115d6213291a339589c79d60" Jul 10 14:08:07.071929 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:07.071682 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h" Jul 10 14:08:07.081941 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:07.081923 2575 scope.go:117] "RemoveContainer" containerID="101d4fe2604800488fb2862f2aefc0798ffb66da4215a6a19186e26b60f1d8e5" Jul 10 14:08:07.089888 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:07.089874 2575 scope.go:117] "RemoveContainer" containerID="1c64d411ba7473966849de721c83633da004200f115d6213291a339589c79d60" Jul 10 14:08:07.090135 ip-10-0-128-57 kubenswrapper[2575]: E0710 14:08:07.090118 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c64d411ba7473966849de721c83633da004200f115d6213291a339589c79d60\": container with ID starting with 1c64d411ba7473966849de721c83633da004200f115d6213291a339589c79d60 not found: ID does not exist" containerID="1c64d411ba7473966849de721c83633da004200f115d6213291a339589c79d60" Jul 10 14:08:07.090186 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:07.090143 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c64d411ba7473966849de721c83633da004200f115d6213291a339589c79d60"} err="failed to get container status \"1c64d411ba7473966849de721c83633da004200f115d6213291a339589c79d60\": rpc error: code = NotFound desc = could not find container \"1c64d411ba7473966849de721c83633da004200f115d6213291a339589c79d60\": container with ID starting with 1c64d411ba7473966849de721c83633da004200f115d6213291a339589c79d60 not found: ID does not exist" Jul 10 14:08:07.090186 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:07.090158 2575 scope.go:117] "RemoveContainer" containerID="101d4fe2604800488fb2862f2aefc0798ffb66da4215a6a19186e26b60f1d8e5" Jul 10 14:08:07.090353 ip-10-0-128-57 kubenswrapper[2575]: E0710 14:08:07.090335 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"101d4fe2604800488fb2862f2aefc0798ffb66da4215a6a19186e26b60f1d8e5\": container with ID starting with 101d4fe2604800488fb2862f2aefc0798ffb66da4215a6a19186e26b60f1d8e5 not found: ID does not exist" containerID="101d4fe2604800488fb2862f2aefc0798ffb66da4215a6a19186e26b60f1d8e5" Jul 10 14:08:07.090446 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:07.090363 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"101d4fe2604800488fb2862f2aefc0798ffb66da4215a6a19186e26b60f1d8e5"} err="failed to get container status \"101d4fe2604800488fb2862f2aefc0798ffb66da4215a6a19186e26b60f1d8e5\": rpc error: code = NotFound desc = could not find container \"101d4fe2604800488fb2862f2aefc0798ffb66da4215a6a19186e26b60f1d8e5\": container with ID starting with 101d4fe2604800488fb2862f2aefc0798ffb66da4215a6a19186e26b60f1d8e5 not found: ID does not exist" Jul 10 14:08:07.095902 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:07.095883 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h"] Jul 10 14:08:07.104374 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:07.104355 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-ffeadb-openshift-default-56cb8d7cc9-62c8h"] Jul 10 14:08:08.238385 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:08.238353 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5120a5b-3e9e-4aa0-9345-e8352c408983" path="/var/lib/kubelet/pods/c5120a5b-3e9e-4aa0-9345-e8352c408983/volumes" Jul 10 14:08:09.539552 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:09.539518 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4"] Jul 10 14:08:09.539952 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:09.539777 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" podUID="76047017-7d67-4aec-87ef-524af41b1d50" containerName="istio-proxy" containerID="cri-o://2fa6aff9edca9b5e05e5e9e6d4a35d7a51516cd691779ac3d84724de0f96d5c3" gracePeriod=30 Jul 10 14:08:14.786599 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:14.786577 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:08:14.874237 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:14.874212 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzrc5\" (UniqueName: \"kubernetes.io/projected/76047017-7d67-4aec-87ef-524af41b1d50-kube-api-access-wzrc5\") pod \"76047017-7d67-4aec-87ef-524af41b1d50\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " Jul 10 14:08:14.874365 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:14.874244 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76047017-7d67-4aec-87ef-524af41b1d50-istio-token\") pod \"76047017-7d67-4aec-87ef-524af41b1d50\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " Jul 10 14:08:14.874365 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:14.874288 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76047017-7d67-4aec-87ef-524af41b1d50-istiod-ca-cert\") pod \"76047017-7d67-4aec-87ef-524af41b1d50\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " Jul 10 14:08:14.874365 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:14.874312 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-istio-data\") pod \"76047017-7d67-4aec-87ef-524af41b1d50\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " Jul 10 14:08:14.874365 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:14.874332 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-credential-socket\") pod \"76047017-7d67-4aec-87ef-524af41b1d50\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " Jul 10 14:08:14.874563 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:14.874364 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-istio-envoy\") pod \"76047017-7d67-4aec-87ef-524af41b1d50\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " Jul 10 14:08:14.874563 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:14.874412 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76047017-7d67-4aec-87ef-524af41b1d50-istio-podinfo\") pod \"76047017-7d67-4aec-87ef-524af41b1d50\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " Jul 10 14:08:14.874563 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:14.874447 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-workload-socket\") pod \"76047017-7d67-4aec-87ef-524af41b1d50\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " Jul 10 14:08:14.874563 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:14.874516 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-workload-certs\") pod \"76047017-7d67-4aec-87ef-524af41b1d50\" (UID: \"76047017-7d67-4aec-87ef-524af41b1d50\") " Jul 10 14:08:14.874816 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:14.874661 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "76047017-7d67-4aec-87ef-524af41b1d50" (UID: "76047017-7d67-4aec-87ef-524af41b1d50"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:08:14.874816 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:14.874746 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76047017-7d67-4aec-87ef-524af41b1d50-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "76047017-7d67-4aec-87ef-524af41b1d50" (UID: "76047017-7d67-4aec-87ef-524af41b1d50"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:08:14.874933 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:14.874859 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "76047017-7d67-4aec-87ef-524af41b1d50" (UID: "76047017-7d67-4aec-87ef-524af41b1d50"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:08:14.874990 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:14.874932 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76047017-7d67-4aec-87ef-524af41b1d50-istiod-ca-cert\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:08:14.874990 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:14.874952 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-credential-socket\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:08:14.874990 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:14.874966 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-workload-certs\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:08:14.875198 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:14.875020 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "76047017-7d67-4aec-87ef-524af41b1d50" (UID: "76047017-7d67-4aec-87ef-524af41b1d50"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:08:14.875270 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:14.875244 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-istio-data" (OuterVolumeSpecName: "istio-data") pod "76047017-7d67-4aec-87ef-524af41b1d50" (UID: "76047017-7d67-4aec-87ef-524af41b1d50"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:08:14.876570 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:14.876542 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "76047017-7d67-4aec-87ef-524af41b1d50" (UID: "76047017-7d67-4aec-87ef-524af41b1d50"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:08:14.876701 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:14.876606 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76047017-7d67-4aec-87ef-524af41b1d50-kube-api-access-wzrc5" (OuterVolumeSpecName: "kube-api-access-wzrc5") pod "76047017-7d67-4aec-87ef-524af41b1d50" (UID: "76047017-7d67-4aec-87ef-524af41b1d50"). InnerVolumeSpecName "kube-api-access-wzrc5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:08:14.876701 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:14.876618 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76047017-7d67-4aec-87ef-524af41b1d50-istio-token" (OuterVolumeSpecName: "istio-token") pod "76047017-7d67-4aec-87ef-524af41b1d50" (UID: "76047017-7d67-4aec-87ef-524af41b1d50"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:08:14.876789 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:14.876749 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/76047017-7d67-4aec-87ef-524af41b1d50-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "76047017-7d67-4aec-87ef-524af41b1d50" (UID: "76047017-7d67-4aec-87ef-524af41b1d50"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 14:08:14.975506 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:14.975481 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzrc5\" (UniqueName: \"kubernetes.io/projected/76047017-7d67-4aec-87ef-524af41b1d50-kube-api-access-wzrc5\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:08:14.975506 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:14.975503 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76047017-7d67-4aec-87ef-524af41b1d50-istio-token\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:08:14.975689 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:14.975512 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-istio-data\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:08:14.975689 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:14.975520 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-istio-envoy\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:08:14.975689 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:14.975528 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76047017-7d67-4aec-87ef-524af41b1d50-istio-podinfo\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:08:14.975689 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:14.975535 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76047017-7d67-4aec-87ef-524af41b1d50-workload-socket\") on node \"ip-10-0-128-57.ec2.internal\" DevicePath \"\"" Jul 10 14:08:15.116693 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:15.116657 2575 generic.go:356] "Generic (PLEG): container finished" podID="76047017-7d67-4aec-87ef-524af41b1d50" containerID="2fa6aff9edca9b5e05e5e9e6d4a35d7a51516cd691779ac3d84724de0f96d5c3" exitCode=0 Jul 10 14:08:15.116854 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:15.116712 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" Jul 10 14:08:15.116854 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:15.116749 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" event={"ID":"76047017-7d67-4aec-87ef-524af41b1d50","Type":"ContainerDied","Data":"2fa6aff9edca9b5e05e5e9e6d4a35d7a51516cd691779ac3d84724de0f96d5c3"} Jul 10 14:08:15.116854 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:15.116816 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4" event={"ID":"76047017-7d67-4aec-87ef-524af41b1d50","Type":"ContainerDied","Data":"74264bdc91c845f52ff9d014851b740b6d8778e6c21d4952087414a6ec535bcf"} Jul 10 14:08:15.116854 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:15.116846 2575 scope.go:117] "RemoveContainer" containerID="2fa6aff9edca9b5e05e5e9e6d4a35d7a51516cd691779ac3d84724de0f96d5c3" Jul 10 14:08:15.127817 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:15.127797 2575 scope.go:117] "RemoveContainer" containerID="4a2f29520ef67018e659bd494586cab5c06ae9f0439c0ef52322a4d945b8f4b9" Jul 10 14:08:15.136086 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:15.136066 2575 scope.go:117] "RemoveContainer" containerID="2fa6aff9edca9b5e05e5e9e6d4a35d7a51516cd691779ac3d84724de0f96d5c3" Jul 10 14:08:15.136356 ip-10-0-128-57 kubenswrapper[2575]: E0710 14:08:15.136333 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fa6aff9edca9b5e05e5e9e6d4a35d7a51516cd691779ac3d84724de0f96d5c3\": container with ID starting with 2fa6aff9edca9b5e05e5e9e6d4a35d7a51516cd691779ac3d84724de0f96d5c3 not found: ID does not exist" containerID="2fa6aff9edca9b5e05e5e9e6d4a35d7a51516cd691779ac3d84724de0f96d5c3" Jul 10 14:08:15.136440 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:15.136367 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fa6aff9edca9b5e05e5e9e6d4a35d7a51516cd691779ac3d84724de0f96d5c3"} err="failed to get container status \"2fa6aff9edca9b5e05e5e9e6d4a35d7a51516cd691779ac3d84724de0f96d5c3\": rpc error: code = NotFound desc = could not find container \"2fa6aff9edca9b5e05e5e9e6d4a35d7a51516cd691779ac3d84724de0f96d5c3\": container with ID starting with 2fa6aff9edca9b5e05e5e9e6d4a35d7a51516cd691779ac3d84724de0f96d5c3 not found: ID does not exist" Jul 10 14:08:15.136440 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:15.136384 2575 scope.go:117] "RemoveContainer" containerID="4a2f29520ef67018e659bd494586cab5c06ae9f0439c0ef52322a4d945b8f4b9" Jul 10 14:08:15.136625 ip-10-0-128-57 kubenswrapper[2575]: E0710 14:08:15.136605 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a2f29520ef67018e659bd494586cab5c06ae9f0439c0ef52322a4d945b8f4b9\": container with ID starting with 4a2f29520ef67018e659bd494586cab5c06ae9f0439c0ef52322a4d945b8f4b9 not found: ID does not exist" containerID="4a2f29520ef67018e659bd494586cab5c06ae9f0439c0ef52322a4d945b8f4b9" Jul 10 14:08:15.136707 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:15.136631 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a2f29520ef67018e659bd494586cab5c06ae9f0439c0ef52322a4d945b8f4b9"} err="failed to get container status \"4a2f29520ef67018e659bd494586cab5c06ae9f0439c0ef52322a4d945b8f4b9\": rpc error: code = NotFound desc = could not find container \"4a2f29520ef67018e659bd494586cab5c06ae9f0439c0ef52322a4d945b8f4b9\": container with ID starting with 4a2f29520ef67018e659bd494586cab5c06ae9f0439c0ef52322a4d945b8f4b9 not found: ID does not exist" Jul 10 14:08:15.140733 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:15.140711 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4"] Jul 10 14:08:15.145432 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:15.145413 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-c21824-openshift-default-bfb87bcb7-59lr4"] Jul 10 14:08:16.067948 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:16.067909 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4_47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6/manager/0.log" Jul 10 14:08:16.076524 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:16.076499 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4_47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6/copy-manifests/0.log" Jul 10 14:08:16.238458 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:16.238423 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76047017-7d67-4aec-87ef-524af41b1d50" path="/var/lib/kubelet/pods/76047017-7d67-4aec-87ef-524af41b1d50/volumes" Jul 10 14:08:17.745953 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:17.745927 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8_352c4002-0fb8-4f24-840c-36325935cd7e/util/0.log" Jul 10 14:08:17.755026 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:17.755001 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8_352c4002-0fb8-4f24-840c-36325935cd7e/pull/0.log" Jul 10 14:08:17.764664 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:17.764161 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8_352c4002-0fb8-4f24-840c-36325935cd7e/extract/0.log" Jul 10 14:08:17.892695 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:17.892667 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2_414b6d0b-817b-4b71-8b74-54ba02cd9ad2/util/0.log" Jul 10 14:08:17.901755 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:17.901731 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2_414b6d0b-817b-4b71-8b74-54ba02cd9ad2/pull/0.log" Jul 10 14:08:17.910008 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:17.909991 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2_414b6d0b-817b-4b71-8b74-54ba02cd9ad2/extract/0.log" Jul 10 14:08:18.024224 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:18.024152 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9_f426abc4-d0d1-4c70-9900-5c761fd79b4b/extract/0.log" Jul 10 14:08:18.031925 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:18.031901 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9_f426abc4-d0d1-4c70-9900-5c761fd79b4b/util/0.log" Jul 10 14:08:18.043276 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:18.043251 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9_f426abc4-d0d1-4c70-9900-5c761fd79b4b/pull/0.log" Jul 10 14:08:18.163353 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:18.163327 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv_1ce05209-1333-4826-a604-38aa7ababb5f/util/0.log" Jul 10 14:08:18.173107 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:18.173089 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv_1ce05209-1333-4826-a604-38aa7ababb5f/pull/0.log" Jul 10 14:08:18.181472 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:18.181450 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv_1ce05209-1333-4826-a604-38aa7ababb5f/extract/0.log" Jul 10 14:08:19.573811 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:19.573782 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xjk9q_d301a6f7-d8e0-4f96-8950-09a560e00a9e/istio-proxy/0.log" Jul 10 14:08:19.707497 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:19.707467 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-n2q8q_11f0e6b9-439c-4987-9cb2-8d9c736b24f1/discovery/0.log" Jul 10 14:08:20.084387 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:20.084357 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8hwkz_c551fb1b-c385-4ff6-8ae3-cb51c9361856/istio-proxy/1.log" Jul 10 14:08:20.341249 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:20.341172 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-bgcqj_553fdd38-810e-41cb-bb75-aec8da5d90af/payload-processing/0.log" Jul 10 14:08:20.461442 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:20.461416 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bcdf5f866-j6l87_e3cb5d91-edc8-4b74-bcb4-464cad827f6f/router/0.log" Jul 10 14:08:20.972506 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:20.972481 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-vvzdx_d0336c8b-ab20-474f-abda-3501970ca92f/main/0.log" Jul 10 14:08:21.494896 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:21.494851 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-g9gch_30889ed1-f060-4491-bff6-d4ffb8492423/main/0.log" Jul 10 14:08:28.849689 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:28.849662 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hq6lx_633592e9-f523-4eb4-af61-f1da4eb57acc/global-pull-secret-syncer/0.log" Jul 10 14:08:28.971812 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:28.971779 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ltbc5_02457bf7-b2c7-4acb-a724-924903432966/konnectivity-agent/0.log" Jul 10 14:08:29.006061 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:29.006029 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-57.ec2.internal_2b32c6e6093dd88d5ed1fac2adab9431/haproxy/0.log" Jul 10 14:08:33.601969 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:33.601858 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8_352c4002-0fb8-4f24-840c-36325935cd7e/extract/0.log" Jul 10 14:08:33.626120 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:33.626091 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8_352c4002-0fb8-4f24-840c-36325935cd7e/util/0.log" Jul 10 14:08:33.649423 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:33.649396 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gj9g8_352c4002-0fb8-4f24-840c-36325935cd7e/pull/0.log" Jul 10 14:08:33.679625 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:33.679595 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2_414b6d0b-817b-4b71-8b74-54ba02cd9ad2/extract/0.log" Jul 10 14:08:33.705281 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:33.705261 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2_414b6d0b-817b-4b71-8b74-54ba02cd9ad2/util/0.log" Jul 10 14:08:33.730399 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:33.730375 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whgg2_414b6d0b-817b-4b71-8b74-54ba02cd9ad2/pull/0.log" Jul 10 14:08:33.767685 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:33.767662 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9_f426abc4-d0d1-4c70-9900-5c761fd79b4b/extract/0.log" Jul 10 14:08:33.797040 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:33.797015 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9_f426abc4-d0d1-4c70-9900-5c761fd79b4b/util/0.log" Jul 10 14:08:33.824350 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:33.824333 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cfrq9_f426abc4-d0d1-4c70-9900-5c761fd79b4b/pull/0.log" Jul 10 14:08:33.864181 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:33.864161 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv_1ce05209-1333-4826-a604-38aa7ababb5f/extract/0.log" Jul 10 14:08:33.889373 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:33.889357 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv_1ce05209-1333-4826-a604-38aa7ababb5f/util/0.log" Jul 10 14:08:33.915900 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:33.915877 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t29rv_1ce05209-1333-4826-a604-38aa7ababb5f/pull/0.log" Jul 10 14:08:36.543860 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:36.543827 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-lbcbj_d13a73e0-bd87-4a7b-b968-34290f15f6f0/cluster-monitoring-operator/0.log" Jul 10 14:08:36.721377 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:36.721343 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bjvnw_a50b820a-fa62-4685-931d-0aeb4ee47e6a/node-exporter/0.log" Jul 10 14:08:36.743584 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:36.743559 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bjvnw_a50b820a-fa62-4685-931d-0aeb4ee47e6a/kube-rbac-proxy/0.log" Jul 10 14:08:36.768686 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:36.768667 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bjvnw_a50b820a-fa62-4685-931d-0aeb4ee47e6a/init-textfile/0.log" Jul 10 14:08:38.580163 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.580067 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-59nbp/perf-node-gather-daemonset-g56xk"] Jul 10 14:08:38.580695 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.580532 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76047017-7d67-4aec-87ef-524af41b1d50" containerName="istio-proxy" Jul 10 14:08:38.580695 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.580550 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="76047017-7d67-4aec-87ef-524af41b1d50" containerName="istio-proxy" Jul 10 14:08:38.580695 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.580568 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5120a5b-3e9e-4aa0-9345-e8352c408983" containerName="istio-proxy" Jul 10 14:08:38.580695 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.580576 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5120a5b-3e9e-4aa0-9345-e8352c408983" containerName="istio-proxy" Jul 10 14:08:38.580695 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.580592 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5120a5b-3e9e-4aa0-9345-e8352c408983" containerName="istio-proxy" Jul 10 14:08:38.580695 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.580601 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5120a5b-3e9e-4aa0-9345-e8352c408983" containerName="istio-proxy" Jul 10 14:08:38.580695 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.580684 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="76047017-7d67-4aec-87ef-524af41b1d50" containerName="istio-proxy" Jul 10 14:08:38.580695 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.580691 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5120a5b-3e9e-4aa0-9345-e8352c408983" containerName="istio-proxy" Jul 10 14:08:38.580695 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.580701 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5120a5b-3e9e-4aa0-9345-e8352c408983" containerName="istio-proxy" Jul 10 14:08:38.582595 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.582580 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-59nbp/perf-node-gather-daemonset-g56xk" Jul 10 14:08:38.584517 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.584496 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-59nbp\"/\"kube-root-ca.crt\"" Jul 10 14:08:38.584664 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.584523 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-59nbp\"/\"openshift-service-ca.crt\"" Jul 10 14:08:38.584739 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.584676 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-59nbp\"/\"default-dockercfg-pvgbn\"" Jul 10 14:08:38.592559 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.592536 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-59nbp/perf-node-gather-daemonset-g56xk"] Jul 10 14:08:38.683117 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.683088 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2171952f-32a0-47d8-9d3c-2e0d687ed9f7-podres\") pod \"perf-node-gather-daemonset-g56xk\" (UID: \"2171952f-32a0-47d8-9d3c-2e0d687ed9f7\") " pod="openshift-must-gather-59nbp/perf-node-gather-daemonset-g56xk" Jul 10 14:08:38.683285 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.683197 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2171952f-32a0-47d8-9d3c-2e0d687ed9f7-sys\") pod \"perf-node-gather-daemonset-g56xk\" (UID: \"2171952f-32a0-47d8-9d3c-2e0d687ed9f7\") " pod="openshift-must-gather-59nbp/perf-node-gather-daemonset-g56xk" Jul 10 14:08:38.683285 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.683223 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2171952f-32a0-47d8-9d3c-2e0d687ed9f7-lib-modules\") pod \"perf-node-gather-daemonset-g56xk\" (UID: \"2171952f-32a0-47d8-9d3c-2e0d687ed9f7\") " pod="openshift-must-gather-59nbp/perf-node-gather-daemonset-g56xk" Jul 10 14:08:38.683412 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.683280 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2171952f-32a0-47d8-9d3c-2e0d687ed9f7-proc\") pod \"perf-node-gather-daemonset-g56xk\" (UID: \"2171952f-32a0-47d8-9d3c-2e0d687ed9f7\") " pod="openshift-must-gather-59nbp/perf-node-gather-daemonset-g56xk" Jul 10 14:08:38.683412 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.683314 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vd7w\" (UniqueName: \"kubernetes.io/projected/2171952f-32a0-47d8-9d3c-2e0d687ed9f7-kube-api-access-8vd7w\") pod \"perf-node-gather-daemonset-g56xk\" (UID: \"2171952f-32a0-47d8-9d3c-2e0d687ed9f7\") " pod="openshift-must-gather-59nbp/perf-node-gather-daemonset-g56xk" Jul 10 14:08:38.784693 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.784662 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vd7w\" (UniqueName: \"kubernetes.io/projected/2171952f-32a0-47d8-9d3c-2e0d687ed9f7-kube-api-access-8vd7w\") pod \"perf-node-gather-daemonset-g56xk\" (UID: \"2171952f-32a0-47d8-9d3c-2e0d687ed9f7\") " pod="openshift-must-gather-59nbp/perf-node-gather-daemonset-g56xk" Jul 10 14:08:38.784693 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.784699 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2171952f-32a0-47d8-9d3c-2e0d687ed9f7-podres\") pod \"perf-node-gather-daemonset-g56xk\" (UID: \"2171952f-32a0-47d8-9d3c-2e0d687ed9f7\") " pod="openshift-must-gather-59nbp/perf-node-gather-daemonset-g56xk" Jul 10 14:08:38.784925 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.784771 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2171952f-32a0-47d8-9d3c-2e0d687ed9f7-sys\") pod \"perf-node-gather-daemonset-g56xk\" (UID: \"2171952f-32a0-47d8-9d3c-2e0d687ed9f7\") " pod="openshift-must-gather-59nbp/perf-node-gather-daemonset-g56xk" Jul 10 14:08:38.784925 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.784786 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2171952f-32a0-47d8-9d3c-2e0d687ed9f7-lib-modules\") pod \"perf-node-gather-daemonset-g56xk\" (UID: \"2171952f-32a0-47d8-9d3c-2e0d687ed9f7\") " pod="openshift-must-gather-59nbp/perf-node-gather-daemonset-g56xk" Jul 10 14:08:38.784925 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.784803 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2171952f-32a0-47d8-9d3c-2e0d687ed9f7-proc\") pod \"perf-node-gather-daemonset-g56xk\" (UID: \"2171952f-32a0-47d8-9d3c-2e0d687ed9f7\") " pod="openshift-must-gather-59nbp/perf-node-gather-daemonset-g56xk" Jul 10 14:08:38.784925 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.784874 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2171952f-32a0-47d8-9d3c-2e0d687ed9f7-sys\") pod \"perf-node-gather-daemonset-g56xk\" (UID: \"2171952f-32a0-47d8-9d3c-2e0d687ed9f7\") " pod="openshift-must-gather-59nbp/perf-node-gather-daemonset-g56xk" Jul 10 14:08:38.784925 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.784889 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2171952f-32a0-47d8-9d3c-2e0d687ed9f7-proc\") pod \"perf-node-gather-daemonset-g56xk\" (UID: \"2171952f-32a0-47d8-9d3c-2e0d687ed9f7\") " pod="openshift-must-gather-59nbp/perf-node-gather-daemonset-g56xk" Jul 10 14:08:38.784925 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.784893 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2171952f-32a0-47d8-9d3c-2e0d687ed9f7-podres\") pod \"perf-node-gather-daemonset-g56xk\" (UID: \"2171952f-32a0-47d8-9d3c-2e0d687ed9f7\") " pod="openshift-must-gather-59nbp/perf-node-gather-daemonset-g56xk" Jul 10 14:08:38.785141 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.784933 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2171952f-32a0-47d8-9d3c-2e0d687ed9f7-lib-modules\") pod \"perf-node-gather-daemonset-g56xk\" (UID: \"2171952f-32a0-47d8-9d3c-2e0d687ed9f7\") " pod="openshift-must-gather-59nbp/perf-node-gather-daemonset-g56xk" Jul 10 14:08:38.793755 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.793728 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vd7w\" (UniqueName: \"kubernetes.io/projected/2171952f-32a0-47d8-9d3c-2e0d687ed9f7-kube-api-access-8vd7w\") pod \"perf-node-gather-daemonset-g56xk\" (UID: \"2171952f-32a0-47d8-9d3c-2e0d687ed9f7\") " pod="openshift-must-gather-59nbp/perf-node-gather-daemonset-g56xk" Jul 10 14:08:38.892864 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:38.892847 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-59nbp/perf-node-gather-daemonset-g56xk" Jul 10 14:08:39.025301 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:39.025275 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-59nbp/perf-node-gather-daemonset-g56xk"] Jul 10 14:08:39.027198 ip-10-0-128-57 kubenswrapper[2575]: W0710 14:08:39.027173 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2171952f_32a0_47d8_9d3c_2e0d687ed9f7.slice/crio-9f4f103e5d8d00fdc744e2516f13135805965e8f968ec56fd40af23c829a20ad WatchSource:0}: Error finding container 9f4f103e5d8d00fdc744e2516f13135805965e8f968ec56fd40af23c829a20ad: Status 404 returned error can't find the container with id 9f4f103e5d8d00fdc744e2516f13135805965e8f968ec56fd40af23c829a20ad Jul 10 14:08:39.239120 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:39.239031 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-59nbp/perf-node-gather-daemonset-g56xk" event={"ID":"2171952f-32a0-47d8-9d3c-2e0d687ed9f7","Type":"ContainerStarted","Data":"c897024ec4fa93378d3c6725df77023e33e7ae5a9c71032e2ca8d4cde0f7f253"} Jul 10 14:08:39.239120 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:39.239093 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-59nbp/perf-node-gather-daemonset-g56xk" event={"ID":"2171952f-32a0-47d8-9d3c-2e0d687ed9f7","Type":"ContainerStarted","Data":"9f4f103e5d8d00fdc744e2516f13135805965e8f968ec56fd40af23c829a20ad"} Jul 10 14:08:39.239120 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:39.239117 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-59nbp/perf-node-gather-daemonset-g56xk" Jul 10 14:08:39.258040 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:39.257994 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-59nbp/perf-node-gather-daemonset-g56xk" podStartSLOduration=1.257979744 podStartE2EDuration="1.257979744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:08:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:08:39.254937337 +0000 UTC m=+2572.494269258" watchObservedRunningTime="2026-07-10 14:08:39.257979744 +0000 UTC m=+2572.497311664" Jul 10 14:08:39.393493 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:39.393468 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hrq6g_63c89ec5-2de9-4855-8fe8-57baaa8e0588/console-operator/1.log" Jul 10 14:08:39.403514 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:39.403486 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-hrq6g_63c89ec5-2de9-4855-8fe8-57baaa8e0588/console-operator/2.log" Jul 10 14:08:39.929328 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:39.929295 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-zdqc6_85d4fe9b-fcfe-4796-a866-fb0f316531e1/download-server/0.log" Jul 10 14:08:40.526490 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:40.526458 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-cz854_392e2bbd-a9f3-4032-a0dc-c59f5d4133e0/volume-data-source-validator/0.log" Jul 10 14:08:41.704079 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:41.704047 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gjkg6_051b95cc-7289-4c0c-aa25-98fe724192d6/dns/0.log" Jul 10 14:08:41.728522 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:41.728495 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gjkg6_051b95cc-7289-4c0c-aa25-98fe724192d6/kube-rbac-proxy/0.log" Jul 10 14:08:41.754262 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:41.754233 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9rwhx_a3c237cf-7931-4c12-868e-351a7abcdd91/dns-node-resolver/0.log" Jul 10 14:08:42.427358 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:42.427328 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bvlcd_7c327241-7b52-4e48-83dc-bb9629af3edc/node-ca/0.log" Jul 10 14:08:43.481011 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:43.480984 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xjk9q_d301a6f7-d8e0-4f96-8950-09a560e00a9e/istio-proxy/0.log" Jul 10 14:08:43.671828 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:43.671801 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-n2q8q_11f0e6b9-439c-4987-9cb2-8d9c736b24f1/discovery/0.log" Jul 10 14:08:43.759481 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:43.759396 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8hwkz_c551fb1b-c385-4ff6-8ae3-cb51c9361856/istio-proxy/0.log" Jul 10 14:08:43.818562 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:43.818535 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8hwkz_c551fb1b-c385-4ff6-8ae3-cb51c9361856/istio-proxy/1.log" Jul 10 14:08:43.893711 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:43.893684 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-bgcqj_553fdd38-810e-41cb-bb75-aec8da5d90af/payload-processing/0.log" Jul 10 14:08:43.926016 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:43.925986 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bcdf5f866-j6l87_e3cb5d91-edc8-4b74-bcb4-464cad827f6f/router/0.log" Jul 10 14:08:44.730416 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:44.730387 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xzm2l_35afbd6c-d5c1-4deb-929d-71dbf71b6d0d/serve-healthcheck-canary/0.log" Jul 10 14:08:45.221198 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:45.221166 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-l4859_5702eeb0-bcc8-4557-87a8-f25f6e3f46cf/insights-operator/0.log" Jul 10 14:08:45.222833 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:45.222809 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-l4859_5702eeb0-bcc8-4557-87a8-f25f6e3f46cf/insights-operator/1.log" Jul 10 14:08:45.253721 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:45.253702 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-59nbp/perf-node-gather-daemonset-g56xk" Jul 10 14:08:45.332398 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:45.332368 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ttzgw_0c5d1aad-4935-4a95-8813-2aedd8dc9022/kube-rbac-proxy/0.log" Jul 10 14:08:45.366214 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:45.366187 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ttzgw_0c5d1aad-4935-4a95-8813-2aedd8dc9022/exporter/0.log" Jul 10 14:08:45.391367 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:45.391345 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ttzgw_0c5d1aad-4935-4a95-8813-2aedd8dc9022/extractor/0.log" Jul 10 14:08:48.457126 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:48.457100 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4_47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6/manager/0.log" Jul 10 14:08:48.480918 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:48.480893 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d67ccc8fd-5qvw4_47f4b1c9-4ec5-4fdc-93e0-cc3cb54cb2a6/copy-manifests/0.log" Jul 10 14:08:48.854842 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:48.854817 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xjk9q_d301a6f7-d8e0-4f96-8950-09a560e00a9e/istio-proxy/0.log" Jul 10 14:08:49.044408 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:49.044379 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-n2q8q_11f0e6b9-439c-4987-9cb2-8d9c736b24f1/discovery/0.log" Jul 10 14:08:49.126666 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:49.126582 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8hwkz_c551fb1b-c385-4ff6-8ae3-cb51c9361856/istio-proxy/0.log" Jul 10 14:08:49.185407 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:49.185378 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8hwkz_c551fb1b-c385-4ff6-8ae3-cb51c9361856/istio-proxy/1.log" Jul 10 14:08:49.241734 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:49.241707 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-bgcqj_553fdd38-810e-41cb-bb75-aec8da5d90af/payload-processing/0.log" Jul 10 14:08:49.258448 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:49.258427 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bcdf5f866-j6l87_e3cb5d91-edc8-4b74-bcb4-464cad827f6f/router/0.log" Jul 10 14:08:49.952689 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:49.952661 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7b765fbf76-6pl2m_6d537713-2044-4ec2-9435-70eb7e81e317/manager/0.log" Jul 10 14:08:50.011865 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:50.011839 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-gvr6c_3c1ee0a5-d2c3-4257-94d1-b1df268e60b0/openshift-lws-operator/0.log" Jul 10 14:08:50.389672 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:50.389626 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xjk9q_d301a6f7-d8e0-4f96-8950-09a560e00a9e/istio-proxy/0.log" Jul 10 14:08:50.580464 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:50.580430 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-n2q8q_11f0e6b9-439c-4987-9cb2-8d9c736b24f1/discovery/0.log" Jul 10 14:08:50.638116 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:50.638086 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8hwkz_c551fb1b-c385-4ff6-8ae3-cb51c9361856/istio-proxy/0.log" Jul 10 14:08:50.696743 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:50.696676 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8hwkz_c551fb1b-c385-4ff6-8ae3-cb51c9361856/istio-proxy/1.log" Jul 10 14:08:50.752749 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:50.752726 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-bgcqj_553fdd38-810e-41cb-bb75-aec8da5d90af/payload-processing/0.log" Jul 10 14:08:50.769103 ip-10-0-128-57 kubenswrapper[2575]: I0710 14:08:50.769072 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7bcdf5f866-j6l87_e3cb5d91-edc8-4b74-bcb4-464cad827f6f/router/0.log"