Jul 08 17:16:27.466188 ip-10-0-133-231 systemd[1]: Starting Kubernetes Kubelet... Jul 08 17:16:27.939981 ip-10-0-133-231 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 17:16:27.939981 ip-10-0-133-231 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 17:16:27.939981 ip-10-0-133-231 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 17:16:27.939981 ip-10-0-133-231 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 17:16:27.939981 ip-10-0-133-231 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 17:16:27.939981 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.872206 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 17:16:27.939981 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877641 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:16:27.939981 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877657 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:16:27.939981 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877663 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:16:27.939981 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877667 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:16:27.939981 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877671 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:16:27.939981 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877675 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:16:27.939981 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877680 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:16:27.939981 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877685 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:16:27.954444 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877690 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:16:27.954444 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877693 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:16:27.954444 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877697 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:16:27.954444 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877701 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:16:27.954444 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877705 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:16:27.954444 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877709 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:16:27.954444 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877713 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:16:27.954444 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877717 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:16:27.954444 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877721 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:16:27.954444 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877726 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:16:27.954444 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877730 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:16:27.954444 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877733 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:16:27.954444 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877738 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:16:27.954444 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877741 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:16:27.954444 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877745 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:16:27.954444 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877751 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:16:27.954444 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877756 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:16:27.954444 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877761 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:16:27.954444 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877768 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:16:27.954444 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877772 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:16:27.947253 ip-10-0-133-231 systemd[1]: Started Kubernetes Kubelet. Jul 08 17:16:27.957237 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877774 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:16:27.957237 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877778 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:16:27.957237 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877784 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:16:27.957237 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877788 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:16:27.957237 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877792 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:16:27.957237 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877795 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:16:27.957237 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877799 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:16:27.957237 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877803 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:16:27.957237 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877807 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:16:27.957237 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877811 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:16:27.957237 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877815 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:16:27.957237 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877819 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:16:27.957237 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877823 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:16:27.957237 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877827 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:16:27.957237 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877831 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:16:27.957237 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877835 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:16:27.957237 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877839 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:16:27.957237 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877842 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:16:27.957237 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877847 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:16:27.971457 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877851 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:16:27.971457 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877854 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:16:27.971457 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877859 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:16:27.971457 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877863 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:16:27.971457 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877866 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:16:27.971457 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877870 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:16:27.971457 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877874 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:16:27.971457 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877877 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:16:27.971457 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877881 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:16:27.971457 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877886 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:16:27.971457 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877890 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:16:27.971457 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877893 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:16:27.971457 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877897 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:16:27.971457 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877901 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:16:27.971457 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877905 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:16:27.971457 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877923 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:16:27.971457 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877927 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:16:27.971457 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877934 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:16:27.971457 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877939 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:16:27.971457 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877944 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:16:27.986668 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877948 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:16:27.986668 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877952 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:16:27.986668 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877957 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:16:27.986668 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877960 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:16:27.986668 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877964 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:16:27.986668 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877968 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:16:27.986668 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877975 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:16:27.986668 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877979 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:16:27.986668 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877983 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:16:27.986668 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877987 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:16:27.986668 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877992 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:16:27.986668 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.877996 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:16:27.986668 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.878001 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:16:27.986668 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.878005 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:16:27.986668 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.878009 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:16:27.986668 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.878013 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:16:27.986668 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.878018 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:16:27.986668 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.878022 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:16:27.986668 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.878026 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:16:27.986668 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.878030 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:16:28.004790 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.878034 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:16:28.004790 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.878039 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:16:28.004790 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.878043 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:16:28.004790 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.878047 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:16:28.004790 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.878051 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:16:28.004790 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.878055 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:16:28.004790 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.878059 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:16:28.004790 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.878065 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:16:28.004790 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.878070 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:16:28.004790 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.878076 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:16:28.004790 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.878079 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:16:28.004790 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.878084 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:16:28.004790 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880003 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:16:28.004790 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880012 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:16:28.004790 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880015 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:16:28.004790 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880018 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:16:28.004790 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880021 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:16:28.004790 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880025 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:16:28.004790 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880027 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:16:28.019727 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880030 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:16:28.019727 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880035 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:16:28.019727 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880037 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:16:28.019727 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880040 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:16:28.019727 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880043 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:16:28.019727 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880046 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:16:28.019727 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880049 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:16:28.019727 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880052 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:16:28.019727 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880055 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:16:28.019727 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880057 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:16:28.019727 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880060 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:16:28.019727 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880062 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:16:28.019727 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880065 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:16:28.019727 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880068 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:16:28.019727 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880072 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:16:28.019727 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880076 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:16:28.019727 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880081 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:16:28.019727 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880084 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:16:28.019727 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880087 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:16:28.023771 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880090 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:16:28.023771 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880094 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:16:28.023771 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880097 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:16:28.023771 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880099 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:16:28.023771 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880102 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:16:28.023771 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880106 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:16:28.023771 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880109 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:16:28.023771 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880112 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:16:28.023771 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880114 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:16:28.023771 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880117 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:16:28.023771 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880120 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:16:28.023771 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880123 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:16:28.023771 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880126 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:16:28.023771 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880128 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:16:28.023771 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880131 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:16:28.023771 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880133 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:16:28.023771 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880136 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:16:28.023771 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880139 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:16:28.023771 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880141 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:16:28.023771 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880145 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:16:28.171938 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880148 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:16:28.171938 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880151 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:16:28.171938 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880154 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:16:28.171938 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880156 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:16:28.171938 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880159 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:16:28.171938 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880161 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:16:28.171938 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880164 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:16:28.171938 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880166 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:16:28.171938 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880168 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:16:28.171938 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880171 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:16:28.171938 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880173 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:16:28.171938 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880176 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:16:28.171938 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880179 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:16:28.171938 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880182 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:16:28.171938 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880184 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:16:28.171938 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880190 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:16:28.171938 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880193 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:16:28.171938 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880195 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:16:28.171938 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880199 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:16:28.171938 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880202 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:16:28.173840 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880205 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:16:28.173840 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880208 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:16:28.173840 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880211 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:16:28.173840 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880214 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:16:28.173840 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880217 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:16:28.173840 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880219 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:16:28.173840 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880222 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:16:28.173840 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880225 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:16:28.173840 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880228 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:16:28.173840 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880230 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:16:28.173840 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880233 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:16:28.173840 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880235 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:16:28.173840 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880238 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:16:28.173840 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880242 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:16:28.173840 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880244 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:16:28.173840 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880247 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:16:28.173840 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880249 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:16:28.173840 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880251 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:16:28.173840 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880254 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:16:28.173840 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880257 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:16:28.176202 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880259 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:16:28.176202 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880261 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:16:28.176202 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880264 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:16:28.176202 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880267 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:16:28.176202 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880269 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:16:28.176202 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880272 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:16:28.176202 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880275 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:16:28.176202 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880280 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:16:28.176202 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880283 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:16:28.176202 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880285 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:16:28.176202 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880288 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:16:28.176202 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880290 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:16:28.176202 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880293 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:16:28.176202 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880684 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:16:28.176202 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880688 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:16:28.176202 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880691 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:16:28.176202 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880696 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:16:28.176202 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880700 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:16:28.176202 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880703 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:16:28.178016 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880706 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:16:28.178016 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880708 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:16:28.178016 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880711 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:16:28.178016 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880714 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:16:28.178016 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880717 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:16:28.178016 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880720 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:16:28.178016 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880723 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:16:28.178016 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880726 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:16:28.178016 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880729 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:16:28.178016 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880732 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:16:28.178016 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880734 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:16:28.178016 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880737 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:16:28.178016 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880739 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:16:28.178016 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880742 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:16:28.178016 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880744 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:16:28.178016 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880747 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:16:28.178016 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880749 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:16:28.178016 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880752 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:16:28.178016 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880754 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:16:28.178016 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880757 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:16:28.180333 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880761 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:16:28.180333 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880764 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:16:28.180333 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880767 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:16:28.180333 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880769 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:16:28.180333 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880772 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:16:28.180333 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880774 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:16:28.180333 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880777 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:16:28.180333 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880780 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:16:28.180333 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880782 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:16:28.180333 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880785 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:16:28.180333 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880788 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:16:28.180333 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880790 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:16:28.180333 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880793 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:16:28.180333 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880796 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:16:28.180333 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880800 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:16:28.180333 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880803 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:16:28.180333 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880806 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:16:28.180333 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880809 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:16:28.180333 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880812 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:16:28.182120 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880815 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:16:28.182120 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880817 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:16:28.182120 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880820 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:16:28.182120 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880824 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:16:28.182120 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880827 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:16:28.182120 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880830 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:16:28.182120 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880833 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:16:28.182120 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880836 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:16:28.182120 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880839 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:16:28.182120 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880841 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:16:28.182120 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880844 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:16:28.182120 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880846 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:16:28.182120 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880849 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:16:28.182120 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880853 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:16:28.182120 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880855 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:16:28.182120 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880858 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:16:28.182120 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880860 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:16:28.182120 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880863 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:16:28.182120 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880866 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:16:28.182120 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880868 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:16:28.184426 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880871 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:16:28.184426 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880874 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:16:28.184426 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880876 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:16:28.184426 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880880 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:16:28.184426 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880883 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:16:28.184426 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880885 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:16:28.184426 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880887 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:16:28.184426 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880892 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:16:28.184426 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880895 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:16:28.184426 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880897 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:16:28.184426 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880899 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:16:28.184426 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880902 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:16:28.184426 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880904 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:16:28.184426 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880926 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:16:28.184426 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880931 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:16:28.184426 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880935 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:16:28.184426 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880938 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:16:28.184426 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880941 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:16:28.184426 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880943 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:16:28.184426 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880946 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:16:28.185044 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880948 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:16:28.185044 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880951 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:16:28.185044 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880953 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:16:28.185044 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880956 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:16:28.185044 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880959 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:16:28.185044 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880963 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:16:28.185044 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880965 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:16:28.185044 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880968 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:16:28.185044 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880970 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:16:28.185044 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880973 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:16:28.185044 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880976 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:16:28.185044 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880978 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:16:28.185044 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880981 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:16:28.185044 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.880983 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:16:28.185044 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881065 2556 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 17:16:28.185044 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881073 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 17:16:28.185044 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881080 2556 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 17:16:28.185044 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881085 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 17:16:28.185044 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881089 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 17:16:28.185044 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881094 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 17:16:28.185044 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881098 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 17:16:28.185675 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881103 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 17:16:28.185675 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881106 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 17:16:28.185675 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881109 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 17:16:28.185675 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881112 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 17:16:28.185675 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881115 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 17:16:28.185675 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881120 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 17:16:28.185675 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881123 2556 flags.go:64] FLAG: --cgroup-root="" Jul 08 17:16:28.185675 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881126 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 17:16:28.185675 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881129 2556 flags.go:64] FLAG: --client-ca-file="" Jul 08 17:16:28.185675 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881132 2556 flags.go:64] FLAG: --cloud-provider="external" Jul 08 17:16:28.185675 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881135 2556 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 17:16:28.185675 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881140 2556 flags.go:64] FLAG: --cluster-domain="" Jul 08 17:16:28.185675 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881143 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 17:16:28.185675 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881146 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 17:16:28.185675 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881149 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 17:16:28.185675 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881152 2556 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 17:16:28.185675 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881157 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 17:16:28.185675 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881161 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 17:16:28.185675 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881164 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 17:16:28.185675 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881167 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 17:16:28.185675 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881170 2556 flags.go:64] FLAG: --contention-profiling="false" Jul 08 17:16:28.185675 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881173 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 17:16:28.185675 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881176 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 17:16:28.185675 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881180 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 17:16:28.186503 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881183 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 17:16:28.186503 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881187 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 17:16:28.186503 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881190 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 17:16:28.186503 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881193 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 17:16:28.186503 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881196 2556 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 17:16:28.186503 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881199 2556 flags.go:64] FLAG: --enable-server="true" Jul 08 17:16:28.186503 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881203 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 17:16:28.186503 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881208 2556 flags.go:64] FLAG: --event-burst="100" Jul 08 17:16:28.186503 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881211 2556 flags.go:64] FLAG: --event-qps="50" Jul 08 17:16:28.186503 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881213 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 17:16:28.186503 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881216 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 17:16:28.186503 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881219 2556 flags.go:64] FLAG: --eviction-hard="" Jul 08 17:16:28.186503 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881223 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 17:16:28.186503 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881226 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 17:16:28.186503 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881233 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 17:16:28.186503 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881236 2556 flags.go:64] FLAG: --eviction-soft="" Jul 08 17:16:28.186503 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881239 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 17:16:28.186503 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881242 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 17:16:28.186503 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881245 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 17:16:28.186503 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881248 2556 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 17:16:28.186503 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881251 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 17:16:28.186503 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881254 2556 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 17:16:28.186503 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881256 2556 flags.go:64] FLAG: --feature-gates="" Jul 08 17:16:28.186503 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881260 2556 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 17:16:28.186503 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881264 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 17:16:28.187323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881267 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 17:16:28.187323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881270 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 17:16:28.187323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881273 2556 flags.go:64] FLAG: --healthz-port="10248" Jul 08 17:16:28.187323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881276 2556 flags.go:64] FLAG: --help="false" Jul 08 17:16:28.187323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881279 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-133-231.ec2.internal" Jul 08 17:16:28.187323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881282 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 17:16:28.187323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881284 2556 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 17:16:28.187323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881288 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 17:16:28.187323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881291 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 17:16:28.187323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881294 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 17:16:28.187323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881297 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 17:16:28.187323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881299 2556 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 17:16:28.187323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881302 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 17:16:28.187323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881306 2556 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 17:16:28.187323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881309 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 17:16:28.187323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881312 2556 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 17:16:28.187323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881315 2556 flags.go:64] FLAG: --kube-reserved="" Jul 08 17:16:28.187323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881318 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 17:16:28.187323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881321 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 17:16:28.187323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881324 2556 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 17:16:28.187323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881326 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 17:16:28.187323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881329 2556 flags.go:64] FLAG: --lock-file="" Jul 08 17:16:28.187323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881338 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 17:16:28.187323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881341 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 17:16:28.189513 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881344 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 17:16:28.189513 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881349 2556 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 17:16:28.189513 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881352 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 17:16:28.189513 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881354 2556 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 17:16:28.189513 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881357 2556 flags.go:64] FLAG: --logging-format="text" Jul 08 17:16:28.189513 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881360 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 17:16:28.189513 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881363 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 17:16:28.189513 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881367 2556 flags.go:64] FLAG: --manifest-url="" Jul 08 17:16:28.189513 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881370 2556 flags.go:64] FLAG: --manifest-url-header="" Jul 08 17:16:28.189513 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881374 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 17:16:28.189513 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881377 2556 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 17:16:28.189513 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881381 2556 flags.go:64] FLAG: --max-pods="110" Jul 08 17:16:28.189513 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881384 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 17:16:28.189513 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881387 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 17:16:28.189513 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881389 2556 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 17:16:28.189513 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881392 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 17:16:28.189513 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881395 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 17:16:28.189513 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881398 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 17:16:28.189513 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881401 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 17:16:28.189513 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881408 2556 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 17:16:28.189513 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881411 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 17:16:28.189513 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881416 2556 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 17:16:28.189513 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881419 2556 flags.go:64] FLAG: --pod-cidr="" Jul 08 17:16:28.190225 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881422 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 17:16:28.190225 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881427 2556 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 17:16:28.190225 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881430 2556 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 17:16:28.190225 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881433 2556 flags.go:64] FLAG: --pods-per-core="0" Jul 08 17:16:28.190225 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881436 2556 flags.go:64] FLAG: --port="10250" Jul 08 17:16:28.190225 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881439 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 17:16:28.190225 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881441 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00b222f6ae3574db7" Jul 08 17:16:28.190225 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881444 2556 flags.go:64] FLAG: --qos-reserved="" Jul 08 17:16:28.190225 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881453 2556 flags.go:64] FLAG: --read-only-port="10255" Jul 08 17:16:28.190225 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881456 2556 flags.go:64] FLAG: --register-node="true" Jul 08 17:16:28.190225 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881459 2556 flags.go:64] FLAG: --register-with-taints="" Jul 08 17:16:28.190225 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881463 2556 flags.go:64] FLAG: --registry-burst="10" Jul 08 17:16:28.190225 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881465 2556 flags.go:64] FLAG: --registry-qps="5" Jul 08 17:16:28.190225 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881468 2556 flags.go:64] FLAG: --reserved-cpus="" Jul 08 17:16:28.190225 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881471 2556 flags.go:64] FLAG: --reserved-memory="" Jul 08 17:16:28.190225 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881474 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 17:16:28.190225 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881477 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 17:16:28.190225 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881481 2556 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 17:16:28.190225 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881484 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 17:16:28.190225 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881487 2556 flags.go:64] FLAG: --runonce="false" Jul 08 17:16:28.190225 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881490 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 17:16:28.190225 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881493 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 17:16:28.190225 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881496 2556 flags.go:64] FLAG: --seccomp-default="false" Jul 08 17:16:28.190225 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881498 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 17:16:28.190225 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881501 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 17:16:28.191754 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881504 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 17:16:28.191754 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881507 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 17:16:28.191754 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881510 2556 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 17:16:28.191754 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881513 2556 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 17:16:28.191754 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881516 2556 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 17:16:28.191754 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881520 2556 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 17:16:28.191754 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881523 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 17:16:28.191754 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881526 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 17:16:28.191754 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881529 2556 flags.go:64] FLAG: --system-cgroups="" Jul 08 17:16:28.191754 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881531 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 17:16:28.191754 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881537 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 17:16:28.191754 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881539 2556 flags.go:64] FLAG: --tls-cert-file="" Jul 08 17:16:28.191754 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881542 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 17:16:28.191754 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881549 2556 flags.go:64] FLAG: --tls-min-version="" Jul 08 17:16:28.191754 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881551 2556 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 17:16:28.191754 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881554 2556 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 17:16:28.191754 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881562 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 17:16:28.191754 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881566 2556 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 17:16:28.191754 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881568 2556 flags.go:64] FLAG: --v="2" Jul 08 17:16:28.191754 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881572 2556 flags.go:64] FLAG: --version="false" Jul 08 17:16:28.191754 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881580 2556 flags.go:64] FLAG: --vmodule="" Jul 08 17:16:28.191754 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881584 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 17:16:28.191754 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.881587 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 17:16:28.191754 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881718 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:16:28.191754 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881723 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:16:28.192586 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881726 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:16:28.192586 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881729 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:16:28.192586 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881732 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:16:28.192586 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881735 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:16:28.192586 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881738 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:16:28.192586 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881740 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:16:28.192586 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881743 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:16:28.192586 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881745 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:16:28.192586 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881748 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:16:28.192586 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881756 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:16:28.192586 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881759 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:16:28.192586 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881761 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:16:28.192586 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881765 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:16:28.192586 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881768 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:16:28.192586 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881770 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:16:28.192586 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881773 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:16:28.192586 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881775 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:16:28.192586 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881778 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:16:28.192586 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881780 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:16:28.192586 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881783 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:16:28.194158 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881786 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:16:28.194158 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881789 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:16:28.194158 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881791 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:16:28.194158 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881794 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:16:28.194158 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881797 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:16:28.194158 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881800 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:16:28.194158 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881803 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:16:28.194158 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881805 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:16:28.194158 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881808 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:16:28.194158 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881810 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:16:28.194158 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881813 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:16:28.194158 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881816 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:16:28.194158 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881819 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:16:28.194158 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881822 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:16:28.194158 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881824 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:16:28.194158 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881827 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:16:28.194158 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881830 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:16:28.194158 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881832 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:16:28.194158 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881835 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:16:28.194158 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881837 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:16:28.195577 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881840 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:16:28.195577 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881842 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:16:28.195577 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881845 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:16:28.195577 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881848 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:16:28.195577 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881852 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:16:28.195577 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881854 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:16:28.195577 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881857 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:16:28.195577 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881861 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:16:28.195577 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881864 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:16:28.195577 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881867 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:16:28.195577 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881870 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:16:28.195577 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881874 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:16:28.195577 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881877 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:16:28.195577 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881881 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:16:28.195577 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881883 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:16:28.195577 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881886 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:16:28.195577 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881889 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:16:28.195577 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881892 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:16:28.195577 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881895 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:16:28.197850 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881898 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:16:28.197850 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881900 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:16:28.197850 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881903 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:16:28.197850 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881922 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:16:28.197850 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881928 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:16:28.197850 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881934 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:16:28.197850 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881938 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:16:28.197850 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881941 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:16:28.197850 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881944 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:16:28.197850 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881947 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:16:28.197850 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881950 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:16:28.197850 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881953 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:16:28.197850 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881956 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:16:28.197850 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881959 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:16:28.197850 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881961 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:16:28.197850 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881964 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:16:28.197850 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881967 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:16:28.197850 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881971 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:16:28.197850 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881974 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:16:28.197850 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881976 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:16:28.199777 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881979 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:16:28.199777 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881981 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:16:28.199777 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881984 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:16:28.199777 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881986 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:16:28.199777 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881989 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:16:28.199777 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881992 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:16:28.199777 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881994 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:16:28.199777 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881997 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:16:28.199777 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.881999 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:16:28.199777 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.882002 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:16:28.199777 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.882005 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:16:28.199777 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.882008 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:16:28.199777 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.882010 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:16:28.199777 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.882014 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:16:28.199777 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.882016 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:16:28.199777 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.882019 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:16:28.199777 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.882022 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:16:28.199777 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.882025 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:16:28.201923 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.882034 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 17:16:28.201923 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.889772 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 17:16:28.201923 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.889795 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 17:16:28.201923 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.889819 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 17:16:28.201923 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.889830 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 17:16:28.201923 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.889902 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:16:28.201923 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.889925 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:16:28.201923 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.889930 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:16:28.201923 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.889935 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:16:28.201923 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.889938 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:16:28.201923 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.889943 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:16:28.201923 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.889946 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:16:28.201923 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.889949 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:16:28.201923 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.889952 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:16:28.202702 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.889955 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:16:28.202702 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.889958 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:16:28.202702 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.889960 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:16:28.202702 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.889967 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:16:28.202702 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.889969 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:16:28.202702 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.889972 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:16:28.202702 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.889979 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:16:28.202702 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.889982 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:16:28.202702 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.889987 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:16:28.202702 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.889990 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:16:28.202702 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.889992 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:16:28.202702 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.889995 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:16:28.202702 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890000 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:16:28.202702 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890002 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:16:28.202702 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890005 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:16:28.202702 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890007 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:16:28.202702 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890012 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:16:28.202702 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890015 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:16:28.202702 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890017 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:16:28.202702 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890022 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:16:28.204667 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890025 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:16:28.204667 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890028 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:16:28.204667 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890031 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:16:28.204667 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890035 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:16:28.204667 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890038 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:16:28.204667 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890040 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:16:28.204667 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890045 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:16:28.204667 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890048 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:16:28.204667 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890051 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:16:28.204667 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890054 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:16:28.204667 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890059 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:16:28.204667 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890061 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:16:28.204667 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890064 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:16:28.204667 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890068 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:16:28.204667 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890071 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:16:28.204667 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890074 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:16:28.204667 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890076 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:16:28.204667 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890082 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:16:28.204667 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890087 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:16:28.204667 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890092 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:16:28.206427 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890094 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:16:28.206427 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890097 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:16:28.206427 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890099 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:16:28.206427 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890104 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:16:28.206427 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890106 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:16:28.206427 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890109 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:16:28.206427 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890112 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:16:28.206427 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890117 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:16:28.206427 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890119 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:16:28.206427 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890122 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:16:28.206427 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890127 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:16:28.206427 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890129 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:16:28.206427 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890132 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:16:28.206427 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890136 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:16:28.206427 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890141 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:16:28.206427 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890143 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:16:28.206427 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890146 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:16:28.206427 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890148 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:16:28.206427 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890155 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:16:28.206427 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890157 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:16:28.207554 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890160 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:16:28.207554 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890163 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:16:28.207554 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890165 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:16:28.207554 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890168 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:16:28.207554 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890174 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:16:28.207554 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890177 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:16:28.207554 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890179 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:16:28.207554 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890184 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:16:28.207554 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890187 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:16:28.207554 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890191 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:16:28.207554 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890197 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:16:28.207554 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890199 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:16:28.207554 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890202 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:16:28.207554 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890204 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:16:28.207554 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890209 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:16:28.207554 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890212 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:16:28.207554 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890214 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:16:28.207554 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890222 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:16:28.207554 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890226 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:16:28.208388 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890229 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:16:28.208388 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890232 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:16:28.208388 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890236 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:16:28.208388 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890240 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:16:28.208388 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890243 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:16:28.208388 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890246 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:16:28.208388 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890250 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:16:28.208388 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890254 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:16:28.208388 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890257 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:16:28.208388 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890260 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:16:28.208388 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890262 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:16:28.208388 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.890268 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 17:16:28.208388 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890400 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:16:28.208388 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890408 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:16:28.208803 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890411 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:16:28.208803 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890414 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:16:28.208803 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890420 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:16:28.208803 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890423 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:16:28.208803 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890425 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:16:28.208803 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890430 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:16:28.208803 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890433 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:16:28.208803 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890436 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:16:28.208803 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890439 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:16:28.208803 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890446 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:16:28.208803 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890449 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:16:28.208803 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890454 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:16:28.208803 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890457 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:16:28.208803 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890459 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:16:28.208803 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890462 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:16:28.208803 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890467 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:16:28.208803 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890469 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:16:28.208803 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890472 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:16:28.208803 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890475 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:16:28.208803 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890479 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:16:28.209438 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890482 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:16:28.209438 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890485 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:16:28.209438 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890489 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:16:28.209438 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890492 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:16:28.209438 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890495 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:16:28.209438 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890498 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:16:28.209438 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890503 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:16:28.209438 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890506 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:16:28.209438 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890509 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:16:28.209438 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890514 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:16:28.209438 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890516 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:16:28.209438 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890518 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:16:28.209438 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890521 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:16:28.209438 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890525 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:16:28.209438 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890528 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:16:28.209438 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890530 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:16:28.209438 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890536 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:16:28.209438 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890538 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:16:28.209438 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890542 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:16:28.210060 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890548 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:16:28.210060 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890551 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:16:28.210060 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890556 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:16:28.210060 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890564 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:16:28.210060 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890567 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:16:28.210060 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890573 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:16:28.210060 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890575 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:16:28.210060 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890578 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:16:28.210060 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890581 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:16:28.210060 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890585 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:16:28.210060 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890587 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:16:28.210060 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890590 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:16:28.210060 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890596 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:16:28.210060 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890598 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:16:28.210060 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890601 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:16:28.210060 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890606 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:16:28.210060 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890608 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:16:28.210060 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890611 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:16:28.210060 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890613 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:16:28.210060 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890618 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:16:28.210903 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890622 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:16:28.210903 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890624 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:16:28.210903 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890629 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:16:28.210903 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890633 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:16:28.210903 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890636 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:16:28.210903 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890641 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:16:28.210903 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890643 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:16:28.210903 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890646 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:16:28.210903 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890649 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:16:28.210903 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890653 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:16:28.210903 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890656 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:16:28.210903 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890658 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:16:28.210903 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890663 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:16:28.210903 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890666 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:16:28.210903 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890671 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:16:28.210903 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890675 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:16:28.210903 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890678 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:16:28.210903 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890681 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:16:28.210903 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890683 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:16:28.211514 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890688 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:16:28.211514 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890691 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:16:28.211514 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890693 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:16:28.211514 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890698 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:16:28.211514 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890701 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:16:28.211514 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890703 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:16:28.211514 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890706 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:16:28.211514 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890711 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:16:28.211514 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890713 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:16:28.211514 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890716 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:16:28.211514 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890718 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:16:28.211514 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890723 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:16:28.211514 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890726 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:16:28.211514 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890728 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:16:28.211514 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890731 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:16:28.211514 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890736 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:16:28.211514 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890738 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:16:28.211514 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890741 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:16:28.211514 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:27.890745 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:16:28.212112 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.890750 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 17:16:28.212112 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.890892 2556 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 17:16:28.212112 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.893061 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 17:16:28.212112 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.894720 2556 server.go:1019] "Starting client certificate rotation" Jul 08 17:16:28.212112 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.894816 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 17:16:28.212112 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.895564 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 17:16:28.212112 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.897692 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 17:16:28.212112 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.902356 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 17:16:28.212112 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.911249 2556 log.go:25] "Validated CRI v1 runtime API" Jul 08 17:16:28.212112 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.913306 2556 log.go:25] "Validated CRI v1 image API" Jul 08 17:16:28.212112 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.914111 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 17:16:28.212112 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.919535 2556 fs.go:135] Filesystem UUIDs: map[08b1b033-0a68-4e08-9d8b-ac9d367a6599:/dev/nvme0n1p4 5a07296c-415f-49f6-bc92-68e6aeff1f4b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 08 17:16:28.212506 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.919552 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 17:16:28.212726 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.924779 2556 manager.go:216] Machine: {Timestamp:2026-07-08 17:16:27.923251013 +0000 UTC m=+0.334066382 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3114378 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2403955a1eaef18ead22fe5a1291d0 SystemUUID:ec240395-5a1e-aef1-8ead-22fe5a1291d0 BootID:9042c50b-a8c2-48f1-8184-a01d2fe82272 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f4:95:c3:ed:53 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f4:95:c3:ed:53 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:45:cf:78:f0:62 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 17:16:28.212726 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.924884 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 17:16:28.212726 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.924981 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 17:16:28.212726 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.928490 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 17:16:28.212726 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.928519 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-231.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 17:16:28.212726 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.929273 2556 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 17:16:28.212726 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.929284 2556 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 17:16:28.212726 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.929292 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.930515 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.931705 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.934707 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.934827 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.935412 2556 kubelet.go:486] "Attempting to sync node with API server" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.935421 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.935436 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.935445 2556 kubelet.go:398] "Adding apiserver pod source" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.935459 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.935784 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.935798 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.939571 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.941606 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.941635 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.942705 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.942722 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.942727 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.942732 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.942741 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.942747 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.942756 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.942761 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.942768 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.942774 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.942787 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.942793 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.943457 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.943469 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.946447 2556 server.go:1268] "Started kubelet" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.946520 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.946530 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.946630 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.947845 2556 server.go:310] "Adding debug handlers to kubelet server" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.948243 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:27.953335 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.953746 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.953751 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:27.953846 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-231.ec2.internal\" not found" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.954385 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.954692 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.955340 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.955014 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.955385 2556 factory.go:55] Registering systemd factory Jul 08 17:16:28.213591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.955408 2556 factory.go:223] Registration of the systemd container factory successfully Jul 08 17:16:28.214978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.956658 2556 factory.go:153] Registering CRI-O factory Jul 08 17:16:28.214978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.956683 2556 factory.go:223] Registration of the crio container factory successfully Jul 08 17:16:28.214978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.956717 2556 factory.go:103] Registering Raw factory Jul 08 17:16:28.214978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.956746 2556 manager.go:1196] Started watching for new ooms in manager Jul 08 17:16:28.214978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.956996 2556 reconstruct.go:97] "Volume reconstruction finished" Jul 08 17:16:28.214978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.957009 2556 reconciler.go:29] "Reconciler: start to sync state" Jul 08 17:16:28.214978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.957366 2556 manager.go:349] Starting recovery of all containers Jul 08 17:16:28.214978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.961588 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 17:16:28.214978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.967400 2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-231.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 17:16:28.214978 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:27.967610 2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-231.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 17:16:28.214978 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:27.967657 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 17:16:28.214978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.968511 2556 manager.go:354] Recovery completed Jul 08 17:16:28.214978 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:27.967902 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-231.ec2.internal.18c05ffbe672ac96 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-231.ec2.internal,UID:ip-10-0-133-231.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-231.ec2.internal,},FirstTimestamp:2026-07-08 17:16:27.946421398 +0000 UTC m=+0.357236764,LastTimestamp:2026-07-08 17:16:27.946421398 +0000 UTC m=+0.357236764,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-231.ec2.internal,}" Jul 08 17:16:28.214978 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:27.970129 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 17:16:28.214978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.972845 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:16:28.214978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.974836 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-231.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:16:28.214978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.974868 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-231.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:16:28.214978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.974879 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-231.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:16:28.214978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.975442 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 17:16:28.214978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.975451 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 17:16:28.214978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.975469 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 08 17:16:28.214978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.975492 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:16:28.214978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.976157 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-231.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:16:28.214978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.976185 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-231.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:16:28.214978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.976194 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-231.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:16:28.214978 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:27.976470 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-231.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 17:16:28.214978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.976816 2556 policy_none.go:49] "None policy: Start" Jul 08 17:16:28.214978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.976830 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 17:16:28.401943 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.976839 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 17:16:28.401943 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:27.977846 2556 policy_none.go:47] "Start" Jul 08 17:16:28.401943 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:28.005951 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-231.ec2.internal.18c05ffbe8247950 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-231.ec2.internal,UID:ip-10-0-133-231.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-231.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-231.ec2.internal,},FirstTimestamp:2026-07-08 17:16:27.974850896 +0000 UTC m=+0.385666264,LastTimestamp:2026-07-08 17:16:27.974850896 +0000 UTC m=+0.385666264,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-231.ec2.internal,}" Jul 08 17:16:28.401943 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:28.013172 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-231.ec2.internal.18c05ffbe824d014 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-231.ec2.internal,UID:ip-10-0-133-231.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-231.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-231.ec2.internal,},FirstTimestamp:2026-07-08 17:16:27.974873108 +0000 UTC m=+0.385688476,LastTimestamp:2026-07-08 17:16:27.974873108 +0000 UTC m=+0.385688476,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-231.ec2.internal,}" Jul 08 17:16:28.401943 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:28.035622 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-231.ec2.internal.18c05ffbe824f56b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-231.ec2.internal,UID:ip-10-0-133-231.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-231.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-231.ec2.internal,},FirstTimestamp:2026-07-08 17:16:27.974882667 +0000 UTC m=+0.385698034,LastTimestamp:2026-07-08 17:16:27.974882667 +0000 UTC m=+0.385698034,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-231.ec2.internal,}" Jul 08 17:16:28.401943 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.041528 2556 manager.go:337] "Starting Device Plugin manager" Jul 08 17:16:28.401943 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:28.041563 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 17:16:28.401943 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.041575 2556 server.go:87] "Starting device plugin registration server" Jul 08 17:16:28.401943 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.041831 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 17:16:28.401943 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.041842 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 17:16:28.401943 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.041942 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 17:16:28.401943 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.042019 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 17:16:28.401943 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.042027 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 17:16:28.401943 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:28.042574 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 17:16:28.401943 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:28.042620 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-231.ec2.internal\" not found" Jul 08 17:16:28.402745 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:28.058572 2556 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-231.ec2.internal.18c05ffbe8247950\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-231.ec2.internal.18c05ffbe8247950 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-231.ec2.internal,UID:ip-10-0-133-231.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-231.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-231.ec2.internal,},FirstTimestamp:2026-07-08 17:16:27.974850896 +0000 UTC m=+0.385666264,LastTimestamp:2026-07-08 17:16:27.97617145 +0000 UTC m=+0.386986818,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-231.ec2.internal,}" Jul 08 17:16:28.402745 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.068737 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g4ml9" Jul 08 17:16:28.402745 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:28.078485 2556 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-231.ec2.internal.18c05ffbe824d014\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-231.ec2.internal.18c05ffbe824d014 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-231.ec2.internal,UID:ip-10-0-133-231.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-231.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-231.ec2.internal,},FirstTimestamp:2026-07-08 17:16:27.974873108 +0000 UTC m=+0.385688476,LastTimestamp:2026-07-08 17:16:27.976189288 +0000 UTC m=+0.387004657,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-231.ec2.internal,}" Jul 08 17:16:28.402745 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:28.088960 2556 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-133-231.ec2.internal.18c05ffbe824f56b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-231.ec2.internal.18c05ffbe824f56b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-231.ec2.internal,UID:ip-10-0-133-231.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-231.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-231.ec2.internal,},FirstTimestamp:2026-07-08 17:16:27.974882667 +0000 UTC m=+0.385698034,LastTimestamp:2026-07-08 17:16:27.976197636 +0000 UTC m=+0.387013004,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-231.ec2.internal,}" Jul 08 17:16:28.402745 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.089183 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g4ml9" Jul 08 17:16:28.402745 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.103921 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 17:16:28.402745 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.105116 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 17:16:28.402745 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.105159 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 17:16:28.402745 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.105183 2556 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 17:16:28.402745 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:28.105223 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 17:16:28.402745 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.107387 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:16:28.402745 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.142597 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:16:28.402745 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.143621 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-231.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:16:28.402745 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.143651 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-231.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:16:28.402745 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.143666 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-231.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:16:28.402745 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.143689 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-231.ec2.internal" Jul 08 17:16:28.402745 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.157196 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-231.ec2.internal" Jul 08 17:16:28.403323 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:28.157213 2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-231.ec2.internal\": node \"ip-10-0-133-231.ec2.internal\" not found" Jul 08 17:16:28.403323 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:28.185842 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-231.ec2.internal\" not found" Jul 08 17:16:28.403323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.205492 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-231.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-231.ec2.internal"] Jul 08 17:16:28.403323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.205988 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:16:28.403323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.212813 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-231.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:16:28.403323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.212844 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-231.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:16:28.403323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.212854 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-231.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:16:28.403323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.214220 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:16:28.403323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.214351 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-231.ec2.internal" Jul 08 17:16:28.403323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.214380 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:16:28.403323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.215006 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-231.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:16:28.403323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.215037 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-231.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:16:28.403323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.215052 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-231.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:16:28.403323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.215057 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-231.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:16:28.403323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.215073 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-231.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:16:28.403323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.215082 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-231.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:16:28.403323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.216250 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-231.ec2.internal" Jul 08 17:16:28.403323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.216281 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:16:28.403323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.216900 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-231.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:16:28.403323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.216937 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-231.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:16:28.403323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.216947 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-231.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:16:28.403323 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:28.249617 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-231.ec2.internal\" not found" node="ip-10-0-133-231.ec2.internal" Jul 08 17:16:28.403323 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:28.253846 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-231.ec2.internal\" not found" node="ip-10-0-133-231.ec2.internal" Jul 08 17:16:28.403323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.261084 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e2575db7186b136a83984c343389bd0f-config\") pod \"kube-apiserver-proxy-ip-10-0-133-231.ec2.internal\" (UID: \"e2575db7186b136a83984c343389bd0f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-231.ec2.internal" Jul 08 17:16:28.403323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.261106 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1996761b2a6601656df9dd008e013ebd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-231.ec2.internal\" (UID: \"1996761b2a6601656df9dd008e013ebd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-231.ec2.internal" Jul 08 17:16:28.403323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.261124 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1996761b2a6601656df9dd008e013ebd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-231.ec2.internal\" (UID: \"1996761b2a6601656df9dd008e013ebd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-231.ec2.internal" Jul 08 17:16:28.404087 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:28.285929 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-231.ec2.internal\" not found" Jul 08 17:16:28.404087 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.361852 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1996761b2a6601656df9dd008e013ebd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-231.ec2.internal\" (UID: \"1996761b2a6601656df9dd008e013ebd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-231.ec2.internal" Jul 08 17:16:28.404087 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.361870 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1996761b2a6601656df9dd008e013ebd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-231.ec2.internal\" (UID: \"1996761b2a6601656df9dd008e013ebd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-231.ec2.internal" Jul 08 17:16:28.404087 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.361927 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1996761b2a6601656df9dd008e013ebd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-231.ec2.internal\" (UID: \"1996761b2a6601656df9dd008e013ebd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-231.ec2.internal" Jul 08 17:16:28.404087 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.361947 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e2575db7186b136a83984c343389bd0f-config\") pod \"kube-apiserver-proxy-ip-10-0-133-231.ec2.internal\" (UID: \"e2575db7186b136a83984c343389bd0f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-231.ec2.internal" Jul 08 17:16:28.404087 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.361980 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e2575db7186b136a83984c343389bd0f-config\") pod \"kube-apiserver-proxy-ip-10-0-133-231.ec2.internal\" (UID: \"e2575db7186b136a83984c343389bd0f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-231.ec2.internal" Jul 08 17:16:28.404087 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.362006 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1996761b2a6601656df9dd008e013ebd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-231.ec2.internal\" (UID: \"1996761b2a6601656df9dd008e013ebd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-231.ec2.internal" Jul 08 17:16:28.404087 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:28.386495 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-231.ec2.internal\" not found" Jul 08 17:16:28.558734 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:28.487026 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-231.ec2.internal\" not found" Jul 08 17:16:28.558734 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.553207 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-231.ec2.internal" Jul 08 17:16:28.558734 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.557549 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-231.ec2.internal" Jul 08 17:16:28.752803 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:28.588020 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-231.ec2.internal\" not found" Jul 08 17:16:28.752803 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:28.688645 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-231.ec2.internal\" not found" Jul 08 17:16:28.905689 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:28.789217 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-231.ec2.internal\" not found" Jul 08 17:16:28.905689 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:28.890218 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-231.ec2.internal\" not found" Jul 08 17:16:28.905689 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.894331 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 17:16:28.905689 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.894460 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 17:16:29.063579 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:28.934849 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:16:29.063579 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:28.990508 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-231.ec2.internal\" not found" Jul 08 17:16:29.218665 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:29.091087 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-231.ec2.internal\" not found" Jul 08 17:16:29.218665 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.091087 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 17:11:27 +0000 UTC" deadline="2028-03-01 10:22:57.009261279 +0000 UTC" Jul 08 17:16:29.218665 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.091113 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14441h6m27.918151332s" Jul 08 17:16:29.218665 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.114204 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:16:29.218665 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.115036 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-231.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:16:29.218665 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.115063 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-231.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:16:29.218665 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.115071 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-231.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:16:29.218665 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:29.192075 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-231.ec2.internal\" not found" Jul 08 17:16:29.377259 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:29.292486 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-231.ec2.internal\" not found" Jul 08 17:16:29.544824 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:29.379646 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1996761b2a6601656df9dd008e013ebd.slice/crio-8be74dde0c82ba716eb2b8988d11b4ad5a5284ca47b9070eecc99d692397a5ef WatchSource:0}: Error finding container 8be74dde0c82ba716eb2b8988d11b4ad5a5284ca47b9070eecc99d692397a5ef: Status 404 returned error can't find the container with id 8be74dde0c82ba716eb2b8988d11b4ad5a5284ca47b9070eecc99d692397a5ef Jul 08 17:16:29.544824 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:29.379823 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2575db7186b136a83984c343389bd0f.slice/crio-c05543e6f690196fff1e7cd8cc1b9ef42dfc7d02bfe66f21738d82e877d1638f WatchSource:0}: Error finding container c05543e6f690196fff1e7cd8cc1b9ef42dfc7d02bfe66f21738d82e877d1638f: Status 404 returned error can't find the container with id c05543e6f690196fff1e7cd8cc1b9ef42dfc7d02bfe66f21738d82e877d1638f Jul 08 17:16:29.544824 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.384895 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 17:16:29.544824 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:29.393466 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-231.ec2.internal\" not found" Jul 08 17:16:29.544824 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.409363 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:16:29.544824 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.454356 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-231.ec2.internal" Jul 08 17:16:29.544824 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.468717 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 17:16:29.544824 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.470374 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-231.ec2.internal" Jul 08 17:16:29.544824 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.478610 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 17:16:29.544824 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.494756 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.936208 2556 apiserver.go:52] "Watching apiserver" Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.954307 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.955363 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.955454 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-v55sp","kube-system/konnectivity-agent-x524h","kube-system/kube-apiserver-proxy-ip-10-0-133-231.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf","openshift-cluster-node-tuning-operator/tuned-5dlfg","openshift-dns/node-resolver-prs9n","openshift-image-registry/node-ca-cppc4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-231.ec2.internal","openshift-multus/multus-9sl22","openshift-multus/multus-additional-cni-plugins-h4mm8","openshift-multus/network-metrics-daemon-84tqr","openshift-network-diagnostics/network-check-target-8nfnf","openshift-network-operator/iptables-alerter-zm25k","openshift-ovn-kubernetes/ovnkube-node-cpkll"] Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.956729 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cppc4" Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.958145 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zm25k" Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.958953 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.958973 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.958974 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.959103 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dzkmk\"" Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.959491 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.961179 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.961432 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zwx7r\"" Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.961445 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.961539 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.962956 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.963201 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf" Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.963581 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.963672 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.963735 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.963675 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.964624 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-g7g8p\"" Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.965333 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.965555 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.966283 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.966553 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-prs9n" Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.967933 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9sl22" Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.968370 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 17:16:29.980258 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.969015 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 17:16:29.981501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.969033 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-z6zr8\"" Jul 08 17:16:29.981501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.969044 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 17:16:29.981501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.969080 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fbpzc\"" Jul 08 17:16:29.981501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.969018 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 17:16:29.981501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.969259 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 17:16:29.981501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.969290 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:16:29.981501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.969474 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dx27l\"" Jul 08 17:16:29.981501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.969484 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:29.981501 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:29.969552 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v55sp" podUID="6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1" Jul 08 17:16:29.981501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.970578 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x524h" Jul 08 17:16:29.981501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.972002 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h4mm8" Jul 08 17:16:29.981501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.972401 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 17:16:29.981501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.972429 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 17:16:29.981501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.972546 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 17:16:29.981501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.972650 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 17:16:29.981501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.972680 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-phxbx\"" Jul 08 17:16:29.981501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.973171 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:16:29.981501 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:29.973228 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84tqr" podUID="6408e7f4-87d3-48a2-943f-7971adbf51f8" Jul 08 17:16:29.981501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.974475 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:16:29.981501 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:29.974531 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nfnf" podUID="e421c9ea-1bf8-45cd-9ac8-8f798439ac68" Jul 08 17:16:29.981501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.976535 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 17:16:29.981501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.976695 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 17:16:29.981501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.976700 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 17:16:29.981501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.976832 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nhhw5\"" Jul 08 17:16:29.981501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.976904 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 17:16:29.981501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.976949 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-f84z5\"" Jul 08 17:16:29.981501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:29.977265 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 17:16:30.034635 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.018345 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x9rnd" Jul 08 17:16:30.034635 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.031596 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x9rnd" Jul 08 17:16:30.168501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.056230 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 17:16:30.168501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.072228 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c0dd73b-3891-4196-8e1c-be8560620dda-ovn-node-metrics-cert\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.168501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.072262 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-system-cni-dir\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.168501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.072288 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-host-run-netns\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.168501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.072310 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-etc-sysctl-d\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.168501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.072331 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-lib-modules\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.168501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.072353 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/beee831c-cfd3-4511-9a7c-e4ce7c3d87ab-cnibin\") pod \"multus-additional-cni-plugins-h4mm8\" (UID: \"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab\") " pod="openshift-multus/multus-additional-cni-plugins-h4mm8" Jul 08 17:16:30.168501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.072392 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-multus-cni-dir\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.168501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.072425 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-host-kubelet\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.168501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.072495 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-host-slash\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.168501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.072538 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-run-systemd\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.168501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.072562 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c0dd73b-3891-4196-8e1c-be8560620dda-ovnkube-script-lib\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.168501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.072586 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/beee831c-cfd3-4511-9a7c-e4ce7c3d87ab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h4mm8\" (UID: \"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab\") " pod="openshift-multus/multus-additional-cni-plugins-h4mm8" Jul 08 17:16:30.168501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.072609 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-dbus\") pod \"global-pull-secret-syncer-v55sp\" (UID: \"6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1\") " pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:30.169693 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.072640 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs\") pod \"network-metrics-daemon-84tqr\" (UID: \"6408e7f4-87d3-48a2-943f-7971adbf51f8\") " pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:16:30.169693 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.072700 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-host-run-netns\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.169693 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.072729 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-run-ovn\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.169693 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.072745 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-etc-systemd\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.169693 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.072786 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-run\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.169693 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.072817 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e1fcbba8-fae2-4f9a-8a18-80e3925c5623-iptables-alerter-script\") pod \"iptables-alerter-zm25k\" (UID: \"e1fcbba8-fae2-4f9a-8a18-80e3925c5623\") " pod="openshift-network-operator/iptables-alerter-zm25k" Jul 08 17:16:30.169693 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.072841 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/48804137-00f6-400f-8f9a-a3fcb48d3024-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q9njf\" (UID: \"48804137-00f6-400f-8f9a-a3fcb48d3024\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf" Jul 08 17:16:30.169693 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.072863 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/48804137-00f6-400f-8f9a-a3fcb48d3024-sys-fs\") pod \"aws-ebs-csi-driver-node-q9njf\" (UID: \"48804137-00f6-400f-8f9a-a3fcb48d3024\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf" Jul 08 17:16:30.169693 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.072884 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-os-release\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.169693 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.072924 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/beee831c-cfd3-4511-9a7c-e4ce7c3d87ab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h4mm8\" (UID: \"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab\") " pod="openshift-multus/multus-additional-cni-plugins-h4mm8" Jul 08 17:16:30.169693 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.072954 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjgw2\" (UniqueName: \"kubernetes.io/projected/beee831c-cfd3-4511-9a7c-e4ce7c3d87ab-kube-api-access-wjgw2\") pod \"multus-additional-cni-plugins-h4mm8\" (UID: \"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab\") " pod="openshift-multus/multus-additional-cni-plugins-h4mm8" Jul 08 17:16:30.169693 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.072984 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/48804137-00f6-400f-8f9a-a3fcb48d3024-socket-dir\") pod \"aws-ebs-csi-driver-node-q9njf\" (UID: \"48804137-00f6-400f-8f9a-a3fcb48d3024\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf" Jul 08 17:16:30.169693 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.073005 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-host-run-k8s-cni-cncf-io\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.172625 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.073022 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/101444d0-efcc-4185-9566-452b0a26d513-agent-certs\") pod \"konnectivity-agent-x524h\" (UID: \"101444d0-efcc-4185-9566-452b0a26d513\") " pod="kube-system/konnectivity-agent-x524h" Jul 08 17:16:30.172625 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.073037 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptj6g\" (UniqueName: \"kubernetes.io/projected/6408e7f4-87d3-48a2-943f-7971adbf51f8-kube-api-access-ptj6g\") pod \"network-metrics-daemon-84tqr\" (UID: \"6408e7f4-87d3-48a2-943f-7971adbf51f8\") " pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:16:30.172625 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.073055 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-etc-kubernetes\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.172625 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.073074 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-sys\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.172625 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.073094 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-host\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.172625 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.073108 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/beee831c-cfd3-4511-9a7c-e4ce7c3d87ab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h4mm8\" (UID: \"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab\") " pod="openshift-multus/multus-additional-cni-plugins-h4mm8" Jul 08 17:16:30.172625 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.073129 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6061ff5-caa6-4175-8354-20493d8d339d-tmp\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.172625 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.073144 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp4ll\" (UniqueName: \"kubernetes.io/projected/15835642-65cd-4a89-a1a1-1950d6130bd1-kube-api-access-wp4ll\") pod \"node-resolver-prs9n\" (UID: \"15835642-65cd-4a89-a1a1-1950d6130bd1\") " pod="openshift-dns/node-resolver-prs9n" Jul 08 17:16:30.172625 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.073163 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-hostroot\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.172625 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.073179 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-var-lib-openvswitch\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.172625 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.073199 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/beee831c-cfd3-4511-9a7c-e4ce7c3d87ab-system-cni-dir\") pod \"multus-additional-cni-plugins-h4mm8\" (UID: \"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab\") " pod="openshift-multus/multus-additional-cni-plugins-h4mm8" Jul 08 17:16:30.172625 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.073247 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/beee831c-cfd3-4511-9a7c-e4ce7c3d87ab-cni-binary-copy\") pod \"multus-additional-cni-plugins-h4mm8\" (UID: \"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab\") " pod="openshift-multus/multus-additional-cni-plugins-h4mm8" Jul 08 17:16:30.172625 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.086973 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvjrg\" (UniqueName: \"kubernetes.io/projected/8f7a5c3b-9cee-4f0c-b5d0-dbf3d4d4b7af-kube-api-access-kvjrg\") pod \"node-ca-cppc4\" (UID: \"8f7a5c3b-9cee-4f0c-b5d0-dbf3d4d4b7af\") " pod="openshift-image-registry/node-ca-cppc4" Jul 08 17:16:30.172625 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087000 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-multus-conf-dir\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.173591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087024 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-host-run-multus-certs\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.173591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087045 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-original-pull-secret\") pod \"global-pull-secret-syncer-v55sp\" (UID: \"6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1\") " pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:30.173591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087066 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-host-run-ovn-kubernetes\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.173591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087086 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/48804137-00f6-400f-8f9a-a3fcb48d3024-registration-dir\") pod \"aws-ebs-csi-driver-node-q9njf\" (UID: \"48804137-00f6-400f-8f9a-a3fcb48d3024\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf" Jul 08 17:16:30.173591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087106 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njh26\" (UniqueName: \"kubernetes.io/projected/48804137-00f6-400f-8f9a-a3fcb48d3024-kube-api-access-njh26\") pod \"aws-ebs-csi-driver-node-q9njf\" (UID: \"48804137-00f6-400f-8f9a-a3fcb48d3024\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf" Jul 08 17:16:30.173591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087126 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kkdv\" (UniqueName: \"kubernetes.io/projected/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-kube-api-access-2kkdv\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.173591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087149 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-host-cni-bin\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.173591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087169 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-host-cni-netd\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.173591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087190 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.173591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087212 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-etc-modprobe-d\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.173591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087235 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rsts\" (UniqueName: \"kubernetes.io/projected/e6061ff5-caa6-4175-8354-20493d8d339d-kube-api-access-4rsts\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.173591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087256 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/15835642-65cd-4a89-a1a1-1950d6130bd1-hosts-file\") pod \"node-resolver-prs9n\" (UID: \"15835642-65cd-4a89-a1a1-1950d6130bd1\") " pod="openshift-dns/node-resolver-prs9n" Jul 08 17:16:30.173591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087276 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/beee831c-cfd3-4511-9a7c-e4ce7c3d87ab-os-release\") pod \"multus-additional-cni-plugins-h4mm8\" (UID: \"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab\") " pod="openshift-multus/multus-additional-cni-plugins-h4mm8" Jul 08 17:16:30.174351 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087294 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-systemd-units\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.174351 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087309 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-run-openvswitch\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.174351 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087330 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-log-socket\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.174351 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087356 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-etc-sysconfig\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.174351 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087377 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-var-lib-kubelet\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.174351 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087414 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8f7a5c3b-9cee-4f0c-b5d0-dbf3d4d4b7af-serviceca\") pod \"node-ca-cppc4\" (UID: \"8f7a5c3b-9cee-4f0c-b5d0-dbf3d4d4b7af\") " pod="openshift-image-registry/node-ca-cppc4" Jul 08 17:16:30.174351 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087446 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-host-var-lib-cni-bin\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.174351 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087467 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-host-var-lib-kubelet\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.174351 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087491 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-cnibin\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.174351 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087514 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c0dd73b-3891-4196-8e1c-be8560620dda-env-overrides\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.174351 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087535 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r68lv\" (UniqueName: \"kubernetes.io/projected/0c0dd73b-3891-4196-8e1c-be8560620dda-kube-api-access-r68lv\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.174351 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087549 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e6061ff5-caa6-4175-8354-20493d8d339d-etc-tuned\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.174351 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087563 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15835642-65cd-4a89-a1a1-1950d6130bd1-tmp-dir\") pod \"node-resolver-prs9n\" (UID: \"15835642-65cd-4a89-a1a1-1950d6130bd1\") " pod="openshift-dns/node-resolver-prs9n" Jul 08 17:16:30.174351 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087575 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/48804137-00f6-400f-8f9a-a3fcb48d3024-etc-selinux\") pod \"aws-ebs-csi-driver-node-q9njf\" (UID: \"48804137-00f6-400f-8f9a-a3fcb48d3024\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf" Jul 08 17:16:30.175875 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087590 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-etc-kubernetes\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.175875 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087603 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/101444d0-efcc-4185-9566-452b0a26d513-konnectivity-ca\") pod \"konnectivity-agent-x524h\" (UID: \"101444d0-efcc-4185-9566-452b0a26d513\") " pod="kube-system/konnectivity-agent-x524h" Jul 08 17:16:30.175875 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087616 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-etc-sysctl-conf\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.175875 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087636 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzccg\" (UniqueName: \"kubernetes.io/projected/e421c9ea-1bf8-45cd-9ac8-8f798439ac68-kube-api-access-vzccg\") pod \"network-check-target-8nfnf\" (UID: \"e421c9ea-1bf8-45cd-9ac8-8f798439ac68\") " pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:16:30.175875 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087656 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f7a5c3b-9cee-4f0c-b5d0-dbf3d4d4b7af-host\") pod \"node-ca-cppc4\" (UID: \"8f7a5c3b-9cee-4f0c-b5d0-dbf3d4d4b7af\") " pod="openshift-image-registry/node-ca-cppc4" Jul 08 17:16:30.175875 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087676 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-cni-binary-copy\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.175875 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087722 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-host-var-lib-cni-multus\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.175875 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087764 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-kubelet-config\") pod \"global-pull-secret-syncer-v55sp\" (UID: \"6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1\") " pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:30.175875 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087791 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-node-log\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.175875 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087811 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c0dd73b-3891-4196-8e1c-be8560620dda-ovnkube-config\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.175875 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087843 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1fcbba8-fae2-4f9a-8a18-80e3925c5623-host-slash\") pod \"iptables-alerter-zm25k\" (UID: \"e1fcbba8-fae2-4f9a-8a18-80e3925c5623\") " pod="openshift-network-operator/iptables-alerter-zm25k" Jul 08 17:16:30.175875 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087872 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v5xg\" (UniqueName: \"kubernetes.io/projected/e1fcbba8-fae2-4f9a-8a18-80e3925c5623-kube-api-access-7v5xg\") pod \"iptables-alerter-zm25k\" (UID: \"e1fcbba8-fae2-4f9a-8a18-80e3925c5623\") " pod="openshift-network-operator/iptables-alerter-zm25k" Jul 08 17:16:30.175875 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087922 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/48804137-00f6-400f-8f9a-a3fcb48d3024-device-dir\") pod \"aws-ebs-csi-driver-node-q9njf\" (UID: \"48804137-00f6-400f-8f9a-a3fcb48d3024\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf" Jul 08 17:16:30.175875 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087959 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-multus-socket-dir-parent\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.176639 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.087982 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-multus-daemon-config\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.176639 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.088002 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-etc-openvswitch\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.176639 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.109479 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-231.ec2.internal" event={"ID":"1996761b2a6601656df9dd008e013ebd","Type":"ContainerStarted","Data":"8be74dde0c82ba716eb2b8988d11b4ad5a5284ca47b9070eecc99d692397a5ef"} Jul 08 17:16:30.176639 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.110543 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-231.ec2.internal" event={"ID":"e2575db7186b136a83984c343389bd0f","Type":"ContainerStarted","Data":"c05543e6f690196fff1e7cd8cc1b9ef42dfc7d02bfe66f21738d82e877d1638f"} Jul 08 17:16:30.228957 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.188232 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-host-kubelet\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.228957 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.188269 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-host-slash\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.228957 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.188291 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-run-systemd\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.228957 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.188314 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c0dd73b-3891-4196-8e1c-be8560620dda-ovnkube-script-lib\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.228957 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.188339 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/beee831c-cfd3-4511-9a7c-e4ce7c3d87ab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h4mm8\" (UID: \"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab\") " pod="openshift-multus/multus-additional-cni-plugins-h4mm8" Jul 08 17:16:30.228957 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.188365 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-dbus\") pod \"global-pull-secret-syncer-v55sp\" (UID: \"6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1\") " pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:30.228957 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.188386 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs\") pod \"network-metrics-daemon-84tqr\" (UID: \"6408e7f4-87d3-48a2-943f-7971adbf51f8\") " pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:16:30.228957 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.188410 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-host-run-netns\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.228957 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.188433 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-run-ovn\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.228957 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.188454 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-etc-systemd\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.228957 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.188474 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-run\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.228957 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.188494 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e1fcbba8-fae2-4f9a-8a18-80e3925c5623-iptables-alerter-script\") pod \"iptables-alerter-zm25k\" (UID: \"e1fcbba8-fae2-4f9a-8a18-80e3925c5623\") " pod="openshift-network-operator/iptables-alerter-zm25k" Jul 08 17:16:30.228957 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.188519 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/48804137-00f6-400f-8f9a-a3fcb48d3024-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q9njf\" (UID: \"48804137-00f6-400f-8f9a-a3fcb48d3024\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf" Jul 08 17:16:30.228957 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.188539 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/48804137-00f6-400f-8f9a-a3fcb48d3024-sys-fs\") pod \"aws-ebs-csi-driver-node-q9njf\" (UID: \"48804137-00f6-400f-8f9a-a3fcb48d3024\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf" Jul 08 17:16:30.235861 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.188559 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-os-release\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.235861 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.188595 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/beee831c-cfd3-4511-9a7c-e4ce7c3d87ab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h4mm8\" (UID: \"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab\") " pod="openshift-multus/multus-additional-cni-plugins-h4mm8" Jul 08 17:16:30.235861 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.188668 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/48804137-00f6-400f-8f9a-a3fcb48d3024-sys-fs\") pod \"aws-ebs-csi-driver-node-q9njf\" (UID: \"48804137-00f6-400f-8f9a-a3fcb48d3024\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf" Jul 08 17:16:30.235861 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:30.188693 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:16:30.235861 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.188725 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-run\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.235861 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.188734 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-os-release\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.235861 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:30.188782 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs podName:6408e7f4-87d3-48a2-943f-7971adbf51f8 nodeName:}" failed. No retries permitted until 2026-07-08 17:16:30.688747 +0000 UTC m=+3.099562359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs") pod "network-metrics-daemon-84tqr" (UID: "6408e7f4-87d3-48a2-943f-7971adbf51f8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:16:30.235861 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.188784 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-run-ovn\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.235861 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.188804 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjgw2\" (UniqueName: \"kubernetes.io/projected/beee831c-cfd3-4511-9a7c-e4ce7c3d87ab-kube-api-access-wjgw2\") pod \"multus-additional-cni-plugins-h4mm8\" (UID: \"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab\") " pod="openshift-multus/multus-additional-cni-plugins-h4mm8" Jul 08 17:16:30.235861 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.188833 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-etc-systemd\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.235861 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.188944 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/48804137-00f6-400f-8f9a-a3fcb48d3024-socket-dir\") pod \"aws-ebs-csi-driver-node-q9njf\" (UID: \"48804137-00f6-400f-8f9a-a3fcb48d3024\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf" Jul 08 17:16:30.235861 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.188993 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-dbus\") pod \"global-pull-secret-syncer-v55sp\" (UID: \"6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1\") " pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:30.235861 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189042 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/48804137-00f6-400f-8f9a-a3fcb48d3024-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q9njf\" (UID: \"48804137-00f6-400f-8f9a-a3fcb48d3024\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf" Jul 08 17:16:30.235861 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189208 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/beee831c-cfd3-4511-9a7c-e4ce7c3d87ab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h4mm8\" (UID: \"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab\") " pod="openshift-multus/multus-additional-cni-plugins-h4mm8" Jul 08 17:16:30.237538 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189247 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-host-slash\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.237538 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189272 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-host-kubelet\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.237538 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.188838 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/48804137-00f6-400f-8f9a-a3fcb48d3024-socket-dir\") pod \"aws-ebs-csi-driver-node-q9njf\" (UID: \"48804137-00f6-400f-8f9a-a3fcb48d3024\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf" Jul 08 17:16:30.237538 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189306 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-host-run-k8s-cni-cncf-io\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.237538 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189324 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/101444d0-efcc-4185-9566-452b0a26d513-agent-certs\") pod \"konnectivity-agent-x524h\" (UID: \"101444d0-efcc-4185-9566-452b0a26d513\") " pod="kube-system/konnectivity-agent-x524h" Jul 08 17:16:30.237538 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189338 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptj6g\" (UniqueName: \"kubernetes.io/projected/6408e7f4-87d3-48a2-943f-7971adbf51f8-kube-api-access-ptj6g\") pod \"network-metrics-daemon-84tqr\" (UID: \"6408e7f4-87d3-48a2-943f-7971adbf51f8\") " pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:16:30.237538 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189356 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-etc-kubernetes\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.237538 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189361 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c0dd73b-3891-4196-8e1c-be8560620dda-ovnkube-script-lib\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.237538 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189373 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-sys\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.237538 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189385 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-host\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.237538 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189400 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/beee831c-cfd3-4511-9a7c-e4ce7c3d87ab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h4mm8\" (UID: \"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab\") " pod="openshift-multus/multus-additional-cni-plugins-h4mm8" Jul 08 17:16:30.237538 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189412 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/beee831c-cfd3-4511-9a7c-e4ce7c3d87ab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h4mm8\" (UID: \"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab\") " pod="openshift-multus/multus-additional-cni-plugins-h4mm8" Jul 08 17:16:30.237538 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189430 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-host-run-netns\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.237538 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189452 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6061ff5-caa6-4175-8354-20493d8d339d-tmp\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.238545 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189461 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-run-systemd\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.238545 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189466 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-etc-kubernetes\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.238545 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189467 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp4ll\" (UniqueName: \"kubernetes.io/projected/15835642-65cd-4a89-a1a1-1950d6130bd1-kube-api-access-wp4ll\") pod \"node-resolver-prs9n\" (UID: \"15835642-65cd-4a89-a1a1-1950d6130bd1\") " pod="openshift-dns/node-resolver-prs9n" Jul 08 17:16:30.238545 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189480 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-host\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.238545 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189449 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e1fcbba8-fae2-4f9a-8a18-80e3925c5623-iptables-alerter-script\") pod \"iptables-alerter-zm25k\" (UID: \"e1fcbba8-fae2-4f9a-8a18-80e3925c5623\") " pod="openshift-network-operator/iptables-alerter-zm25k" Jul 08 17:16:30.238545 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189521 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-sys\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.238545 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189586 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-host-run-k8s-cni-cncf-io\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.238545 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189589 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-hostroot\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.238545 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189630 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-var-lib-openvswitch\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.238545 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189664 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/beee831c-cfd3-4511-9a7c-e4ce7c3d87ab-system-cni-dir\") pod \"multus-additional-cni-plugins-h4mm8\" (UID: \"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab\") " pod="openshift-multus/multus-additional-cni-plugins-h4mm8" Jul 08 17:16:30.238545 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189667 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-hostroot\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.238545 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189702 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/beee831c-cfd3-4511-9a7c-e4ce7c3d87ab-cni-binary-copy\") pod \"multus-additional-cni-plugins-h4mm8\" (UID: \"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab\") " pod="openshift-multus/multus-additional-cni-plugins-h4mm8" Jul 08 17:16:30.238545 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189721 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-var-lib-openvswitch\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.238545 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189733 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvjrg\" (UniqueName: \"kubernetes.io/projected/8f7a5c3b-9cee-4f0c-b5d0-dbf3d4d4b7af-kube-api-access-kvjrg\") pod \"node-ca-cppc4\" (UID: \"8f7a5c3b-9cee-4f0c-b5d0-dbf3d4d4b7af\") " pod="openshift-image-registry/node-ca-cppc4" Jul 08 17:16:30.238545 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189767 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-multus-conf-dir\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.241265 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189786 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/beee831c-cfd3-4511-9a7c-e4ce7c3d87ab-system-cni-dir\") pod \"multus-additional-cni-plugins-h4mm8\" (UID: \"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab\") " pod="openshift-multus/multus-additional-cni-plugins-h4mm8" Jul 08 17:16:30.241265 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189798 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-host-run-multus-certs\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.241265 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189828 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-original-pull-secret\") pod \"global-pull-secret-syncer-v55sp\" (UID: \"6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1\") " pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:30.241265 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189859 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-host-run-ovn-kubernetes\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.241265 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189873 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 17:16:30.241265 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189894 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/48804137-00f6-400f-8f9a-a3fcb48d3024-registration-dir\") pod \"aws-ebs-csi-driver-node-q9njf\" (UID: \"48804137-00f6-400f-8f9a-a3fcb48d3024\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf" Jul 08 17:16:30.241265 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189896 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/beee831c-cfd3-4511-9a7c-e4ce7c3d87ab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h4mm8\" (UID: \"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab\") " pod="openshift-multus/multus-additional-cni-plugins-h4mm8" Jul 08 17:16:30.241265 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189901 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-host-run-multus-certs\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.241265 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189939 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njh26\" (UniqueName: \"kubernetes.io/projected/48804137-00f6-400f-8f9a-a3fcb48d3024-kube-api-access-njh26\") pod \"aws-ebs-csi-driver-node-q9njf\" (UID: \"48804137-00f6-400f-8f9a-a3fcb48d3024\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf" Jul 08 17:16:30.241265 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189969 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kkdv\" (UniqueName: \"kubernetes.io/projected/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-kube-api-access-2kkdv\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.241265 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189998 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-host-run-ovn-kubernetes\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.241265 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:30.190004 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:16:30.241265 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:30.190044 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-original-pull-secret podName:6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1 nodeName:}" failed. No retries permitted until 2026-07-08 17:16:30.690029314 +0000 UTC m=+3.100844676 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-original-pull-secret") pod "global-pull-secret-syncer-v55sp" (UID: "6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:16:30.241265 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190002 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-host-cni-bin\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.242426 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190052 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/48804137-00f6-400f-8f9a-a3fcb48d3024-registration-dir\") pod \"aws-ebs-csi-driver-node-q9njf\" (UID: \"48804137-00f6-400f-8f9a-a3fcb48d3024\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf" Jul 08 17:16:30.242426 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190076 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-host-cni-netd\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.242426 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190092 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-host-cni-bin\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.242426 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190101 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.242426 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190124 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-etc-modprobe-d\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.242426 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190128 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-host-cni-netd\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.242426 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.189972 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-multus-conf-dir\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.242426 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190147 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rsts\" (UniqueName: \"kubernetes.io/projected/e6061ff5-caa6-4175-8354-20493d8d339d-kube-api-access-4rsts\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.242426 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190166 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/15835642-65cd-4a89-a1a1-1950d6130bd1-hosts-file\") pod \"node-resolver-prs9n\" (UID: \"15835642-65cd-4a89-a1a1-1950d6130bd1\") " pod="openshift-dns/node-resolver-prs9n" Jul 08 17:16:30.242426 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190167 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.242426 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190185 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/beee831c-cfd3-4511-9a7c-e4ce7c3d87ab-os-release\") pod \"multus-additional-cni-plugins-h4mm8\" (UID: \"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab\") " pod="openshift-multus/multus-additional-cni-plugins-h4mm8" Jul 08 17:16:30.242426 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190191 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/beee831c-cfd3-4511-9a7c-e4ce7c3d87ab-cni-binary-copy\") pod \"multus-additional-cni-plugins-h4mm8\" (UID: \"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab\") " pod="openshift-multus/multus-additional-cni-plugins-h4mm8" Jul 08 17:16:30.242426 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190208 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-systemd-units\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.242426 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190230 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/15835642-65cd-4a89-a1a1-1950d6130bd1-hosts-file\") pod \"node-resolver-prs9n\" (UID: \"15835642-65cd-4a89-a1a1-1950d6130bd1\") " pod="openshift-dns/node-resolver-prs9n" Jul 08 17:16:30.243554 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190238 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/beee831c-cfd3-4511-9a7c-e4ce7c3d87ab-os-release\") pod \"multus-additional-cni-plugins-h4mm8\" (UID: \"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab\") " pod="openshift-multus/multus-additional-cni-plugins-h4mm8" Jul 08 17:16:30.243554 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190229 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-run-openvswitch\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.243554 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190273 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-systemd-units\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.243554 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190290 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-run-openvswitch\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.243554 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190294 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-log-socket\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.243554 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190260 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-etc-modprobe-d\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.243554 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190323 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-log-socket\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.243554 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190317 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-etc-sysconfig\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.243554 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190355 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-var-lib-kubelet\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.243554 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190398 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-var-lib-kubelet\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.243554 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190407 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-etc-sysconfig\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.243554 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190420 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8f7a5c3b-9cee-4f0c-b5d0-dbf3d4d4b7af-serviceca\") pod \"node-ca-cppc4\" (UID: \"8f7a5c3b-9cee-4f0c-b5d0-dbf3d4d4b7af\") " pod="openshift-image-registry/node-ca-cppc4" Jul 08 17:16:30.243554 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190442 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-host-var-lib-cni-bin\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.243554 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190462 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-host-var-lib-kubelet\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.243554 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190481 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-cnibin\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.244344 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190500 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c0dd73b-3891-4196-8e1c-be8560620dda-env-overrides\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.244344 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190499 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-host-var-lib-cni-bin\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.244344 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190516 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-host-var-lib-kubelet\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.244344 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190518 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r68lv\" (UniqueName: \"kubernetes.io/projected/0c0dd73b-3891-4196-8e1c-be8560620dda-kube-api-access-r68lv\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.244344 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190565 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-cnibin\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.244344 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190567 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e6061ff5-caa6-4175-8354-20493d8d339d-etc-tuned\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.244344 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190593 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15835642-65cd-4a89-a1a1-1950d6130bd1-tmp-dir\") pod \"node-resolver-prs9n\" (UID: \"15835642-65cd-4a89-a1a1-1950d6130bd1\") " pod="openshift-dns/node-resolver-prs9n" Jul 08 17:16:30.244344 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190613 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/48804137-00f6-400f-8f9a-a3fcb48d3024-etc-selinux\") pod \"aws-ebs-csi-driver-node-q9njf\" (UID: \"48804137-00f6-400f-8f9a-a3fcb48d3024\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf" Jul 08 17:16:30.244344 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190636 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-etc-kubernetes\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.244344 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190658 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/101444d0-efcc-4185-9566-452b0a26d513-konnectivity-ca\") pod \"konnectivity-agent-x524h\" (UID: \"101444d0-efcc-4185-9566-452b0a26d513\") " pod="kube-system/konnectivity-agent-x524h" Jul 08 17:16:30.244344 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190702 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-etc-sysctl-conf\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.244344 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190726 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzccg\" (UniqueName: \"kubernetes.io/projected/e421c9ea-1bf8-45cd-9ac8-8f798439ac68-kube-api-access-vzccg\") pod \"network-check-target-8nfnf\" (UID: \"e421c9ea-1bf8-45cd-9ac8-8f798439ac68\") " pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:16:30.244344 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190748 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f7a5c3b-9cee-4f0c-b5d0-dbf3d4d4b7af-host\") pod \"node-ca-cppc4\" (UID: \"8f7a5c3b-9cee-4f0c-b5d0-dbf3d4d4b7af\") " pod="openshift-image-registry/node-ca-cppc4" Jul 08 17:16:30.244344 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190771 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-cni-binary-copy\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.244344 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190792 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-host-var-lib-cni-multus\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.245341 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190816 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-kubelet-config\") pod \"global-pull-secret-syncer-v55sp\" (UID: \"6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1\") " pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:30.245341 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190829 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8f7a5c3b-9cee-4f0c-b5d0-dbf3d4d4b7af-serviceca\") pod \"node-ca-cppc4\" (UID: \"8f7a5c3b-9cee-4f0c-b5d0-dbf3d4d4b7af\") " pod="openshift-image-registry/node-ca-cppc4" Jul 08 17:16:30.245341 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190838 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-node-log\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.245341 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190861 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c0dd73b-3891-4196-8e1c-be8560620dda-ovnkube-config\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.245341 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190890 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1fcbba8-fae2-4f9a-8a18-80e3925c5623-host-slash\") pod \"iptables-alerter-zm25k\" (UID: \"e1fcbba8-fae2-4f9a-8a18-80e3925c5623\") " pod="openshift-network-operator/iptables-alerter-zm25k" Jul 08 17:16:30.245341 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190934 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v5xg\" (UniqueName: \"kubernetes.io/projected/e1fcbba8-fae2-4f9a-8a18-80e3925c5623-kube-api-access-7v5xg\") pod \"iptables-alerter-zm25k\" (UID: \"e1fcbba8-fae2-4f9a-8a18-80e3925c5623\") " pod="openshift-network-operator/iptables-alerter-zm25k" Jul 08 17:16:30.245341 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190955 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15835642-65cd-4a89-a1a1-1950d6130bd1-tmp-dir\") pod \"node-resolver-prs9n\" (UID: \"15835642-65cd-4a89-a1a1-1950d6130bd1\") " pod="openshift-dns/node-resolver-prs9n" Jul 08 17:16:30.245341 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191000 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8f7a5c3b-9cee-4f0c-b5d0-dbf3d4d4b7af-host\") pod \"node-ca-cppc4\" (UID: \"8f7a5c3b-9cee-4f0c-b5d0-dbf3d4d4b7af\") " pod="openshift-image-registry/node-ca-cppc4" Jul 08 17:16:30.245341 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190957 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/48804137-00f6-400f-8f9a-a3fcb48d3024-device-dir\") pod \"aws-ebs-csi-driver-node-q9njf\" (UID: \"48804137-00f6-400f-8f9a-a3fcb48d3024\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf" Jul 08 17:16:30.245341 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191059 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-multus-socket-dir-parent\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.245341 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191080 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-multus-daemon-config\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.245341 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191100 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-etc-openvswitch\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.245341 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191104 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/48804137-00f6-400f-8f9a-a3fcb48d3024-etc-selinux\") pod \"aws-ebs-csi-driver-node-q9njf\" (UID: \"48804137-00f6-400f-8f9a-a3fcb48d3024\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf" Jul 08 17:16:30.245341 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191120 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c0dd73b-3891-4196-8e1c-be8560620dda-ovn-node-metrics-cert\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.245341 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191154 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/48804137-00f6-400f-8f9a-a3fcb48d3024-device-dir\") pod \"aws-ebs-csi-driver-node-q9njf\" (UID: \"48804137-00f6-400f-8f9a-a3fcb48d3024\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf" Jul 08 17:16:30.246700 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191189 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-etc-kubernetes\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.246700 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191228 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-system-cni-dir\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.246700 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191250 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-host-run-netns\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.246700 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191269 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-etc-sysctl-d\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.246700 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191290 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-lib-modules\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.246700 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191313 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/beee831c-cfd3-4511-9a7c-e4ce7c3d87ab-cnibin\") pod \"multus-additional-cni-plugins-h4mm8\" (UID: \"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab\") " pod="openshift-multus/multus-additional-cni-plugins-h4mm8" Jul 08 17:16:30.246700 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191332 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-multus-cni-dir\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.246700 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191415 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-multus-cni-dir\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.246700 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191458 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-multus-socket-dir-parent\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.246700 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191471 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-cni-binary-copy\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.246700 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191549 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-host-var-lib-cni-multus\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.246700 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191598 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-kubelet-config\") pod \"global-pull-secret-syncer-v55sp\" (UID: \"6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1\") " pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:30.246700 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191609 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/101444d0-efcc-4185-9566-452b0a26d513-konnectivity-ca\") pod \"konnectivity-agent-x524h\" (UID: \"101444d0-efcc-4185-9566-452b0a26d513\") " pod="kube-system/konnectivity-agent-x524h" Jul 08 17:16:30.246700 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191615 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-host-run-netns\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.246700 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191635 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-node-log\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.247257 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.190891 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c0dd73b-3891-4196-8e1c-be8560620dda-env-overrides\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.247257 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191709 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-system-cni-dir\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.247257 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191719 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-etc-sysctl-conf\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.247257 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191739 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c0dd73b-3891-4196-8e1c-be8560620dda-etc-openvswitch\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.247257 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191757 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-lib-modules\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.247257 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191812 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-multus-daemon-config\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.247257 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191926 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e6061ff5-caa6-4175-8354-20493d8d339d-etc-sysctl-d\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.247257 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191958 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1fcbba8-fae2-4f9a-8a18-80e3925c5623-host-slash\") pod \"iptables-alerter-zm25k\" (UID: \"e1fcbba8-fae2-4f9a-8a18-80e3925c5623\") " pod="openshift-network-operator/iptables-alerter-zm25k" Jul 08 17:16:30.247257 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.191958 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/beee831c-cfd3-4511-9a7c-e4ce7c3d87ab-cnibin\") pod \"multus-additional-cni-plugins-h4mm8\" (UID: \"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab\") " pod="openshift-multus/multus-additional-cni-plugins-h4mm8" Jul 08 17:16:30.247257 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.192176 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c0dd73b-3891-4196-8e1c-be8560620dda-ovnkube-config\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.247257 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.194116 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e6061ff5-caa6-4175-8354-20493d8d339d-etc-tuned\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.247257 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.194153 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6061ff5-caa6-4175-8354-20493d8d339d-tmp\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.247257 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.195319 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c0dd73b-3891-4196-8e1c-be8560620dda-ovn-node-metrics-cert\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.247257 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.195560 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/101444d0-efcc-4185-9566-452b0a26d513-agent-certs\") pod \"konnectivity-agent-x524h\" (UID: \"101444d0-efcc-4185-9566-452b0a26d513\") " pod="kube-system/konnectivity-agent-x524h" Jul 08 17:16:30.247257 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.211462 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptj6g\" (UniqueName: \"kubernetes.io/projected/6408e7f4-87d3-48a2-943f-7971adbf51f8-kube-api-access-ptj6g\") pod \"network-metrics-daemon-84tqr\" (UID: \"6408e7f4-87d3-48a2-943f-7971adbf51f8\") " pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:16:30.247691 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.211790 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjgw2\" (UniqueName: \"kubernetes.io/projected/beee831c-cfd3-4511-9a7c-e4ce7c3d87ab-kube-api-access-wjgw2\") pod \"multus-additional-cni-plugins-h4mm8\" (UID: \"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab\") " pod="openshift-multus/multus-additional-cni-plugins-h4mm8" Jul 08 17:16:30.247691 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:30.213752 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:16:30.247691 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:30.213775 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:16:30.247691 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:30.213788 2556 projected.go:196] Error preparing data for projected volume kube-api-access-vzccg for pod openshift-network-diagnostics/network-check-target-8nfnf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:16:30.247691 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:30.213842 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e421c9ea-1bf8-45cd-9ac8-8f798439ac68-kube-api-access-vzccg podName:e421c9ea-1bf8-45cd-9ac8-8f798439ac68 nodeName:}" failed. No retries permitted until 2026-07-08 17:16:30.713825915 +0000 UTC m=+3.124641282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vzccg" (UniqueName: "kubernetes.io/projected/e421c9ea-1bf8-45cd-9ac8-8f798439ac68-kube-api-access-vzccg") pod "network-check-target-8nfnf" (UID: "e421c9ea-1bf8-45cd-9ac8-8f798439ac68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:16:30.247691 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.214132 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp4ll\" (UniqueName: \"kubernetes.io/projected/15835642-65cd-4a89-a1a1-1950d6130bd1-kube-api-access-wp4ll\") pod \"node-resolver-prs9n\" (UID: \"15835642-65cd-4a89-a1a1-1950d6130bd1\") " pod="openshift-dns/node-resolver-prs9n" Jul 08 17:16:30.247691 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.214176 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvjrg\" (UniqueName: \"kubernetes.io/projected/8f7a5c3b-9cee-4f0c-b5d0-dbf3d4d4b7af-kube-api-access-kvjrg\") pod \"node-ca-cppc4\" (UID: \"8f7a5c3b-9cee-4f0c-b5d0-dbf3d4d4b7af\") " pod="openshift-image-registry/node-ca-cppc4" Jul 08 17:16:30.247691 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.216957 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kkdv\" (UniqueName: \"kubernetes.io/projected/b61baec6-f2dc-424c-99e3-b82a8ab1c73d-kube-api-access-2kkdv\") pod \"multus-9sl22\" (UID: \"b61baec6-f2dc-424c-99e3-b82a8ab1c73d\") " pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.247691 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.217020 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njh26\" (UniqueName: \"kubernetes.io/projected/48804137-00f6-400f-8f9a-a3fcb48d3024-kube-api-access-njh26\") pod \"aws-ebs-csi-driver-node-q9njf\" (UID: \"48804137-00f6-400f-8f9a-a3fcb48d3024\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf" Jul 08 17:16:30.247691 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.217418 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r68lv\" (UniqueName: \"kubernetes.io/projected/0c0dd73b-3891-4196-8e1c-be8560620dda-kube-api-access-r68lv\") pod \"ovnkube-node-cpkll\" (UID: \"0c0dd73b-3891-4196-8e1c-be8560620dda\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.247691 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.217841 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rsts\" (UniqueName: \"kubernetes.io/projected/e6061ff5-caa6-4175-8354-20493d8d339d-kube-api-access-4rsts\") pod \"tuned-5dlfg\" (UID: \"e6061ff5-caa6-4175-8354-20493d8d339d\") " pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.247691 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.218206 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v5xg\" (UniqueName: \"kubernetes.io/projected/e1fcbba8-fae2-4f9a-8a18-80e3925c5623-kube-api-access-7v5xg\") pod \"iptables-alerter-zm25k\" (UID: \"e1fcbba8-fae2-4f9a-8a18-80e3925c5623\") " pod="openshift-network-operator/iptables-alerter-zm25k" Jul 08 17:16:30.247691 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.240923 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:16:30.269835 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.269808 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cppc4" Jul 08 17:16:30.282012 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.281989 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zm25k" Jul 08 17:16:30.289436 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.289410 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:30.293387 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:30.293354 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f7a5c3b_9cee_4f0c_b5d0_dbf3d4d4b7af.slice/crio-7367179a9a1c0ab206df831b9525717a3b273b59cfe97f1d7ea4c0d44ace128f WatchSource:0}: Error finding container 7367179a9a1c0ab206df831b9525717a3b273b59cfe97f1d7ea4c0d44ace128f: Status 404 returned error can't find the container with id 7367179a9a1c0ab206df831b9525717a3b273b59cfe97f1d7ea4c0d44ace128f Jul 08 17:16:30.294561 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.294408 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf" Jul 08 17:16:30.304013 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.301647 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" Jul 08 17:16:30.309039 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.309022 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-prs9n" Jul 08 17:16:30.317799 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.317606 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9sl22" Jul 08 17:16:30.321462 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.321444 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x524h" Jul 08 17:16:30.327371 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.326806 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h4mm8" Jul 08 17:16:30.337368 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:30.337340 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1fcbba8_fae2_4f9a_8a18_80e3925c5623.slice/crio-5f6bae6650be2191ec8960cf59d1c393a46487d66b9e8243b12d3e950e85528a WatchSource:0}: Error finding container 5f6bae6650be2191ec8960cf59d1c393a46487d66b9e8243b12d3e950e85528a: Status 404 returned error can't find the container with id 5f6bae6650be2191ec8960cf59d1c393a46487d66b9e8243b12d3e950e85528a Jul 08 17:16:30.341229 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:30.341207 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48804137_00f6_400f_8f9a_a3fcb48d3024.slice/crio-0e721aea0b05587d9d148e28a51356a533252ea6f03244a6e815dc143d8d2b98 WatchSource:0}: Error finding container 0e721aea0b05587d9d148e28a51356a533252ea6f03244a6e815dc143d8d2b98: Status 404 returned error can't find the container with id 0e721aea0b05587d9d148e28a51356a533252ea6f03244a6e815dc143d8d2b98 Jul 08 17:16:30.345661 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:30.345638 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0dd73b_3891_4196_8e1c_be8560620dda.slice/crio-f2f8f5124426e19de47153ef184e4ff92b248c192928f5dd6d3457840d8f2b97 WatchSource:0}: Error finding container f2f8f5124426e19de47153ef184e4ff92b248c192928f5dd6d3457840d8f2b97: Status 404 returned error can't find the container with id f2f8f5124426e19de47153ef184e4ff92b248c192928f5dd6d3457840d8f2b97 Jul 08 17:16:30.347317 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:30.347288 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15835642_65cd_4a89_a1a1_1950d6130bd1.slice/crio-59b129c70c0a79b488da7ede49bf65e6c1c007b4bdab29da8da3fee91285b86f WatchSource:0}: Error finding container 59b129c70c0a79b488da7ede49bf65e6c1c007b4bdab29da8da3fee91285b86f: Status 404 returned error can't find the container with id 59b129c70c0a79b488da7ede49bf65e6c1c007b4bdab29da8da3fee91285b86f Jul 08 17:16:30.357372 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:30.357348 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb61baec6_f2dc_424c_99e3_b82a8ab1c73d.slice/crio-3c163e22e9504233afe71071fca1856f53d98e0c0e323bebad8689c574e029f3 WatchSource:0}: Error finding container 3c163e22e9504233afe71071fca1856f53d98e0c0e323bebad8689c574e029f3: Status 404 returned error can't find the container with id 3c163e22e9504233afe71071fca1856f53d98e0c0e323bebad8689c574e029f3 Jul 08 17:16:30.359090 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:30.359065 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeee831c_cfd3_4511_9a7c_e4ce7c3d87ab.slice/crio-5566818a6da86d6d5581a873fd1ee58e577c694fcc4c796e075f0f831fc648e6 WatchSource:0}: Error finding container 5566818a6da86d6d5581a873fd1ee58e577c694fcc4c796e075f0f831fc648e6: Status 404 returned error can't find the container with id 5566818a6da86d6d5581a873fd1ee58e577c694fcc4c796e075f0f831fc648e6 Jul 08 17:16:30.359509 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:16:30.359489 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod101444d0_efcc_4185_9566_452b0a26d513.slice/crio-604e170b494ebc12d21b6ad81b14754dfbf310c6bea5b4dfbd6c417fd73b88bd WatchSource:0}: Error finding container 604e170b494ebc12d21b6ad81b14754dfbf310c6bea5b4dfbd6c417fd73b88bd: Status 404 returned error can't find the container with id 604e170b494ebc12d21b6ad81b14754dfbf310c6bea5b4dfbd6c417fd73b88bd Jul 08 17:16:30.694412 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.694379 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs\") pod \"network-metrics-daemon-84tqr\" (UID: \"6408e7f4-87d3-48a2-943f-7971adbf51f8\") " pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:16:30.694578 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.694429 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-original-pull-secret\") pod \"global-pull-secret-syncer-v55sp\" (UID: \"6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1\") " pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:30.694578 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:30.694532 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:16:30.694578 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:30.694537 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:16:30.694749 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:30.694584 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-original-pull-secret podName:6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1 nodeName:}" failed. No retries permitted until 2026-07-08 17:16:31.694571898 +0000 UTC m=+4.105387252 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-original-pull-secret") pod "global-pull-secret-syncer-v55sp" (UID: "6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:16:30.694749 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:30.694599 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs podName:6408e7f4-87d3-48a2-943f-7971adbf51f8 nodeName:}" failed. No retries permitted until 2026-07-08 17:16:31.694591665 +0000 UTC m=+4.105407020 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs") pod "network-metrics-daemon-84tqr" (UID: "6408e7f4-87d3-48a2-943f-7971adbf51f8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:16:30.795591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:30.795549 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzccg\" (UniqueName: \"kubernetes.io/projected/e421c9ea-1bf8-45cd-9ac8-8f798439ac68-kube-api-access-vzccg\") pod \"network-check-target-8nfnf\" (UID: \"e421c9ea-1bf8-45cd-9ac8-8f798439ac68\") " pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:16:30.795742 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:30.795722 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:16:30.795809 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:30.795748 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:16:30.795809 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:30.795759 2556 projected.go:196] Error preparing data for projected volume kube-api-access-vzccg for pod openshift-network-diagnostics/network-check-target-8nfnf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:16:30.795891 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:30.795817 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e421c9ea-1bf8-45cd-9ac8-8f798439ac68-kube-api-access-vzccg podName:e421c9ea-1bf8-45cd-9ac8-8f798439ac68 nodeName:}" failed. No retries permitted until 2026-07-08 17:16:31.7957991 +0000 UTC m=+4.206614473 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vzccg" (UniqueName: "kubernetes.io/projected/e421c9ea-1bf8-45cd-9ac8-8f798439ac68-kube-api-access-vzccg") pod "network-check-target-8nfnf" (UID: "e421c9ea-1bf8-45cd-9ac8-8f798439ac68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:16:31.034142 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:31.033984 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 17:11:29 +0000 UTC" deadline="2028-02-07 03:48:22.548844748 +0000 UTC" Jul 08 17:16:31.034142 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:31.034044 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13882h31m51.514804509s" Jul 08 17:16:31.105859 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:31.105827 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:16:31.106027 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:31.105958 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84tqr" podUID="6408e7f4-87d3-48a2-943f-7971adbf51f8" Jul 08 17:16:31.106027 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:31.106012 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:31.106145 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:31.106122 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v55sp" podUID="6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1" Jul 08 17:16:31.112824 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:31.112801 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf" event={"ID":"48804137-00f6-400f-8f9a-a3fcb48d3024","Type":"ContainerStarted","Data":"0e721aea0b05587d9d148e28a51356a533252ea6f03244a6e815dc143d8d2b98"} Jul 08 17:16:31.113857 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:31.113836 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zm25k" event={"ID":"e1fcbba8-fae2-4f9a-8a18-80e3925c5623","Type":"ContainerStarted","Data":"5f6bae6650be2191ec8960cf59d1c393a46487d66b9e8243b12d3e950e85528a"} Jul 08 17:16:31.114777 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:31.114758 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x524h" event={"ID":"101444d0-efcc-4185-9566-452b0a26d513","Type":"ContainerStarted","Data":"604e170b494ebc12d21b6ad81b14754dfbf310c6bea5b4dfbd6c417fd73b88bd"} Jul 08 17:16:31.115739 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:31.115715 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h4mm8" event={"ID":"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab","Type":"ContainerStarted","Data":"5566818a6da86d6d5581a873fd1ee58e577c694fcc4c796e075f0f831fc648e6"} Jul 08 17:16:31.116683 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:31.116639 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-prs9n" event={"ID":"15835642-65cd-4a89-a1a1-1950d6130bd1","Type":"ContainerStarted","Data":"59b129c70c0a79b488da7ede49bf65e6c1c007b4bdab29da8da3fee91285b86f"} Jul 08 17:16:31.120691 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:31.120667 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cppc4" event={"ID":"8f7a5c3b-9cee-4f0c-b5d0-dbf3d4d4b7af","Type":"ContainerStarted","Data":"7367179a9a1c0ab206df831b9525717a3b273b59cfe97f1d7ea4c0d44ace128f"} Jul 08 17:16:31.122293 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:31.122270 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9sl22" event={"ID":"b61baec6-f2dc-424c-99e3-b82a8ab1c73d","Type":"ContainerStarted","Data":"3c163e22e9504233afe71071fca1856f53d98e0c0e323bebad8689c574e029f3"} Jul 08 17:16:31.123253 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:31.123233 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" event={"ID":"e6061ff5-caa6-4175-8354-20493d8d339d","Type":"ContainerStarted","Data":"d470128f30b799e16b175bcc2b76e2d78e40f607f4b5cba57f6fdd6d5f9bed74"} Jul 08 17:16:31.124107 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:31.124086 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" event={"ID":"0c0dd73b-3891-4196-8e1c-be8560620dda","Type":"ContainerStarted","Data":"f2f8f5124426e19de47153ef184e4ff92b248c192928f5dd6d3457840d8f2b97"} Jul 08 17:16:31.702853 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:31.702775 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-original-pull-secret\") pod \"global-pull-secret-syncer-v55sp\" (UID: \"6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1\") " pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:31.702853 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:31.702856 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs\") pod \"network-metrics-daemon-84tqr\" (UID: \"6408e7f4-87d3-48a2-943f-7971adbf51f8\") " pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:16:31.703611 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:31.702991 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:16:31.703611 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:31.703051 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs podName:6408e7f4-87d3-48a2-943f-7971adbf51f8 nodeName:}" failed. No retries permitted until 2026-07-08 17:16:33.703033324 +0000 UTC m=+6.113848680 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs") pod "network-metrics-daemon-84tqr" (UID: "6408e7f4-87d3-48a2-943f-7971adbf51f8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:16:31.703611 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:31.703420 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:16:31.703611 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:31.703469 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-original-pull-secret podName:6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1 nodeName:}" failed. No retries permitted until 2026-07-08 17:16:33.70345367 +0000 UTC m=+6.114269035 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-original-pull-secret") pod "global-pull-secret-syncer-v55sp" (UID: "6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:16:31.804889 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:31.804271 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzccg\" (UniqueName: \"kubernetes.io/projected/e421c9ea-1bf8-45cd-9ac8-8f798439ac68-kube-api-access-vzccg\") pod \"network-check-target-8nfnf\" (UID: \"e421c9ea-1bf8-45cd-9ac8-8f798439ac68\") " pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:16:31.804889 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:31.804434 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:16:31.804889 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:31.804454 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:16:31.804889 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:31.804467 2556 projected.go:196] Error preparing data for projected volume kube-api-access-vzccg for pod openshift-network-diagnostics/network-check-target-8nfnf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:16:31.804889 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:31.804526 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e421c9ea-1bf8-45cd-9ac8-8f798439ac68-kube-api-access-vzccg podName:e421c9ea-1bf8-45cd-9ac8-8f798439ac68 nodeName:}" failed. No retries permitted until 2026-07-08 17:16:33.804507 +0000 UTC m=+6.215322356 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vzccg" (UniqueName: "kubernetes.io/projected/e421c9ea-1bf8-45cd-9ac8-8f798439ac68-kube-api-access-vzccg") pod "network-check-target-8nfnf" (UID: "e421c9ea-1bf8-45cd-9ac8-8f798439ac68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:16:32.034869 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:32.034746 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 17:11:29 +0000 UTC" deadline="2028-01-21 17:24:24.658448715 +0000 UTC" Jul 08 17:16:32.034869 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:32.034787 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13488h7m52.623666571s" Jul 08 17:16:32.108965 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:32.108433 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:16:32.108965 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:32.108572 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nfnf" podUID="e421c9ea-1bf8-45cd-9ac8-8f798439ac68" Jul 08 17:16:32.149012 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:32.148964 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-231.ec2.internal" event={"ID":"e2575db7186b136a83984c343389bd0f","Type":"ContainerStarted","Data":"44e3bcb8d02049a76bea1e72e9a8ee91509aa1737fc3620b8dcbbbc0a82997eb"} Jul 08 17:16:33.105621 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:33.105366 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:33.106167 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:33.105749 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v55sp" podUID="6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1" Jul 08 17:16:33.107514 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:33.105899 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:16:33.107667 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:33.107644 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84tqr" podUID="6408e7f4-87d3-48a2-943f-7971adbf51f8" Jul 08 17:16:33.725481 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:33.725447 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs\") pod \"network-metrics-daemon-84tqr\" (UID: \"6408e7f4-87d3-48a2-943f-7971adbf51f8\") " pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:16:33.725651 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:33.725505 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-original-pull-secret\") pod \"global-pull-secret-syncer-v55sp\" (UID: \"6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1\") " pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:33.725651 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:33.725628 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:16:33.725780 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:33.725685 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-original-pull-secret podName:6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1 nodeName:}" failed. No retries permitted until 2026-07-08 17:16:37.725667379 +0000 UTC m=+10.136482740 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-original-pull-secret") pod "global-pull-secret-syncer-v55sp" (UID: "6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:16:33.726122 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:33.726033 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:16:33.726122 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:33.726103 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs podName:6408e7f4-87d3-48a2-943f-7971adbf51f8 nodeName:}" failed. No retries permitted until 2026-07-08 17:16:37.726084949 +0000 UTC m=+10.136900307 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs") pod "network-metrics-daemon-84tqr" (UID: "6408e7f4-87d3-48a2-943f-7971adbf51f8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:16:33.826533 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:33.826452 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzccg\" (UniqueName: \"kubernetes.io/projected/e421c9ea-1bf8-45cd-9ac8-8f798439ac68-kube-api-access-vzccg\") pod \"network-check-target-8nfnf\" (UID: \"e421c9ea-1bf8-45cd-9ac8-8f798439ac68\") " pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:16:33.826754 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:33.826735 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:16:33.826833 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:33.826760 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:16:33.826833 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:33.826772 2556 projected.go:196] Error preparing data for projected volume kube-api-access-vzccg for pod openshift-network-diagnostics/network-check-target-8nfnf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:16:33.826833 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:33.826829 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e421c9ea-1bf8-45cd-9ac8-8f798439ac68-kube-api-access-vzccg podName:e421c9ea-1bf8-45cd-9ac8-8f798439ac68 nodeName:}" failed. No retries permitted until 2026-07-08 17:16:37.826811072 +0000 UTC m=+10.237626441 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vzccg" (UniqueName: "kubernetes.io/projected/e421c9ea-1bf8-45cd-9ac8-8f798439ac68-kube-api-access-vzccg") pod "network-check-target-8nfnf" (UID: "e421c9ea-1bf8-45cd-9ac8-8f798439ac68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:16:34.105578 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:34.105449 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:16:34.105742 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:34.105626 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nfnf" podUID="e421c9ea-1bf8-45cd-9ac8-8f798439ac68" Jul 08 17:16:34.162448 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:34.161819 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-231.ec2.internal" event={"ID":"1996761b2a6601656df9dd008e013ebd","Type":"ContainerStarted","Data":"c7e10d583eb1cb7efa5cde0d1339367ef58fb42680f8d494a122c73aa50dd358"} Jul 08 17:16:34.186050 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:34.185690 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-231.ec2.internal" podStartSLOduration=5.18566723 podStartE2EDuration="5.18566723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:16:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:16:32.173322837 +0000 UTC m=+4.584138216" watchObservedRunningTime="2026-07-08 17:16:34.18566723 +0000 UTC m=+6.596482608" Jul 08 17:16:35.106228 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:35.105619 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:16:35.106228 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:35.105783 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84tqr" podUID="6408e7f4-87d3-48a2-943f-7971adbf51f8" Jul 08 17:16:35.106228 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:35.106205 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:35.106769 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:35.106305 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v55sp" podUID="6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1" Jul 08 17:16:36.108628 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:36.108096 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:16:36.108628 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:36.108225 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nfnf" podUID="e421c9ea-1bf8-45cd-9ac8-8f798439ac68" Jul 08 17:16:36.168942 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:36.168073 2556 generic.go:356] "Generic (PLEG): container finished" podID="1996761b2a6601656df9dd008e013ebd" containerID="c7e10d583eb1cb7efa5cde0d1339367ef58fb42680f8d494a122c73aa50dd358" exitCode=0 Jul 08 17:16:36.168942 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:36.168132 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-231.ec2.internal" event={"ID":"1996761b2a6601656df9dd008e013ebd","Type":"ContainerDied","Data":"c7e10d583eb1cb7efa5cde0d1339367ef58fb42680f8d494a122c73aa50dd358"} Jul 08 17:16:37.107039 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:37.106381 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:37.107039 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:37.106505 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v55sp" podUID="6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1" Jul 08 17:16:37.107039 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:37.106879 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:16:37.107039 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:37.107005 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84tqr" podUID="6408e7f4-87d3-48a2-943f-7971adbf51f8" Jul 08 17:16:37.763317 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:37.762986 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs\") pod \"network-metrics-daemon-84tqr\" (UID: \"6408e7f4-87d3-48a2-943f-7971adbf51f8\") " pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:16:37.763317 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:37.763050 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-original-pull-secret\") pod \"global-pull-secret-syncer-v55sp\" (UID: \"6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1\") " pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:37.763317 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:37.763120 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:16:37.763317 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:37.763134 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:16:37.763317 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:37.763185 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs podName:6408e7f4-87d3-48a2-943f-7971adbf51f8 nodeName:}" failed. No retries permitted until 2026-07-08 17:16:45.763165787 +0000 UTC m=+18.173981145 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs") pod "network-metrics-daemon-84tqr" (UID: "6408e7f4-87d3-48a2-943f-7971adbf51f8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:16:37.763317 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:37.763201 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-original-pull-secret podName:6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1 nodeName:}" failed. No retries permitted until 2026-07-08 17:16:45.763193497 +0000 UTC m=+18.174008853 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-original-pull-secret") pod "global-pull-secret-syncer-v55sp" (UID: "6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:16:37.863928 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:37.863881 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzccg\" (UniqueName: \"kubernetes.io/projected/e421c9ea-1bf8-45cd-9ac8-8f798439ac68-kube-api-access-vzccg\") pod \"network-check-target-8nfnf\" (UID: \"e421c9ea-1bf8-45cd-9ac8-8f798439ac68\") " pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:16:37.864090 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:37.864048 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:16:37.864090 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:37.864070 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:16:37.864090 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:37.864080 2556 projected.go:196] Error preparing data for projected volume kube-api-access-vzccg for pod openshift-network-diagnostics/network-check-target-8nfnf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:16:37.864200 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:37.864128 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e421c9ea-1bf8-45cd-9ac8-8f798439ac68-kube-api-access-vzccg podName:e421c9ea-1bf8-45cd-9ac8-8f798439ac68 nodeName:}" failed. No retries permitted until 2026-07-08 17:16:45.864115958 +0000 UTC m=+18.274931313 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vzccg" (UniqueName: "kubernetes.io/projected/e421c9ea-1bf8-45cd-9ac8-8f798439ac68-kube-api-access-vzccg") pod "network-check-target-8nfnf" (UID: "e421c9ea-1bf8-45cd-9ac8-8f798439ac68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:16:38.107071 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:38.106597 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:16:38.107071 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:38.106692 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nfnf" podUID="e421c9ea-1bf8-45cd-9ac8-8f798439ac68" Jul 08 17:16:39.106381 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:39.106302 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:16:39.106829 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:39.106461 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84tqr" podUID="6408e7f4-87d3-48a2-943f-7971adbf51f8" Jul 08 17:16:39.106829 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:39.106588 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:39.106829 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:39.106705 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v55sp" podUID="6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1" Jul 08 17:16:40.106156 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:40.106129 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:16:40.106348 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:40.106223 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nfnf" podUID="e421c9ea-1bf8-45cd-9ac8-8f798439ac68" Jul 08 17:16:41.105398 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:41.105367 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:41.105799 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:41.105367 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:16:41.105799 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:41.105483 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v55sp" podUID="6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1" Jul 08 17:16:41.105799 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:41.105588 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84tqr" podUID="6408e7f4-87d3-48a2-943f-7971adbf51f8" Jul 08 17:16:42.106163 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:42.106122 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:16:42.106610 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:42.106257 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nfnf" podUID="e421c9ea-1bf8-45cd-9ac8-8f798439ac68" Jul 08 17:16:43.106265 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:43.106227 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:16:43.106709 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:43.106385 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84tqr" podUID="6408e7f4-87d3-48a2-943f-7971adbf51f8" Jul 08 17:16:43.106709 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:43.106393 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:43.106709 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:43.106506 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v55sp" podUID="6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1" Jul 08 17:16:44.105482 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:44.105454 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:16:44.105649 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:44.105568 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nfnf" podUID="e421c9ea-1bf8-45cd-9ac8-8f798439ac68" Jul 08 17:16:45.106406 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:45.106367 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:16:45.106963 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:45.106383 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:45.106963 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:45.106551 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84tqr" podUID="6408e7f4-87d3-48a2-943f-7971adbf51f8" Jul 08 17:16:45.106963 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:45.106713 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v55sp" podUID="6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1" Jul 08 17:16:45.823920 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:45.823882 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs\") pod \"network-metrics-daemon-84tqr\" (UID: \"6408e7f4-87d3-48a2-943f-7971adbf51f8\") " pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:16:45.824085 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:45.824037 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-original-pull-secret\") pod \"global-pull-secret-syncer-v55sp\" (UID: \"6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1\") " pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:45.824085 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:45.824055 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:16:45.824205 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:45.824132 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs podName:6408e7f4-87d3-48a2-943f-7971adbf51f8 nodeName:}" failed. No retries permitted until 2026-07-08 17:17:01.824111586 +0000 UTC m=+34.234926947 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs") pod "network-metrics-daemon-84tqr" (UID: "6408e7f4-87d3-48a2-943f-7971adbf51f8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:16:45.824205 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:45.824134 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:16:45.824205 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:45.824179 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-original-pull-secret podName:6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1 nodeName:}" failed. No retries permitted until 2026-07-08 17:17:01.824163212 +0000 UTC m=+34.234978567 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-original-pull-secret") pod "global-pull-secret-syncer-v55sp" (UID: "6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:16:45.925128 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:45.925097 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzccg\" (UniqueName: \"kubernetes.io/projected/e421c9ea-1bf8-45cd-9ac8-8f798439ac68-kube-api-access-vzccg\") pod \"network-check-target-8nfnf\" (UID: \"e421c9ea-1bf8-45cd-9ac8-8f798439ac68\") " pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:16:45.925274 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:45.925224 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:16:45.925274 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:45.925238 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:16:45.925274 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:45.925249 2556 projected.go:196] Error preparing data for projected volume kube-api-access-vzccg for pod openshift-network-diagnostics/network-check-target-8nfnf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:16:45.925397 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:45.925306 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e421c9ea-1bf8-45cd-9ac8-8f798439ac68-kube-api-access-vzccg podName:e421c9ea-1bf8-45cd-9ac8-8f798439ac68 nodeName:}" failed. No retries permitted until 2026-07-08 17:17:01.925292705 +0000 UTC m=+34.336108060 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vzccg" (UniqueName: "kubernetes.io/projected/e421c9ea-1bf8-45cd-9ac8-8f798439ac68-kube-api-access-vzccg") pod "network-check-target-8nfnf" (UID: "e421c9ea-1bf8-45cd-9ac8-8f798439ac68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:16:46.106248 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:46.106167 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:16:46.106421 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:46.106300 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nfnf" podUID="e421c9ea-1bf8-45cd-9ac8-8f798439ac68" Jul 08 17:16:47.106012 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:47.105978 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:16:47.106434 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:47.105985 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:47.106434 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:47.106108 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84tqr" podUID="6408e7f4-87d3-48a2-943f-7971adbf51f8" Jul 08 17:16:47.106434 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:47.106191 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v55sp" podUID="6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1" Jul 08 17:16:48.109573 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:48.108530 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:16:48.109573 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:48.108685 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nfnf" podUID="e421c9ea-1bf8-45cd-9ac8-8f798439ac68" Jul 08 17:16:49.106109 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:49.106072 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:16:49.106274 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:49.106072 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:49.106274 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:49.106195 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84tqr" podUID="6408e7f4-87d3-48a2-943f-7971adbf51f8" Jul 08 17:16:49.106274 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:49.106239 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v55sp" podUID="6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1" Jul 08 17:16:50.105954 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:50.105760 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:16:50.106722 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:50.106030 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nfnf" podUID="e421c9ea-1bf8-45cd-9ac8-8f798439ac68" Jul 08 17:16:50.196077 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:50.195832 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cppc4" event={"ID":"8f7a5c3b-9cee-4f0c-b5d0-dbf3d4d4b7af","Type":"ContainerStarted","Data":"3a53cef1c177ad41da8ca7553241d54a6b1db6935d63f7e2b51b21ea15fb3baa"} Jul 08 17:16:50.197254 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:50.197233 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9sl22" event={"ID":"b61baec6-f2dc-424c-99e3-b82a8ab1c73d","Type":"ContainerStarted","Data":"197116855d1d209e8f5e724d1952fccd08cb6af61b5d5a4436941b9e0a00faf2"} Jul 08 17:16:50.198772 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:50.198751 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" event={"ID":"e6061ff5-caa6-4175-8354-20493d8d339d","Type":"ContainerStarted","Data":"cdbb5822c81e4fcad9eb25dae2fe438da847c832619760327a5f516766e874d8"} Jul 08 17:16:50.200577 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:50.200554 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" event={"ID":"0c0dd73b-3891-4196-8e1c-be8560620dda","Type":"ContainerStarted","Data":"82fb42a6c24fb2b7f4ffa19113d3d1a6b590035d395ba83f59fbf51d796cbba8"} Jul 08 17:16:50.200679 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:50.200633 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" event={"ID":"0c0dd73b-3891-4196-8e1c-be8560620dda","Type":"ContainerStarted","Data":"0b44e7a268ab5c9261474e53f71b950098226158318cc32c30c1b8329f092044"} Jul 08 17:16:50.201947 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:50.201930 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf" event={"ID":"48804137-00f6-400f-8f9a-a3fcb48d3024","Type":"ContainerStarted","Data":"5a8d61651f550811859799fefcc1e6ea0a9cbb1b122c302a8badfc6f057ffb12"} Jul 08 17:16:50.203649 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:50.203628 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-231.ec2.internal" event={"ID":"1996761b2a6601656df9dd008e013ebd","Type":"ContainerStarted","Data":"a95d3696a895a5c63b91cb36339f1837f5bf8e360a6239317fd6193c2f50060e"} Jul 08 17:16:50.205091 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:50.205072 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x524h" event={"ID":"101444d0-efcc-4185-9566-452b0a26d513","Type":"ContainerStarted","Data":"893dd48b7daed386219ffa6ac0226cb2d5b424b25ac5f5b1374b8de291e3f8c7"} Jul 08 17:16:50.206525 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:50.206499 2556 generic.go:356] "Generic (PLEG): container finished" podID="beee831c-cfd3-4511-9a7c-e4ce7c3d87ab" containerID="65b70a63ccaf598712b05298fea4ced157f8783e6fc39b522b21bbe66dd743ca" exitCode=0 Jul 08 17:16:50.206621 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:50.206567 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h4mm8" event={"ID":"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab","Type":"ContainerDied","Data":"65b70a63ccaf598712b05298fea4ced157f8783e6fc39b522b21bbe66dd743ca"} Jul 08 17:16:50.207943 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:50.207841 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-prs9n" event={"ID":"15835642-65cd-4a89-a1a1-1950d6130bd1","Type":"ContainerStarted","Data":"5b17aa2249d17116fe48afb984109bdcd92a5e98ea72da9f5afe920bcf1515ca"} Jul 08 17:16:50.260044 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:50.259998 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cppc4" podStartSLOduration=2.853170891 podStartE2EDuration="22.259981514s" totalImagesPullingTime="19.406810623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:16:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:16:50.227801666 +0000 UTC m=+22.638617055" watchObservedRunningTime="2026-07-08 17:16:50.259981514 +0000 UTC m=+22.670796890" Jul 08 17:16:50.260161 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:50.260108 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9sl22" podStartSLOduration=2.848729653 podStartE2EDuration="22.260100974s" totalImagesPullingTime="19.411371321s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:16:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:16:50.259157311 +0000 UTC m=+22.669972687" watchObservedRunningTime="2026-07-08 17:16:50.260100974 +0000 UTC m=+22.670916351" Jul 08 17:16:50.298638 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:50.298598 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5dlfg" podStartSLOduration=2.947267811 podStartE2EDuration="22.29858299s" totalImagesPullingTime="19.351315179s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:16:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:16:50.298464003 +0000 UTC m=+22.709279379" watchObservedRunningTime="2026-07-08 17:16:50.29858299 +0000 UTC m=+22.709398367" Jul 08 17:16:50.338112 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:50.338069 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-231.ec2.internal" podStartSLOduration=21.338052664 podStartE2EDuration="21.338052664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:16:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:16:50.337706968 +0000 UTC m=+22.748522345" watchObservedRunningTime="2026-07-08 17:16:50.338052664 +0000 UTC m=+22.748868040" Jul 08 17:16:50.435927 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:50.435860 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-x524h" podStartSLOduration=7.092509991 podStartE2EDuration="22.435842281s" totalImagesPullingTime="15.34333229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:16:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:16:50.434457887 +0000 UTC m=+22.845273264" watchObservedRunningTime="2026-07-08 17:16:50.435842281 +0000 UTC m=+22.846657658" Jul 08 17:16:50.436180 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:50.436152 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-prs9n" podStartSLOduration=7.080207088 podStartE2EDuration="22.436144295s" totalImagesPullingTime="15.355937207s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:16:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:16:50.386897621 +0000 UTC m=+22.797712997" watchObservedRunningTime="2026-07-08 17:16:50.436144295 +0000 UTC m=+22.846959671" Jul 08 17:16:51.092865 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:51.092834 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 17:16:51.105435 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:51.105416 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:16:51.105531 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:51.105514 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84tqr" podUID="6408e7f4-87d3-48a2-943f-7971adbf51f8" Jul 08 17:16:51.105574 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:51.105545 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:51.105606 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:51.105596 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v55sp" podUID="6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1" Jul 08 17:16:51.213417 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:51.213382 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" event={"ID":"0c0dd73b-3891-4196-8e1c-be8560620dda","Type":"ContainerStarted","Data":"f19d08f749332f322505f86e0ff40d9cc68b5c22745caed5849036231438350a"} Jul 08 17:16:51.213905 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:51.213467 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" event={"ID":"0c0dd73b-3891-4196-8e1c-be8560620dda","Type":"ContainerStarted","Data":"67300f31b0711a4c823f53bbf89e5265d11d0f212751fa4b81680128a585582d"} Jul 08 17:16:51.213905 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:51.213520 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" event={"ID":"0c0dd73b-3891-4196-8e1c-be8560620dda","Type":"ContainerStarted","Data":"f9a85e3066a20d5e4cf0a449d0257fdbf0b9c8501d8b09d8298fe91bf17f1b9a"} Jul 08 17:16:51.213905 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:51.213566 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" event={"ID":"0c0dd73b-3891-4196-8e1c-be8560620dda","Type":"ContainerStarted","Data":"137af03bcc02b53c414a039294b9c4d0534c6d564cc7921c13cf177cd84db95d"} Jul 08 17:16:51.215083 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:51.215064 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf" event={"ID":"48804137-00f6-400f-8f9a-a3fcb48d3024","Type":"ContainerStarted","Data":"459a250154486f3b1cbfae4d44c8938b6c47f6463b51848ba6a0f8de092f38f2"} Jul 08 17:16:51.216436 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:51.216408 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zm25k" event={"ID":"e1fcbba8-fae2-4f9a-8a18-80e3925c5623","Type":"ContainerStarted","Data":"ec9998421c2777a3491c0fbb89194a36cd89a7a1344a16bb2f5a7d775f8a5b23"} Jul 08 17:16:51.251490 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:51.251441 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zm25k" podStartSLOduration=3.887690896 podStartE2EDuration="23.251428567s" totalImagesPullingTime="19.363737671s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:16:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:16:51.251018369 +0000 UTC m=+23.661833748" watchObservedRunningTime="2026-07-08 17:16:51.251428567 +0000 UTC m=+23.662243944" Jul 08 17:16:52.053646 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:52.053531 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T17:16:51.092859221Z","UUID":"54c8322a-84cb-4753-a7d2-0e586c150286","Handler":null,"Name":"","Endpoint":""} Jul 08 17:16:52.055227 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:52.055207 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 17:16:52.055362 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:52.055247 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 17:16:52.106286 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:52.106242 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:16:52.106462 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:52.106372 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nfnf" podUID="e421c9ea-1bf8-45cd-9ac8-8f798439ac68" Jul 08 17:16:53.106156 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:53.106123 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:16:53.106495 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:53.106233 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84tqr" podUID="6408e7f4-87d3-48a2-943f-7971adbf51f8" Jul 08 17:16:53.106495 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:53.106282 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:53.106495 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:53.106377 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v55sp" podUID="6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1" Jul 08 17:16:53.226153 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:53.226066 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" event={"ID":"0c0dd73b-3891-4196-8e1c-be8560620dda","Type":"ContainerStarted","Data":"15cb5a5a1ec642826fdf9c659e0a65d54394934afbdbf14236df81c8e07c9d66"} Jul 08 17:16:53.227838 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:53.227807 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf" event={"ID":"48804137-00f6-400f-8f9a-a3fcb48d3024","Type":"ContainerStarted","Data":"01440c21f3e9ca74d51ded5f638a30cc361784ffa921e84e181ee2f698eda353"} Jul 08 17:16:53.257784 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:53.257738 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q9njf" podStartSLOduration=7.006582524 podStartE2EDuration="25.257724402s" totalImagesPullingTime="18.251141878s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:16:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:16:53.25764913 +0000 UTC m=+25.668464508" watchObservedRunningTime="2026-07-08 17:16:53.257724402 +0000 UTC m=+25.668539781" Jul 08 17:16:54.106149 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:54.106112 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:16:54.106374 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:54.106300 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nfnf" podUID="e421c9ea-1bf8-45cd-9ac8-8f798439ac68" Jul 08 17:16:54.682191 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:54.682155 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-x524h" Jul 08 17:16:54.682806 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:54.682786 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-x524h" Jul 08 17:16:55.105804 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:55.105770 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:16:55.105986 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:55.105814 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:55.105986 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:55.105881 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84tqr" podUID="6408e7f4-87d3-48a2-943f-7971adbf51f8" Jul 08 17:16:55.106066 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:55.105996 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v55sp" podUID="6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1" Jul 08 17:16:55.235868 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:55.235776 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" event={"ID":"0c0dd73b-3891-4196-8e1c-be8560620dda","Type":"ContainerStarted","Data":"09611effaf8f7d38429fdd6cfe0acf2188924a7ff490dce82927eae86398b7f6"} Jul 08 17:16:55.236447 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:55.235990 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-x524h" Jul 08 17:16:55.236561 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:55.236545 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-x524h" Jul 08 17:16:55.308942 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:55.308878 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" podStartSLOduration=7.679031046 podStartE2EDuration="27.308861095s" totalImagesPullingTime="19.629830049s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:16:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:16:55.285359099 +0000 UTC m=+27.696174478" watchObservedRunningTime="2026-07-08 17:16:55.308861095 +0000 UTC m=+27.719676492" Jul 08 17:16:56.111509 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:56.111470 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:16:56.111735 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:56.111601 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nfnf" podUID="e421c9ea-1bf8-45cd-9ac8-8f798439ac68" Jul 08 17:16:56.237792 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:56.237767 2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 17:16:56.238361 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:56.238341 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:56.238444 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:56.238401 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:56.256597 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:56.256572 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:56.262414 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:56.262389 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:56.479223 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:56.479136 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:16:57.105477 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:57.105373 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:16:57.105685 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:57.105479 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84tqr" podUID="6408e7f4-87d3-48a2-943f-7971adbf51f8" Jul 08 17:16:57.105685 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:57.105528 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:57.105685 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:57.105628 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v55sp" podUID="6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1" Jul 08 17:16:57.297252 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:57.297162 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v55sp"] Jul 08 17:16:57.297629 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:57.297283 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:57.297629 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:57.297379 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v55sp" podUID="6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1" Jul 08 17:16:57.302132 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:57.302107 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8nfnf"] Jul 08 17:16:57.302281 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:57.302208 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:16:57.302342 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:57.302294 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nfnf" podUID="e421c9ea-1bf8-45cd-9ac8-8f798439ac68" Jul 08 17:16:57.302699 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:57.302682 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-84tqr"] Jul 08 17:16:57.302776 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:57.302759 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:16:57.302900 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:57.302849 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84tqr" podUID="6408e7f4-87d3-48a2-943f-7971adbf51f8" Jul 08 17:16:59.105698 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:59.105666 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:16:59.106139 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:59.105666 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:16:59.106139 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:59.105785 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84tqr" podUID="6408e7f4-87d3-48a2-943f-7971adbf51f8" Jul 08 17:16:59.106139 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:59.105873 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nfnf" podUID="e421c9ea-1bf8-45cd-9ac8-8f798439ac68" Jul 08 17:16:59.106139 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:16:59.105666 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:16:59.106139 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:16:59.105994 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v55sp" podUID="6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1" Jul 08 17:17:00.248768 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:00.248728 2556 generic.go:356] "Generic (PLEG): container finished" podID="beee831c-cfd3-4511-9a7c-e4ce7c3d87ab" containerID="3641c26053d6b70ac1c403a21c60884371248f8298ad26c218e70d1aa2226f01" exitCode=0 Jul 08 17:17:00.248768 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:00.248775 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h4mm8" event={"ID":"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab","Type":"ContainerDied","Data":"3641c26053d6b70ac1c403a21c60884371248f8298ad26c218e70d1aa2226f01"} Jul 08 17:17:01.106086 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:01.106050 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:17:01.106224 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:01.106100 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:17:01.106224 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:01.106069 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:17:01.106224 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:17:01.106170 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8nfnf" podUID="e421c9ea-1bf8-45cd-9ac8-8f798439ac68" Jul 08 17:17:01.106327 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:17:01.106228 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v55sp" podUID="6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1" Jul 08 17:17:01.106327 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:17:01.106312 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-84tqr" podUID="6408e7f4-87d3-48a2-943f-7971adbf51f8" Jul 08 17:17:01.840614 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:01.840575 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-original-pull-secret\") pod \"global-pull-secret-syncer-v55sp\" (UID: \"6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1\") " pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:17:01.841126 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:01.840661 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs\") pod \"network-metrics-daemon-84tqr\" (UID: \"6408e7f4-87d3-48a2-943f-7971adbf51f8\") " pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:17:01.841126 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:17:01.840721 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:17:01.841126 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:17:01.840770 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:17:01.841126 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:17:01.840790 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-original-pull-secret podName:6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1 nodeName:}" failed. No retries permitted until 2026-07-08 17:17:33.840775468 +0000 UTC m=+66.251590822 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-original-pull-secret") pod "global-pull-secret-syncer-v55sp" (UID: "6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:17:01.841126 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:17:01.840817 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs podName:6408e7f4-87d3-48a2-943f-7971adbf51f8 nodeName:}" failed. No retries permitted until 2026-07-08 17:17:33.840800854 +0000 UTC m=+66.251616208 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs") pod "network-metrics-daemon-84tqr" (UID: "6408e7f4-87d3-48a2-943f-7971adbf51f8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:17:01.941955 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:01.941920 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzccg\" (UniqueName: \"kubernetes.io/projected/e421c9ea-1bf8-45cd-9ac8-8f798439ac68-kube-api-access-vzccg\") pod \"network-check-target-8nfnf\" (UID: \"e421c9ea-1bf8-45cd-9ac8-8f798439ac68\") " pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:17:01.942102 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:17:01.942073 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:17:01.942102 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:17:01.942094 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:17:01.942163 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:17:01.942105 2556 projected.go:196] Error preparing data for projected volume kube-api-access-vzccg for pod openshift-network-diagnostics/network-check-target-8nfnf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:17:01.942163 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:17:01.942161 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e421c9ea-1bf8-45cd-9ac8-8f798439ac68-kube-api-access-vzccg podName:e421c9ea-1bf8-45cd-9ac8-8f798439ac68 nodeName:}" failed. No retries permitted until 2026-07-08 17:17:33.942146273 +0000 UTC m=+66.352961628 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vzccg" (UniqueName: "kubernetes.io/projected/e421c9ea-1bf8-45cd-9ac8-8f798439ac68-kube-api-access-vzccg") pod "network-check-target-8nfnf" (UID: "e421c9ea-1bf8-45cd-9ac8-8f798439ac68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:17:02.256370 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.256331 2556 generic.go:356] "Generic (PLEG): container finished" podID="beee831c-cfd3-4511-9a7c-e4ce7c3d87ab" containerID="a218c338cdaa225af42fcd5916c136f9a01469de926aea523a9eaad714a15ade" exitCode=0 Jul 08 17:17:02.256542 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.256392 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h4mm8" event={"ID":"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab","Type":"ContainerDied","Data":"a218c338cdaa225af42fcd5916c136f9a01469de926aea523a9eaad714a15ade"} Jul 08 17:17:02.379233 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.379204 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-231.ec2.internal" event="NodeReady" Jul 08 17:17:02.379378 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.379332 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 17:17:02.486135 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.486098 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jh42n"] Jul 08 17:17:02.502898 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.502862 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-x6rq9"] Jul 08 17:17:02.503075 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.502992 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jh42n" Jul 08 17:17:02.513656 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.513629 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 17:17:02.513793 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.513706 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zsfk5\"" Jul 08 17:17:02.513793 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.513715 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 17:17:02.513793 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.513756 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 17:17:02.523169 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.523136 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jh42n"] Jul 08 17:17:02.523169 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.523172 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x6rq9"] Jul 08 17:17:02.523343 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.523247 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x6rq9" Jul 08 17:17:02.526960 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.526939 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 17:17:02.527093 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.527065 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 17:17:02.527132 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.527099 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dpkhh\"" Jul 08 17:17:02.646609 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.646573 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls\") pod \"dns-default-x6rq9\" (UID: \"63232d67-ba2c-4954-8d14-6d057af2f3bc\") " pod="openshift-dns/dns-default-x6rq9" Jul 08 17:17:02.646609 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.646617 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6xn9\" (UniqueName: \"kubernetes.io/projected/e45622c1-3192-42a3-aeef-56cf942bcc63-kube-api-access-r6xn9\") pod \"ingress-canary-jh42n\" (UID: \"e45622c1-3192-42a3-aeef-56cf942bcc63\") " pod="openshift-ingress-canary/ingress-canary-jh42n" Jul 08 17:17:02.646792 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.646652 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63232d67-ba2c-4954-8d14-6d057af2f3bc-tmp-dir\") pod \"dns-default-x6rq9\" (UID: \"63232d67-ba2c-4954-8d14-6d057af2f3bc\") " pod="openshift-dns/dns-default-x6rq9" Jul 08 17:17:02.646792 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.646668 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e45622c1-3192-42a3-aeef-56cf942bcc63-cert\") pod \"ingress-canary-jh42n\" (UID: \"e45622c1-3192-42a3-aeef-56cf942bcc63\") " pod="openshift-ingress-canary/ingress-canary-jh42n" Jul 08 17:17:02.646792 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.646715 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfqbc\" (UniqueName: \"kubernetes.io/projected/63232d67-ba2c-4954-8d14-6d057af2f3bc-kube-api-access-gfqbc\") pod \"dns-default-x6rq9\" (UID: \"63232d67-ba2c-4954-8d14-6d057af2f3bc\") " pod="openshift-dns/dns-default-x6rq9" Jul 08 17:17:02.646792 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.646759 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/63232d67-ba2c-4954-8d14-6d057af2f3bc-config-volume\") pod \"dns-default-x6rq9\" (UID: \"63232d67-ba2c-4954-8d14-6d057af2f3bc\") " pod="openshift-dns/dns-default-x6rq9" Jul 08 17:17:02.747809 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.747772 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfqbc\" (UniqueName: \"kubernetes.io/projected/63232d67-ba2c-4954-8d14-6d057af2f3bc-kube-api-access-gfqbc\") pod \"dns-default-x6rq9\" (UID: \"63232d67-ba2c-4954-8d14-6d057af2f3bc\") " pod="openshift-dns/dns-default-x6rq9" Jul 08 17:17:02.747997 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.747827 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/63232d67-ba2c-4954-8d14-6d057af2f3bc-config-volume\") pod \"dns-default-x6rq9\" (UID: \"63232d67-ba2c-4954-8d14-6d057af2f3bc\") " pod="openshift-dns/dns-default-x6rq9" Jul 08 17:17:02.747997 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.747864 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls\") pod \"dns-default-x6rq9\" (UID: \"63232d67-ba2c-4954-8d14-6d057af2f3bc\") " pod="openshift-dns/dns-default-x6rq9" Jul 08 17:17:02.747997 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.747892 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6xn9\" (UniqueName: \"kubernetes.io/projected/e45622c1-3192-42a3-aeef-56cf942bcc63-kube-api-access-r6xn9\") pod \"ingress-canary-jh42n\" (UID: \"e45622c1-3192-42a3-aeef-56cf942bcc63\") " pod="openshift-ingress-canary/ingress-canary-jh42n" Jul 08 17:17:02.747997 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.747980 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63232d67-ba2c-4954-8d14-6d057af2f3bc-tmp-dir\") pod \"dns-default-x6rq9\" (UID: \"63232d67-ba2c-4954-8d14-6d057af2f3bc\") " pod="openshift-dns/dns-default-x6rq9" Jul 08 17:17:02.748196 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.747997 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e45622c1-3192-42a3-aeef-56cf942bcc63-cert\") pod \"ingress-canary-jh42n\" (UID: \"e45622c1-3192-42a3-aeef-56cf942bcc63\") " pod="openshift-ingress-canary/ingress-canary-jh42n" Jul 08 17:17:02.748196 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:17:02.748025 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:17:02.748196 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:17:02.748092 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls podName:63232d67-ba2c-4954-8d14-6d057af2f3bc nodeName:}" failed. No retries permitted until 2026-07-08 17:17:03.24807303 +0000 UTC m=+35.658888391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls") pod "dns-default-x6rq9" (UID: "63232d67-ba2c-4954-8d14-6d057af2f3bc") : secret "dns-default-metrics-tls" not found Jul 08 17:17:02.748350 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.748332 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63232d67-ba2c-4954-8d14-6d057af2f3bc-tmp-dir\") pod \"dns-default-x6rq9\" (UID: \"63232d67-ba2c-4954-8d14-6d057af2f3bc\") " pod="openshift-dns/dns-default-x6rq9" Jul 08 17:17:02.748537 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.748518 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/63232d67-ba2c-4954-8d14-6d057af2f3bc-config-volume\") pod \"dns-default-x6rq9\" (UID: \"63232d67-ba2c-4954-8d14-6d057af2f3bc\") " pod="openshift-dns/dns-default-x6rq9" Jul 08 17:17:02.752338 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.752313 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e45622c1-3192-42a3-aeef-56cf942bcc63-cert\") pod \"ingress-canary-jh42n\" (UID: \"e45622c1-3192-42a3-aeef-56cf942bcc63\") " pod="openshift-ingress-canary/ingress-canary-jh42n" Jul 08 17:17:02.759606 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.759098 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfqbc\" (UniqueName: \"kubernetes.io/projected/63232d67-ba2c-4954-8d14-6d057af2f3bc-kube-api-access-gfqbc\") pod \"dns-default-x6rq9\" (UID: \"63232d67-ba2c-4954-8d14-6d057af2f3bc\") " pod="openshift-dns/dns-default-x6rq9" Jul 08 17:17:02.762157 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.762100 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6xn9\" (UniqueName: \"kubernetes.io/projected/e45622c1-3192-42a3-aeef-56cf942bcc63-kube-api-access-r6xn9\") pod \"ingress-canary-jh42n\" (UID: \"e45622c1-3192-42a3-aeef-56cf942bcc63\") " pod="openshift-ingress-canary/ingress-canary-jh42n" Jul 08 17:17:02.812947 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.812891 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jh42n" Jul 08 17:17:02.992037 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:02.991754 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jh42n"] Jul 08 17:17:02.995011 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:17:02.994978 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode45622c1_3192_42a3_aeef_56cf942bcc63.slice/crio-86d4a21d8303682af04b01a04a356cd25c81d1e3768003d4af8bd85e7044c2e8 WatchSource:0}: Error finding container 86d4a21d8303682af04b01a04a356cd25c81d1e3768003d4af8bd85e7044c2e8: Status 404 returned error can't find the container with id 86d4a21d8303682af04b01a04a356cd25c81d1e3768003d4af8bd85e7044c2e8 Jul 08 17:17:03.106199 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:03.106162 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:17:03.106379 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:03.106202 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:17:03.106379 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:03.106205 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:17:03.116700 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:03.116675 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 17:17:03.116843 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:03.116769 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 17:17:03.116843 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:03.116787 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xkss2\"" Jul 08 17:17:03.117010 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:03.116995 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 17:17:03.117065 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:03.117035 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 17:17:03.117149 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:03.117132 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8pnd7\"" Jul 08 17:17:03.251162 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:03.251120 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls\") pod \"dns-default-x6rq9\" (UID: \"63232d67-ba2c-4954-8d14-6d057af2f3bc\") " pod="openshift-dns/dns-default-x6rq9" Jul 08 17:17:03.251357 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:17:03.251259 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:17:03.251357 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:17:03.251319 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls podName:63232d67-ba2c-4954-8d14-6d057af2f3bc nodeName:}" failed. No retries permitted until 2026-07-08 17:17:04.251304151 +0000 UTC m=+36.662119505 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls") pod "dns-default-x6rq9" (UID: "63232d67-ba2c-4954-8d14-6d057af2f3bc") : secret "dns-default-metrics-tls" not found Jul 08 17:17:03.259793 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:03.259766 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jh42n" event={"ID":"e45622c1-3192-42a3-aeef-56cf942bcc63","Type":"ContainerStarted","Data":"86d4a21d8303682af04b01a04a356cd25c81d1e3768003d4af8bd85e7044c2e8"} Jul 08 17:17:04.260621 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:04.260595 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls\") pod \"dns-default-x6rq9\" (UID: \"63232d67-ba2c-4954-8d14-6d057af2f3bc\") " pod="openshift-dns/dns-default-x6rq9" Jul 08 17:17:04.261080 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:17:04.260702 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:17:04.261080 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:17:04.260765 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls podName:63232d67-ba2c-4954-8d14-6d057af2f3bc nodeName:}" failed. No retries permitted until 2026-07-08 17:17:06.260742065 +0000 UTC m=+38.671557420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls") pod "dns-default-x6rq9" (UID: "63232d67-ba2c-4954-8d14-6d057af2f3bc") : secret "dns-default-metrics-tls" not found Jul 08 17:17:04.264658 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:04.264627 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h4mm8" event={"ID":"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab","Type":"ContainerStarted","Data":"8d1d7ef9c3fcfad648ddf9b9e9be209a60fb654424557cfd7c44196c5d836561"} Jul 08 17:17:05.270679 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:05.270630 2556 generic.go:356] "Generic (PLEG): container finished" podID="beee831c-cfd3-4511-9a7c-e4ce7c3d87ab" containerID="8d1d7ef9c3fcfad648ddf9b9e9be209a60fb654424557cfd7c44196c5d836561" exitCode=0 Jul 08 17:17:05.270679 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:05.270683 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h4mm8" event={"ID":"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab","Type":"ContainerDied","Data":"8d1d7ef9c3fcfad648ddf9b9e9be209a60fb654424557cfd7c44196c5d836561"} Jul 08 17:17:06.274787 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:06.274519 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jh42n" event={"ID":"e45622c1-3192-42a3-aeef-56cf942bcc63","Type":"ContainerStarted","Data":"5557bf2fd4cf2beba09b8bccc5a3699da858576dac8f6a318d3820ff94ec3d20"} Jul 08 17:17:06.275979 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:06.275959 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls\") pod \"dns-default-x6rq9\" (UID: \"63232d67-ba2c-4954-8d14-6d057af2f3bc\") " pod="openshift-dns/dns-default-x6rq9" Jul 08 17:17:06.276057 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:17:06.276050 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:17:06.276102 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:17:06.276096 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls podName:63232d67-ba2c-4954-8d14-6d057af2f3bc nodeName:}" failed. No retries permitted until 2026-07-08 17:17:10.276083761 +0000 UTC m=+42.686899117 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls") pod "dns-default-x6rq9" (UID: "63232d67-ba2c-4954-8d14-6d057af2f3bc") : secret "dns-default-metrics-tls" not found Jul 08 17:17:06.291642 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:06.291592 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jh42n" podStartSLOduration=1.176054393 podStartE2EDuration="4.291576027s" totalImagesPullingTime="3.115521634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:17:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:17:06.290992841 +0000 UTC m=+38.701808210" watchObservedRunningTime="2026-07-08 17:17:06.291576027 +0000 UTC m=+38.702391404" Jul 08 17:17:10.307408 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:10.307370 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls\") pod \"dns-default-x6rq9\" (UID: \"63232d67-ba2c-4954-8d14-6d057af2f3bc\") " pod="openshift-dns/dns-default-x6rq9" Jul 08 17:17:10.307852 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:17:10.307481 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:17:10.307852 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:17:10.307542 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls podName:63232d67-ba2c-4954-8d14-6d057af2f3bc nodeName:}" failed. No retries permitted until 2026-07-08 17:17:18.307525191 +0000 UTC m=+50.718340558 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls") pod "dns-default-x6rq9" (UID: "63232d67-ba2c-4954-8d14-6d057af2f3bc") : secret "dns-default-metrics-tls" not found Jul 08 17:17:11.290133 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:11.290038 2556 generic.go:356] "Generic (PLEG): container finished" podID="beee831c-cfd3-4511-9a7c-e4ce7c3d87ab" containerID="96b25c245db9363ff9f1af86fda9e4f4353a3547a443dbc13cda446858930ce5" exitCode=0 Jul 08 17:17:11.290133 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:11.290085 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h4mm8" event={"ID":"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab","Type":"ContainerDied","Data":"96b25c245db9363ff9f1af86fda9e4f4353a3547a443dbc13cda446858930ce5"} Jul 08 17:17:12.295562 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:12.295526 2556 generic.go:356] "Generic (PLEG): container finished" podID="beee831c-cfd3-4511-9a7c-e4ce7c3d87ab" containerID="ed26a17497d43fd8874bf8bb185601d8f753de0df48d07ba36bd4c02bb10c098" exitCode=0 Jul 08 17:17:12.296071 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:12.295594 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h4mm8" event={"ID":"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab","Type":"ContainerDied","Data":"ed26a17497d43fd8874bf8bb185601d8f753de0df48d07ba36bd4c02bb10c098"} Jul 08 17:17:13.301529 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:13.301498 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h4mm8" event={"ID":"beee831c-cfd3-4511-9a7c-e4ce7c3d87ab","Type":"ContainerStarted","Data":"cff84bd572fb132c7827d62565f4542b5078429a728cc15865ba075f4c2838be"} Jul 08 17:17:13.344869 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:13.344818 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h4mm8" podStartSLOduration=7.880342962 podStartE2EDuration="45.344799992s" totalImagesPullingTime="37.46445703s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:16:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:17:13.344500396 +0000 UTC m=+45.755315773" watchObservedRunningTime="2026-07-08 17:17:13.344799992 +0000 UTC m=+45.755615374" Jul 08 17:17:18.361327 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:18.361286 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls\") pod \"dns-default-x6rq9\" (UID: \"63232d67-ba2c-4954-8d14-6d057af2f3bc\") " pod="openshift-dns/dns-default-x6rq9" Jul 08 17:17:18.361700 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:17:18.361405 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:17:18.361700 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:17:18.361453 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls podName:63232d67-ba2c-4954-8d14-6d057af2f3bc nodeName:}" failed. No retries permitted until 2026-07-08 17:17:34.361440535 +0000 UTC m=+66.772255891 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls") pod "dns-default-x6rq9" (UID: "63232d67-ba2c-4954-8d14-6d057af2f3bc") : secret "dns-default-metrics-tls" not found Jul 08 17:17:28.253933 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:28.253886 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cpkll" Jul 08 17:17:33.870589 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:33.870548 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-original-pull-secret\") pod \"global-pull-secret-syncer-v55sp\" (UID: \"6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1\") " pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:17:33.871026 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:33.870622 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs\") pod \"network-metrics-daemon-84tqr\" (UID: \"6408e7f4-87d3-48a2-943f-7971adbf51f8\") " pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:17:33.873149 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:33.873122 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 17:17:33.873245 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:33.873153 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 17:17:33.881131 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:17:33.881100 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 17:17:33.881259 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:17:33.881208 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs podName:6408e7f4-87d3-48a2-943f-7971adbf51f8 nodeName:}" failed. No retries permitted until 2026-07-08 17:18:37.881184398 +0000 UTC m=+130.291999770 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs") pod "network-metrics-daemon-84tqr" (UID: "6408e7f4-87d3-48a2-943f-7971adbf51f8") : secret "metrics-daemon-secret" not found Jul 08 17:17:33.884817 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:33.884799 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1-original-pull-secret\") pod \"global-pull-secret-syncer-v55sp\" (UID: \"6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1\") " pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:17:33.971473 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:33.971424 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzccg\" (UniqueName: \"kubernetes.io/projected/e421c9ea-1bf8-45cd-9ac8-8f798439ac68-kube-api-access-vzccg\") pod \"network-check-target-8nfnf\" (UID: \"e421c9ea-1bf8-45cd-9ac8-8f798439ac68\") " pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:17:33.974056 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:33.974038 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 17:17:33.984784 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:33.984751 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 17:17:33.994663 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:33.994639 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzccg\" (UniqueName: \"kubernetes.io/projected/e421c9ea-1bf8-45cd-9ac8-8f798439ac68-kube-api-access-vzccg\") pod \"network-check-target-8nfnf\" (UID: \"e421c9ea-1bf8-45cd-9ac8-8f798439ac68\") " pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:17:34.016563 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:34.016531 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v55sp" Jul 08 17:17:34.030630 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:34.030609 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8pnd7\"" Jul 08 17:17:34.038075 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:34.038054 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:17:34.150736 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:34.150705 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v55sp"] Jul 08 17:17:34.154073 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:17:34.154035 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d0a9a22_a290_4cd1_9e16_8c4a6ca4b9e1.slice/crio-7e95d2c83e998e25f6c4c9820b0257972aadaa84e37ff384f38184ca02e08ffb WatchSource:0}: Error finding container 7e95d2c83e998e25f6c4c9820b0257972aadaa84e37ff384f38184ca02e08ffb: Status 404 returned error can't find the container with id 7e95d2c83e998e25f6c4c9820b0257972aadaa84e37ff384f38184ca02e08ffb Jul 08 17:17:34.168567 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:34.168545 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8nfnf"] Jul 08 17:17:34.171482 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:17:34.171456 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode421c9ea_1bf8_45cd_9ac8_8f798439ac68.slice/crio-a731f3bd62c838a9fdcb0e113d9cf975400d95e323888e1d3b5498f19258139d WatchSource:0}: Error finding container a731f3bd62c838a9fdcb0e113d9cf975400d95e323888e1d3b5498f19258139d: Status 404 returned error can't find the container with id a731f3bd62c838a9fdcb0e113d9cf975400d95e323888e1d3b5498f19258139d Jul 08 17:17:34.351325 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:34.351289 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v55sp" event={"ID":"6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1","Type":"ContainerStarted","Data":"7e95d2c83e998e25f6c4c9820b0257972aadaa84e37ff384f38184ca02e08ffb"} Jul 08 17:17:34.352268 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:34.352242 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8nfnf" event={"ID":"e421c9ea-1bf8-45cd-9ac8-8f798439ac68","Type":"ContainerStarted","Data":"a731f3bd62c838a9fdcb0e113d9cf975400d95e323888e1d3b5498f19258139d"} Jul 08 17:17:34.374779 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:34.374702 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls\") pod \"dns-default-x6rq9\" (UID: \"63232d67-ba2c-4954-8d14-6d057af2f3bc\") " pod="openshift-dns/dns-default-x6rq9" Jul 08 17:17:34.374936 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:17:34.374858 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:17:34.374985 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:17:34.374942 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls podName:63232d67-ba2c-4954-8d14-6d057af2f3bc nodeName:}" failed. No retries permitted until 2026-07-08 17:18:06.374926704 +0000 UTC m=+98.785742072 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls") pod "dns-default-x6rq9" (UID: "63232d67-ba2c-4954-8d14-6d057af2f3bc") : secret "dns-default-metrics-tls" not found Jul 08 17:17:34.950892 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:34.950858 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bb8db54cd-xpnd4"] Jul 08 17:17:34.953199 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:34.953177 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bb8db54cd-xpnd4" Jul 08 17:17:34.957188 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:34.957154 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 08 17:17:34.957325 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:34.957193 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 08 17:17:34.957325 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:34.957209 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-bvbbd\"" Jul 08 17:17:34.957325 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:34.957233 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 08 17:17:34.957325 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:34.957257 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 08 17:17:34.971905 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:34.971837 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bb8db54cd-xpnd4"] Jul 08 17:17:34.979974 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:34.979949 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a792e467-3124-4b05-b1b1-2b6c522b7b95-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6bb8db54cd-xpnd4\" (UID: \"a792e467-3124-4b05-b1b1-2b6c522b7b95\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bb8db54cd-xpnd4" Jul 08 17:17:34.980115 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:34.979998 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljt67\" (UniqueName: \"kubernetes.io/projected/a792e467-3124-4b05-b1b1-2b6c522b7b95-kube-api-access-ljt67\") pod \"managed-serviceaccount-addon-agent-6bb8db54cd-xpnd4\" (UID: \"a792e467-3124-4b05-b1b1-2b6c522b7b95\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bb8db54cd-xpnd4" Jul 08 17:17:35.080775 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:35.080731 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a792e467-3124-4b05-b1b1-2b6c522b7b95-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6bb8db54cd-xpnd4\" (UID: \"a792e467-3124-4b05-b1b1-2b6c522b7b95\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bb8db54cd-xpnd4" Jul 08 17:17:35.080973 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:35.080810 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljt67\" (UniqueName: \"kubernetes.io/projected/a792e467-3124-4b05-b1b1-2b6c522b7b95-kube-api-access-ljt67\") pod \"managed-serviceaccount-addon-agent-6bb8db54cd-xpnd4\" (UID: \"a792e467-3124-4b05-b1b1-2b6c522b7b95\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bb8db54cd-xpnd4" Jul 08 17:17:35.083890 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:35.083860 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a792e467-3124-4b05-b1b1-2b6c522b7b95-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6bb8db54cd-xpnd4\" (UID: \"a792e467-3124-4b05-b1b1-2b6c522b7b95\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bb8db54cd-xpnd4" Jul 08 17:17:35.090197 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:35.090171 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljt67\" (UniqueName: \"kubernetes.io/projected/a792e467-3124-4b05-b1b1-2b6c522b7b95-kube-api-access-ljt67\") pod \"managed-serviceaccount-addon-agent-6bb8db54cd-xpnd4\" (UID: \"a792e467-3124-4b05-b1b1-2b6c522b7b95\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bb8db54cd-xpnd4" Jul 08 17:17:35.274428 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:35.274332 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bb8db54cd-xpnd4" Jul 08 17:17:35.412666 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:35.412635 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bb8db54cd-xpnd4"] Jul 08 17:17:35.416637 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:17:35.416607 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda792e467_3124_4b05_b1b1_2b6c522b7b95.slice/crio-1248c882392e005cf2aa8dbfdf8b36e57079ffc756b73aa4886a1820ed0cd213 WatchSource:0}: Error finding container 1248c882392e005cf2aa8dbfdf8b36e57079ffc756b73aa4886a1820ed0cd213: Status 404 returned error can't find the container with id 1248c882392e005cf2aa8dbfdf8b36e57079ffc756b73aa4886a1820ed0cd213 Jul 08 17:17:36.362591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:36.362512 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bb8db54cd-xpnd4" event={"ID":"a792e467-3124-4b05-b1b1-2b6c522b7b95","Type":"ContainerStarted","Data":"1248c882392e005cf2aa8dbfdf8b36e57079ffc756b73aa4886a1820ed0cd213"} Jul 08 17:17:41.377313 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:41.377273 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v55sp" event={"ID":"6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1","Type":"ContainerStarted","Data":"8c670e5bcb9ea02a92534f699368a88635f6da0156fc21e2da67c169b8cc88ee"} Jul 08 17:17:41.378676 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:41.378655 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bb8db54cd-xpnd4" event={"ID":"a792e467-3124-4b05-b1b1-2b6c522b7b95","Type":"ContainerStarted","Data":"ef4798859594e3c1f374712619aa43fc81fcb7aa07643c6ec03130e76548122e"} Jul 08 17:17:41.380005 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:41.379978 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8nfnf" event={"ID":"e421c9ea-1bf8-45cd-9ac8-8f798439ac68","Type":"ContainerStarted","Data":"46e8515680a3917ee4bca6a9b2cddb5156c3c00b57f496824343c6937a37b1bd"} Jul 08 17:17:41.380107 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:41.380091 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:17:41.396244 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:41.396198 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-v55sp" podStartSLOduration=66.672892579 podStartE2EDuration="1m13.396181981s" totalImagesPullingTime="6.723289402s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:16:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:17:41.396022274 +0000 UTC m=+73.806837651" watchObservedRunningTime="2026-07-08 17:17:41.396181981 +0000 UTC m=+73.806997336" Jul 08 17:17:41.411799 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:41.411754 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bb8db54cd-xpnd4" podStartSLOduration=1.96385664 podStartE2EDuration="7.411741937s" totalImagesPullingTime="5.447885297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:17:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:17:41.411727675 +0000 UTC m=+73.822543051" watchObservedRunningTime="2026-07-08 17:17:41.411741937 +0000 UTC m=+73.822557315" Jul 08 17:17:41.430969 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:17:41.430802 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8nfnf" podStartSLOduration=66.737309028 podStartE2EDuration="1m13.430785065s" totalImagesPullingTime="6.693476037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:16:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:17:41.430556123 +0000 UTC m=+73.841371500" watchObservedRunningTime="2026-07-08 17:17:41.430785065 +0000 UTC m=+73.841600419" Jul 08 17:18:06.391375 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:18:06.391337 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls\") pod \"dns-default-x6rq9\" (UID: \"63232d67-ba2c-4954-8d14-6d057af2f3bc\") " pod="openshift-dns/dns-default-x6rq9" Jul 08 17:18:06.391837 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:18:06.391469 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:18:06.391837 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:18:06.391539 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls podName:63232d67-ba2c-4954-8d14-6d057af2f3bc nodeName:}" failed. No retries permitted until 2026-07-08 17:19:10.391525706 +0000 UTC m=+162.802341065 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls") pod "dns-default-x6rq9" (UID: "63232d67-ba2c-4954-8d14-6d057af2f3bc") : secret "dns-default-metrics-tls" not found Jul 08 17:18:12.384746 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:18:12.384716 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8nfnf" Jul 08 17:18:37.907857 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:18:37.907814 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs\") pod \"network-metrics-daemon-84tqr\" (UID: \"6408e7f4-87d3-48a2-943f-7971adbf51f8\") " pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:18:37.908363 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:18:37.907952 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 17:18:37.908363 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:18:37.908021 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs podName:6408e7f4-87d3-48a2-943f-7971adbf51f8 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:39.908006531 +0000 UTC m=+252.318821886 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs") pod "network-metrics-daemon-84tqr" (UID: "6408e7f4-87d3-48a2-943f-7971adbf51f8") : secret "metrics-daemon-secret" not found Jul 08 17:19:05.531617 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:19:05.531569 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-x6rq9" podUID="63232d67-ba2c-4954-8d14-6d057af2f3bc" Jul 08 17:19:05.577424 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:19:05.577398 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x6rq9" Jul 08 17:19:06.122473 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:19:06.122427 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-84tqr" podUID="6408e7f4-87d3-48a2-943f-7971adbf51f8" Jul 08 17:19:10.416991 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:19:10.416939 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls\") pod \"dns-default-x6rq9\" (UID: \"63232d67-ba2c-4954-8d14-6d057af2f3bc\") " pod="openshift-dns/dns-default-x6rq9" Jul 08 17:19:10.417469 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:19:10.417092 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:19:10.417469 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:19:10.417154 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls podName:63232d67-ba2c-4954-8d14-6d057af2f3bc nodeName:}" failed. No retries permitted until 2026-07-08 17:21:12.41713951 +0000 UTC m=+284.827954866 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls") pod "dns-default-x6rq9" (UID: "63232d67-ba2c-4954-8d14-6d057af2f3bc") : secret "dns-default-metrics-tls" not found Jul 08 17:19:17.105634 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:19:17.105581 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:19:41.665804 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:19:41.665769 2556 generic.go:356] "Generic (PLEG): container finished" podID="a792e467-3124-4b05-b1b1-2b6c522b7b95" containerID="ef4798859594e3c1f374712619aa43fc81fcb7aa07643c6ec03130e76548122e" exitCode=255 Jul 08 17:19:41.666281 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:19:41.665814 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bb8db54cd-xpnd4" event={"ID":"a792e467-3124-4b05-b1b1-2b6c522b7b95","Type":"ContainerDied","Data":"ef4798859594e3c1f374712619aa43fc81fcb7aa07643c6ec03130e76548122e"} Jul 08 17:19:41.671327 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:19:41.671311 2556 scope.go:117] "RemoveContainer" containerID="ef4798859594e3c1f374712619aa43fc81fcb7aa07643c6ec03130e76548122e" Jul 08 17:19:42.669524 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:19:42.669488 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6bb8db54cd-xpnd4" event={"ID":"a792e467-3124-4b05-b1b1-2b6c522b7b95","Type":"ContainerStarted","Data":"6d6bc646189abd92b0c1002cd84bf031db4eaab86f2804f1e8b3ea8e6a3db4d4"} Jul 08 17:20:33.140700 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.140664 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-w8rkb"] Jul 08 17:20:33.142416 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.142400 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-w8rkb" Jul 08 17:20:33.144826 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.144801 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mp2bg"] Jul 08 17:20:33.145298 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.145229 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 08 17:20:33.145298 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.145256 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 08 17:20:33.145298 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.145284 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 08 17:20:33.145527 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.145234 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:20:33.145983 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.145967 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6gvs7\"" Jul 08 17:20:33.147176 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.147158 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-gsn8l"] Jul 08 17:20:33.147316 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.147258 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mp2bg" Jul 08 17:20:33.149198 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.149180 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68b7f75f48-x2qhc"] Jul 08 17:20:33.149303 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.149288 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-gsn8l" Jul 08 17:20:33.149659 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.149630 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 08 17:20:33.149790 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.149704 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-f8kd5\"" Jul 08 17:20:33.150307 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.150278 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:20:33.150381 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.150290 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 08 17:20:33.151152 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.151136 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:33.153357 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.153336 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 08 17:20:33.153556 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.153541 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 08 17:20:33.154494 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.154471 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 08 17:20:33.154600 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.154519 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:20:33.154737 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.154715 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-w8rkb"] Jul 08 17:20:33.155492 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.155443 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 17:20:33.155680 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.155660 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-xsxwb\"" Jul 08 17:20:33.155784 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.155693 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 17:20:33.156982 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.156718 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tnxw9\"" Jul 08 17:20:33.157313 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.157248 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 17:20:33.160402 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.160381 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 08 17:20:33.160747 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.160721 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 17:20:33.170392 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.170373 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mp2bg"] Jul 08 17:20:33.171313 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.171290 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-gsn8l"] Jul 08 17:20:33.171973 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.171953 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68b7f75f48-x2qhc"] Jul 08 17:20:33.237423 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.237385 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-zxkjb"] Jul 08 17:20:33.239511 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.239494 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zxkjb" Jul 08 17:20:33.244006 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.243984 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-9g78s\"" Jul 08 17:20:33.250452 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.250427 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-zxkjb"] Jul 08 17:20:33.284106 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.284073 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-installation-pull-secrets\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:33.284106 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.284106 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c2541cd3-af4f-4de5-b042-3611d02a80ab-trusted-ca\") pod \"console-operator-68b757fb67-gsn8l\" (UID: \"c2541cd3-af4f-4de5-b042-3611d02a80ab\") " pod="openshift-console-operator/console-operator-68b757fb67-gsn8l" Jul 08 17:20:33.284321 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.284133 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrnwp\" (UniqueName: \"kubernetes.io/projected/426b5172-1e2b-4b06-861e-cdff3b2722b5-kube-api-access-jrnwp\") pod \"cluster-samples-operator-56fcf86bf-mp2bg\" (UID: \"426b5172-1e2b-4b06-861e-cdff3b2722b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mp2bg" Jul 08 17:20:33.284321 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.284150 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px8ft\" (UniqueName: \"kubernetes.io/projected/c2541cd3-af4f-4de5-b042-3611d02a80ab-kube-api-access-px8ft\") pod \"console-operator-68b757fb67-gsn8l\" (UID: \"c2541cd3-af4f-4de5-b042-3611d02a80ab\") " pod="openshift-console-operator/console-operator-68b757fb67-gsn8l" Jul 08 17:20:33.284321 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.284248 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49zxh\" (UniqueName: \"kubernetes.io/projected/06a502a0-c274-4577-907d-9a9986f6d050-kube-api-access-49zxh\") pod \"service-ca-operator-5d46d9ffd4-w8rkb\" (UID: \"06a502a0-c274-4577-907d-9a9986f6d050\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-w8rkb" Jul 08 17:20:33.284321 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.284291 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-registry-certificates\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:33.284321 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.284308 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c2541cd3-af4f-4de5-b042-3611d02a80ab-config\") pod \"console-operator-68b757fb67-gsn8l\" (UID: \"c2541cd3-af4f-4de5-b042-3611d02a80ab\") " pod="openshift-console-operator/console-operator-68b757fb67-gsn8l" Jul 08 17:20:33.284494 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.284327 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/426b5172-1e2b-4b06-861e-cdff3b2722b5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mp2bg\" (UID: \"426b5172-1e2b-4b06-861e-cdff3b2722b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mp2bg" Jul 08 17:20:33.284494 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.284344 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-trusted-ca\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:33.284494 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.284369 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/06a502a0-c274-4577-907d-9a9986f6d050-config\") pod \"service-ca-operator-5d46d9ffd4-w8rkb\" (UID: \"06a502a0-c274-4577-907d-9a9986f6d050\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-w8rkb" Jul 08 17:20:33.284494 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.284424 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-registry-tls\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:33.284494 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.284452 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-bound-sa-token\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:33.284494 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.284480 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c2541cd3-af4f-4de5-b042-3611d02a80ab-serving-cert\") pod \"console-operator-68b757fb67-gsn8l\" (UID: \"c2541cd3-af4f-4de5-b042-3611d02a80ab\") " pod="openshift-console-operator/console-operator-68b757fb67-gsn8l" Jul 08 17:20:33.284669 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.284500 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-image-registry-private-configuration\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:33.284669 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.284523 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-ca-trust-extracted\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:33.284669 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.284547 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/06a502a0-c274-4577-907d-9a9986f6d050-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-w8rkb\" (UID: \"06a502a0-c274-4577-907d-9a9986f6d050\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-w8rkb" Jul 08 17:20:33.284669 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.284562 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntbck\" (UniqueName: \"kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-kube-api-access-ntbck\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:33.385160 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.385111 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrnwp\" (UniqueName: \"kubernetes.io/projected/426b5172-1e2b-4b06-861e-cdff3b2722b5-kube-api-access-jrnwp\") pod \"cluster-samples-operator-56fcf86bf-mp2bg\" (UID: \"426b5172-1e2b-4b06-861e-cdff3b2722b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mp2bg" Jul 08 17:20:33.385160 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.385161 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px8ft\" (UniqueName: \"kubernetes.io/projected/c2541cd3-af4f-4de5-b042-3611d02a80ab-kube-api-access-px8ft\") pod \"console-operator-68b757fb67-gsn8l\" (UID: \"c2541cd3-af4f-4de5-b042-3611d02a80ab\") " pod="openshift-console-operator/console-operator-68b757fb67-gsn8l" Jul 08 17:20:33.385417 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.385290 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49zxh\" (UniqueName: \"kubernetes.io/projected/06a502a0-c274-4577-907d-9a9986f6d050-kube-api-access-49zxh\") pod \"service-ca-operator-5d46d9ffd4-w8rkb\" (UID: \"06a502a0-c274-4577-907d-9a9986f6d050\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-w8rkb" Jul 08 17:20:33.385417 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.385326 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-registry-certificates\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:33.385417 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.385342 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c2541cd3-af4f-4de5-b042-3611d02a80ab-config\") pod \"console-operator-68b757fb67-gsn8l\" (UID: \"c2541cd3-af4f-4de5-b042-3611d02a80ab\") " pod="openshift-console-operator/console-operator-68b757fb67-gsn8l" Jul 08 17:20:33.385417 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.385361 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/426b5172-1e2b-4b06-861e-cdff3b2722b5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mp2bg\" (UID: \"426b5172-1e2b-4b06-861e-cdff3b2722b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mp2bg" Jul 08 17:20:33.385417 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.385379 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-trusted-ca\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:33.385649 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:33.385467 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 17:20:33.385649 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:33.385519 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/426b5172-1e2b-4b06-861e-cdff3b2722b5-samples-operator-tls podName:426b5172-1e2b-4b06-861e-cdff3b2722b5 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:33.885503286 +0000 UTC m=+246.296318641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/426b5172-1e2b-4b06-861e-cdff3b2722b5-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mp2bg" (UID: "426b5172-1e2b-4b06-861e-cdff3b2722b5") : secret "samples-operator-tls" not found Jul 08 17:20:33.385759 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.385714 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/06a502a0-c274-4577-907d-9a9986f6d050-config\") pod \"service-ca-operator-5d46d9ffd4-w8rkb\" (UID: \"06a502a0-c274-4577-907d-9a9986f6d050\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-w8rkb" Jul 08 17:20:33.385759 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.385751 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-registry-tls\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:33.385865 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:33.385809 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:20:33.385865 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:33.385820 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b7f75f48-x2qhc: secret "image-registry-tls" not found Jul 08 17:20:33.385988 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.385867 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-bound-sa-token\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:33.385988 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:33.385873 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-registry-tls podName:cbc6e240-dbb5-480e-9139-7f3d73c8a5e6 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:33.88585742 +0000 UTC m=+246.296672795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-registry-tls") pod "image-registry-68b7f75f48-x2qhc" (UID: "cbc6e240-dbb5-480e-9139-7f3d73c8a5e6") : secret "image-registry-tls" not found Jul 08 17:20:33.385988 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.385902 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c2541cd3-af4f-4de5-b042-3611d02a80ab-serving-cert\") pod \"console-operator-68b757fb67-gsn8l\" (UID: \"c2541cd3-af4f-4de5-b042-3611d02a80ab\") " pod="openshift-console-operator/console-operator-68b757fb67-gsn8l" Jul 08 17:20:33.385988 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.385954 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-image-registry-private-configuration\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:33.385988 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.385980 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-ca-trust-extracted\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:33.386232 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.386010 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/06a502a0-c274-4577-907d-9a9986f6d050-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-w8rkb\" (UID: \"06a502a0-c274-4577-907d-9a9986f6d050\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-w8rkb" Jul 08 17:20:33.386232 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.386035 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntbck\" (UniqueName: \"kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-kube-api-access-ntbck\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:33.386232 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.386054 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-registry-certificates\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:33.386232 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.386065 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-installation-pull-secrets\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:33.386232 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.386091 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c2541cd3-af4f-4de5-b042-3611d02a80ab-trusted-ca\") pod \"console-operator-68b757fb67-gsn8l\" (UID: \"c2541cd3-af4f-4de5-b042-3611d02a80ab\") " pod="openshift-console-operator/console-operator-68b757fb67-gsn8l" Jul 08 17:20:33.386232 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.386120 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmfdl\" (UniqueName: \"kubernetes.io/projected/163045b4-d9dd-49b6-86f9-eb3e75f72fe0-kube-api-access-mmfdl\") pod \"network-check-source-989f8b8dc-zxkjb\" (UID: \"163045b4-d9dd-49b6-86f9-eb3e75f72fe0\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zxkjb" Jul 08 17:20:33.386513 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.386286 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c2541cd3-af4f-4de5-b042-3611d02a80ab-config\") pod \"console-operator-68b757fb67-gsn8l\" (UID: \"c2541cd3-af4f-4de5-b042-3611d02a80ab\") " pod="openshift-console-operator/console-operator-68b757fb67-gsn8l" Jul 08 17:20:33.386513 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.386358 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/06a502a0-c274-4577-907d-9a9986f6d050-config\") pod \"service-ca-operator-5d46d9ffd4-w8rkb\" (UID: \"06a502a0-c274-4577-907d-9a9986f6d050\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-w8rkb" Jul 08 17:20:33.386513 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.386368 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-ca-trust-extracted\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:33.386678 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.386536 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-trusted-ca\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:33.387101 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.387079 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c2541cd3-af4f-4de5-b042-3611d02a80ab-trusted-ca\") pod \"console-operator-68b757fb67-gsn8l\" (UID: \"c2541cd3-af4f-4de5-b042-3611d02a80ab\") " pod="openshift-console-operator/console-operator-68b757fb67-gsn8l" Jul 08 17:20:33.388341 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.388318 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c2541cd3-af4f-4de5-b042-3611d02a80ab-serving-cert\") pod \"console-operator-68b757fb67-gsn8l\" (UID: \"c2541cd3-af4f-4de5-b042-3611d02a80ab\") " pod="openshift-console-operator/console-operator-68b757fb67-gsn8l" Jul 08 17:20:33.388524 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.388350 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/06a502a0-c274-4577-907d-9a9986f6d050-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-w8rkb\" (UID: \"06a502a0-c274-4577-907d-9a9986f6d050\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-w8rkb" Jul 08 17:20:33.388823 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.388801 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-installation-pull-secrets\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:33.388893 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.388821 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-image-registry-private-configuration\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:33.393664 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.393588 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrnwp\" (UniqueName: \"kubernetes.io/projected/426b5172-1e2b-4b06-861e-cdff3b2722b5-kube-api-access-jrnwp\") pod \"cluster-samples-operator-56fcf86bf-mp2bg\" (UID: \"426b5172-1e2b-4b06-861e-cdff3b2722b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mp2bg" Jul 08 17:20:33.393777 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.393762 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49zxh\" (UniqueName: \"kubernetes.io/projected/06a502a0-c274-4577-907d-9a9986f6d050-kube-api-access-49zxh\") pod \"service-ca-operator-5d46d9ffd4-w8rkb\" (UID: \"06a502a0-c274-4577-907d-9a9986f6d050\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-w8rkb" Jul 08 17:20:33.393865 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.393843 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px8ft\" (UniqueName: \"kubernetes.io/projected/c2541cd3-af4f-4de5-b042-3611d02a80ab-kube-api-access-px8ft\") pod \"console-operator-68b757fb67-gsn8l\" (UID: \"c2541cd3-af4f-4de5-b042-3611d02a80ab\") " pod="openshift-console-operator/console-operator-68b757fb67-gsn8l" Jul 08 17:20:33.394299 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.394275 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-bound-sa-token\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:33.394409 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.394329 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntbck\" (UniqueName: \"kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-kube-api-access-ntbck\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:33.453184 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.453146 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-w8rkb" Jul 08 17:20:33.466271 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.466245 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-gsn8l" Jul 08 17:20:33.486927 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.486880 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmfdl\" (UniqueName: \"kubernetes.io/projected/163045b4-d9dd-49b6-86f9-eb3e75f72fe0-kube-api-access-mmfdl\") pod \"network-check-source-989f8b8dc-zxkjb\" (UID: \"163045b4-d9dd-49b6-86f9-eb3e75f72fe0\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zxkjb" Jul 08 17:20:33.495757 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.495722 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmfdl\" (UniqueName: \"kubernetes.io/projected/163045b4-d9dd-49b6-86f9-eb3e75f72fe0-kube-api-access-mmfdl\") pod \"network-check-source-989f8b8dc-zxkjb\" (UID: \"163045b4-d9dd-49b6-86f9-eb3e75f72fe0\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zxkjb" Jul 08 17:20:33.548255 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.548208 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zxkjb" Jul 08 17:20:33.586101 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.586067 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-w8rkb"] Jul 08 17:20:33.588895 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:20:33.588851 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06a502a0_c274_4577_907d_9a9986f6d050.slice/crio-e31470e2026ae3a80401007f210de79f32491f2133218d66fa71efb4a136cf24 WatchSource:0}: Error finding container e31470e2026ae3a80401007f210de79f32491f2133218d66fa71efb4a136cf24: Status 404 returned error can't find the container with id e31470e2026ae3a80401007f210de79f32491f2133218d66fa71efb4a136cf24 Jul 08 17:20:33.606504 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.606470 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-gsn8l"] Jul 08 17:20:33.610197 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:20:33.610171 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2541cd3_af4f_4de5_b042_3611d02a80ab.slice/crio-723143c3fa73b49b1605d720401dbc828a2e6f911a8da7ac39ab78ec1032fec6 WatchSource:0}: Error finding container 723143c3fa73b49b1605d720401dbc828a2e6f911a8da7ac39ab78ec1032fec6: Status 404 returned error can't find the container with id 723143c3fa73b49b1605d720401dbc828a2e6f911a8da7ac39ab78ec1032fec6 Jul 08 17:20:33.679588 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.679499 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-zxkjb"] Jul 08 17:20:33.682939 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:20:33.682894 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod163045b4_d9dd_49b6_86f9_eb3e75f72fe0.slice/crio-415e9b9e16a1b87c3ec616459029a185da6becd00c93f16c8d987627a8118f86 WatchSource:0}: Error finding container 415e9b9e16a1b87c3ec616459029a185da6becd00c93f16c8d987627a8118f86: Status 404 returned error can't find the container with id 415e9b9e16a1b87c3ec616459029a185da6becd00c93f16c8d987627a8118f86 Jul 08 17:20:33.794455 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.794420 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-w8rkb" event={"ID":"06a502a0-c274-4577-907d-9a9986f6d050","Type":"ContainerStarted","Data":"e31470e2026ae3a80401007f210de79f32491f2133218d66fa71efb4a136cf24"} Jul 08 17:20:33.795851 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.795821 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zxkjb" event={"ID":"163045b4-d9dd-49b6-86f9-eb3e75f72fe0","Type":"ContainerStarted","Data":"97d71c72d7d16c5827c7d75f51733fb5063f410e055bd46ec7639ce28b3a5ebb"} Jul 08 17:20:33.796009 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.795876 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zxkjb" event={"ID":"163045b4-d9dd-49b6-86f9-eb3e75f72fe0","Type":"ContainerStarted","Data":"415e9b9e16a1b87c3ec616459029a185da6becd00c93f16c8d987627a8118f86"} Jul 08 17:20:33.796846 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.796820 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-gsn8l" event={"ID":"c2541cd3-af4f-4de5-b042-3611d02a80ab","Type":"ContainerStarted","Data":"723143c3fa73b49b1605d720401dbc828a2e6f911a8da7ac39ab78ec1032fec6"} Jul 08 17:20:33.812769 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.812714 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-zxkjb" podStartSLOduration=0.812692131 podStartE2EDuration="812.692131ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:20:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:33.811541599 +0000 UTC m=+246.222356990" watchObservedRunningTime="2026-07-08 17:20:33.812692131 +0000 UTC m=+246.223507511" Jul 08 17:20:33.889584 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.889544 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/426b5172-1e2b-4b06-861e-cdff3b2722b5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mp2bg\" (UID: \"426b5172-1e2b-4b06-861e-cdff3b2722b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mp2bg" Jul 08 17:20:33.889782 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:33.889615 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-registry-tls\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:33.889782 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:33.889693 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 17:20:33.889782 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:33.889714 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:20:33.889782 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:33.889731 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b7f75f48-x2qhc: secret "image-registry-tls" not found Jul 08 17:20:33.889782 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:33.889756 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/426b5172-1e2b-4b06-861e-cdff3b2722b5-samples-operator-tls podName:426b5172-1e2b-4b06-861e-cdff3b2722b5 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:34.889740041 +0000 UTC m=+247.300555396 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/426b5172-1e2b-4b06-861e-cdff3b2722b5-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mp2bg" (UID: "426b5172-1e2b-4b06-861e-cdff3b2722b5") : secret "samples-operator-tls" not found Jul 08 17:20:33.889782 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:33.889773 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-registry-tls podName:cbc6e240-dbb5-480e-9139-7f3d73c8a5e6 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:34.889766642 +0000 UTC m=+247.300581997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-registry-tls") pod "image-registry-68b7f75f48-x2qhc" (UID: "cbc6e240-dbb5-480e-9139-7f3d73c8a5e6") : secret "image-registry-tls" not found Jul 08 17:20:34.898764 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:34.898724 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/426b5172-1e2b-4b06-861e-cdff3b2722b5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mp2bg\" (UID: \"426b5172-1e2b-4b06-861e-cdff3b2722b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mp2bg" Jul 08 17:20:34.899263 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:34.898781 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-registry-tls\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:34.899263 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:34.898885 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 17:20:34.899263 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:34.898933 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:20:34.899263 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:34.898947 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b7f75f48-x2qhc: secret "image-registry-tls" not found Jul 08 17:20:34.899263 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:34.898975 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/426b5172-1e2b-4b06-861e-cdff3b2722b5-samples-operator-tls podName:426b5172-1e2b-4b06-861e-cdff3b2722b5 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:36.898955001 +0000 UTC m=+249.309770358 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/426b5172-1e2b-4b06-861e-cdff3b2722b5-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mp2bg" (UID: "426b5172-1e2b-4b06-861e-cdff3b2722b5") : secret "samples-operator-tls" not found Jul 08 17:20:34.899263 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:34.898993 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-registry-tls podName:cbc6e240-dbb5-480e-9139-7f3d73c8a5e6 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:36.89898441 +0000 UTC m=+249.309799765 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-registry-tls") pod "image-registry-68b7f75f48-x2qhc" (UID: "cbc6e240-dbb5-480e-9139-7f3d73c8a5e6") : secret "image-registry-tls" not found Jul 08 17:20:36.814742 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:36.814633 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-w8rkb" event={"ID":"06a502a0-c274-4577-907d-9a9986f6d050","Type":"ContainerStarted","Data":"c5905324b6cf66deaa675388828133be418dc6360e69b5ef1972c19d1261ec3e"} Jul 08 17:20:36.816206 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:36.816185 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gsn8l_c2541cd3-af4f-4de5-b042-3611d02a80ab/console-operator/0.log" Jul 08 17:20:36.816350 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:36.816225 2556 generic.go:356] "Generic (PLEG): container finished" podID="c2541cd3-af4f-4de5-b042-3611d02a80ab" containerID="edf8007db66dfbb396b91f6919038359b43d10661c025876b88ff158efa1a538" exitCode=255 Jul 08 17:20:36.816350 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:36.816269 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-gsn8l" event={"ID":"c2541cd3-af4f-4de5-b042-3611d02a80ab","Type":"ContainerDied","Data":"edf8007db66dfbb396b91f6919038359b43d10661c025876b88ff158efa1a538"} Jul 08 17:20:36.816500 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:36.816485 2556 scope.go:117] "RemoveContainer" containerID="edf8007db66dfbb396b91f6919038359b43d10661c025876b88ff158efa1a538" Jul 08 17:20:36.829298 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:36.829091 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-w8rkb" podStartSLOduration=1.047732716 podStartE2EDuration="3.829073748s" totalImagesPullingTime="2.781341032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:20:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:36.828221053 +0000 UTC m=+249.239036432" watchObservedRunningTime="2026-07-08 17:20:36.829073748 +0000 UTC m=+249.239889125" Jul 08 17:20:36.913373 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:36.913330 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/426b5172-1e2b-4b06-861e-cdff3b2722b5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mp2bg\" (UID: \"426b5172-1e2b-4b06-861e-cdff3b2722b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mp2bg" Jul 08 17:20:36.913567 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:36.913470 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 17:20:36.913567 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:36.913531 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/426b5172-1e2b-4b06-861e-cdff3b2722b5-samples-operator-tls podName:426b5172-1e2b-4b06-861e-cdff3b2722b5 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:40.913512378 +0000 UTC m=+253.324327739 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/426b5172-1e2b-4b06-861e-cdff3b2722b5-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mp2bg" (UID: "426b5172-1e2b-4b06-861e-cdff3b2722b5") : secret "samples-operator-tls" not found Jul 08 17:20:36.913669 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:36.913618 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-registry-tls\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:36.914136 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:36.914098 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:20:36.914136 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:36.914116 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b7f75f48-x2qhc: secret "image-registry-tls" not found Jul 08 17:20:36.914334 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:36.914175 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-registry-tls podName:cbc6e240-dbb5-480e-9139-7f3d73c8a5e6 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:40.914155952 +0000 UTC m=+253.324971322 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-registry-tls") pod "image-registry-68b7f75f48-x2qhc" (UID: "cbc6e240-dbb5-480e-9139-7f3d73c8a5e6") : secret "image-registry-tls" not found Jul 08 17:20:37.574234 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:37.574197 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-25r84"] Jul 08 17:20:37.576366 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:37.576344 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-25r84" Jul 08 17:20:37.578874 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:37.578850 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 17:20:37.579015 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:37.578878 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 17:20:37.579015 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:37.578948 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 17:20:37.579320 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:37.579304 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 17:20:37.579843 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:37.579830 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6zxwc\"" Jul 08 17:20:37.590033 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:37.590008 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-25r84"] Jul 08 17:20:37.719735 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:37.719693 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c12acef5-40a9-4e66-932a-d26dcf75aa4e-crio-socket\") pod \"insights-runtime-extractor-25r84\" (UID: \"c12acef5-40a9-4e66-932a-d26dcf75aa4e\") " pod="openshift-insights/insights-runtime-extractor-25r84" Jul 08 17:20:37.719735 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:37.719730 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c12acef5-40a9-4e66-932a-d26dcf75aa4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25r84\" (UID: \"c12acef5-40a9-4e66-932a-d26dcf75aa4e\") " pod="openshift-insights/insights-runtime-extractor-25r84" Jul 08 17:20:37.719938 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:37.719832 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c12acef5-40a9-4e66-932a-d26dcf75aa4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25r84\" (UID: \"c12acef5-40a9-4e66-932a-d26dcf75aa4e\") " pod="openshift-insights/insights-runtime-extractor-25r84" Jul 08 17:20:37.719938 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:37.719867 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c12acef5-40a9-4e66-932a-d26dcf75aa4e-data-volume\") pod \"insights-runtime-extractor-25r84\" (UID: \"c12acef5-40a9-4e66-932a-d26dcf75aa4e\") " pod="openshift-insights/insights-runtime-extractor-25r84" Jul 08 17:20:37.720025 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:37.719935 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9b49\" (UniqueName: \"kubernetes.io/projected/c12acef5-40a9-4e66-932a-d26dcf75aa4e-kube-api-access-j9b49\") pod \"insights-runtime-extractor-25r84\" (UID: \"c12acef5-40a9-4e66-932a-d26dcf75aa4e\") " pod="openshift-insights/insights-runtime-extractor-25r84" Jul 08 17:20:37.820262 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:37.820229 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c12acef5-40a9-4e66-932a-d26dcf75aa4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25r84\" (UID: \"c12acef5-40a9-4e66-932a-d26dcf75aa4e\") " pod="openshift-insights/insights-runtime-extractor-25r84" Jul 08 17:20:37.820262 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:37.820261 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c12acef5-40a9-4e66-932a-d26dcf75aa4e-data-volume\") pod \"insights-runtime-extractor-25r84\" (UID: \"c12acef5-40a9-4e66-932a-d26dcf75aa4e\") " pod="openshift-insights/insights-runtime-extractor-25r84" Jul 08 17:20:37.820783 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:37.820302 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9b49\" (UniqueName: \"kubernetes.io/projected/c12acef5-40a9-4e66-932a-d26dcf75aa4e-kube-api-access-j9b49\") pod \"insights-runtime-extractor-25r84\" (UID: \"c12acef5-40a9-4e66-932a-d26dcf75aa4e\") " pod="openshift-insights/insights-runtime-extractor-25r84" Jul 08 17:20:37.820783 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:37.820330 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:20:37.820783 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:37.820409 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c12acef5-40a9-4e66-932a-d26dcf75aa4e-insights-runtime-extractor-tls podName:c12acef5-40a9-4e66-932a-d26dcf75aa4e nodeName:}" failed. No retries permitted until 2026-07-08 17:20:38.320385506 +0000 UTC m=+250.731200863 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c12acef5-40a9-4e66-932a-d26dcf75aa4e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-25r84" (UID: "c12acef5-40a9-4e66-932a-d26dcf75aa4e") : secret "insights-runtime-extractor-tls" not found Jul 08 17:20:37.820783 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:37.820434 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c12acef5-40a9-4e66-932a-d26dcf75aa4e-crio-socket\") pod \"insights-runtime-extractor-25r84\" (UID: \"c12acef5-40a9-4e66-932a-d26dcf75aa4e\") " pod="openshift-insights/insights-runtime-extractor-25r84" Jul 08 17:20:37.820783 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:37.820465 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c12acef5-40a9-4e66-932a-d26dcf75aa4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25r84\" (UID: \"c12acef5-40a9-4e66-932a-d26dcf75aa4e\") " pod="openshift-insights/insights-runtime-extractor-25r84" Jul 08 17:20:37.820783 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:37.820514 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c12acef5-40a9-4e66-932a-d26dcf75aa4e-crio-socket\") pod \"insights-runtime-extractor-25r84\" (UID: \"c12acef5-40a9-4e66-932a-d26dcf75aa4e\") " pod="openshift-insights/insights-runtime-extractor-25r84" Jul 08 17:20:37.820783 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:37.820550 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 17:20:37.820783 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:37.820594 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c12acef5-40a9-4e66-932a-d26dcf75aa4e-kube-rbac-proxy-cm podName:c12acef5-40a9-4e66-932a-d26dcf75aa4e nodeName:}" failed. No retries permitted until 2026-07-08 17:20:38.32058051 +0000 UTC m=+250.731395866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c12acef5-40a9-4e66-932a-d26dcf75aa4e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-25r84" (UID: "c12acef5-40a9-4e66-932a-d26dcf75aa4e") : configmap "kube-rbac-proxy" not found Jul 08 17:20:37.820783 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:37.820758 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c12acef5-40a9-4e66-932a-d26dcf75aa4e-data-volume\") pod \"insights-runtime-extractor-25r84\" (UID: \"c12acef5-40a9-4e66-932a-d26dcf75aa4e\") " pod="openshift-insights/insights-runtime-extractor-25r84" Jul 08 17:20:37.821255 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:37.821241 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gsn8l_c2541cd3-af4f-4de5-b042-3611d02a80ab/console-operator/1.log" Jul 08 17:20:37.821683 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:37.821666 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gsn8l_c2541cd3-af4f-4de5-b042-3611d02a80ab/console-operator/0.log" Jul 08 17:20:37.821783 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:37.821703 2556 generic.go:356] "Generic (PLEG): container finished" podID="c2541cd3-af4f-4de5-b042-3611d02a80ab" containerID="994616afed9d0098d130e799f462fdc5afc736cf7962906f1ad5d9b0c43b60c6" exitCode=255 Jul 08 17:20:37.821832 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:37.821777 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-gsn8l" event={"ID":"c2541cd3-af4f-4de5-b042-3611d02a80ab","Type":"ContainerDied","Data":"994616afed9d0098d130e799f462fdc5afc736cf7962906f1ad5d9b0c43b60c6"} Jul 08 17:20:37.821832 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:37.821822 2556 scope.go:117] "RemoveContainer" containerID="edf8007db66dfbb396b91f6919038359b43d10661c025876b88ff158efa1a538" Jul 08 17:20:37.822042 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:37.822020 2556 scope.go:117] "RemoveContainer" containerID="994616afed9d0098d130e799f462fdc5afc736cf7962906f1ad5d9b0c43b60c6" Jul 08 17:20:37.822220 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:37.822198 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-gsn8l_openshift-console-operator(c2541cd3-af4f-4de5-b042-3611d02a80ab)\"" pod="openshift-console-operator/console-operator-68b757fb67-gsn8l" podUID="c2541cd3-af4f-4de5-b042-3611d02a80ab" Jul 08 17:20:37.830757 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:37.830705 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9b49\" (UniqueName: \"kubernetes.io/projected/c12acef5-40a9-4e66-932a-d26dcf75aa4e-kube-api-access-j9b49\") pod \"insights-runtime-extractor-25r84\" (UID: \"c12acef5-40a9-4e66-932a-d26dcf75aa4e\") " pod="openshift-insights/insights-runtime-extractor-25r84" Jul 08 17:20:38.324927 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:38.324884 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c12acef5-40a9-4e66-932a-d26dcf75aa4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25r84\" (UID: \"c12acef5-40a9-4e66-932a-d26dcf75aa4e\") " pod="openshift-insights/insights-runtime-extractor-25r84" Jul 08 17:20:38.325090 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:38.324968 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c12acef5-40a9-4e66-932a-d26dcf75aa4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25r84\" (UID: \"c12acef5-40a9-4e66-932a-d26dcf75aa4e\") " pod="openshift-insights/insights-runtime-extractor-25r84" Jul 08 17:20:38.325090 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:38.325002 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 17:20:38.325090 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:38.325069 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:20:38.325090 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:38.325079 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c12acef5-40a9-4e66-932a-d26dcf75aa4e-kube-rbac-proxy-cm podName:c12acef5-40a9-4e66-932a-d26dcf75aa4e nodeName:}" failed. No retries permitted until 2026-07-08 17:20:39.325062518 +0000 UTC m=+251.735877873 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c12acef5-40a9-4e66-932a-d26dcf75aa4e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-25r84" (UID: "c12acef5-40a9-4e66-932a-d26dcf75aa4e") : configmap "kube-rbac-proxy" not found Jul 08 17:20:38.325237 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:38.325108 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c12acef5-40a9-4e66-932a-d26dcf75aa4e-insights-runtime-extractor-tls podName:c12acef5-40a9-4e66-932a-d26dcf75aa4e nodeName:}" failed. No retries permitted until 2026-07-08 17:20:39.325097077 +0000 UTC m=+251.735912433 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c12acef5-40a9-4e66-932a-d26dcf75aa4e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-25r84" (UID: "c12acef5-40a9-4e66-932a-d26dcf75aa4e") : secret "insights-runtime-extractor-tls" not found Jul 08 17:20:38.401480 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:38.401444 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-blmwx"] Jul 08 17:20:38.404054 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:38.404038 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-blmwx" Jul 08 17:20:38.406208 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:38.406185 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 08 17:20:38.407171 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:38.407150 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-xp5hg\"" Jul 08 17:20:38.407171 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:38.407161 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 08 17:20:38.416217 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:38.416194 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-blmwx"] Jul 08 17:20:38.526031 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:38.525994 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn558\" (UniqueName: \"kubernetes.io/projected/e0ad491d-2559-4336-98b8-78d3ccf57ffc-kube-api-access-zn558\") pod \"migrator-d57d58cc9-blmwx\" (UID: \"e0ad491d-2559-4336-98b8-78d3ccf57ffc\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-blmwx" Jul 08 17:20:38.626504 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:38.626463 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn558\" (UniqueName: \"kubernetes.io/projected/e0ad491d-2559-4336-98b8-78d3ccf57ffc-kube-api-access-zn558\") pod \"migrator-d57d58cc9-blmwx\" (UID: \"e0ad491d-2559-4336-98b8-78d3ccf57ffc\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-blmwx" Jul 08 17:20:38.635087 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:38.635063 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn558\" (UniqueName: \"kubernetes.io/projected/e0ad491d-2559-4336-98b8-78d3ccf57ffc-kube-api-access-zn558\") pod \"migrator-d57d58cc9-blmwx\" (UID: \"e0ad491d-2559-4336-98b8-78d3ccf57ffc\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-blmwx" Jul 08 17:20:38.712862 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:38.712828 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-blmwx" Jul 08 17:20:38.826490 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:38.826466 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gsn8l_c2541cd3-af4f-4de5-b042-3611d02a80ab/console-operator/1.log" Jul 08 17:20:38.826955 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:38.826881 2556 scope.go:117] "RemoveContainer" containerID="994616afed9d0098d130e799f462fdc5afc736cf7962906f1ad5d9b0c43b60c6" Jul 08 17:20:38.827107 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:38.827085 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-gsn8l_openshift-console-operator(c2541cd3-af4f-4de5-b042-3611d02a80ab)\"" pod="openshift-console-operator/console-operator-68b757fb67-gsn8l" podUID="c2541cd3-af4f-4de5-b042-3611d02a80ab" Jul 08 17:20:38.840500 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:38.840474 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-blmwx"] Jul 08 17:20:38.843688 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:20:38.843663 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0ad491d_2559_4336_98b8_78d3ccf57ffc.slice/crio-ab782be768d8f187776dee26d25aa6bb42cc8cbb6f2d2810f3bfd9defa558756 WatchSource:0}: Error finding container ab782be768d8f187776dee26d25aa6bb42cc8cbb6f2d2810f3bfd9defa558756: Status 404 returned error can't find the container with id ab782be768d8f187776dee26d25aa6bb42cc8cbb6f2d2810f3bfd9defa558756 Jul 08 17:20:39.331994 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:39.331958 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c12acef5-40a9-4e66-932a-d26dcf75aa4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25r84\" (UID: \"c12acef5-40a9-4e66-932a-d26dcf75aa4e\") " pod="openshift-insights/insights-runtime-extractor-25r84" Jul 08 17:20:39.332189 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:39.332011 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c12acef5-40a9-4e66-932a-d26dcf75aa4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25r84\" (UID: \"c12acef5-40a9-4e66-932a-d26dcf75aa4e\") " pod="openshift-insights/insights-runtime-extractor-25r84" Jul 08 17:20:39.332189 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:39.332095 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 17:20:39.332189 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:39.332119 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:20:39.332189 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:39.332166 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c12acef5-40a9-4e66-932a-d26dcf75aa4e-kube-rbac-proxy-cm podName:c12acef5-40a9-4e66-932a-d26dcf75aa4e nodeName:}" failed. No retries permitted until 2026-07-08 17:20:41.332147398 +0000 UTC m=+253.742962768 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c12acef5-40a9-4e66-932a-d26dcf75aa4e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-25r84" (UID: "c12acef5-40a9-4e66-932a-d26dcf75aa4e") : configmap "kube-rbac-proxy" not found Jul 08 17:20:39.332189 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:39.332182 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c12acef5-40a9-4e66-932a-d26dcf75aa4e-insights-runtime-extractor-tls podName:c12acef5-40a9-4e66-932a-d26dcf75aa4e nodeName:}" failed. No retries permitted until 2026-07-08 17:20:41.332172111 +0000 UTC m=+253.742987466 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c12acef5-40a9-4e66-932a-d26dcf75aa4e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-25r84" (UID: "c12acef5-40a9-4e66-932a-d26dcf75aa4e") : secret "insights-runtime-extractor-tls" not found Jul 08 17:20:39.541550 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:39.541514 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-prs9n_15835642-65cd-4a89-a1a1-1950d6130bd1/dns-node-resolver/0.log" Jul 08 17:20:39.830450 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:39.830412 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-blmwx" event={"ID":"e0ad491d-2559-4336-98b8-78d3ccf57ffc","Type":"ContainerStarted","Data":"ab782be768d8f187776dee26d25aa6bb42cc8cbb6f2d2810f3bfd9defa558756"} Jul 08 17:20:39.937394 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:39.937355 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs\") pod \"network-metrics-daemon-84tqr\" (UID: \"6408e7f4-87d3-48a2-943f-7971adbf51f8\") " pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:20:39.937570 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:39.937494 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 17:20:39.937570 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:39.937554 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs podName:6408e7f4-87d3-48a2-943f-7971adbf51f8 nodeName:}" failed. No retries permitted until 2026-07-08 17:22:41.937537777 +0000 UTC m=+374.348353151 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs") pod "network-metrics-daemon-84tqr" (UID: "6408e7f4-87d3-48a2-943f-7971adbf51f8") : secret "metrics-daemon-secret" not found Jul 08 17:20:40.742160 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:40.742135 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cppc4_8f7a5c3b-9cee-4f0c-b5d0-dbf3d4d4b7af/node-ca/0.log" Jul 08 17:20:40.834797 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:40.834763 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-blmwx" event={"ID":"e0ad491d-2559-4336-98b8-78d3ccf57ffc","Type":"ContainerStarted","Data":"54726e5506727503dc9120f4141b94772292680eeadc412ab508b4d535ecb51f"} Jul 08 17:20:40.835163 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:40.834823 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-blmwx" event={"ID":"e0ad491d-2559-4336-98b8-78d3ccf57ffc","Type":"ContainerStarted","Data":"c35755f270d364c79e3f88bb4c9fbdd903b8a1e504dffb17637d1420e3bc56f2"} Jul 08 17:20:40.853046 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:40.853000 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-blmwx" podStartSLOduration=1.575402186 podStartE2EDuration="2.852985199s" totalImagesPullingTime="1.277583013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:20:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:40.852046042 +0000 UTC m=+253.262861423" watchObservedRunningTime="2026-07-08 17:20:40.852985199 +0000 UTC m=+253.263800575" Jul 08 17:20:40.945291 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:40.945248 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/426b5172-1e2b-4b06-861e-cdff3b2722b5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mp2bg\" (UID: \"426b5172-1e2b-4b06-861e-cdff3b2722b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mp2bg" Jul 08 17:20:40.945402 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:40.945378 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-registry-tls\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:40.945498 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:40.945476 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:20:40.945533 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:40.945500 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b7f75f48-x2qhc: secret "image-registry-tls" not found Jul 08 17:20:40.945533 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:40.945515 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 17:20:40.945593 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:40.945554 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-registry-tls podName:cbc6e240-dbb5-480e-9139-7f3d73c8a5e6 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:48.945538837 +0000 UTC m=+261.356354192 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-registry-tls") pod "image-registry-68b7f75f48-x2qhc" (UID: "cbc6e240-dbb5-480e-9139-7f3d73c8a5e6") : secret "image-registry-tls" not found Jul 08 17:20:40.945593 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:40.945569 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/426b5172-1e2b-4b06-861e-cdff3b2722b5-samples-operator-tls podName:426b5172-1e2b-4b06-861e-cdff3b2722b5 nodeName:}" failed. No retries permitted until 2026-07-08 17:20:48.945562406 +0000 UTC m=+261.356377761 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/426b5172-1e2b-4b06-861e-cdff3b2722b5-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-mp2bg" (UID: "426b5172-1e2b-4b06-861e-cdff3b2722b5") : secret "samples-operator-tls" not found Jul 08 17:20:41.341499 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:41.341469 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jh42n_e45622c1-3192-42a3-aeef-56cf942bcc63/serve-healthcheck-canary/0.log" Jul 08 17:20:41.347741 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:41.347717 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c12acef5-40a9-4e66-932a-d26dcf75aa4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25r84\" (UID: \"c12acef5-40a9-4e66-932a-d26dcf75aa4e\") " pod="openshift-insights/insights-runtime-extractor-25r84" Jul 08 17:20:41.347825 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:41.347773 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c12acef5-40a9-4e66-932a-d26dcf75aa4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25r84\" (UID: \"c12acef5-40a9-4e66-932a-d26dcf75aa4e\") " pod="openshift-insights/insights-runtime-extractor-25r84" Jul 08 17:20:41.347878 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:41.347828 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 17:20:41.347878 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:41.347868 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:20:41.347981 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:41.347886 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c12acef5-40a9-4e66-932a-d26dcf75aa4e-kube-rbac-proxy-cm podName:c12acef5-40a9-4e66-932a-d26dcf75aa4e nodeName:}" failed. No retries permitted until 2026-07-08 17:20:45.347872125 +0000 UTC m=+257.758687480 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c12acef5-40a9-4e66-932a-d26dcf75aa4e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-25r84" (UID: "c12acef5-40a9-4e66-932a-d26dcf75aa4e") : configmap "kube-rbac-proxy" not found Jul 08 17:20:41.347981 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:41.347943 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c12acef5-40a9-4e66-932a-d26dcf75aa4e-insights-runtime-extractor-tls podName:c12acef5-40a9-4e66-932a-d26dcf75aa4e nodeName:}" failed. No retries permitted until 2026-07-08 17:20:45.347897828 +0000 UTC m=+257.758713183 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c12acef5-40a9-4e66-932a-d26dcf75aa4e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-25r84" (UID: "c12acef5-40a9-4e66-932a-d26dcf75aa4e") : secret "insights-runtime-extractor-tls" not found Jul 08 17:20:43.467118 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:43.467033 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-gsn8l" Jul 08 17:20:43.467118 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:43.467085 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-gsn8l" Jul 08 17:20:43.467504 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:43.467395 2556 scope.go:117] "RemoveContainer" containerID="994616afed9d0098d130e799f462fdc5afc736cf7962906f1ad5d9b0c43b60c6" Jul 08 17:20:43.467540 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:43.467526 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-gsn8l_openshift-console-operator(c2541cd3-af4f-4de5-b042-3611d02a80ab)\"" pod="openshift-console-operator/console-operator-68b757fb67-gsn8l" podUID="c2541cd3-af4f-4de5-b042-3611d02a80ab" Jul 08 17:20:45.376761 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:45.376717 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c12acef5-40a9-4e66-932a-d26dcf75aa4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25r84\" (UID: \"c12acef5-40a9-4e66-932a-d26dcf75aa4e\") " pod="openshift-insights/insights-runtime-extractor-25r84" Jul 08 17:20:45.377209 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:45.376864 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:20:45.377209 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:45.376889 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c12acef5-40a9-4e66-932a-d26dcf75aa4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25r84\" (UID: \"c12acef5-40a9-4e66-932a-d26dcf75aa4e\") " pod="openshift-insights/insights-runtime-extractor-25r84" Jul 08 17:20:45.377209 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:45.376946 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c12acef5-40a9-4e66-932a-d26dcf75aa4e-insights-runtime-extractor-tls podName:c12acef5-40a9-4e66-932a-d26dcf75aa4e nodeName:}" failed. No retries permitted until 2026-07-08 17:20:53.376930653 +0000 UTC m=+265.787746009 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c12acef5-40a9-4e66-932a-d26dcf75aa4e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-25r84" (UID: "c12acef5-40a9-4e66-932a-d26dcf75aa4e") : secret "insights-runtime-extractor-tls" not found Jul 08 17:20:45.377209 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:45.376977 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 17:20:45.377209 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:45.377015 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c12acef5-40a9-4e66-932a-d26dcf75aa4e-kube-rbac-proxy-cm podName:c12acef5-40a9-4e66-932a-d26dcf75aa4e nodeName:}" failed. No retries permitted until 2026-07-08 17:20:53.377004763 +0000 UTC m=+265.787820118 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c12acef5-40a9-4e66-932a-d26dcf75aa4e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-25r84" (UID: "c12acef5-40a9-4e66-932a-d26dcf75aa4e") : configmap "kube-rbac-proxy" not found Jul 08 17:20:49.006431 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:49.006389 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/426b5172-1e2b-4b06-861e-cdff3b2722b5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mp2bg\" (UID: \"426b5172-1e2b-4b06-861e-cdff3b2722b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mp2bg" Jul 08 17:20:49.006954 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:49.006513 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-registry-tls\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:49.008741 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:49.008714 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/426b5172-1e2b-4b06-861e-cdff3b2722b5-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-mp2bg\" (UID: \"426b5172-1e2b-4b06-861e-cdff3b2722b5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mp2bg" Jul 08 17:20:49.008843 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:49.008780 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-registry-tls\") pod \"image-registry-68b7f75f48-x2qhc\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:49.060215 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:49.060182 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mp2bg" Jul 08 17:20:49.072526 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:49.072504 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:49.196061 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:49.196033 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mp2bg"] Jul 08 17:20:49.216676 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:49.216645 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68b7f75f48-x2qhc"] Jul 08 17:20:49.220019 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:20:49.219992 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbc6e240_dbb5_480e_9139_7f3d73c8a5e6.slice/crio-29e58207cb216b6f925dae3079cec7f87b114e080afcb0e29260265adc8b6536 WatchSource:0}: Error finding container 29e58207cb216b6f925dae3079cec7f87b114e080afcb0e29260265adc8b6536: Status 404 returned error can't find the container with id 29e58207cb216b6f925dae3079cec7f87b114e080afcb0e29260265adc8b6536 Jul 08 17:20:49.861564 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:49.861525 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mp2bg" event={"ID":"426b5172-1e2b-4b06-861e-cdff3b2722b5","Type":"ContainerStarted","Data":"38addc93c38454fe09061e99aa0fb8151030c1ab8522cd8b90008e5a1c40e45e"} Jul 08 17:20:49.862807 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:49.862782 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" event={"ID":"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6","Type":"ContainerStarted","Data":"dc23027f0d06e1480d9fcba81e46f3c794ab80971156224da0f190391fd55e94"} Jul 08 17:20:49.862963 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:49.862823 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" event={"ID":"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6","Type":"ContainerStarted","Data":"29e58207cb216b6f925dae3079cec7f87b114e080afcb0e29260265adc8b6536"} Jul 08 17:20:49.862963 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:49.862930 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:20:49.881344 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:49.881297 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" podStartSLOduration=16.881282756 podStartE2EDuration="16.881282756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:20:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:49.879644723 +0000 UTC m=+262.290460100" watchObservedRunningTime="2026-07-08 17:20:49.881282756 +0000 UTC m=+262.292098132" Jul 08 17:20:51.869944 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:51.869897 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mp2bg" event={"ID":"426b5172-1e2b-4b06-861e-cdff3b2722b5","Type":"ContainerStarted","Data":"4497c3456ebdf7aaf6dd1ba01b62154be06e1f15894bbf07cf262f328028657a"} Jul 08 17:20:51.870409 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:51.870006 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mp2bg" event={"ID":"426b5172-1e2b-4b06-861e-cdff3b2722b5","Type":"ContainerStarted","Data":"17a68e81b74f2ea5176a75b55d7b26e3f8f0f09e6e30e5c7653a8f48e449d0f8"} Jul 08 17:20:51.885209 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:51.885162 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-mp2bg" podStartSLOduration=16.71670406 podStartE2EDuration="18.885148156s" totalImagesPullingTime="2.168444096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:20:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:51.884495666 +0000 UTC m=+264.295311044" watchObservedRunningTime="2026-07-08 17:20:51.885148156 +0000 UTC m=+264.295963532" Jul 08 17:20:53.442045 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:53.441997 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c12acef5-40a9-4e66-932a-d26dcf75aa4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25r84\" (UID: \"c12acef5-40a9-4e66-932a-d26dcf75aa4e\") " pod="openshift-insights/insights-runtime-extractor-25r84" Jul 08 17:20:53.442451 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:53.442072 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c12acef5-40a9-4e66-932a-d26dcf75aa4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25r84\" (UID: \"c12acef5-40a9-4e66-932a-d26dcf75aa4e\") " pod="openshift-insights/insights-runtime-extractor-25r84" Jul 08 17:20:53.442451 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:53.442210 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:20:53.442451 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:20:53.442266 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c12acef5-40a9-4e66-932a-d26dcf75aa4e-insights-runtime-extractor-tls podName:c12acef5-40a9-4e66-932a-d26dcf75aa4e nodeName:}" failed. No retries permitted until 2026-07-08 17:21:09.442253312 +0000 UTC m=+281.853068667 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c12acef5-40a9-4e66-932a-d26dcf75aa4e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-25r84" (UID: "c12acef5-40a9-4e66-932a-d26dcf75aa4e") : secret "insights-runtime-extractor-tls" not found Jul 08 17:20:53.442563 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:53.442544 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c12acef5-40a9-4e66-932a-d26dcf75aa4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-25r84\" (UID: \"c12acef5-40a9-4e66-932a-d26dcf75aa4e\") " pod="openshift-insights/insights-runtime-extractor-25r84" Jul 08 17:20:55.106232 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:55.106206 2556 scope.go:117] "RemoveContainer" containerID="994616afed9d0098d130e799f462fdc5afc736cf7962906f1ad5d9b0c43b60c6" Jul 08 17:20:55.885292 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:55.885264 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gsn8l_c2541cd3-af4f-4de5-b042-3611d02a80ab/console-operator/1.log" Jul 08 17:20:55.885491 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:55.885318 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-gsn8l" event={"ID":"c2541cd3-af4f-4de5-b042-3611d02a80ab","Type":"ContainerStarted","Data":"c65100bebbb041626c71f7956bc45a6fb5b3f88431d3d4516b363775d0ff8d00"} Jul 08 17:20:55.885596 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:55.885577 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-gsn8l" Jul 08 17:20:55.890558 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:55.890532 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-gsn8l" Jul 08 17:20:55.904243 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:20:55.904202 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-gsn8l" podStartSLOduration=20.147496264 podStartE2EDuration="22.904189078s" totalImagesPullingTime="2.756692814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:20:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:20:55.902791265 +0000 UTC m=+268.313606643" watchObservedRunningTime="2026-07-08 17:20:55.904189078 +0000 UTC m=+268.315004455" Jul 08 17:21:02.231838 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.231805 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-dlxx4"] Jul 08 17:21:02.237553 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.237529 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-dlxx4" Jul 08 17:21:02.239589 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.239564 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68b7f75f48-x2qhc"] Jul 08 17:21:02.240021 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.240001 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 08 17:21:02.240165 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.240109 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 08 17:21:02.240279 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.240264 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-m7dx9\"" Jul 08 17:21:02.249360 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.249331 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-dlxx4"] Jul 08 17:21:02.280990 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.280951 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75dd8c987d-vrgvh"] Jul 08 17:21:02.284794 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.284772 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" Jul 08 17:21:02.306579 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.306549 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75dd8c987d-vrgvh"] Jul 08 17:21:02.308549 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.308515 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b5ce1039-f0d0-4337-8eee-093ccd762b8d-registry-tls\") pod \"image-registry-75dd8c987d-vrgvh\" (UID: \"b5ce1039-f0d0-4337-8eee-093ccd762b8d\") " pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" Jul 08 17:21:02.308726 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.308557 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b5ce1039-f0d0-4337-8eee-093ccd762b8d-registry-certificates\") pod \"image-registry-75dd8c987d-vrgvh\" (UID: \"b5ce1039-f0d0-4337-8eee-093ccd762b8d\") " pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" Jul 08 17:21:02.308726 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.308646 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b5ce1039-f0d0-4337-8eee-093ccd762b8d-installation-pull-secrets\") pod \"image-registry-75dd8c987d-vrgvh\" (UID: \"b5ce1039-f0d0-4337-8eee-093ccd762b8d\") " pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" Jul 08 17:21:02.308726 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.308692 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4shwt\" (UniqueName: \"kubernetes.io/projected/e7706413-170b-45a9-b7d5-ac5178927c7a-kube-api-access-4shwt\") pod \"downloads-685bfb5f64-dlxx4\" (UID: \"e7706413-170b-45a9-b7d5-ac5178927c7a\") " pod="openshift-console/downloads-685bfb5f64-dlxx4" Jul 08 17:21:02.308726 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.308712 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b5ce1039-f0d0-4337-8eee-093ccd762b8d-image-registry-private-configuration\") pod \"image-registry-75dd8c987d-vrgvh\" (UID: \"b5ce1039-f0d0-4337-8eee-093ccd762b8d\") " pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" Jul 08 17:21:02.308980 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.308761 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q96ht\" (UniqueName: \"kubernetes.io/projected/b5ce1039-f0d0-4337-8eee-093ccd762b8d-kube-api-access-q96ht\") pod \"image-registry-75dd8c987d-vrgvh\" (UID: \"b5ce1039-f0d0-4337-8eee-093ccd762b8d\") " pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" Jul 08 17:21:02.308980 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.308805 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b5ce1039-f0d0-4337-8eee-093ccd762b8d-ca-trust-extracted\") pod \"image-registry-75dd8c987d-vrgvh\" (UID: \"b5ce1039-f0d0-4337-8eee-093ccd762b8d\") " pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" Jul 08 17:21:02.308980 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.308830 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b5ce1039-f0d0-4337-8eee-093ccd762b8d-trusted-ca\") pod \"image-registry-75dd8c987d-vrgvh\" (UID: \"b5ce1039-f0d0-4337-8eee-093ccd762b8d\") " pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" Jul 08 17:21:02.308980 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.308882 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5ce1039-f0d0-4337-8eee-093ccd762b8d-bound-sa-token\") pod \"image-registry-75dd8c987d-vrgvh\" (UID: \"b5ce1039-f0d0-4337-8eee-093ccd762b8d\") " pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" Jul 08 17:21:02.409495 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.409460 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5ce1039-f0d0-4337-8eee-093ccd762b8d-bound-sa-token\") pod \"image-registry-75dd8c987d-vrgvh\" (UID: \"b5ce1039-f0d0-4337-8eee-093ccd762b8d\") " pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" Jul 08 17:21:02.409709 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.409515 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b5ce1039-f0d0-4337-8eee-093ccd762b8d-registry-tls\") pod \"image-registry-75dd8c987d-vrgvh\" (UID: \"b5ce1039-f0d0-4337-8eee-093ccd762b8d\") " pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" Jul 08 17:21:02.409709 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.409542 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b5ce1039-f0d0-4337-8eee-093ccd762b8d-registry-certificates\") pod \"image-registry-75dd8c987d-vrgvh\" (UID: \"b5ce1039-f0d0-4337-8eee-093ccd762b8d\") " pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" Jul 08 17:21:02.409709 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.409602 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b5ce1039-f0d0-4337-8eee-093ccd762b8d-installation-pull-secrets\") pod \"image-registry-75dd8c987d-vrgvh\" (UID: \"b5ce1039-f0d0-4337-8eee-093ccd762b8d\") " pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" Jul 08 17:21:02.409709 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.409647 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4shwt\" (UniqueName: \"kubernetes.io/projected/e7706413-170b-45a9-b7d5-ac5178927c7a-kube-api-access-4shwt\") pod \"downloads-685bfb5f64-dlxx4\" (UID: \"e7706413-170b-45a9-b7d5-ac5178927c7a\") " pod="openshift-console/downloads-685bfb5f64-dlxx4" Jul 08 17:21:02.409709 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.409672 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b5ce1039-f0d0-4337-8eee-093ccd762b8d-image-registry-private-configuration\") pod \"image-registry-75dd8c987d-vrgvh\" (UID: \"b5ce1039-f0d0-4337-8eee-093ccd762b8d\") " pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" Jul 08 17:21:02.409709 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.409709 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q96ht\" (UniqueName: \"kubernetes.io/projected/b5ce1039-f0d0-4337-8eee-093ccd762b8d-kube-api-access-q96ht\") pod \"image-registry-75dd8c987d-vrgvh\" (UID: \"b5ce1039-f0d0-4337-8eee-093ccd762b8d\") " pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" Jul 08 17:21:02.410171 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.409742 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b5ce1039-f0d0-4337-8eee-093ccd762b8d-ca-trust-extracted\") pod \"image-registry-75dd8c987d-vrgvh\" (UID: \"b5ce1039-f0d0-4337-8eee-093ccd762b8d\") " pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" Jul 08 17:21:02.410171 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.409768 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b5ce1039-f0d0-4337-8eee-093ccd762b8d-trusted-ca\") pod \"image-registry-75dd8c987d-vrgvh\" (UID: \"b5ce1039-f0d0-4337-8eee-093ccd762b8d\") " pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" Jul 08 17:21:02.410466 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.410439 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b5ce1039-f0d0-4337-8eee-093ccd762b8d-ca-trust-extracted\") pod \"image-registry-75dd8c987d-vrgvh\" (UID: \"b5ce1039-f0d0-4337-8eee-093ccd762b8d\") " pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" Jul 08 17:21:02.410655 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.410610 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b5ce1039-f0d0-4337-8eee-093ccd762b8d-registry-certificates\") pod \"image-registry-75dd8c987d-vrgvh\" (UID: \"b5ce1039-f0d0-4337-8eee-093ccd762b8d\") " pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" Jul 08 17:21:02.410720 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.410681 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b5ce1039-f0d0-4337-8eee-093ccd762b8d-trusted-ca\") pod \"image-registry-75dd8c987d-vrgvh\" (UID: \"b5ce1039-f0d0-4337-8eee-093ccd762b8d\") " pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" Jul 08 17:21:02.412192 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.412173 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b5ce1039-f0d0-4337-8eee-093ccd762b8d-registry-tls\") pod \"image-registry-75dd8c987d-vrgvh\" (UID: \"b5ce1039-f0d0-4337-8eee-093ccd762b8d\") " pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" Jul 08 17:21:02.412646 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.412625 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b5ce1039-f0d0-4337-8eee-093ccd762b8d-installation-pull-secrets\") pod \"image-registry-75dd8c987d-vrgvh\" (UID: \"b5ce1039-f0d0-4337-8eee-093ccd762b8d\") " pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" Jul 08 17:21:02.412850 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.412829 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b5ce1039-f0d0-4337-8eee-093ccd762b8d-image-registry-private-configuration\") pod \"image-registry-75dd8c987d-vrgvh\" (UID: \"b5ce1039-f0d0-4337-8eee-093ccd762b8d\") " pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" Jul 08 17:21:02.419658 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.419627 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q96ht\" (UniqueName: \"kubernetes.io/projected/b5ce1039-f0d0-4337-8eee-093ccd762b8d-kube-api-access-q96ht\") pod \"image-registry-75dd8c987d-vrgvh\" (UID: \"b5ce1039-f0d0-4337-8eee-093ccd762b8d\") " pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" Jul 08 17:21:02.419994 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.419975 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4shwt\" (UniqueName: \"kubernetes.io/projected/e7706413-170b-45a9-b7d5-ac5178927c7a-kube-api-access-4shwt\") pod \"downloads-685bfb5f64-dlxx4\" (UID: \"e7706413-170b-45a9-b7d5-ac5178927c7a\") " pod="openshift-console/downloads-685bfb5f64-dlxx4" Jul 08 17:21:02.420099 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.420079 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b5ce1039-f0d0-4337-8eee-093ccd762b8d-bound-sa-token\") pod \"image-registry-75dd8c987d-vrgvh\" (UID: \"b5ce1039-f0d0-4337-8eee-093ccd762b8d\") " pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" Jul 08 17:21:02.547429 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.547334 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-dlxx4" Jul 08 17:21:02.594699 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.594669 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" Jul 08 17:21:02.699282 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.699238 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-dlxx4"] Jul 08 17:21:02.703022 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:21:02.702991 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7706413_170b_45a9_b7d5_ac5178927c7a.slice/crio-fa1dec1c5c5e6b1f1be999f05b21a39719791ce4eb59b6544b85391ebbb58e1b WatchSource:0}: Error finding container fa1dec1c5c5e6b1f1be999f05b21a39719791ce4eb59b6544b85391ebbb58e1b: Status 404 returned error can't find the container with id fa1dec1c5c5e6b1f1be999f05b21a39719791ce4eb59b6544b85391ebbb58e1b Jul 08 17:21:02.753932 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.753882 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75dd8c987d-vrgvh"] Jul 08 17:21:02.756562 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:21:02.756527 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5ce1039_f0d0_4337_8eee_093ccd762b8d.slice/crio-8bd8c8c456bab6cd659438e34ecc17f61d3f01f0652367d03a740b80d9bd8807 WatchSource:0}: Error finding container 8bd8c8c456bab6cd659438e34ecc17f61d3f01f0652367d03a740b80d9bd8807: Status 404 returned error can't find the container with id 8bd8c8c456bab6cd659438e34ecc17f61d3f01f0652367d03a740b80d9bd8807 Jul 08 17:21:02.907866 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.907830 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" event={"ID":"b5ce1039-f0d0-4337-8eee-093ccd762b8d","Type":"ContainerStarted","Data":"f363d23bb2eceb1d57882f96f711ae7a2b4c14300c27542d426626d698197277"} Jul 08 17:21:02.908044 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.907892 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" event={"ID":"b5ce1039-f0d0-4337-8eee-093ccd762b8d","Type":"ContainerStarted","Data":"8bd8c8c456bab6cd659438e34ecc17f61d3f01f0652367d03a740b80d9bd8807"} Jul 08 17:21:02.908044 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.907945 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" Jul 08 17:21:02.909106 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.909075 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-dlxx4" event={"ID":"e7706413-170b-45a9-b7d5-ac5178927c7a","Type":"ContainerStarted","Data":"fa1dec1c5c5e6b1f1be999f05b21a39719791ce4eb59b6544b85391ebbb58e1b"} Jul 08 17:21:02.925127 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:02.925076 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" podStartSLOduration=0.925061427 podStartE2EDuration="925.061427ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:21:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:21:02.923995637 +0000 UTC m=+275.334811015" watchObservedRunningTime="2026-07-08 17:21:02.925061427 +0000 UTC m=+275.335876822" Jul 08 17:21:08.578488 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:21:08.578444 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-x6rq9" podUID="63232d67-ba2c-4954-8d14-6d057af2f3bc" Jul 08 17:21:08.933887 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:08.933856 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x6rq9" Jul 08 17:21:09.469305 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:09.469267 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c12acef5-40a9-4e66-932a-d26dcf75aa4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25r84\" (UID: \"c12acef5-40a9-4e66-932a-d26dcf75aa4e\") " pod="openshift-insights/insights-runtime-extractor-25r84" Jul 08 17:21:09.471849 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:09.471817 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c12acef5-40a9-4e66-932a-d26dcf75aa4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-25r84\" (UID: \"c12acef5-40a9-4e66-932a-d26dcf75aa4e\") " pod="openshift-insights/insights-runtime-extractor-25r84" Jul 08 17:21:09.685510 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:09.685442 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-25r84" Jul 08 17:21:09.836609 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:09.836430 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-25r84"] Jul 08 17:21:09.839716 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:21:09.839656 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc12acef5_40a9_4e66_932a_d26dcf75aa4e.slice/crio-139484e98e7a6a878e2b0585b5c29e433a916f8242dda0011fc9a04329175c31 WatchSource:0}: Error finding container 139484e98e7a6a878e2b0585b5c29e433a916f8242dda0011fc9a04329175c31: Status 404 returned error can't find the container with id 139484e98e7a6a878e2b0585b5c29e433a916f8242dda0011fc9a04329175c31 Jul 08 17:21:09.938291 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:09.938255 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-25r84" event={"ID":"c12acef5-40a9-4e66-932a-d26dcf75aa4e","Type":"ContainerStarted","Data":"139484e98e7a6a878e2b0585b5c29e433a916f8242dda0011fc9a04329175c31"} Jul 08 17:21:12.246166 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:12.246138 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:21:12.498495 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:12.498347 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls\") pod \"dns-default-x6rq9\" (UID: \"63232d67-ba2c-4954-8d14-6d057af2f3bc\") " pod="openshift-dns/dns-default-x6rq9" Jul 08 17:21:12.501627 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:12.501588 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/63232d67-ba2c-4954-8d14-6d057af2f3bc-metrics-tls\") pod \"dns-default-x6rq9\" (UID: \"63232d67-ba2c-4954-8d14-6d057af2f3bc\") " pod="openshift-dns/dns-default-x6rq9" Jul 08 17:21:12.537152 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:12.537117 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dpkhh\"" Jul 08 17:21:12.545082 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:12.545048 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x6rq9" Jul 08 17:21:14.380262 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:14.380218 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x6rq9"] Jul 08 17:21:14.382789 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:21:14.382764 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63232d67_ba2c_4954_8d14_6d057af2f3bc.slice/crio-bc375441f975313561362412be234162a43ab7d2eb17005c20e7b0878cab455a WatchSource:0}: Error finding container bc375441f975313561362412be234162a43ab7d2eb17005c20e7b0878cab455a: Status 404 returned error can't find the container with id bc375441f975313561362412be234162a43ab7d2eb17005c20e7b0878cab455a Jul 08 17:21:14.958749 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:14.958708 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x6rq9" event={"ID":"63232d67-ba2c-4954-8d14-6d057af2f3bc","Type":"ContainerStarted","Data":"bc375441f975313561362412be234162a43ab7d2eb17005c20e7b0878cab455a"} Jul 08 17:21:14.960249 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:14.960220 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-25r84" event={"ID":"c12acef5-40a9-4e66-932a-d26dcf75aa4e","Type":"ContainerStarted","Data":"c984d51de392da8d7aefcc79e8e1e16f22594e10d3c1ccd83bd80c73cfee3ca7"} Jul 08 17:21:17.196932 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.196865 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-q5blw"] Jul 08 17:21:17.200501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.200479 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-q5blw" Jul 08 17:21:17.203738 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.203668 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 17:21:17.204661 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.203868 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 17:21:17.204661 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.203874 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 08 17:21:17.204661 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.203882 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 17:21:17.204661 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.204174 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 08 17:21:17.204661 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.204337 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-x2gw5\"" Jul 08 17:21:17.204661 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.204365 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 08 17:21:17.205470 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.205407 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tczzm"] Jul 08 17:21:17.207946 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.207880 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:17.210386 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.210366 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 17:21:17.210490 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.210394 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 17:21:17.210663 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.210647 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 17:21:17.211389 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.211239 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p2wsh\"" Jul 08 17:21:17.213176 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.213111 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-q5blw"] Jul 08 17:21:17.337222 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.337173 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd143acd-7f5c-4000-a499-9f5d4e79106e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-q5blw\" (UID: \"fd143acd-7f5c-4000-a499-9f5d4e79106e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-q5blw" Jul 08 17:21:17.337222 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.337227 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd143acd-7f5c-4000-a499-9f5d4e79106e-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-q5blw\" (UID: \"fd143acd-7f5c-4000-a499-9f5d4e79106e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-q5blw" Jul 08 17:21:17.337478 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.337298 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd143acd-7f5c-4000-a499-9f5d4e79106e-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-q5blw\" (UID: \"fd143acd-7f5c-4000-a499-9f5d4e79106e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-q5blw" Jul 08 17:21:17.337478 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.337339 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d7c42d04-3fd1-404c-86d0-642e9cb6189a-node-exporter-tls\") pod \"node-exporter-tczzm\" (UID: \"d7c42d04-3fd1-404c-86d0-642e9cb6189a\") " pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:17.337478 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.337378 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d7c42d04-3fd1-404c-86d0-642e9cb6189a-node-exporter-accelerators-collector-config\") pod \"node-exporter-tczzm\" (UID: \"d7c42d04-3fd1-404c-86d0-642e9cb6189a\") " pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:17.337633 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.337474 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnbdj\" (UniqueName: \"kubernetes.io/projected/fd143acd-7f5c-4000-a499-9f5d4e79106e-kube-api-access-vnbdj\") pod \"kube-state-metrics-7c9dbb8b7d-q5blw\" (UID: \"fd143acd-7f5c-4000-a499-9f5d4e79106e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-q5blw" Jul 08 17:21:17.337633 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.337508 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7c42d04-3fd1-404c-86d0-642e9cb6189a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tczzm\" (UID: \"d7c42d04-3fd1-404c-86d0-642e9cb6189a\") " pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:17.337633 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.337536 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7nhf\" (UniqueName: \"kubernetes.io/projected/d7c42d04-3fd1-404c-86d0-642e9cb6189a-kube-api-access-z7nhf\") pod \"node-exporter-tczzm\" (UID: \"d7c42d04-3fd1-404c-86d0-642e9cb6189a\") " pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:17.337633 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.337619 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7c42d04-3fd1-404c-86d0-642e9cb6189a-metrics-client-ca\") pod \"node-exporter-tczzm\" (UID: \"d7c42d04-3fd1-404c-86d0-642e9cb6189a\") " pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:17.337827 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.337652 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d7c42d04-3fd1-404c-86d0-642e9cb6189a-root\") pod \"node-exporter-tczzm\" (UID: \"d7c42d04-3fd1-404c-86d0-642e9cb6189a\") " pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:17.337827 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.337682 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d7c42d04-3fd1-404c-86d0-642e9cb6189a-node-exporter-wtmp\") pod \"node-exporter-tczzm\" (UID: \"d7c42d04-3fd1-404c-86d0-642e9cb6189a\") " pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:17.337827 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.337715 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fd143acd-7f5c-4000-a499-9f5d4e79106e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-q5blw\" (UID: \"fd143acd-7f5c-4000-a499-9f5d4e79106e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-q5blw" Jul 08 17:21:17.337827 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.337740 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7c42d04-3fd1-404c-86d0-642e9cb6189a-sys\") pod \"node-exporter-tczzm\" (UID: \"d7c42d04-3fd1-404c-86d0-642e9cb6189a\") " pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:17.337827 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.337802 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fd143acd-7f5c-4000-a499-9f5d4e79106e-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-q5blw\" (UID: \"fd143acd-7f5c-4000-a499-9f5d4e79106e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-q5blw" Jul 08 17:21:17.337827 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.337826 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d7c42d04-3fd1-404c-86d0-642e9cb6189a-node-exporter-textfile\") pod \"node-exporter-tczzm\" (UID: \"d7c42d04-3fd1-404c-86d0-642e9cb6189a\") " pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:17.438939 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.438893 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnbdj\" (UniqueName: \"kubernetes.io/projected/fd143acd-7f5c-4000-a499-9f5d4e79106e-kube-api-access-vnbdj\") pod \"kube-state-metrics-7c9dbb8b7d-q5blw\" (UID: \"fd143acd-7f5c-4000-a499-9f5d4e79106e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-q5blw" Jul 08 17:21:17.439116 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.438949 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7c42d04-3fd1-404c-86d0-642e9cb6189a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tczzm\" (UID: \"d7c42d04-3fd1-404c-86d0-642e9cb6189a\") " pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:17.439116 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.438977 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7nhf\" (UniqueName: \"kubernetes.io/projected/d7c42d04-3fd1-404c-86d0-642e9cb6189a-kube-api-access-z7nhf\") pod \"node-exporter-tczzm\" (UID: \"d7c42d04-3fd1-404c-86d0-642e9cb6189a\") " pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:17.439116 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.439014 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7c42d04-3fd1-404c-86d0-642e9cb6189a-metrics-client-ca\") pod \"node-exporter-tczzm\" (UID: \"d7c42d04-3fd1-404c-86d0-642e9cb6189a\") " pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:17.439116 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.439038 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d7c42d04-3fd1-404c-86d0-642e9cb6189a-root\") pod \"node-exporter-tczzm\" (UID: \"d7c42d04-3fd1-404c-86d0-642e9cb6189a\") " pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:17.439116 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.439068 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d7c42d04-3fd1-404c-86d0-642e9cb6189a-node-exporter-wtmp\") pod \"node-exporter-tczzm\" (UID: \"d7c42d04-3fd1-404c-86d0-642e9cb6189a\") " pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:17.439395 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.439201 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d7c42d04-3fd1-404c-86d0-642e9cb6189a-root\") pod \"node-exporter-tczzm\" (UID: \"d7c42d04-3fd1-404c-86d0-642e9cb6189a\") " pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:17.439395 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.439211 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d7c42d04-3fd1-404c-86d0-642e9cb6189a-node-exporter-wtmp\") pod \"node-exporter-tczzm\" (UID: \"d7c42d04-3fd1-404c-86d0-642e9cb6189a\") " pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:17.439395 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.439250 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fd143acd-7f5c-4000-a499-9f5d4e79106e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-q5blw\" (UID: \"fd143acd-7f5c-4000-a499-9f5d4e79106e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-q5blw" Jul 08 17:21:17.439395 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.439289 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7c42d04-3fd1-404c-86d0-642e9cb6189a-sys\") pod \"node-exporter-tczzm\" (UID: \"d7c42d04-3fd1-404c-86d0-642e9cb6189a\") " pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:17.439395 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.439356 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fd143acd-7f5c-4000-a499-9f5d4e79106e-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-q5blw\" (UID: \"fd143acd-7f5c-4000-a499-9f5d4e79106e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-q5blw" Jul 08 17:21:17.439395 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.439381 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d7c42d04-3fd1-404c-86d0-642e9cb6189a-node-exporter-textfile\") pod \"node-exporter-tczzm\" (UID: \"d7c42d04-3fd1-404c-86d0-642e9cb6189a\") " pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:17.439695 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.439412 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd143acd-7f5c-4000-a499-9f5d4e79106e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-q5blw\" (UID: \"fd143acd-7f5c-4000-a499-9f5d4e79106e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-q5blw" Jul 08 17:21:17.439695 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.439425 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7c42d04-3fd1-404c-86d0-642e9cb6189a-sys\") pod \"node-exporter-tczzm\" (UID: \"d7c42d04-3fd1-404c-86d0-642e9cb6189a\") " pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:17.439695 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.439445 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd143acd-7f5c-4000-a499-9f5d4e79106e-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-q5blw\" (UID: \"fd143acd-7f5c-4000-a499-9f5d4e79106e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-q5blw" Jul 08 17:21:17.439695 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.439469 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd143acd-7f5c-4000-a499-9f5d4e79106e-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-q5blw\" (UID: \"fd143acd-7f5c-4000-a499-9f5d4e79106e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-q5blw" Jul 08 17:21:17.439695 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.439491 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d7c42d04-3fd1-404c-86d0-642e9cb6189a-node-exporter-tls\") pod \"node-exporter-tczzm\" (UID: \"d7c42d04-3fd1-404c-86d0-642e9cb6189a\") " pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:17.439695 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.439528 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d7c42d04-3fd1-404c-86d0-642e9cb6189a-node-exporter-accelerators-collector-config\") pod \"node-exporter-tczzm\" (UID: \"d7c42d04-3fd1-404c-86d0-642e9cb6189a\") " pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:17.440030 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.439721 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fd143acd-7f5c-4000-a499-9f5d4e79106e-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-q5blw\" (UID: \"fd143acd-7f5c-4000-a499-9f5d4e79106e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-q5blw" Jul 08 17:21:17.440030 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.439744 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7c42d04-3fd1-404c-86d0-642e9cb6189a-metrics-client-ca\") pod \"node-exporter-tczzm\" (UID: \"d7c42d04-3fd1-404c-86d0-642e9cb6189a\") " pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:17.440030 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.439726 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d7c42d04-3fd1-404c-86d0-642e9cb6189a-node-exporter-textfile\") pod \"node-exporter-tczzm\" (UID: \"d7c42d04-3fd1-404c-86d0-642e9cb6189a\") " pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:17.440175 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.440072 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fd143acd-7f5c-4000-a499-9f5d4e79106e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-q5blw\" (UID: \"fd143acd-7f5c-4000-a499-9f5d4e79106e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-q5blw" Jul 08 17:21:17.440175 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.440094 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d7c42d04-3fd1-404c-86d0-642e9cb6189a-node-exporter-accelerators-collector-config\") pod \"node-exporter-tczzm\" (UID: \"d7c42d04-3fd1-404c-86d0-642e9cb6189a\") " pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:17.440330 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.440309 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd143acd-7f5c-4000-a499-9f5d4e79106e-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-q5blw\" (UID: \"fd143acd-7f5c-4000-a499-9f5d4e79106e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-q5blw" Jul 08 17:21:17.442428 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.442399 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7c42d04-3fd1-404c-86d0-642e9cb6189a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tczzm\" (UID: \"d7c42d04-3fd1-404c-86d0-642e9cb6189a\") " pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:17.442544 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.442513 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd143acd-7f5c-4000-a499-9f5d4e79106e-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-q5blw\" (UID: \"fd143acd-7f5c-4000-a499-9f5d4e79106e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-q5blw" Jul 08 17:21:17.442733 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.442714 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d7c42d04-3fd1-404c-86d0-642e9cb6189a-node-exporter-tls\") pod \"node-exporter-tczzm\" (UID: \"d7c42d04-3fd1-404c-86d0-642e9cb6189a\") " pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:17.442812 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.442719 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd143acd-7f5c-4000-a499-9f5d4e79106e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-q5blw\" (UID: \"fd143acd-7f5c-4000-a499-9f5d4e79106e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-q5blw" Jul 08 17:21:17.447236 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.447167 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7nhf\" (UniqueName: \"kubernetes.io/projected/d7c42d04-3fd1-404c-86d0-642e9cb6189a-kube-api-access-z7nhf\") pod \"node-exporter-tczzm\" (UID: \"d7c42d04-3fd1-404c-86d0-642e9cb6189a\") " pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:17.447315 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.447233 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnbdj\" (UniqueName: \"kubernetes.io/projected/fd143acd-7f5c-4000-a499-9f5d4e79106e-kube-api-access-vnbdj\") pod \"kube-state-metrics-7c9dbb8b7d-q5blw\" (UID: \"fd143acd-7f5c-4000-a499-9f5d4e79106e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-q5blw" Jul 08 17:21:17.514014 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.513976 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-q5blw" Jul 08 17:21:17.520937 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:17.520897 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tczzm" Jul 08 17:21:20.106710 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:21:20.106651 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-84tqr" podUID="6408e7f4-87d3-48a2-943f-7971adbf51f8" Jul 08 17:21:21.492040 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.491993 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5567f76648-9rzhz"] Jul 08 17:21:21.495157 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.495133 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" Jul 08 17:21:21.497608 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.497584 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 08 17:21:21.497756 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.497584 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-psqjq\"" Jul 08 17:21:21.498723 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.498532 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 08 17:21:21.498723 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.498634 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 08 17:21:21.498723 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.498594 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 08 17:21:21.498723 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.498665 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-h96thqvuc4c7\"" Jul 08 17:21:21.506591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.506523 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5567f76648-9rzhz"] Jul 08 17:21:21.576379 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.576345 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/34af209a-3652-436c-8b89-6cc5dd471e53-secret-metrics-server-tls\") pod \"metrics-server-5567f76648-9rzhz\" (UID: \"34af209a-3652-436c-8b89-6cc5dd471e53\") " pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" Jul 08 17:21:21.576379 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.576387 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/34af209a-3652-436c-8b89-6cc5dd471e53-audit-log\") pod \"metrics-server-5567f76648-9rzhz\" (UID: \"34af209a-3652-436c-8b89-6cc5dd471e53\") " pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" Jul 08 17:21:21.576608 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.576409 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5tlg\" (UniqueName: \"kubernetes.io/projected/34af209a-3652-436c-8b89-6cc5dd471e53-kube-api-access-z5tlg\") pod \"metrics-server-5567f76648-9rzhz\" (UID: \"34af209a-3652-436c-8b89-6cc5dd471e53\") " pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" Jul 08 17:21:21.576608 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.576430 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/34af209a-3652-436c-8b89-6cc5dd471e53-secret-metrics-server-client-certs\") pod \"metrics-server-5567f76648-9rzhz\" (UID: \"34af209a-3652-436c-8b89-6cc5dd471e53\") " pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" Jul 08 17:21:21.576608 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.576502 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34af209a-3652-436c-8b89-6cc5dd471e53-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5567f76648-9rzhz\" (UID: \"34af209a-3652-436c-8b89-6cc5dd471e53\") " pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" Jul 08 17:21:21.576608 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.576534 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/34af209a-3652-436c-8b89-6cc5dd471e53-metrics-server-audit-profiles\") pod \"metrics-server-5567f76648-9rzhz\" (UID: \"34af209a-3652-436c-8b89-6cc5dd471e53\") " pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" Jul 08 17:21:21.576789 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.576645 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34af209a-3652-436c-8b89-6cc5dd471e53-client-ca-bundle\") pod \"metrics-server-5567f76648-9rzhz\" (UID: \"34af209a-3652-436c-8b89-6cc5dd471e53\") " pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" Jul 08 17:21:21.581494 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:21:21.581468 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7c42d04_3fd1_404c_86d0_642e9cb6189a.slice/crio-2e820fb7e04917558cd352625d80d593391db9b78a625f079363448d39521a4c WatchSource:0}: Error finding container 2e820fb7e04917558cd352625d80d593391db9b78a625f079363448d39521a4c: Status 404 returned error can't find the container with id 2e820fb7e04917558cd352625d80d593391db9b78a625f079363448d39521a4c Jul 08 17:21:21.677241 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.677198 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34af209a-3652-436c-8b89-6cc5dd471e53-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5567f76648-9rzhz\" (UID: \"34af209a-3652-436c-8b89-6cc5dd471e53\") " pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" Jul 08 17:21:21.677376 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.677248 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/34af209a-3652-436c-8b89-6cc5dd471e53-metrics-server-audit-profiles\") pod \"metrics-server-5567f76648-9rzhz\" (UID: \"34af209a-3652-436c-8b89-6cc5dd471e53\") " pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" Jul 08 17:21:21.677376 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.677317 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34af209a-3652-436c-8b89-6cc5dd471e53-client-ca-bundle\") pod \"metrics-server-5567f76648-9rzhz\" (UID: \"34af209a-3652-436c-8b89-6cc5dd471e53\") " pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" Jul 08 17:21:21.677376 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.677370 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/34af209a-3652-436c-8b89-6cc5dd471e53-secret-metrics-server-tls\") pod \"metrics-server-5567f76648-9rzhz\" (UID: \"34af209a-3652-436c-8b89-6cc5dd471e53\") " pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" Jul 08 17:21:21.677793 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.677398 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/34af209a-3652-436c-8b89-6cc5dd471e53-audit-log\") pod \"metrics-server-5567f76648-9rzhz\" (UID: \"34af209a-3652-436c-8b89-6cc5dd471e53\") " pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" Jul 08 17:21:21.677793 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.677430 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5tlg\" (UniqueName: \"kubernetes.io/projected/34af209a-3652-436c-8b89-6cc5dd471e53-kube-api-access-z5tlg\") pod \"metrics-server-5567f76648-9rzhz\" (UID: \"34af209a-3652-436c-8b89-6cc5dd471e53\") " pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" Jul 08 17:21:21.677793 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.677455 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/34af209a-3652-436c-8b89-6cc5dd471e53-secret-metrics-server-client-certs\") pod \"metrics-server-5567f76648-9rzhz\" (UID: \"34af209a-3652-436c-8b89-6cc5dd471e53\") " pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" Jul 08 17:21:21.678165 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.678083 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34af209a-3652-436c-8b89-6cc5dd471e53-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5567f76648-9rzhz\" (UID: \"34af209a-3652-436c-8b89-6cc5dd471e53\") " pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" Jul 08 17:21:21.680474 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.678441 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/34af209a-3652-436c-8b89-6cc5dd471e53-audit-log\") pod \"metrics-server-5567f76648-9rzhz\" (UID: \"34af209a-3652-436c-8b89-6cc5dd471e53\") " pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" Jul 08 17:21:21.680474 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.679131 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/34af209a-3652-436c-8b89-6cc5dd471e53-metrics-server-audit-profiles\") pod \"metrics-server-5567f76648-9rzhz\" (UID: \"34af209a-3652-436c-8b89-6cc5dd471e53\") " pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" Jul 08 17:21:21.681479 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.681412 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/34af209a-3652-436c-8b89-6cc5dd471e53-secret-metrics-server-client-certs\") pod \"metrics-server-5567f76648-9rzhz\" (UID: \"34af209a-3652-436c-8b89-6cc5dd471e53\") " pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" Jul 08 17:21:21.682073 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.682049 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34af209a-3652-436c-8b89-6cc5dd471e53-client-ca-bundle\") pod \"metrics-server-5567f76648-9rzhz\" (UID: \"34af209a-3652-436c-8b89-6cc5dd471e53\") " pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" Jul 08 17:21:21.682471 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.682419 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/34af209a-3652-436c-8b89-6cc5dd471e53-secret-metrics-server-tls\") pod \"metrics-server-5567f76648-9rzhz\" (UID: \"34af209a-3652-436c-8b89-6cc5dd471e53\") " pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" Jul 08 17:21:21.686085 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.686064 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5tlg\" (UniqueName: \"kubernetes.io/projected/34af209a-3652-436c-8b89-6cc5dd471e53-kube-api-access-z5tlg\") pod \"metrics-server-5567f76648-9rzhz\" (UID: \"34af209a-3652-436c-8b89-6cc5dd471e53\") " pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" Jul 08 17:21:21.718816 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.718703 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-q5blw"] Jul 08 17:21:21.721869 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:21:21.721838 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd143acd_7f5c_4000_a499_9f5d4e79106e.slice/crio-cde96cd1c36ff1bee11a5dfdedd1f786e4aa64eb04f3df22cdbfb1de8a361181 WatchSource:0}: Error finding container cde96cd1c36ff1bee11a5dfdedd1f786e4aa64eb04f3df22cdbfb1de8a361181: Status 404 returned error can't find the container with id cde96cd1c36ff1bee11a5dfdedd1f786e4aa64eb04f3df22cdbfb1de8a361181 Jul 08 17:21:21.807107 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.807022 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" Jul 08 17:21:21.971697 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.970153 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-vsxbh"] Jul 08 17:21:21.979011 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.973701 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-vsxbh" Jul 08 17:21:21.979288 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.979263 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-vbzbs\"" Jul 08 17:21:21.981744 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.981554 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 08 17:21:21.984723 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.984649 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-vsxbh"] Jul 08 17:21:21.996755 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.996721 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-25r84" event={"ID":"c12acef5-40a9-4e66-932a-d26dcf75aa4e","Type":"ContainerStarted","Data":"e99922f6530a74790141db82859c9aebc3748d25b4d6bfc84a060ea8a942d2b7"} Jul 08 17:21:21.998716 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:21.998682 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tczzm" event={"ID":"d7c42d04-3fd1-404c-86d0-642e9cb6189a","Type":"ContainerStarted","Data":"2e820fb7e04917558cd352625d80d593391db9b78a625f079363448d39521a4c"} Jul 08 17:21:22.000204 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:22.000175 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-q5blw" event={"ID":"fd143acd-7f5c-4000-a499-9f5d4e79106e","Type":"ContainerStarted","Data":"cde96cd1c36ff1bee11a5dfdedd1f786e4aa64eb04f3df22cdbfb1de8a361181"} Jul 08 17:21:22.002469 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:22.001997 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-dlxx4" event={"ID":"e7706413-170b-45a9-b7d5-ac5178927c7a","Type":"ContainerStarted","Data":"3511daa62680c9067ad687f0db0fdb61b7ea52a60dfc95241a0f5144dc56d4cc"} Jul 08 17:21:22.002629 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:22.002613 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-dlxx4" Jul 08 17:21:22.011981 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:22.011937 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-dlxx4" Jul 08 17:21:22.013985 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:22.013903 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5567f76648-9rzhz"] Jul 08 17:21:22.017058 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:21:22.017031 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34af209a_3652_436c_8b89_6cc5dd471e53.slice/crio-935b3115e46ae5b420f5a2d57187e885534d734d846398d1239d4d6a4ece3d51 WatchSource:0}: Error finding container 935b3115e46ae5b420f5a2d57187e885534d734d846398d1239d4d6a4ece3d51: Status 404 returned error can't find the container with id 935b3115e46ae5b420f5a2d57187e885534d734d846398d1239d4d6a4ece3d51 Jul 08 17:21:22.021242 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:22.021200 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-dlxx4" podStartSLOduration=1.072551965 podStartE2EDuration="20.021187269s" totalImagesPullingTime="18.948635304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:21:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:21:22.020631907 +0000 UTC m=+294.431447288" watchObservedRunningTime="2026-07-08 17:21:22.021187269 +0000 UTC m=+294.432002646" Jul 08 17:21:22.083115 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:22.082069 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e6a75b7-5705-4905-965c-29aad57f9008-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-vsxbh\" (UID: \"6e6a75b7-5705-4905-965c-29aad57f9008\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-vsxbh" Jul 08 17:21:22.083115 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:22.082144 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7gxj\" (UniqueName: \"kubernetes.io/projected/6e6a75b7-5705-4905-965c-29aad57f9008-kube-api-access-s7gxj\") pod \"monitoring-plugin-d5dcff7cf-vsxbh\" (UID: \"6e6a75b7-5705-4905-965c-29aad57f9008\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-vsxbh" Jul 08 17:21:22.183201 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:22.182737 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e6a75b7-5705-4905-965c-29aad57f9008-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-vsxbh\" (UID: \"6e6a75b7-5705-4905-965c-29aad57f9008\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-vsxbh" Jul 08 17:21:22.183201 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:22.182805 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7gxj\" (UniqueName: \"kubernetes.io/projected/6e6a75b7-5705-4905-965c-29aad57f9008-kube-api-access-s7gxj\") pod \"monitoring-plugin-d5dcff7cf-vsxbh\" (UID: \"6e6a75b7-5705-4905-965c-29aad57f9008\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-vsxbh" Jul 08 17:21:22.186342 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:22.186276 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e6a75b7-5705-4905-965c-29aad57f9008-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-vsxbh\" (UID: \"6e6a75b7-5705-4905-965c-29aad57f9008\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-vsxbh" Jul 08 17:21:22.197320 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:22.197266 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7gxj\" (UniqueName: \"kubernetes.io/projected/6e6a75b7-5705-4905-965c-29aad57f9008-kube-api-access-s7gxj\") pod \"monitoring-plugin-d5dcff7cf-vsxbh\" (UID: \"6e6a75b7-5705-4905-965c-29aad57f9008\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-vsxbh" Jul 08 17:21:22.296101 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:22.296059 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-vsxbh" Jul 08 17:21:22.490210 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:22.490169 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-vsxbh"] Jul 08 17:21:22.497761 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:21:22.497700 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e6a75b7_5705_4905_965c_29aad57f9008.slice/crio-9a019e2e0cfc4abdbb257803c43360a61127aba1789ed22b311d5a440979bb00 WatchSource:0}: Error finding container 9a019e2e0cfc4abdbb257803c43360a61127aba1789ed22b311d5a440979bb00: Status 404 returned error can't find the container with id 9a019e2e0cfc4abdbb257803c43360a61127aba1789ed22b311d5a440979bb00 Jul 08 17:21:23.031290 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:23.029203 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-vsxbh" event={"ID":"6e6a75b7-5705-4905-965c-29aad57f9008","Type":"ContainerStarted","Data":"9a019e2e0cfc4abdbb257803c43360a61127aba1789ed22b311d5a440979bb00"} Jul 08 17:21:23.031290 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:23.030864 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" event={"ID":"34af209a-3652-436c-8b89-6cc5dd471e53","Type":"ContainerStarted","Data":"935b3115e46ae5b420f5a2d57187e885534d734d846398d1239d4d6a4ece3d51"} Jul 08 17:21:23.921231 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:23.920364 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-75dd8c987d-vrgvh" Jul 08 17:21:25.983858 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:25.983820 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79f8c4d69b-pbgsf"] Jul 08 17:21:26.013468 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.012463 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79f8c4d69b-pbgsf"] Jul 08 17:21:26.013468 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.012586 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:21:26.015476 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.015343 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 08 17:21:26.015476 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.015407 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 08 17:21:26.015689 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.015499 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 08 17:21:26.015689 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.015542 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 08 17:21:26.016582 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.016561 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 08 17:21:26.016779 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.016759 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7kr92\"" Jul 08 17:21:26.022480 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.022460 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 08 17:21:26.129121 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.129065 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/101f8be2-f543-44de-b004-5fdb8e3a381e-trusted-ca-bundle\") pod \"console-79f8c4d69b-pbgsf\" (UID: \"101f8be2-f543-44de-b004-5fdb8e3a381e\") " pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:21:26.129376 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.129138 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/101f8be2-f543-44de-b004-5fdb8e3a381e-service-ca\") pod \"console-79f8c4d69b-pbgsf\" (UID: \"101f8be2-f543-44de-b004-5fdb8e3a381e\") " pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:21:26.129376 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.129188 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/101f8be2-f543-44de-b004-5fdb8e3a381e-console-oauth-config\") pod \"console-79f8c4d69b-pbgsf\" (UID: \"101f8be2-f543-44de-b004-5fdb8e3a381e\") " pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:21:26.129376 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.129233 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/101f8be2-f543-44de-b004-5fdb8e3a381e-console-config\") pod \"console-79f8c4d69b-pbgsf\" (UID: \"101f8be2-f543-44de-b004-5fdb8e3a381e\") " pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:21:26.129376 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.129282 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/101f8be2-f543-44de-b004-5fdb8e3a381e-console-serving-cert\") pod \"console-79f8c4d69b-pbgsf\" (UID: \"101f8be2-f543-44de-b004-5fdb8e3a381e\") " pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:21:26.129376 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.129314 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx2pp\" (UniqueName: \"kubernetes.io/projected/101f8be2-f543-44de-b004-5fdb8e3a381e-kube-api-access-vx2pp\") pod \"console-79f8c4d69b-pbgsf\" (UID: \"101f8be2-f543-44de-b004-5fdb8e3a381e\") " pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:21:26.129376 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.129349 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/101f8be2-f543-44de-b004-5fdb8e3a381e-oauth-serving-cert\") pod \"console-79f8c4d69b-pbgsf\" (UID: \"101f8be2-f543-44de-b004-5fdb8e3a381e\") " pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:21:26.230655 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.230613 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/101f8be2-f543-44de-b004-5fdb8e3a381e-oauth-serving-cert\") pod \"console-79f8c4d69b-pbgsf\" (UID: \"101f8be2-f543-44de-b004-5fdb8e3a381e\") " pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:21:26.230877 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.230680 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/101f8be2-f543-44de-b004-5fdb8e3a381e-trusted-ca-bundle\") pod \"console-79f8c4d69b-pbgsf\" (UID: \"101f8be2-f543-44de-b004-5fdb8e3a381e\") " pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:21:26.230877 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.230715 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/101f8be2-f543-44de-b004-5fdb8e3a381e-service-ca\") pod \"console-79f8c4d69b-pbgsf\" (UID: \"101f8be2-f543-44de-b004-5fdb8e3a381e\") " pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:21:26.230877 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.230757 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/101f8be2-f543-44de-b004-5fdb8e3a381e-console-oauth-config\") pod \"console-79f8c4d69b-pbgsf\" (UID: \"101f8be2-f543-44de-b004-5fdb8e3a381e\") " pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:21:26.230877 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.230799 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/101f8be2-f543-44de-b004-5fdb8e3a381e-console-config\") pod \"console-79f8c4d69b-pbgsf\" (UID: \"101f8be2-f543-44de-b004-5fdb8e3a381e\") " pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:21:26.230877 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.230844 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/101f8be2-f543-44de-b004-5fdb8e3a381e-console-serving-cert\") pod \"console-79f8c4d69b-pbgsf\" (UID: \"101f8be2-f543-44de-b004-5fdb8e3a381e\") " pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:21:26.230877 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.230874 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx2pp\" (UniqueName: \"kubernetes.io/projected/101f8be2-f543-44de-b004-5fdb8e3a381e-kube-api-access-vx2pp\") pod \"console-79f8c4d69b-pbgsf\" (UID: \"101f8be2-f543-44de-b004-5fdb8e3a381e\") " pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:21:26.231935 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.231890 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/101f8be2-f543-44de-b004-5fdb8e3a381e-oauth-serving-cert\") pod \"console-79f8c4d69b-pbgsf\" (UID: \"101f8be2-f543-44de-b004-5fdb8e3a381e\") " pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:21:26.236317 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.235371 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/101f8be2-f543-44de-b004-5fdb8e3a381e-console-config\") pod \"console-79f8c4d69b-pbgsf\" (UID: \"101f8be2-f543-44de-b004-5fdb8e3a381e\") " pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:21:26.236317 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.235782 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/101f8be2-f543-44de-b004-5fdb8e3a381e-service-ca\") pod \"console-79f8c4d69b-pbgsf\" (UID: \"101f8be2-f543-44de-b004-5fdb8e3a381e\") " pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:21:26.236317 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.236231 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/101f8be2-f543-44de-b004-5fdb8e3a381e-console-oauth-config\") pod \"console-79f8c4d69b-pbgsf\" (UID: \"101f8be2-f543-44de-b004-5fdb8e3a381e\") " pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:21:26.238126 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.233323 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/101f8be2-f543-44de-b004-5fdb8e3a381e-trusted-ca-bundle\") pod \"console-79f8c4d69b-pbgsf\" (UID: \"101f8be2-f543-44de-b004-5fdb8e3a381e\") " pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:21:26.246932 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.243711 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx2pp\" (UniqueName: \"kubernetes.io/projected/101f8be2-f543-44de-b004-5fdb8e3a381e-kube-api-access-vx2pp\") pod \"console-79f8c4d69b-pbgsf\" (UID: \"101f8be2-f543-44de-b004-5fdb8e3a381e\") " pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:21:26.253641 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.253570 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/101f8be2-f543-44de-b004-5fdb8e3a381e-console-serving-cert\") pod \"console-79f8c4d69b-pbgsf\" (UID: \"101f8be2-f543-44de-b004-5fdb8e3a381e\") " pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:21:26.327871 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:26.327829 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:21:27.261445 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:27.261390 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" podUID="cbc6e240-dbb5-480e-9139-7f3d73c8a5e6" containerName="registry" containerID="cri-o://dc23027f0d06e1480d9fcba81e46f3c794ab80971156224da0f190391fd55e94" gracePeriod=30 Jul 08 17:21:28.056803 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.056588 2556 generic.go:356] "Generic (PLEG): container finished" podID="cbc6e240-dbb5-480e-9139-7f3d73c8a5e6" containerID="dc23027f0d06e1480d9fcba81e46f3c794ab80971156224da0f190391fd55e94" exitCode=0 Jul 08 17:21:28.056803 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.056653 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" event={"ID":"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6","Type":"ContainerDied","Data":"dc23027f0d06e1480d9fcba81e46f3c794ab80971156224da0f190391fd55e94"} Jul 08 17:21:28.541515 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.197225 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gsn8l_c2541cd3-af4f-4de5-b042-3611d02a80ab/console-operator/1.log" Jul 08 17:21:28.541515 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.197706 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gsn8l_c2541cd3-af4f-4de5-b042-3611d02a80ab/console-operator/1.log" Jul 08 17:21:28.541515 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.211311 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:21:28.541515 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.220225 2556 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 17:21:28.541515 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.346881 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79f8c4d69b-pbgsf"] Jul 08 17:21:28.541515 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.358663 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-trusted-ca\") pod \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " Jul 08 17:21:28.541515 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.358725 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-registry-certificates\") pod \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " Jul 08 17:21:28.541515 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.358762 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-installation-pull-secrets\") pod \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " Jul 08 17:21:28.541515 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.358807 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-image-registry-private-configuration\") pod \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " Jul 08 17:21:28.541515 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.358848 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-registry-tls\") pod \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " Jul 08 17:21:28.541515 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.358875 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntbck\" (UniqueName: \"kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-kube-api-access-ntbck\") pod \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " Jul 08 17:21:28.541515 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.358926 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-bound-sa-token\") pod \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " Jul 08 17:21:28.541515 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.359002 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-ca-trust-extracted\") pod \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\" (UID: \"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6\") " Jul 08 17:21:28.541515 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.359463 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "cbc6e240-dbb5-480e-9139-7f3d73c8a5e6" (UID: "cbc6e240-dbb5-480e-9139-7f3d73c8a5e6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:21:28.541515 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.359838 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-trusted-ca\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:21:28.541515 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.363761 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "cbc6e240-dbb5-480e-9139-7f3d73c8a5e6" (UID: "cbc6e240-dbb5-480e-9139-7f3d73c8a5e6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 17:21:28.541515 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.363747 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-kube-api-access-ntbck" (OuterVolumeSpecName: "kube-api-access-ntbck") pod "cbc6e240-dbb5-480e-9139-7f3d73c8a5e6" (UID: "cbc6e240-dbb5-480e-9139-7f3d73c8a5e6"). InnerVolumeSpecName "kube-api-access-ntbck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:21:28.542828 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.364165 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "cbc6e240-dbb5-480e-9139-7f3d73c8a5e6" (UID: "cbc6e240-dbb5-480e-9139-7f3d73c8a5e6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:21:28.542828 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.366143 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "cbc6e240-dbb5-480e-9139-7f3d73c8a5e6" (UID: "cbc6e240-dbb5-480e-9139-7f3d73c8a5e6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 17:21:28.542828 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.366719 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cbc6e240-dbb5-480e-9139-7f3d73c8a5e6" (UID: "cbc6e240-dbb5-480e-9139-7f3d73c8a5e6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:21:28.542828 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.367337 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "cbc6e240-dbb5-480e-9139-7f3d73c8a5e6" (UID: "cbc6e240-dbb5-480e-9139-7f3d73c8a5e6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:21:28.542828 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.369779 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "cbc6e240-dbb5-480e-9139-7f3d73c8a5e6" (UID: "cbc6e240-dbb5-480e-9139-7f3d73c8a5e6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:21:28.542828 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.460600 2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-ca-trust-extracted\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:21:28.542828 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.460633 2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-registry-certificates\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:21:28.542828 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.460647 2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-installation-pull-secrets\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:21:28.542828 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.460663 2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-image-registry-private-configuration\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:21:28.542828 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.460678 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-registry-tls\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:21:28.542828 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.460692 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntbck\" (UniqueName: \"kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-kube-api-access-ntbck\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:21:28.542828 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:28.460707 2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6-bound-sa-token\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:21:28.542828 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:21:28.482253 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod101f8be2_f543_44de_b004_5fdb8e3a381e.slice/crio-5ac01e702cf89ffc4327806324ea077f5c6d751f31411603eadd629807bb2d22 WatchSource:0}: Error finding container 5ac01e702cf89ffc4327806324ea077f5c6d751f31411603eadd629807bb2d22: Status 404 returned error can't find the container with id 5ac01e702cf89ffc4327806324ea077f5c6d751f31411603eadd629807bb2d22 Jul 08 17:21:29.063177 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:29.063133 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-vsxbh" event={"ID":"6e6a75b7-5705-4905-965c-29aad57f9008","Type":"ContainerStarted","Data":"14c344f89d63e3b32b81996f73d4bba3992a9fcd63377f2bc46598259503d7c7"} Jul 08 17:21:29.063540 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:29.063516 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-vsxbh" Jul 08 17:21:29.065437 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:29.064956 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" event={"ID":"34af209a-3652-436c-8b89-6cc5dd471e53","Type":"ContainerStarted","Data":"81e6ee87e7f5cb65870ea93503947c8de55959210ab9a0c8b012cfe16f441788"} Jul 08 17:21:29.066466 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:29.066434 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79f8c4d69b-pbgsf" event={"ID":"101f8be2-f543-44de-b004-5fdb8e3a381e","Type":"ContainerStarted","Data":"5ac01e702cf89ffc4327806324ea077f5c6d751f31411603eadd629807bb2d22"} Jul 08 17:21:29.069369 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:29.069340 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x6rq9" event={"ID":"63232d67-ba2c-4954-8d14-6d057af2f3bc","Type":"ContainerStarted","Data":"0c730bcb5b65e5993e3d34b9420a979609edbfa82f356f04ce844bb70b97006b"} Jul 08 17:21:29.069712 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:29.069392 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x6rq9" event={"ID":"63232d67-ba2c-4954-8d14-6d057af2f3bc","Type":"ContainerStarted","Data":"80f917eb714ea2ee6db424829bb45f1d43ce641eef50cd9c7ff08cf6f4c64a05"} Jul 08 17:21:29.069814 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:29.069758 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-x6rq9" Jul 08 17:21:29.070211 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:29.070191 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-vsxbh" Jul 08 17:21:29.070814 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:29.070796 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" Jul 08 17:21:29.070814 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:29.070797 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68b7f75f48-x2qhc" event={"ID":"cbc6e240-dbb5-480e-9139-7f3d73c8a5e6","Type":"ContainerDied","Data":"29e58207cb216b6f925dae3079cec7f87b114e080afcb0e29260265adc8b6536"} Jul 08 17:21:29.071032 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:29.070851 2556 scope.go:117] "RemoveContainer" containerID="dc23027f0d06e1480d9fcba81e46f3c794ab80971156224da0f190391fd55e94" Jul 08 17:21:29.073727 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:29.073703 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-25r84" event={"ID":"c12acef5-40a9-4e66-932a-d26dcf75aa4e","Type":"ContainerStarted","Data":"b9a164efbabe34ded76cd6e5ad318b015a9d82705b0053f1bff52b73852125d8"} Jul 08 17:21:29.076030 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:29.076004 2556 generic.go:356] "Generic (PLEG): container finished" podID="d7c42d04-3fd1-404c-86d0-642e9cb6189a" containerID="b07cc5d78ca73d310df7552cb4d48e9de625706ee00fca4ea503b4a2aa13e11b" exitCode=0 Jul 08 17:21:29.076290 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:29.076268 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tczzm" event={"ID":"d7c42d04-3fd1-404c-86d0-642e9cb6189a","Type":"ContainerDied","Data":"b07cc5d78ca73d310df7552cb4d48e9de625706ee00fca4ea503b4a2aa13e11b"} Jul 08 17:21:29.081106 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:29.081078 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-q5blw" event={"ID":"fd143acd-7f5c-4000-a499-9f5d4e79106e","Type":"ContainerStarted","Data":"47c5dba5f011dc5b527fa93b7b252db3c4eb3f316e6df5ce09bce3f5e1889881"} Jul 08 17:21:29.081207 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:29.081133 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-q5blw" event={"ID":"fd143acd-7f5c-4000-a499-9f5d4e79106e","Type":"ContainerStarted","Data":"436909633bf91d4d6ca03dfebb1d1228e884f0b4df2dfc9270f9644dab59b41c"} Jul 08 17:21:29.081207 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:29.081156 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-q5blw" event={"ID":"fd143acd-7f5c-4000-a499-9f5d4e79106e","Type":"ContainerStarted","Data":"ccfca0e4445e62a781d86218e5f92f9a4040e000b375ce5c1511352258a98669"} Jul 08 17:21:29.095499 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:29.095445 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-vsxbh" podStartSLOduration=2.090704077 podStartE2EDuration="8.095426565s" totalImagesPullingTime="6.004722488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:21:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:21:29.079835241 +0000 UTC m=+301.490650619" watchObservedRunningTime="2026-07-08 17:21:29.095426565 +0000 UTC m=+301.506241942" Jul 08 17:21:29.111020 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:29.110862 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" podStartSLOduration=1.9636111619999999 podStartE2EDuration="8.110840371s" totalImagesPullingTime="6.147229209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:21:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:21:29.110107217 +0000 UTC m=+301.520922596" watchObservedRunningTime="2026-07-08 17:21:29.110840371 +0000 UTC m=+301.521655749" Jul 08 17:21:29.133421 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:29.133349 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-25r84" podStartSLOduration=33.992741215 podStartE2EDuration="52.133326829s" totalImagesPullingTime="18.140585614s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:20:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:21:29.132491823 +0000 UTC m=+301.543307201" watchObservedRunningTime="2026-07-08 17:21:29.133326829 +0000 UTC m=+301.544142208" Jul 08 17:21:29.154949 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:29.151857 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-x6rq9" podStartSLOduration=253.369752857 podStartE2EDuration="4m27.151833806s" totalImagesPullingTime="13.782080949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:17:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:21:29.150515238 +0000 UTC m=+301.561330617" watchObservedRunningTime="2026-07-08 17:21:29.151833806 +0000 UTC m=+301.562649183" Jul 08 17:21:29.183242 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:29.183205 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68b7f75f48-x2qhc"] Jul 08 17:21:29.186501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:29.186473 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-68b7f75f48-x2qhc"] Jul 08 17:21:29.209953 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:29.209881 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-q5blw" podStartSLOduration=5.766256908 podStartE2EDuration="12.209861443s" totalImagesPullingTime="6.443604535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:21:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:21:29.208039678 +0000 UTC m=+301.618855056" watchObservedRunningTime="2026-07-08 17:21:29.209861443 +0000 UTC m=+301.620676821" Jul 08 17:21:30.089169 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:30.089127 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tczzm" event={"ID":"d7c42d04-3fd1-404c-86d0-642e9cb6189a","Type":"ContainerStarted","Data":"b2e7644056eb95a502deb7e8747848888e4b6a1aa22ac079bf27a6e9533b2449"} Jul 08 17:21:30.089750 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:30.089196 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tczzm" event={"ID":"d7c42d04-3fd1-404c-86d0-642e9cb6189a","Type":"ContainerStarted","Data":"2e33899486f1c678611d631434cf084cbf4ea42d20411c3b506ad865e93df1ef"} Jul 08 17:21:30.109104 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:30.109047 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tczzm" podStartSLOduration=6.393027439 podStartE2EDuration="13.109025923s" totalImagesPullingTime="6.576818227s" totalInitContainerRuntime="139.180257ms" isStatefulPod=true podCreationTimestamp="2026-07-08 17:21:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:21:30.10739455 +0000 UTC m=+302.518209939" watchObservedRunningTime="2026-07-08 17:21:30.109025923 +0000 UTC m=+302.519841301" Jul 08 17:21:30.112414 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:30.112382 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbc6e240-dbb5-480e-9139-7f3d73c8a5e6" path="/var/lib/kubelet/pods/cbc6e240-dbb5-480e-9139-7f3d73c8a5e6/volumes" Jul 08 17:21:31.106396 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:31.106355 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:21:33.102350 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:33.102311 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79f8c4d69b-pbgsf" event={"ID":"101f8be2-f543-44de-b004-5fdb8e3a381e","Type":"ContainerStarted","Data":"23331a8204ddaead8c28612507ec237561a609a6dfe24e8cfcea2ab94e19c162"} Jul 08 17:21:33.119347 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:33.119295 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79f8c4d69b-pbgsf" podStartSLOduration=3.967350456 podStartE2EDuration="8.119275806s" totalImagesPullingTime="4.15192535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:21:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:21:33.118454662 +0000 UTC m=+305.529270052" watchObservedRunningTime="2026-07-08 17:21:33.119275806 +0000 UTC m=+305.530091183" Jul 08 17:21:36.328943 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:36.328887 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:21:36.329422 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:36.328971 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:21:36.333876 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:36.333851 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:21:37.120213 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:37.120182 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:21:40.096317 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:40.096283 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-x6rq9" Jul 08 17:21:41.808019 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:41.807982 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" Jul 08 17:21:41.808452 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:41.808064 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" Jul 08 17:21:52.169283 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:52.169247 2556 generic.go:356] "Generic (PLEG): container finished" podID="06a502a0-c274-4577-907d-9a9986f6d050" containerID="c5905324b6cf66deaa675388828133be418dc6360e69b5ef1972c19d1261ec3e" exitCode=0 Jul 08 17:21:52.169686 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:52.169300 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-w8rkb" event={"ID":"06a502a0-c274-4577-907d-9a9986f6d050","Type":"ContainerDied","Data":"c5905324b6cf66deaa675388828133be418dc6360e69b5ef1972c19d1261ec3e"} Jul 08 17:21:52.169686 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:52.169629 2556 scope.go:117] "RemoveContainer" containerID="c5905324b6cf66deaa675388828133be418dc6360e69b5ef1972c19d1261ec3e" Jul 08 17:21:53.176205 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:21:53.176173 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-w8rkb" event={"ID":"06a502a0-c274-4577-907d-9a9986f6d050","Type":"ContainerStarted","Data":"30333d580042bcb15404570f7d4f636c75da89774cb084e5aede7a79ad0ae900"} Jul 08 17:22:01.813058 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:01.813025 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" Jul 08 17:22:01.816818 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:01.816793 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5567f76648-9rzhz" Jul 08 17:22:41.961766 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:41.961720 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs\") pod \"network-metrics-daemon-84tqr\" (UID: \"6408e7f4-87d3-48a2-943f-7971adbf51f8\") " pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:22:41.964053 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:41.964027 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6408e7f4-87d3-48a2-943f-7971adbf51f8-metrics-certs\") pod \"network-metrics-daemon-84tqr\" (UID: \"6408e7f4-87d3-48a2-943f-7971adbf51f8\") " pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:22:42.210578 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:42.210545 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xkss2\"" Jul 08 17:22:42.218750 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:42.218684 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-84tqr" Jul 08 17:22:42.354179 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:42.354143 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-84tqr"] Jul 08 17:22:42.358483 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:22:42.358457 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6408e7f4_87d3_48a2_943f_7971adbf51f8.slice/crio-fb88aa8e7f23def03d1d08a2b2c66bd82b4d15310e98e8c4623e79fc13deb5fb WatchSource:0}: Error finding container fb88aa8e7f23def03d1d08a2b2c66bd82b4d15310e98e8c4623e79fc13deb5fb: Status 404 returned error can't find the container with id fb88aa8e7f23def03d1d08a2b2c66bd82b4d15310e98e8c4623e79fc13deb5fb Jul 08 17:22:42.360421 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:42.360406 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 17:22:43.363997 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:43.363948 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-84tqr" event={"ID":"6408e7f4-87d3-48a2-943f-7971adbf51f8","Type":"ContainerStarted","Data":"fb88aa8e7f23def03d1d08a2b2c66bd82b4d15310e98e8c4623e79fc13deb5fb"} Jul 08 17:22:44.370410 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:44.370374 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-84tqr" event={"ID":"6408e7f4-87d3-48a2-943f-7971adbf51f8","Type":"ContainerStarted","Data":"ca01086921bb1520d8460dfbfbe03377ce0217c566b9aaadf4df25a9be36147b"} Jul 08 17:22:44.370905 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:44.370438 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-84tqr" event={"ID":"6408e7f4-87d3-48a2-943f-7971adbf51f8","Type":"ContainerStarted","Data":"4798484bb4ae3d3836fecc5b6d9f5794af801859950d4abb7b9dd87207225c4d"} Jul 08 17:22:44.386492 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:44.386443 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-84tqr" podStartSLOduration=375.339485781 podStartE2EDuration="6m16.386427373s" totalImagesPullingTime="1.046941592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:16:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:22:44.385617488 +0000 UTC m=+376.796432866" watchObservedRunningTime="2026-07-08 17:22:44.386427373 +0000 UTC m=+376.797242750" Jul 08 17:22:46.520358 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.520329 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74d6697bf7-b5gjz"] Jul 08 17:22:46.520728 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.520609 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbc6e240-dbb5-480e-9139-7f3d73c8a5e6" containerName="registry" Jul 08 17:22:46.520728 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.520619 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbc6e240-dbb5-480e-9139-7f3d73c8a5e6" containerName="registry" Jul 08 17:22:46.520728 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.520674 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbc6e240-dbb5-480e-9139-7f3d73c8a5e6" containerName="registry" Jul 08 17:22:46.522712 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.522686 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:22:46.535599 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.535575 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74d6697bf7-b5gjz"] Jul 08 17:22:46.592281 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.592247 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42ba7bb1-374a-43a4-a8d4-2774e47972cd-console-serving-cert\") pod \"console-74d6697bf7-b5gjz\" (UID: \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\") " pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:22:46.592448 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.592301 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42ba7bb1-374a-43a4-a8d4-2774e47972cd-console-oauth-config\") pod \"console-74d6697bf7-b5gjz\" (UID: \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\") " pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:22:46.592448 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.592326 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42ba7bb1-374a-43a4-a8d4-2774e47972cd-trusted-ca-bundle\") pod \"console-74d6697bf7-b5gjz\" (UID: \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\") " pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:22:46.592448 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.592348 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wgb9\" (UniqueName: \"kubernetes.io/projected/42ba7bb1-374a-43a4-a8d4-2774e47972cd-kube-api-access-4wgb9\") pod \"console-74d6697bf7-b5gjz\" (UID: \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\") " pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:22:46.592448 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.592370 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42ba7bb1-374a-43a4-a8d4-2774e47972cd-oauth-serving-cert\") pod \"console-74d6697bf7-b5gjz\" (UID: \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\") " pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:22:46.592448 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.592437 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42ba7bb1-374a-43a4-a8d4-2774e47972cd-console-config\") pod \"console-74d6697bf7-b5gjz\" (UID: \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\") " pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:22:46.592657 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.592496 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42ba7bb1-374a-43a4-a8d4-2774e47972cd-service-ca\") pod \"console-74d6697bf7-b5gjz\" (UID: \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\") " pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:22:46.693557 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.693518 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42ba7bb1-374a-43a4-a8d4-2774e47972cd-service-ca\") pod \"console-74d6697bf7-b5gjz\" (UID: \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\") " pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:22:46.693557 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.693558 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42ba7bb1-374a-43a4-a8d4-2774e47972cd-console-serving-cert\") pod \"console-74d6697bf7-b5gjz\" (UID: \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\") " pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:22:46.693818 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.693687 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42ba7bb1-374a-43a4-a8d4-2774e47972cd-console-oauth-config\") pod \"console-74d6697bf7-b5gjz\" (UID: \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\") " pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:22:46.693818 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.693726 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42ba7bb1-374a-43a4-a8d4-2774e47972cd-trusted-ca-bundle\") pod \"console-74d6697bf7-b5gjz\" (UID: \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\") " pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:22:46.693818 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.693751 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wgb9\" (UniqueName: \"kubernetes.io/projected/42ba7bb1-374a-43a4-a8d4-2774e47972cd-kube-api-access-4wgb9\") pod \"console-74d6697bf7-b5gjz\" (UID: \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\") " pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:22:46.693818 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.693777 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42ba7bb1-374a-43a4-a8d4-2774e47972cd-oauth-serving-cert\") pod \"console-74d6697bf7-b5gjz\" (UID: \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\") " pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:22:46.694044 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.693836 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42ba7bb1-374a-43a4-a8d4-2774e47972cd-console-config\") pod \"console-74d6697bf7-b5gjz\" (UID: \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\") " pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:22:46.694346 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.694320 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42ba7bb1-374a-43a4-a8d4-2774e47972cd-service-ca\") pod \"console-74d6697bf7-b5gjz\" (UID: \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\") " pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:22:46.694516 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.694494 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42ba7bb1-374a-43a4-a8d4-2774e47972cd-console-config\") pod \"console-74d6697bf7-b5gjz\" (UID: \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\") " pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:22:46.694516 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.694503 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42ba7bb1-374a-43a4-a8d4-2774e47972cd-oauth-serving-cert\") pod \"console-74d6697bf7-b5gjz\" (UID: \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\") " pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:22:46.694625 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.694603 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42ba7bb1-374a-43a4-a8d4-2774e47972cd-trusted-ca-bundle\") pod \"console-74d6697bf7-b5gjz\" (UID: \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\") " pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:22:46.696511 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.696487 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42ba7bb1-374a-43a4-a8d4-2774e47972cd-console-oauth-config\") pod \"console-74d6697bf7-b5gjz\" (UID: \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\") " pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:22:46.696691 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.696672 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42ba7bb1-374a-43a4-a8d4-2774e47972cd-console-serving-cert\") pod \"console-74d6697bf7-b5gjz\" (UID: \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\") " pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:22:46.705778 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.705754 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wgb9\" (UniqueName: \"kubernetes.io/projected/42ba7bb1-374a-43a4-a8d4-2774e47972cd-kube-api-access-4wgb9\") pod \"console-74d6697bf7-b5gjz\" (UID: \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\") " pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:22:46.832171 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.832076 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:22:46.983360 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:46.983206 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74d6697bf7-b5gjz"] Jul 08 17:22:46.985946 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:22:46.985899 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42ba7bb1_374a_43a4_a8d4_2774e47972cd.slice/crio-b5ace8b1768926855b9c86b9387b3283396dc613e7c020a8aca089228fda582c WatchSource:0}: Error finding container b5ace8b1768926855b9c86b9387b3283396dc613e7c020a8aca089228fda582c: Status 404 returned error can't find the container with id b5ace8b1768926855b9c86b9387b3283396dc613e7c020a8aca089228fda582c Jul 08 17:22:47.385142 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:47.385109 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d6697bf7-b5gjz" event={"ID":"42ba7bb1-374a-43a4-a8d4-2774e47972cd","Type":"ContainerStarted","Data":"430796f9bdcf39397ff79dcf9405884c09b226e2f61a4ddfad502e086dc95902"} Jul 08 17:22:47.385326 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:47.385158 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d6697bf7-b5gjz" event={"ID":"42ba7bb1-374a-43a4-a8d4-2774e47972cd","Type":"ContainerStarted","Data":"b5ace8b1768926855b9c86b9387b3283396dc613e7c020a8aca089228fda582c"} Jul 08 17:22:47.402688 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:47.402641 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74d6697bf7-b5gjz" podStartSLOduration=1.402626289 podStartE2EDuration="1.402626289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:22:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:22:47.402301994 +0000 UTC m=+379.813117372" watchObservedRunningTime="2026-07-08 17:22:47.402626289 +0000 UTC m=+379.813441728" Jul 08 17:22:56.832619 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:56.832576 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:22:56.833059 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:56.832643 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:22:56.837390 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:56.837365 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:22:57.425544 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:57.425513 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:22:57.501435 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:22:57.501398 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79f8c4d69b-pbgsf"] Jul 08 17:23:22.524749 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:22.524683 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-79f8c4d69b-pbgsf" podUID="101f8be2-f543-44de-b004-5fdb8e3a381e" containerName="console" containerID="cri-o://23331a8204ddaead8c28612507ec237561a609a6dfe24e8cfcea2ab94e19c162" gracePeriod=15 Jul 08 17:23:22.763385 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:22.763360 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:23:22.889176 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:22.889129 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/101f8be2-f543-44de-b004-5fdb8e3a381e-console-oauth-config\") pod \"101f8be2-f543-44de-b004-5fdb8e3a381e\" (UID: \"101f8be2-f543-44de-b004-5fdb8e3a381e\") " Jul 08 17:23:22.889373 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:22.889200 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/101f8be2-f543-44de-b004-5fdb8e3a381e-console-config\") pod \"101f8be2-f543-44de-b004-5fdb8e3a381e\" (UID: \"101f8be2-f543-44de-b004-5fdb8e3a381e\") " Jul 08 17:23:22.889373 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:22.889226 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/101f8be2-f543-44de-b004-5fdb8e3a381e-oauth-serving-cert\") pod \"101f8be2-f543-44de-b004-5fdb8e3a381e\" (UID: \"101f8be2-f543-44de-b004-5fdb8e3a381e\") " Jul 08 17:23:22.889373 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:22.889255 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vx2pp\" (UniqueName: \"kubernetes.io/projected/101f8be2-f543-44de-b004-5fdb8e3a381e-kube-api-access-vx2pp\") pod \"101f8be2-f543-44de-b004-5fdb8e3a381e\" (UID: \"101f8be2-f543-44de-b004-5fdb8e3a381e\") " Jul 08 17:23:22.889373 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:22.889277 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/101f8be2-f543-44de-b004-5fdb8e3a381e-trusted-ca-bundle\") pod \"101f8be2-f543-44de-b004-5fdb8e3a381e\" (UID: \"101f8be2-f543-44de-b004-5fdb8e3a381e\") " Jul 08 17:23:22.889373 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:22.889307 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/101f8be2-f543-44de-b004-5fdb8e3a381e-service-ca\") pod \"101f8be2-f543-44de-b004-5fdb8e3a381e\" (UID: \"101f8be2-f543-44de-b004-5fdb8e3a381e\") " Jul 08 17:23:22.889627 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:22.889389 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/101f8be2-f543-44de-b004-5fdb8e3a381e-console-serving-cert\") pod \"101f8be2-f543-44de-b004-5fdb8e3a381e\" (UID: \"101f8be2-f543-44de-b004-5fdb8e3a381e\") " Jul 08 17:23:22.889683 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:22.889652 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/101f8be2-f543-44de-b004-5fdb8e3a381e-console-config" (OuterVolumeSpecName: "console-config") pod "101f8be2-f543-44de-b004-5fdb8e3a381e" (UID: "101f8be2-f543-44de-b004-5fdb8e3a381e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:23:22.889737 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:22.889682 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/101f8be2-f543-44de-b004-5fdb8e3a381e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "101f8be2-f543-44de-b004-5fdb8e3a381e" (UID: "101f8be2-f543-44de-b004-5fdb8e3a381e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:23:22.889737 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:22.889690 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/101f8be2-f543-44de-b004-5fdb8e3a381e-service-ca" (OuterVolumeSpecName: "service-ca") pod "101f8be2-f543-44de-b004-5fdb8e3a381e" (UID: "101f8be2-f543-44de-b004-5fdb8e3a381e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:23:22.889946 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:22.889898 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/101f8be2-f543-44de-b004-5fdb8e3a381e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "101f8be2-f543-44de-b004-5fdb8e3a381e" (UID: "101f8be2-f543-44de-b004-5fdb8e3a381e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:23:22.891521 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:22.891489 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/101f8be2-f543-44de-b004-5fdb8e3a381e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "101f8be2-f543-44de-b004-5fdb8e3a381e" (UID: "101f8be2-f543-44de-b004-5fdb8e3a381e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 17:23:22.891619 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:22.891557 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/101f8be2-f543-44de-b004-5fdb8e3a381e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "101f8be2-f543-44de-b004-5fdb8e3a381e" (UID: "101f8be2-f543-44de-b004-5fdb8e3a381e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 17:23:22.891619 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:22.891595 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/101f8be2-f543-44de-b004-5fdb8e3a381e-kube-api-access-vx2pp" (OuterVolumeSpecName: "kube-api-access-vx2pp") pod "101f8be2-f543-44de-b004-5fdb8e3a381e" (UID: "101f8be2-f543-44de-b004-5fdb8e3a381e"). InnerVolumeSpecName "kube-api-access-vx2pp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:23:22.990257 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:22.990199 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/101f8be2-f543-44de-b004-5fdb8e3a381e-trusted-ca-bundle\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:23:22.990257 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:22.990246 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/101f8be2-f543-44de-b004-5fdb8e3a381e-service-ca\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:23:22.990257 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:22.990256 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/101f8be2-f543-44de-b004-5fdb8e3a381e-console-serving-cert\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:23:22.990257 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:22.990264 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/101f8be2-f543-44de-b004-5fdb8e3a381e-console-oauth-config\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:23:22.990257 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:22.990273 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/101f8be2-f543-44de-b004-5fdb8e3a381e-console-config\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:23:22.990542 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:22.990281 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/101f8be2-f543-44de-b004-5fdb8e3a381e-oauth-serving-cert\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:23:22.990542 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:22.990289 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vx2pp\" (UniqueName: \"kubernetes.io/projected/101f8be2-f543-44de-b004-5fdb8e3a381e-kube-api-access-vx2pp\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:23:23.522208 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:23.522176 2556 generic.go:356] "Generic (PLEG): container finished" podID="101f8be2-f543-44de-b004-5fdb8e3a381e" containerID="23331a8204ddaead8c28612507ec237561a609a6dfe24e8cfcea2ab94e19c162" exitCode=0 Jul 08 17:23:23.522381 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:23.522222 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79f8c4d69b-pbgsf" Jul 08 17:23:23.522381 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:23.522256 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79f8c4d69b-pbgsf" event={"ID":"101f8be2-f543-44de-b004-5fdb8e3a381e","Type":"ContainerDied","Data":"23331a8204ddaead8c28612507ec237561a609a6dfe24e8cfcea2ab94e19c162"} Jul 08 17:23:23.522381 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:23.522307 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79f8c4d69b-pbgsf" event={"ID":"101f8be2-f543-44de-b004-5fdb8e3a381e","Type":"ContainerDied","Data":"5ac01e702cf89ffc4327806324ea077f5c6d751f31411603eadd629807bb2d22"} Jul 08 17:23:23.522381 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:23.522329 2556 scope.go:117] "RemoveContainer" containerID="23331a8204ddaead8c28612507ec237561a609a6dfe24e8cfcea2ab94e19c162" Jul 08 17:23:23.531044 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:23.530877 2556 scope.go:117] "RemoveContainer" containerID="23331a8204ddaead8c28612507ec237561a609a6dfe24e8cfcea2ab94e19c162" Jul 08 17:23:23.531242 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:23:23.531141 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23331a8204ddaead8c28612507ec237561a609a6dfe24e8cfcea2ab94e19c162\": container with ID starting with 23331a8204ddaead8c28612507ec237561a609a6dfe24e8cfcea2ab94e19c162 not found: ID does not exist" containerID="23331a8204ddaead8c28612507ec237561a609a6dfe24e8cfcea2ab94e19c162" Jul 08 17:23:23.531242 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:23.531165 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23331a8204ddaead8c28612507ec237561a609a6dfe24e8cfcea2ab94e19c162"} err="failed to get container status \"23331a8204ddaead8c28612507ec237561a609a6dfe24e8cfcea2ab94e19c162\": rpc error: code = NotFound desc = could not find container \"23331a8204ddaead8c28612507ec237561a609a6dfe24e8cfcea2ab94e19c162\": container with ID starting with 23331a8204ddaead8c28612507ec237561a609a6dfe24e8cfcea2ab94e19c162 not found: ID does not exist" Jul 08 17:23:23.542746 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:23.542721 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79f8c4d69b-pbgsf"] Jul 08 17:23:23.544772 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:23.544752 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79f8c4d69b-pbgsf"] Jul 08 17:23:24.110971 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:24.110938 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="101f8be2-f543-44de-b004-5fdb8e3a381e" path="/var/lib/kubelet/pods/101f8be2-f543-44de-b004-5fdb8e3a381e/volumes" Jul 08 17:23:55.192117 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.192024 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6456df7688-47l9j"] Jul 08 17:23:55.192514 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.192341 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="101f8be2-f543-44de-b004-5fdb8e3a381e" containerName="console" Jul 08 17:23:55.192514 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.192354 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="101f8be2-f543-44de-b004-5fdb8e3a381e" containerName="console" Jul 08 17:23:55.192514 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.192430 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="101f8be2-f543-44de-b004-5fdb8e3a381e" containerName="console" Jul 08 17:23:55.194257 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.194241 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:23:55.217743 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.217711 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6456df7688-47l9j"] Jul 08 17:23:55.250248 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.250218 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/701fa525-ff82-4e86-bf25-1b010809ce68-console-config\") pod \"console-6456df7688-47l9j\" (UID: \"701fa525-ff82-4e86-bf25-1b010809ce68\") " pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:23:55.250439 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.250255 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/701fa525-ff82-4e86-bf25-1b010809ce68-console-serving-cert\") pod \"console-6456df7688-47l9j\" (UID: \"701fa525-ff82-4e86-bf25-1b010809ce68\") " pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:23:55.250439 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.250288 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/701fa525-ff82-4e86-bf25-1b010809ce68-trusted-ca-bundle\") pod \"console-6456df7688-47l9j\" (UID: \"701fa525-ff82-4e86-bf25-1b010809ce68\") " pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:23:55.250439 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.250310 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/701fa525-ff82-4e86-bf25-1b010809ce68-service-ca\") pod \"console-6456df7688-47l9j\" (UID: \"701fa525-ff82-4e86-bf25-1b010809ce68\") " pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:23:55.250439 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.250333 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/701fa525-ff82-4e86-bf25-1b010809ce68-console-oauth-config\") pod \"console-6456df7688-47l9j\" (UID: \"701fa525-ff82-4e86-bf25-1b010809ce68\") " pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:23:55.250439 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.250359 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9bwx\" (UniqueName: \"kubernetes.io/projected/701fa525-ff82-4e86-bf25-1b010809ce68-kube-api-access-r9bwx\") pod \"console-6456df7688-47l9j\" (UID: \"701fa525-ff82-4e86-bf25-1b010809ce68\") " pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:23:55.250605 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.250450 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/701fa525-ff82-4e86-bf25-1b010809ce68-oauth-serving-cert\") pod \"console-6456df7688-47l9j\" (UID: \"701fa525-ff82-4e86-bf25-1b010809ce68\") " pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:23:55.351722 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.351679 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/701fa525-ff82-4e86-bf25-1b010809ce68-console-config\") pod \"console-6456df7688-47l9j\" (UID: \"701fa525-ff82-4e86-bf25-1b010809ce68\") " pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:23:55.351722 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.351725 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/701fa525-ff82-4e86-bf25-1b010809ce68-console-serving-cert\") pod \"console-6456df7688-47l9j\" (UID: \"701fa525-ff82-4e86-bf25-1b010809ce68\") " pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:23:55.351961 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.351844 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/701fa525-ff82-4e86-bf25-1b010809ce68-trusted-ca-bundle\") pod \"console-6456df7688-47l9j\" (UID: \"701fa525-ff82-4e86-bf25-1b010809ce68\") " pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:23:55.351961 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.351877 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/701fa525-ff82-4e86-bf25-1b010809ce68-service-ca\") pod \"console-6456df7688-47l9j\" (UID: \"701fa525-ff82-4e86-bf25-1b010809ce68\") " pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:23:55.351961 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.351933 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/701fa525-ff82-4e86-bf25-1b010809ce68-console-oauth-config\") pod \"console-6456df7688-47l9j\" (UID: \"701fa525-ff82-4e86-bf25-1b010809ce68\") " pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:23:55.352096 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.351970 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9bwx\" (UniqueName: \"kubernetes.io/projected/701fa525-ff82-4e86-bf25-1b010809ce68-kube-api-access-r9bwx\") pod \"console-6456df7688-47l9j\" (UID: \"701fa525-ff82-4e86-bf25-1b010809ce68\") " pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:23:55.352252 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.352220 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/701fa525-ff82-4e86-bf25-1b010809ce68-oauth-serving-cert\") pod \"console-6456df7688-47l9j\" (UID: \"701fa525-ff82-4e86-bf25-1b010809ce68\") " pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:23:55.352484 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.352460 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/701fa525-ff82-4e86-bf25-1b010809ce68-console-config\") pod \"console-6456df7688-47l9j\" (UID: \"701fa525-ff82-4e86-bf25-1b010809ce68\") " pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:23:55.352569 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.352547 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/701fa525-ff82-4e86-bf25-1b010809ce68-service-ca\") pod \"console-6456df7688-47l9j\" (UID: \"701fa525-ff82-4e86-bf25-1b010809ce68\") " pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:23:55.352724 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.352702 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/701fa525-ff82-4e86-bf25-1b010809ce68-trusted-ca-bundle\") pod \"console-6456df7688-47l9j\" (UID: \"701fa525-ff82-4e86-bf25-1b010809ce68\") " pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:23:55.352809 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.352791 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/701fa525-ff82-4e86-bf25-1b010809ce68-oauth-serving-cert\") pod \"console-6456df7688-47l9j\" (UID: \"701fa525-ff82-4e86-bf25-1b010809ce68\") " pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:23:55.354220 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.354191 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/701fa525-ff82-4e86-bf25-1b010809ce68-console-serving-cert\") pod \"console-6456df7688-47l9j\" (UID: \"701fa525-ff82-4e86-bf25-1b010809ce68\") " pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:23:55.354475 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.354457 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/701fa525-ff82-4e86-bf25-1b010809ce68-console-oauth-config\") pod \"console-6456df7688-47l9j\" (UID: \"701fa525-ff82-4e86-bf25-1b010809ce68\") " pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:23:55.367185 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.367163 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9bwx\" (UniqueName: \"kubernetes.io/projected/701fa525-ff82-4e86-bf25-1b010809ce68-kube-api-access-r9bwx\") pod \"console-6456df7688-47l9j\" (UID: \"701fa525-ff82-4e86-bf25-1b010809ce68\") " pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:23:55.503827 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.503744 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:23:55.639837 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:55.639777 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6456df7688-47l9j"] Jul 08 17:23:55.642493 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:23:55.642465 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod701fa525_ff82_4e86_bf25_1b010809ce68.slice/crio-79598e4355d8ad8f0a4705224b291ad41c12c6bd48250468f669eaababd0c141 WatchSource:0}: Error finding container 79598e4355d8ad8f0a4705224b291ad41c12c6bd48250468f669eaababd0c141: Status 404 returned error can't find the container with id 79598e4355d8ad8f0a4705224b291ad41c12c6bd48250468f669eaababd0c141 Jul 08 17:23:56.651015 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:56.650977 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6456df7688-47l9j" event={"ID":"701fa525-ff82-4e86-bf25-1b010809ce68","Type":"ContainerStarted","Data":"8c65f21bf2e511987e7242ae05b38ec77259b573dafde3d128bb8bbaa95dd77b"} Jul 08 17:23:56.651416 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:56.651056 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6456df7688-47l9j" event={"ID":"701fa525-ff82-4e86-bf25-1b010809ce68","Type":"ContainerStarted","Data":"79598e4355d8ad8f0a4705224b291ad41c12c6bd48250468f669eaababd0c141"} Jul 08 17:23:56.676074 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:23:56.676016 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6456df7688-47l9j" podStartSLOduration=1.6760007049999999 podStartE2EDuration="1.676000705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:23:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:23:56.674629924 +0000 UTC m=+449.085445302" watchObservedRunningTime="2026-07-08 17:23:56.676000705 +0000 UTC m=+449.086816080" Jul 08 17:24:05.504320 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:05.504277 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:24:05.504967 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:05.504347 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:24:05.509153 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:05.509131 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:24:05.689285 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:05.689256 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:24:05.792468 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:05.792369 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74d6697bf7-b5gjz"] Jul 08 17:24:30.814183 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:30.814134 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-74d6697bf7-b5gjz" podUID="42ba7bb1-374a-43a4-a8d4-2774e47972cd" containerName="console" containerID="cri-o://430796f9bdcf39397ff79dcf9405884c09b226e2f61a4ddfad502e086dc95902" gracePeriod=15 Jul 08 17:24:31.048223 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.048198 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:24:31.147371 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.147335 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42ba7bb1-374a-43a4-a8d4-2774e47972cd-service-ca\") pod \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\" (UID: \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\") " Jul 08 17:24:31.147371 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.147378 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42ba7bb1-374a-43a4-a8d4-2774e47972cd-console-serving-cert\") pod \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\" (UID: \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\") " Jul 08 17:24:31.147627 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.147401 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42ba7bb1-374a-43a4-a8d4-2774e47972cd-trusted-ca-bundle\") pod \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\" (UID: \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\") " Jul 08 17:24:31.147627 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.147434 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42ba7bb1-374a-43a4-a8d4-2774e47972cd-console-oauth-config\") pod \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\" (UID: \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\") " Jul 08 17:24:31.147627 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.147484 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wgb9\" (UniqueName: \"kubernetes.io/projected/42ba7bb1-374a-43a4-a8d4-2774e47972cd-kube-api-access-4wgb9\") pod \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\" (UID: \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\") " Jul 08 17:24:31.147627 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.147509 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42ba7bb1-374a-43a4-a8d4-2774e47972cd-oauth-serving-cert\") pod \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\" (UID: \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\") " Jul 08 17:24:31.147827 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.147649 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42ba7bb1-374a-43a4-a8d4-2774e47972cd-console-config\") pod \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\" (UID: \"42ba7bb1-374a-43a4-a8d4-2774e47972cd\") " Jul 08 17:24:31.147827 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.147784 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42ba7bb1-374a-43a4-a8d4-2774e47972cd-service-ca" (OuterVolumeSpecName: "service-ca") pod "42ba7bb1-374a-43a4-a8d4-2774e47972cd" (UID: "42ba7bb1-374a-43a4-a8d4-2774e47972cd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:24:31.147965 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.147865 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42ba7bb1-374a-43a4-a8d4-2774e47972cd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "42ba7bb1-374a-43a4-a8d4-2774e47972cd" (UID: "42ba7bb1-374a-43a4-a8d4-2774e47972cd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:24:31.147965 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.147889 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42ba7bb1-374a-43a4-a8d4-2774e47972cd-service-ca\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:24:31.148106 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.148088 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42ba7bb1-374a-43a4-a8d4-2774e47972cd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "42ba7bb1-374a-43a4-a8d4-2774e47972cd" (UID: "42ba7bb1-374a-43a4-a8d4-2774e47972cd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:24:31.148171 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.148108 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42ba7bb1-374a-43a4-a8d4-2774e47972cd-console-config" (OuterVolumeSpecName: "console-config") pod "42ba7bb1-374a-43a4-a8d4-2774e47972cd" (UID: "42ba7bb1-374a-43a4-a8d4-2774e47972cd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:24:31.149676 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.149646 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42ba7bb1-374a-43a4-a8d4-2774e47972cd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "42ba7bb1-374a-43a4-a8d4-2774e47972cd" (UID: "42ba7bb1-374a-43a4-a8d4-2774e47972cd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 17:24:31.149779 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.149705 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42ba7bb1-374a-43a4-a8d4-2774e47972cd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "42ba7bb1-374a-43a4-a8d4-2774e47972cd" (UID: "42ba7bb1-374a-43a4-a8d4-2774e47972cd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 17:24:31.149779 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.149723 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42ba7bb1-374a-43a4-a8d4-2774e47972cd-kube-api-access-4wgb9" (OuterVolumeSpecName: "kube-api-access-4wgb9") pod "42ba7bb1-374a-43a4-a8d4-2774e47972cd" (UID: "42ba7bb1-374a-43a4-a8d4-2774e47972cd"). InnerVolumeSpecName "kube-api-access-4wgb9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:24:31.248354 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.248317 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42ba7bb1-374a-43a4-a8d4-2774e47972cd-console-oauth-config\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:24:31.248354 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.248348 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wgb9\" (UniqueName: \"kubernetes.io/projected/42ba7bb1-374a-43a4-a8d4-2774e47972cd-kube-api-access-4wgb9\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:24:31.248354 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.248363 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42ba7bb1-374a-43a4-a8d4-2774e47972cd-oauth-serving-cert\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:24:31.248679 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.248372 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42ba7bb1-374a-43a4-a8d4-2774e47972cd-console-config\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:24:31.248679 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.248382 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42ba7bb1-374a-43a4-a8d4-2774e47972cd-console-serving-cert\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:24:31.248679 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.248391 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42ba7bb1-374a-43a4-a8d4-2774e47972cd-trusted-ca-bundle\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:24:31.780881 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.780839 2556 generic.go:356] "Generic (PLEG): container finished" podID="42ba7bb1-374a-43a4-a8d4-2774e47972cd" containerID="430796f9bdcf39397ff79dcf9405884c09b226e2f61a4ddfad502e086dc95902" exitCode=0 Jul 08 17:24:31.781079 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.780887 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d6697bf7-b5gjz" Jul 08 17:24:31.781079 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.780941 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d6697bf7-b5gjz" event={"ID":"42ba7bb1-374a-43a4-a8d4-2774e47972cd","Type":"ContainerDied","Data":"430796f9bdcf39397ff79dcf9405884c09b226e2f61a4ddfad502e086dc95902"} Jul 08 17:24:31.781079 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.780997 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d6697bf7-b5gjz" event={"ID":"42ba7bb1-374a-43a4-a8d4-2774e47972cd","Type":"ContainerDied","Data":"b5ace8b1768926855b9c86b9387b3283396dc613e7c020a8aca089228fda582c"} Jul 08 17:24:31.781079 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.781017 2556 scope.go:117] "RemoveContainer" containerID="430796f9bdcf39397ff79dcf9405884c09b226e2f61a4ddfad502e086dc95902" Jul 08 17:24:31.789742 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.789727 2556 scope.go:117] "RemoveContainer" containerID="430796f9bdcf39397ff79dcf9405884c09b226e2f61a4ddfad502e086dc95902" Jul 08 17:24:31.790020 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:24:31.790002 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"430796f9bdcf39397ff79dcf9405884c09b226e2f61a4ddfad502e086dc95902\": container with ID starting with 430796f9bdcf39397ff79dcf9405884c09b226e2f61a4ddfad502e086dc95902 not found: ID does not exist" containerID="430796f9bdcf39397ff79dcf9405884c09b226e2f61a4ddfad502e086dc95902" Jul 08 17:24:31.790093 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.790028 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"430796f9bdcf39397ff79dcf9405884c09b226e2f61a4ddfad502e086dc95902"} err="failed to get container status \"430796f9bdcf39397ff79dcf9405884c09b226e2f61a4ddfad502e086dc95902\": rpc error: code = NotFound desc = could not find container \"430796f9bdcf39397ff79dcf9405884c09b226e2f61a4ddfad502e086dc95902\": container with ID starting with 430796f9bdcf39397ff79dcf9405884c09b226e2f61a4ddfad502e086dc95902 not found: ID does not exist" Jul 08 17:24:31.801929 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.801885 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74d6697bf7-b5gjz"] Jul 08 17:24:31.807551 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:31.807528 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74d6697bf7-b5gjz"] Jul 08 17:24:32.110204 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:24:32.110174 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42ba7bb1-374a-43a4-a8d4-2774e47972cd" path="/var/lib/kubelet/pods/42ba7bb1-374a-43a4-a8d4-2774e47972cd/volumes" Jul 08 17:25:24.235121 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:24.235039 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dv5pl"] Jul 08 17:25:24.235586 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:24.235379 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42ba7bb1-374a-43a4-a8d4-2774e47972cd" containerName="console" Jul 08 17:25:24.235586 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:24.235392 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="42ba7bb1-374a-43a4-a8d4-2774e47972cd" containerName="console" Jul 08 17:25:24.235586 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:24.235436 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="42ba7bb1-374a-43a4-a8d4-2774e47972cd" containerName="console" Jul 08 17:25:24.237439 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:24.237423 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dv5pl" Jul 08 17:25:24.239693 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:24.239668 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 08 17:25:24.239799 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:24.239709 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 08 17:25:24.240400 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:24.240375 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-hzcsg\"" Jul 08 17:25:24.245553 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:24.245531 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dv5pl"] Jul 08 17:25:24.343796 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:24.343761 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b607ca38-98d0-4d33-875d-3c000444c662-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dv5pl\" (UID: \"b607ca38-98d0-4d33-875d-3c000444c662\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dv5pl" Jul 08 17:25:24.343796 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:24.343794 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frkdd\" (UniqueName: \"kubernetes.io/projected/b607ca38-98d0-4d33-875d-3c000444c662-kube-api-access-frkdd\") pod \"cert-manager-cainjector-559cdd8c87-dv5pl\" (UID: \"b607ca38-98d0-4d33-875d-3c000444c662\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dv5pl" Jul 08 17:25:24.444436 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:24.444397 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b607ca38-98d0-4d33-875d-3c000444c662-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dv5pl\" (UID: \"b607ca38-98d0-4d33-875d-3c000444c662\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dv5pl" Jul 08 17:25:24.444436 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:24.444438 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frkdd\" (UniqueName: \"kubernetes.io/projected/b607ca38-98d0-4d33-875d-3c000444c662-kube-api-access-frkdd\") pod \"cert-manager-cainjector-559cdd8c87-dv5pl\" (UID: \"b607ca38-98d0-4d33-875d-3c000444c662\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dv5pl" Jul 08 17:25:24.452347 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:24.452312 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b607ca38-98d0-4d33-875d-3c000444c662-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dv5pl\" (UID: \"b607ca38-98d0-4d33-875d-3c000444c662\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dv5pl" Jul 08 17:25:24.452458 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:24.452443 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frkdd\" (UniqueName: \"kubernetes.io/projected/b607ca38-98d0-4d33-875d-3c000444c662-kube-api-access-frkdd\") pod \"cert-manager-cainjector-559cdd8c87-dv5pl\" (UID: \"b607ca38-98d0-4d33-875d-3c000444c662\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dv5pl" Jul 08 17:25:24.547444 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:24.547349 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dv5pl" Jul 08 17:25:24.680094 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:24.679972 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dv5pl"] Jul 08 17:25:24.682755 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:25:24.682729 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb607ca38_98d0_4d33_875d_3c000444c662.slice/crio-7f572d498025c249d2ba369f826983818b50aad8a894af1e8fbe064e91505c0b WatchSource:0}: Error finding container 7f572d498025c249d2ba369f826983818b50aad8a894af1e8fbe064e91505c0b: Status 404 returned error can't find the container with id 7f572d498025c249d2ba369f826983818b50aad8a894af1e8fbe064e91505c0b Jul 08 17:25:24.978665 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:24.978626 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dv5pl" event={"ID":"b607ca38-98d0-4d33-875d-3c000444c662","Type":"ContainerStarted","Data":"7f572d498025c249d2ba369f826983818b50aad8a894af1e8fbe064e91505c0b"} Jul 08 17:25:27.992812 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:27.992780 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dv5pl" event={"ID":"b607ca38-98d0-4d33-875d-3c000444c662","Type":"ContainerStarted","Data":"4664a2c033172b845eb7d5368af59c2e0b69818f065473916cb1ab6a7c5fbd9c"} Jul 08 17:25:28.008027 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:28.007983 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dv5pl" podStartSLOduration=1.169785015 podStartE2EDuration="4.00796696s" totalImagesPullingTime="2.838181945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:25:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:25:28.007312128 +0000 UTC m=+540.418127508" watchObservedRunningTime="2026-07-08 17:25:28.00796696 +0000 UTC m=+540.418782338" Jul 08 17:25:31.432343 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:31.432305 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ph82l"] Jul 08 17:25:31.435131 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:31.435112 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ph82l" Jul 08 17:25:31.437331 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:31.437308 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-f4xz7\"" Jul 08 17:25:31.445948 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:31.445905 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ph82l"] Jul 08 17:25:31.506111 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:31.506078 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7q78\" (UniqueName: \"kubernetes.io/projected/ead94115-cb41-403f-b815-cb66f6bfb3e7-kube-api-access-n7q78\") pod \"cert-manager-55b4d954d5-ph82l\" (UID: \"ead94115-cb41-403f-b815-cb66f6bfb3e7\") " pod="cert-manager/cert-manager-55b4d954d5-ph82l" Jul 08 17:25:31.506111 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:31.506113 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ead94115-cb41-403f-b815-cb66f6bfb3e7-bound-sa-token\") pod \"cert-manager-55b4d954d5-ph82l\" (UID: \"ead94115-cb41-403f-b815-cb66f6bfb3e7\") " pod="cert-manager/cert-manager-55b4d954d5-ph82l" Jul 08 17:25:31.606486 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:31.606450 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7q78\" (UniqueName: \"kubernetes.io/projected/ead94115-cb41-403f-b815-cb66f6bfb3e7-kube-api-access-n7q78\") pod \"cert-manager-55b4d954d5-ph82l\" (UID: \"ead94115-cb41-403f-b815-cb66f6bfb3e7\") " pod="cert-manager/cert-manager-55b4d954d5-ph82l" Jul 08 17:25:31.606622 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:31.606493 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ead94115-cb41-403f-b815-cb66f6bfb3e7-bound-sa-token\") pod \"cert-manager-55b4d954d5-ph82l\" (UID: \"ead94115-cb41-403f-b815-cb66f6bfb3e7\") " pod="cert-manager/cert-manager-55b4d954d5-ph82l" Jul 08 17:25:31.614396 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:31.614361 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ead94115-cb41-403f-b815-cb66f6bfb3e7-bound-sa-token\") pod \"cert-manager-55b4d954d5-ph82l\" (UID: \"ead94115-cb41-403f-b815-cb66f6bfb3e7\") " pod="cert-manager/cert-manager-55b4d954d5-ph82l" Jul 08 17:25:31.614513 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:31.614485 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7q78\" (UniqueName: \"kubernetes.io/projected/ead94115-cb41-403f-b815-cb66f6bfb3e7-kube-api-access-n7q78\") pod \"cert-manager-55b4d954d5-ph82l\" (UID: \"ead94115-cb41-403f-b815-cb66f6bfb3e7\") " pod="cert-manager/cert-manager-55b4d954d5-ph82l" Jul 08 17:25:31.744343 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:31.744254 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ph82l" Jul 08 17:25:31.889972 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:31.889936 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ph82l"] Jul 08 17:25:31.892704 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:25:31.892673 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podead94115_cb41_403f_b815_cb66f6bfb3e7.slice/crio-4cc6ccd18990da7221aa56c4cd8def173f193c6bdddbf4ef54cf23f78c6bc72c WatchSource:0}: Error finding container 4cc6ccd18990da7221aa56c4cd8def173f193c6bdddbf4ef54cf23f78c6bc72c: Status 404 returned error can't find the container with id 4cc6ccd18990da7221aa56c4cd8def173f193c6bdddbf4ef54cf23f78c6bc72c Jul 08 17:25:32.009298 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:32.009205 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ph82l" event={"ID":"ead94115-cb41-403f-b815-cb66f6bfb3e7","Type":"ContainerStarted","Data":"7ad706d522abf1b9d28767c2b9c18d01434fd260a04af79d432fab49586c94f5"} Jul 08 17:25:32.009298 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:32.009254 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ph82l" event={"ID":"ead94115-cb41-403f-b815-cb66f6bfb3e7","Type":"ContainerStarted","Data":"4cc6ccd18990da7221aa56c4cd8def173f193c6bdddbf4ef54cf23f78c6bc72c"} Jul 08 17:25:32.025642 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:25:32.025592 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-ph82l" podStartSLOduration=1.025575947 podStartE2EDuration="1.025575947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:25:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:25:32.024817292 +0000 UTC m=+544.435632670" watchObservedRunningTime="2026-07-08 17:25:32.025575947 +0000 UTC m=+544.436391324" Jul 08 17:26:11.822793 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:11.822759 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-564755f94b-ggcd4"] Jul 08 17:26:11.827767 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:11.827745 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-ggcd4" Jul 08 17:26:11.830155 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:11.830136 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 17:26:11.830432 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:11.830412 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 17:26:11.830499 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:11.830485 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 17:26:11.830953 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:11.830938 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-748sr\"" Jul 08 17:26:11.834395 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:11.834378 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 17:26:11.843035 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:11.843008 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-564755f94b-ggcd4"] Jul 08 17:26:11.944444 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:11.944401 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad8a8664-2aa8-4055-9998-995e2f1a8235-apiservice-cert\") pod \"opendatahub-operator-controller-manager-564755f94b-ggcd4\" (UID: \"ad8a8664-2aa8-4055-9998-995e2f1a8235\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-ggcd4" Jul 08 17:26:11.944444 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:11.944444 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad8a8664-2aa8-4055-9998-995e2f1a8235-webhook-cert\") pod \"opendatahub-operator-controller-manager-564755f94b-ggcd4\" (UID: \"ad8a8664-2aa8-4055-9998-995e2f1a8235\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-ggcd4" Jul 08 17:26:11.944710 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:11.944467 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad8a8664-2aa8-4055-9998-995e2f1a8235-tmp\") pod \"opendatahub-operator-controller-manager-564755f94b-ggcd4\" (UID: \"ad8a8664-2aa8-4055-9998-995e2f1a8235\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-ggcd4" Jul 08 17:26:11.944710 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:11.944576 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ad8a8664-2aa8-4055-9998-995e2f1a8235-manifests\") pod \"opendatahub-operator-controller-manager-564755f94b-ggcd4\" (UID: \"ad8a8664-2aa8-4055-9998-995e2f1a8235\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-ggcd4" Jul 08 17:26:11.944710 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:11.944613 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29brj\" (UniqueName: \"kubernetes.io/projected/ad8a8664-2aa8-4055-9998-995e2f1a8235-kube-api-access-29brj\") pod \"opendatahub-operator-controller-manager-564755f94b-ggcd4\" (UID: \"ad8a8664-2aa8-4055-9998-995e2f1a8235\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-ggcd4" Jul 08 17:26:12.045197 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:12.045160 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad8a8664-2aa8-4055-9998-995e2f1a8235-apiservice-cert\") pod \"opendatahub-operator-controller-manager-564755f94b-ggcd4\" (UID: \"ad8a8664-2aa8-4055-9998-995e2f1a8235\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-ggcd4" Jul 08 17:26:12.045197 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:12.045203 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad8a8664-2aa8-4055-9998-995e2f1a8235-webhook-cert\") pod \"opendatahub-operator-controller-manager-564755f94b-ggcd4\" (UID: \"ad8a8664-2aa8-4055-9998-995e2f1a8235\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-ggcd4" Jul 08 17:26:12.045450 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:12.045229 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad8a8664-2aa8-4055-9998-995e2f1a8235-tmp\") pod \"opendatahub-operator-controller-manager-564755f94b-ggcd4\" (UID: \"ad8a8664-2aa8-4055-9998-995e2f1a8235\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-ggcd4" Jul 08 17:26:12.045450 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:12.045410 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ad8a8664-2aa8-4055-9998-995e2f1a8235-manifests\") pod \"opendatahub-operator-controller-manager-564755f94b-ggcd4\" (UID: \"ad8a8664-2aa8-4055-9998-995e2f1a8235\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-ggcd4" Jul 08 17:26:12.045569 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:12.045459 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29brj\" (UniqueName: \"kubernetes.io/projected/ad8a8664-2aa8-4055-9998-995e2f1a8235-kube-api-access-29brj\") pod \"opendatahub-operator-controller-manager-564755f94b-ggcd4\" (UID: \"ad8a8664-2aa8-4055-9998-995e2f1a8235\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-ggcd4" Jul 08 17:26:12.045821 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:12.045792 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ad8a8664-2aa8-4055-9998-995e2f1a8235-manifests\") pod \"opendatahub-operator-controller-manager-564755f94b-ggcd4\" (UID: \"ad8a8664-2aa8-4055-9998-995e2f1a8235\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-ggcd4" Jul 08 17:26:12.047602 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:12.047574 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad8a8664-2aa8-4055-9998-995e2f1a8235-tmp\") pod \"opendatahub-operator-controller-manager-564755f94b-ggcd4\" (UID: \"ad8a8664-2aa8-4055-9998-995e2f1a8235\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-ggcd4" Jul 08 17:26:12.047704 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:12.047638 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ad8a8664-2aa8-4055-9998-995e2f1a8235-apiservice-cert\") pod \"opendatahub-operator-controller-manager-564755f94b-ggcd4\" (UID: \"ad8a8664-2aa8-4055-9998-995e2f1a8235\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-ggcd4" Jul 08 17:26:12.047704 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:12.047672 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad8a8664-2aa8-4055-9998-995e2f1a8235-webhook-cert\") pod \"opendatahub-operator-controller-manager-564755f94b-ggcd4\" (UID: \"ad8a8664-2aa8-4055-9998-995e2f1a8235\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-ggcd4" Jul 08 17:26:12.054681 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:12.054648 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29brj\" (UniqueName: \"kubernetes.io/projected/ad8a8664-2aa8-4055-9998-995e2f1a8235-kube-api-access-29brj\") pod \"opendatahub-operator-controller-manager-564755f94b-ggcd4\" (UID: \"ad8a8664-2aa8-4055-9998-995e2f1a8235\") " pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-ggcd4" Jul 08 17:26:12.138613 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:12.138581 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-ggcd4" Jul 08 17:26:12.275855 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:12.275775 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-564755f94b-ggcd4"] Jul 08 17:26:12.284598 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:26:12.284557 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad8a8664_2aa8_4055_9998_995e2f1a8235.slice/crio-00201391f36092c086960a68df0011252a2763b8d42df19b3c052e27fcd90f83 WatchSource:0}: Error finding container 00201391f36092c086960a68df0011252a2763b8d42df19b3c052e27fcd90f83: Status 404 returned error can't find the container with id 00201391f36092c086960a68df0011252a2763b8d42df19b3c052e27fcd90f83 Jul 08 17:26:13.165334 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:13.165297 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-ggcd4" event={"ID":"ad8a8664-2aa8-4055-9998-995e2f1a8235","Type":"ContainerStarted","Data":"00201391f36092c086960a68df0011252a2763b8d42df19b3c052e27fcd90f83"} Jul 08 17:26:16.181151 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:16.181107 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-ggcd4" event={"ID":"ad8a8664-2aa8-4055-9998-995e2f1a8235","Type":"ContainerStarted","Data":"d16482c1736cdff5c31a625cb272337545519376affc5c3c74f778288ff3f168"} Jul 08 17:26:17.187073 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:17.187040 2556 generic.go:356] "Generic (PLEG): container finished" podID="ad8a8664-2aa8-4055-9998-995e2f1a8235" containerID="d16482c1736cdff5c31a625cb272337545519376affc5c3c74f778288ff3f168" exitCode=0 Jul 08 17:26:17.187522 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:17.187122 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-ggcd4" event={"ID":"ad8a8664-2aa8-4055-9998-995e2f1a8235","Type":"ContainerDied","Data":"d16482c1736cdff5c31a625cb272337545519376affc5c3c74f778288ff3f168"} Jul 08 17:26:18.192321 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:18.192283 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-ggcd4" event={"ID":"ad8a8664-2aa8-4055-9998-995e2f1a8235","Type":"ContainerStarted","Data":"8ef10d293cb441a806e3b1828fdc8d154c0af86f1f84ff2e2e4b6e2f1fcd7cdc"} Jul 08 17:26:18.192740 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:18.192417 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-ggcd4" Jul 08 17:26:18.215344 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:18.215296 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-ggcd4" podStartSLOduration=3.003709797 podStartE2EDuration="7.215279581s" totalImagesPullingTime="3.204808972s" totalInitContainerRuntime="1.006760812s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:26:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:26:18.213548031 +0000 UTC m=+590.624363407" watchObservedRunningTime="2026-07-08 17:26:18.215279581 +0000 UTC m=+590.626094958" Jul 08 17:26:28.231744 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:28.231715 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gsn8l_c2541cd3-af4f-4de5-b042-3611d02a80ab/console-operator/1.log" Jul 08 17:26:28.234673 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:28.234654 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gsn8l_c2541cd3-af4f-4de5-b042-3611d02a80ab/console-operator/1.log" Jul 08 17:26:29.198299 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:29.198267 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-564755f94b-ggcd4" Jul 08 17:26:31.687285 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:31.687249 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mp6s7"] Jul 08 17:26:31.690391 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:31.690375 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-mp6s7" Jul 08 17:26:31.693009 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:31.692988 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 08 17:26:31.693145 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:31.693048 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-fdrhd\"" Jul 08 17:26:31.702526 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:31.702502 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mp6s7"] Jul 08 17:26:31.811494 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:31.811460 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/920516cd-cf90-4582-9d41-1c38a837befe-cert\") pod \"odh-model-controller-7998c67dc4-mp6s7\" (UID: \"920516cd-cf90-4582-9d41-1c38a837befe\") " pod="opendatahub/odh-model-controller-7998c67dc4-mp6s7" Jul 08 17:26:31.811494 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:31.811490 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxm8c\" (UniqueName: \"kubernetes.io/projected/920516cd-cf90-4582-9d41-1c38a837befe-kube-api-access-mxm8c\") pod \"odh-model-controller-7998c67dc4-mp6s7\" (UID: \"920516cd-cf90-4582-9d41-1c38a837befe\") " pod="opendatahub/odh-model-controller-7998c67dc4-mp6s7" Jul 08 17:26:31.912359 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:31.912321 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/920516cd-cf90-4582-9d41-1c38a837befe-cert\") pod \"odh-model-controller-7998c67dc4-mp6s7\" (UID: \"920516cd-cf90-4582-9d41-1c38a837befe\") " pod="opendatahub/odh-model-controller-7998c67dc4-mp6s7" Jul 08 17:26:31.912359 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:31.912364 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxm8c\" (UniqueName: \"kubernetes.io/projected/920516cd-cf90-4582-9d41-1c38a837befe-kube-api-access-mxm8c\") pod \"odh-model-controller-7998c67dc4-mp6s7\" (UID: \"920516cd-cf90-4582-9d41-1c38a837befe\") " pod="opendatahub/odh-model-controller-7998c67dc4-mp6s7" Jul 08 17:26:31.914772 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:31.914741 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/920516cd-cf90-4582-9d41-1c38a837befe-cert\") pod \"odh-model-controller-7998c67dc4-mp6s7\" (UID: \"920516cd-cf90-4582-9d41-1c38a837befe\") " pod="opendatahub/odh-model-controller-7998c67dc4-mp6s7" Jul 08 17:26:31.932873 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:31.932845 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxm8c\" (UniqueName: \"kubernetes.io/projected/920516cd-cf90-4582-9d41-1c38a837befe-kube-api-access-mxm8c\") pod \"odh-model-controller-7998c67dc4-mp6s7\" (UID: \"920516cd-cf90-4582-9d41-1c38a837befe\") " pod="opendatahub/odh-model-controller-7998c67dc4-mp6s7" Jul 08 17:26:32.001041 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:32.000957 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-mp6s7" Jul 08 17:26:32.153516 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:32.153440 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mp6s7"] Jul 08 17:26:32.156191 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:26:32.156165 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod920516cd_cf90_4582_9d41_1c38a837befe.slice/crio-ba9ad4a10281c6759bcb0c6b122870e6d3c6b598866b222fae310edb5bed987b WatchSource:0}: Error finding container ba9ad4a10281c6759bcb0c6b122870e6d3c6b598866b222fae310edb5bed987b: Status 404 returned error can't find the container with id ba9ad4a10281c6759bcb0c6b122870e6d3c6b598866b222fae310edb5bed987b Jul 08 17:26:32.249401 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:32.249363 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-mp6s7" event={"ID":"920516cd-cf90-4582-9d41-1c38a837befe","Type":"ContainerStarted","Data":"ba9ad4a10281c6759bcb0c6b122870e6d3c6b598866b222fae310edb5bed987b"} Jul 08 17:26:32.500817 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:32.500779 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-n9b4r"] Jul 08 17:26:32.505155 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:32.505134 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-n9b4r" Jul 08 17:26:32.507328 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:32.507300 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 08 17:26:32.507449 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:32.507400 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-gtmdg\"" Jul 08 17:26:32.521803 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:32.521771 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-n9b4r"] Jul 08 17:26:32.617267 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:32.617227 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj2ww\" (UniqueName: \"kubernetes.io/projected/f411d0c3-f9c6-4694-8ef3-f05d4ab17686-kube-api-access-pj2ww\") pod \"model-serving-api-54d89bd5fc-n9b4r\" (UID: \"f411d0c3-f9c6-4694-8ef3-f05d4ab17686\") " pod="opendatahub/model-serving-api-54d89bd5fc-n9b4r" Jul 08 17:26:32.617439 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:32.617275 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f411d0c3-f9c6-4694-8ef3-f05d4ab17686-tls-certs\") pod \"model-serving-api-54d89bd5fc-n9b4r\" (UID: \"f411d0c3-f9c6-4694-8ef3-f05d4ab17686\") " pod="opendatahub/model-serving-api-54d89bd5fc-n9b4r" Jul 08 17:26:32.718262 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:32.718223 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj2ww\" (UniqueName: \"kubernetes.io/projected/f411d0c3-f9c6-4694-8ef3-f05d4ab17686-kube-api-access-pj2ww\") pod \"model-serving-api-54d89bd5fc-n9b4r\" (UID: \"f411d0c3-f9c6-4694-8ef3-f05d4ab17686\") " pod="opendatahub/model-serving-api-54d89bd5fc-n9b4r" Jul 08 17:26:32.718720 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:32.718273 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f411d0c3-f9c6-4694-8ef3-f05d4ab17686-tls-certs\") pod \"model-serving-api-54d89bd5fc-n9b4r\" (UID: \"f411d0c3-f9c6-4694-8ef3-f05d4ab17686\") " pod="opendatahub/model-serving-api-54d89bd5fc-n9b4r" Jul 08 17:26:32.721162 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:32.721133 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f411d0c3-f9c6-4694-8ef3-f05d4ab17686-tls-certs\") pod \"model-serving-api-54d89bd5fc-n9b4r\" (UID: \"f411d0c3-f9c6-4694-8ef3-f05d4ab17686\") " pod="opendatahub/model-serving-api-54d89bd5fc-n9b4r" Jul 08 17:26:32.727365 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:32.727339 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj2ww\" (UniqueName: \"kubernetes.io/projected/f411d0c3-f9c6-4694-8ef3-f05d4ab17686-kube-api-access-pj2ww\") pod \"model-serving-api-54d89bd5fc-n9b4r\" (UID: \"f411d0c3-f9c6-4694-8ef3-f05d4ab17686\") " pod="opendatahub/model-serving-api-54d89bd5fc-n9b4r" Jul 08 17:26:32.815898 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:32.815786 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-n9b4r" Jul 08 17:26:32.972614 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:32.972471 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-n9b4r"] Jul 08 17:26:32.975152 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:26:32.975124 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf411d0c3_f9c6_4694_8ef3_f05d4ab17686.slice/crio-075a27b06a3f3148ea1cc2fa490ef05a18fc7c3bcedd87702ebdac0259cb6eca WatchSource:0}: Error finding container 075a27b06a3f3148ea1cc2fa490ef05a18fc7c3bcedd87702ebdac0259cb6eca: Status 404 returned error can't find the container with id 075a27b06a3f3148ea1cc2fa490ef05a18fc7c3bcedd87702ebdac0259cb6eca Jul 08 17:26:33.256079 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:33.256040 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-n9b4r" event={"ID":"f411d0c3-f9c6-4694-8ef3-f05d4ab17686","Type":"ContainerStarted","Data":"075a27b06a3f3148ea1cc2fa490ef05a18fc7c3bcedd87702ebdac0259cb6eca"} Jul 08 17:26:36.270823 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:36.270786 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-mp6s7" event={"ID":"920516cd-cf90-4582-9d41-1c38a837befe","Type":"ContainerStarted","Data":"c801d25d37ea020f3bff11affd5d86cec0aa50cd22db0b3efa2892279a56029c"} Jul 08 17:26:36.271324 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:36.270930 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-mp6s7" Jul 08 17:26:36.272428 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:36.272407 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-n9b4r" event={"ID":"f411d0c3-f9c6-4694-8ef3-f05d4ab17686","Type":"ContainerStarted","Data":"ee94a9f9ecff820b592baa5f79c584afdc1f8bac14cb8d25b6eb7188e5982ebc"} Jul 08 17:26:36.272552 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:36.272454 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-n9b4r" Jul 08 17:26:36.287501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:36.287451 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-mp6s7" podStartSLOduration=2.012335136 podStartE2EDuration="5.287436392s" totalImagesPullingTime="3.275101256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:26:36.285440944 +0000 UTC m=+608.696256321" watchObservedRunningTime="2026-07-08 17:26:36.287436392 +0000 UTC m=+608.698251777" Jul 08 17:26:36.301375 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:36.301318 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-n9b4r" podStartSLOduration=1.849013461 podStartE2EDuration="4.301300368s" totalImagesPullingTime="2.452286907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:26:36.299891206 +0000 UTC m=+608.710706608" watchObservedRunningTime="2026-07-08 17:26:36.301300368 +0000 UTC m=+608.712115745" Jul 08 17:26:36.735272 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:36.735236 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6d86b88db9-fxf62"] Jul 08 17:26:36.738512 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:36.738491 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d86b88db9-fxf62" Jul 08 17:26:36.741557 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:36.741533 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 17:26:36.741684 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:36.741559 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6qz6r\"" Jul 08 17:26:36.741684 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:36.741536 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 08 17:26:36.741684 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:36.741539 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 17:26:36.741684 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:36.741580 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 08 17:26:36.748929 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:36.748886 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d86b88db9-fxf62"] Jul 08 17:26:36.860122 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:36.860085 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a8452a4-3b7e-43c8-a84e-0a5ac684609c-tmp\") pod \"kube-auth-proxy-6d86b88db9-fxf62\" (UID: \"8a8452a4-3b7e-43c8-a84e-0a5ac684609c\") " pod="openshift-ingress/kube-auth-proxy-6d86b88db9-fxf62" Jul 08 17:26:36.860122 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:36.860127 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a8452a4-3b7e-43c8-a84e-0a5ac684609c-tls-certs\") pod \"kube-auth-proxy-6d86b88db9-fxf62\" (UID: \"8a8452a4-3b7e-43c8-a84e-0a5ac684609c\") " pod="openshift-ingress/kube-auth-proxy-6d86b88db9-fxf62" Jul 08 17:26:36.860325 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:36.860154 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f7kq\" (UniqueName: \"kubernetes.io/projected/8a8452a4-3b7e-43c8-a84e-0a5ac684609c-kube-api-access-7f7kq\") pod \"kube-auth-proxy-6d86b88db9-fxf62\" (UID: \"8a8452a4-3b7e-43c8-a84e-0a5ac684609c\") " pod="openshift-ingress/kube-auth-proxy-6d86b88db9-fxf62" Jul 08 17:26:36.960752 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:36.960706 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a8452a4-3b7e-43c8-a84e-0a5ac684609c-tmp\") pod \"kube-auth-proxy-6d86b88db9-fxf62\" (UID: \"8a8452a4-3b7e-43c8-a84e-0a5ac684609c\") " pod="openshift-ingress/kube-auth-proxy-6d86b88db9-fxf62" Jul 08 17:26:36.960954 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:36.960761 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a8452a4-3b7e-43c8-a84e-0a5ac684609c-tls-certs\") pod \"kube-auth-proxy-6d86b88db9-fxf62\" (UID: \"8a8452a4-3b7e-43c8-a84e-0a5ac684609c\") " pod="openshift-ingress/kube-auth-proxy-6d86b88db9-fxf62" Jul 08 17:26:36.960954 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:36.960801 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f7kq\" (UniqueName: \"kubernetes.io/projected/8a8452a4-3b7e-43c8-a84e-0a5ac684609c-kube-api-access-7f7kq\") pod \"kube-auth-proxy-6d86b88db9-fxf62\" (UID: \"8a8452a4-3b7e-43c8-a84e-0a5ac684609c\") " pod="openshift-ingress/kube-auth-proxy-6d86b88db9-fxf62" Jul 08 17:26:36.963130 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:36.963099 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a8452a4-3b7e-43c8-a84e-0a5ac684609c-tmp\") pod \"kube-auth-proxy-6d86b88db9-fxf62\" (UID: \"8a8452a4-3b7e-43c8-a84e-0a5ac684609c\") " pod="openshift-ingress/kube-auth-proxy-6d86b88db9-fxf62" Jul 08 17:26:36.963319 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:36.963299 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a8452a4-3b7e-43c8-a84e-0a5ac684609c-tls-certs\") pod \"kube-auth-proxy-6d86b88db9-fxf62\" (UID: \"8a8452a4-3b7e-43c8-a84e-0a5ac684609c\") " pod="openshift-ingress/kube-auth-proxy-6d86b88db9-fxf62" Jul 08 17:26:36.973641 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:36.973611 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f7kq\" (UniqueName: \"kubernetes.io/projected/8a8452a4-3b7e-43c8-a84e-0a5ac684609c-kube-api-access-7f7kq\") pod \"kube-auth-proxy-6d86b88db9-fxf62\" (UID: \"8a8452a4-3b7e-43c8-a84e-0a5ac684609c\") " pod="openshift-ingress/kube-auth-proxy-6d86b88db9-fxf62" Jul 08 17:26:37.048694 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:37.048611 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d86b88db9-fxf62" Jul 08 17:26:37.212539 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:37.212514 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d86b88db9-fxf62"] Jul 08 17:26:37.214500 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:26:37.214479 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a8452a4_3b7e_43c8_a84e_0a5ac684609c.slice/crio-81db27eb35a9271901a82efae8380b39e1beaebbfa4394794dcbb2acff15c181 WatchSource:0}: Error finding container 81db27eb35a9271901a82efae8380b39e1beaebbfa4394794dcbb2acff15c181: Status 404 returned error can't find the container with id 81db27eb35a9271901a82efae8380b39e1beaebbfa4394794dcbb2acff15c181 Jul 08 17:26:37.277927 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:37.277889 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d86b88db9-fxf62" event={"ID":"8a8452a4-3b7e-43c8-a84e-0a5ac684609c","Type":"ContainerStarted","Data":"81db27eb35a9271901a82efae8380b39e1beaebbfa4394794dcbb2acff15c181"} Jul 08 17:26:38.050334 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.050285 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs"] Jul 08 17:26:38.058407 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.058379 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" Jul 08 17:26:38.060836 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.060810 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 08 17:26:38.060995 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.060839 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 08 17:26:38.060995 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.060933 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 08 17:26:38.061310 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.061291 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 08 17:26:38.061385 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.061341 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-8sdtb\"" Jul 08 17:26:38.069325 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.069297 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs"] Jul 08 17:26:38.171342 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.171302 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-local-certs\") pod \"istiod-openshift-gateway-7574459656-kf8vs\" (UID: \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" Jul 08 17:26:38.171342 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.171347 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-kf8vs\" (UID: \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" Jul 08 17:26:38.171685 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.171373 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-kf8vs\" (UID: \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" Jul 08 17:26:38.171685 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.171423 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r5f7\" (UniqueName: \"kubernetes.io/projected/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-kube-api-access-6r5f7\") pod \"istiod-openshift-gateway-7574459656-kf8vs\" (UID: \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" Jul 08 17:26:38.171685 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.171538 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-cacerts\") pod \"istiod-openshift-gateway-7574459656-kf8vs\" (UID: \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" Jul 08 17:26:38.171685 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.171581 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-istio-token\") pod \"istiod-openshift-gateway-7574459656-kf8vs\" (UID: \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" Jul 08 17:26:38.171937 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.171685 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-kf8vs\" (UID: \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" Jul 08 17:26:38.272983 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.272941 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-cacerts\") pod \"istiod-openshift-gateway-7574459656-kf8vs\" (UID: \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" Jul 08 17:26:38.273168 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.273011 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-istio-token\") pod \"istiod-openshift-gateway-7574459656-kf8vs\" (UID: \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" Jul 08 17:26:38.273168 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.273055 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-kf8vs\" (UID: \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" Jul 08 17:26:38.273168 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.273111 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-local-certs\") pod \"istiod-openshift-gateway-7574459656-kf8vs\" (UID: \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" Jul 08 17:26:38.273168 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.273132 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-kf8vs\" (UID: \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" Jul 08 17:26:38.273168 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.273155 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-kf8vs\" (UID: \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" Jul 08 17:26:38.273413 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.273180 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r5f7\" (UniqueName: \"kubernetes.io/projected/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-kube-api-access-6r5f7\") pod \"istiod-openshift-gateway-7574459656-kf8vs\" (UID: \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" Jul 08 17:26:38.273857 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.273832 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-kf8vs\" (UID: \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" Jul 08 17:26:38.275430 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.275397 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-cacerts\") pod \"istiod-openshift-gateway-7574459656-kf8vs\" (UID: \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" Jul 08 17:26:38.275528 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.275435 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-kf8vs\" (UID: \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" Jul 08 17:26:38.275666 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.275651 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-local-certs\") pod \"istiod-openshift-gateway-7574459656-kf8vs\" (UID: \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" Jul 08 17:26:38.275816 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.275799 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-kf8vs\" (UID: \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" Jul 08 17:26:38.298624 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.298586 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r5f7\" (UniqueName: \"kubernetes.io/projected/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-kube-api-access-6r5f7\") pod \"istiod-openshift-gateway-7574459656-kf8vs\" (UID: \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" Jul 08 17:26:38.300899 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.300837 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-istio-token\") pod \"istiod-openshift-gateway-7574459656-kf8vs\" (UID: \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" Jul 08 17:26:38.370709 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.370673 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" Jul 08 17:26:38.555297 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:38.555247 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs"] Jul 08 17:26:38.557588 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:26:38.557553 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda66a4e58_b4b2_496d_98f2_a932cf0bfbfa.slice/crio-9adf817819b47018c4568bf7f05feda7662ef19684c14eacd3d7adced45bbc0a WatchSource:0}: Error finding container 9adf817819b47018c4568bf7f05feda7662ef19684c14eacd3d7adced45bbc0a: Status 404 returned error can't find the container with id 9adf817819b47018c4568bf7f05feda7662ef19684c14eacd3d7adced45bbc0a Jul 08 17:26:39.292692 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:39.292660 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" event={"ID":"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa","Type":"ContainerStarted","Data":"9adf817819b47018c4568bf7f05feda7662ef19684c14eacd3d7adced45bbc0a"} Jul 08 17:26:41.262600 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:41.262563 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:26:41.262868 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:41.262630 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:26:41.641795 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:41.641756 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-65ngj"] Jul 08 17:26:41.645619 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:41.645598 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-65ngj" Jul 08 17:26:41.649211 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:41.649184 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 08 17:26:41.649392 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:41.649374 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-rmzng\"" Jul 08 17:26:41.659044 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:41.659018 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-65ngj"] Jul 08 17:26:41.675561 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:41.675527 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-j5tc6"] Jul 08 17:26:41.679398 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:41.679376 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j5tc6" Jul 08 17:26:41.681963 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:41.681939 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 08 17:26:41.682067 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:41.682032 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-nnmqj\"" Jul 08 17:26:41.692471 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:41.692438 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-j5tc6"] Jul 08 17:26:41.809309 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:41.809270 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp5nj\" (UniqueName: \"kubernetes.io/projected/637a4b7f-6bf6-4f76-886a-390e04ec9273-kube-api-access-kp5nj\") pod \"kserve-controller-manager-d6f4b65b8-65ngj\" (UID: \"637a4b7f-6bf6-4f76-886a-390e04ec9273\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-65ngj" Jul 08 17:26:41.809489 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:41.809360 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/637a4b7f-6bf6-4f76-886a-390e04ec9273-cert\") pod \"kserve-controller-manager-d6f4b65b8-65ngj\" (UID: \"637a4b7f-6bf6-4f76-886a-390e04ec9273\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-65ngj" Jul 08 17:26:41.809489 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:41.809411 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/602f6e2c-9ad1-458a-8577-1b108e330627-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-j5tc6\" (UID: \"602f6e2c-9ad1-458a-8577-1b108e330627\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j5tc6" Jul 08 17:26:41.809489 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:41.809439 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t75rp\" (UniqueName: \"kubernetes.io/projected/602f6e2c-9ad1-458a-8577-1b108e330627-kube-api-access-t75rp\") pod \"llmisvc-controller-manager-777c6bd7d5-j5tc6\" (UID: \"602f6e2c-9ad1-458a-8577-1b108e330627\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j5tc6" Jul 08 17:26:41.910270 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:41.910179 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/602f6e2c-9ad1-458a-8577-1b108e330627-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-j5tc6\" (UID: \"602f6e2c-9ad1-458a-8577-1b108e330627\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j5tc6" Jul 08 17:26:41.910270 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:41.910220 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t75rp\" (UniqueName: \"kubernetes.io/projected/602f6e2c-9ad1-458a-8577-1b108e330627-kube-api-access-t75rp\") pod \"llmisvc-controller-manager-777c6bd7d5-j5tc6\" (UID: \"602f6e2c-9ad1-458a-8577-1b108e330627\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j5tc6" Jul 08 17:26:41.910531 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:41.910279 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp5nj\" (UniqueName: \"kubernetes.io/projected/637a4b7f-6bf6-4f76-886a-390e04ec9273-kube-api-access-kp5nj\") pod \"kserve-controller-manager-d6f4b65b8-65ngj\" (UID: \"637a4b7f-6bf6-4f76-886a-390e04ec9273\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-65ngj" Jul 08 17:26:41.910531 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:41.910311 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/637a4b7f-6bf6-4f76-886a-390e04ec9273-cert\") pod \"kserve-controller-manager-d6f4b65b8-65ngj\" (UID: \"637a4b7f-6bf6-4f76-886a-390e04ec9273\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-65ngj" Jul 08 17:26:41.910531 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:26:41.910350 2556 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 08 17:26:41.910531 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:26:41.910430 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/602f6e2c-9ad1-458a-8577-1b108e330627-cert podName:602f6e2c-9ad1-458a-8577-1b108e330627 nodeName:}" failed. No retries permitted until 2026-07-08 17:26:42.410409309 +0000 UTC m=+614.821224670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/602f6e2c-9ad1-458a-8577-1b108e330627-cert") pod "llmisvc-controller-manager-777c6bd7d5-j5tc6" (UID: "602f6e2c-9ad1-458a-8577-1b108e330627") : secret "llmisvc-webhook-server-cert" not found Jul 08 17:26:41.912642 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:41.912622 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/637a4b7f-6bf6-4f76-886a-390e04ec9273-cert\") pod \"kserve-controller-manager-d6f4b65b8-65ngj\" (UID: \"637a4b7f-6bf6-4f76-886a-390e04ec9273\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-65ngj" Jul 08 17:26:41.948326 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:41.948289 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t75rp\" (UniqueName: \"kubernetes.io/projected/602f6e2c-9ad1-458a-8577-1b108e330627-kube-api-access-t75rp\") pod \"llmisvc-controller-manager-777c6bd7d5-j5tc6\" (UID: \"602f6e2c-9ad1-458a-8577-1b108e330627\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j5tc6" Jul 08 17:26:41.948475 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:41.948425 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp5nj\" (UniqueName: \"kubernetes.io/projected/637a4b7f-6bf6-4f76-886a-390e04ec9273-kube-api-access-kp5nj\") pod \"kserve-controller-manager-d6f4b65b8-65ngj\" (UID: \"637a4b7f-6bf6-4f76-886a-390e04ec9273\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-65ngj" Jul 08 17:26:41.957086 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:41.957051 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-65ngj" Jul 08 17:26:42.112325 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:42.112295 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-65ngj"] Jul 08 17:26:42.115084 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:26:42.115058 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod637a4b7f_6bf6_4f76_886a_390e04ec9273.slice/crio-49f62d28fc5c761988b2c6fcddbe01d5c66ef4cd2a1d96dd4a9bec3465073ce6 WatchSource:0}: Error finding container 49f62d28fc5c761988b2c6fcddbe01d5c66ef4cd2a1d96dd4a9bec3465073ce6: Status 404 returned error can't find the container with id 49f62d28fc5c761988b2c6fcddbe01d5c66ef4cd2a1d96dd4a9bec3465073ce6 Jul 08 17:26:42.313378 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:42.313271 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d86b88db9-fxf62" event={"ID":"8a8452a4-3b7e-43c8-a84e-0a5ac684609c","Type":"ContainerStarted","Data":"5eb46cc6339be4bf00c35bd1e9ae335ab44ecab2dcd0115c6e22ce8553379bbd"} Jul 08 17:26:42.315554 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:42.315517 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" event={"ID":"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa","Type":"ContainerStarted","Data":"73d8422273e41d995422bae87cccb7d909080cb8ee165423b4b48f10817a831d"} Jul 08 17:26:42.315732 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:42.315715 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" Jul 08 17:26:42.316966 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:42.316937 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-65ngj" event={"ID":"637a4b7f-6bf6-4f76-886a-390e04ec9273","Type":"ContainerStarted","Data":"49f62d28fc5c761988b2c6fcddbe01d5c66ef4cd2a1d96dd4a9bec3465073ce6"} Jul 08 17:26:42.317564 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:42.317532 2556 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-kf8vs container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 08 17:26:42.317673 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:42.317601 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" podUID="a66a4e58-b4b2-496d-98f2-a932cf0bfbfa" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 17:26:42.339037 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:42.338985 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6d86b88db9-fxf62" podStartSLOduration=2.295340346 podStartE2EDuration="6.33896778s" totalImagesPullingTime="4.043627434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:26:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:26:42.337932445 +0000 UTC m=+614.748747816" watchObservedRunningTime="2026-07-08 17:26:42.33896778 +0000 UTC m=+614.749783191" Jul 08 17:26:42.414583 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:42.414550 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/602f6e2c-9ad1-458a-8577-1b108e330627-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-j5tc6\" (UID: \"602f6e2c-9ad1-458a-8577-1b108e330627\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j5tc6" Jul 08 17:26:42.417111 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:42.417083 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/602f6e2c-9ad1-458a-8577-1b108e330627-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-j5tc6\" (UID: \"602f6e2c-9ad1-458a-8577-1b108e330627\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j5tc6" Jul 08 17:26:42.448812 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:42.448760 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" podStartSLOduration=1.746484448 podStartE2EDuration="4.44874344s" totalImagesPullingTime="2.702258992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:26:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:26:42.447261718 +0000 UTC m=+614.858077097" watchObservedRunningTime="2026-07-08 17:26:42.44874344 +0000 UTC m=+614.859558816" Jul 08 17:26:42.589788 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:42.589703 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j5tc6" Jul 08 17:26:42.747772 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:42.747733 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-j5tc6"] Jul 08 17:26:42.751413 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:26:42.751370 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod602f6e2c_9ad1_458a_8577_1b108e330627.slice/crio-5c22fb9054df8e07e8a58c3c119925b54614d2de715c6d16d0f0fceb2c6a711b WatchSource:0}: Error finding container 5c22fb9054df8e07e8a58c3c119925b54614d2de715c6d16d0f0fceb2c6a711b: Status 404 returned error can't find the container with id 5c22fb9054df8e07e8a58c3c119925b54614d2de715c6d16d0f0fceb2c6a711b Jul 08 17:26:43.324996 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.324801 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j5tc6" event={"ID":"602f6e2c-9ad1-458a-8577-1b108e330627","Type":"ContainerStarted","Data":"5c22fb9054df8e07e8a58c3c119925b54614d2de715c6d16d0f0fceb2c6a711b"} Jul 08 17:26:43.325755 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.325725 2556 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-kf8vs container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 08 17:26:43.325865 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.325805 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" podUID="a66a4e58-b4b2-496d-98f2-a932cf0bfbfa" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 17:26:43.498892 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.498612 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7"] Jul 08 17:26:43.503031 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.502997 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.506534 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.506301 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-kjtm6\"" Jul 08 17:26:43.517024 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.516983 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7"] Jul 08 17:26:43.626876 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.626840 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/972d360a-0998-4e41-94d6-88ee319573e2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wxtw7\" (UID: \"972d360a-0998-4e41-94d6-88ee319573e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.626876 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.626883 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/972d360a-0998-4e41-94d6-88ee319573e2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wxtw7\" (UID: \"972d360a-0998-4e41-94d6-88ee319573e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.627232 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.626964 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79spb\" (UniqueName: \"kubernetes.io/projected/972d360a-0998-4e41-94d6-88ee319573e2-kube-api-access-79spb\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wxtw7\" (UID: \"972d360a-0998-4e41-94d6-88ee319573e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.627232 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.627080 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/972d360a-0998-4e41-94d6-88ee319573e2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wxtw7\" (UID: \"972d360a-0998-4e41-94d6-88ee319573e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.627232 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.627152 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/972d360a-0998-4e41-94d6-88ee319573e2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wxtw7\" (UID: \"972d360a-0998-4e41-94d6-88ee319573e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.627232 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.627224 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/972d360a-0998-4e41-94d6-88ee319573e2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wxtw7\" (UID: \"972d360a-0998-4e41-94d6-88ee319573e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.627548 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.627249 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/972d360a-0998-4e41-94d6-88ee319573e2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wxtw7\" (UID: \"972d360a-0998-4e41-94d6-88ee319573e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.627548 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.627278 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/972d360a-0998-4e41-94d6-88ee319573e2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wxtw7\" (UID: \"972d360a-0998-4e41-94d6-88ee319573e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.627548 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.627292 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/972d360a-0998-4e41-94d6-88ee319573e2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wxtw7\" (UID: \"972d360a-0998-4e41-94d6-88ee319573e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.728753 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.728717 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/972d360a-0998-4e41-94d6-88ee319573e2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wxtw7\" (UID: \"972d360a-0998-4e41-94d6-88ee319573e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.728943 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.728757 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/972d360a-0998-4e41-94d6-88ee319573e2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wxtw7\" (UID: \"972d360a-0998-4e41-94d6-88ee319573e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.728943 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.728797 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79spb\" (UniqueName: \"kubernetes.io/projected/972d360a-0998-4e41-94d6-88ee319573e2-kube-api-access-79spb\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wxtw7\" (UID: \"972d360a-0998-4e41-94d6-88ee319573e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.728943 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.728819 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/972d360a-0998-4e41-94d6-88ee319573e2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wxtw7\" (UID: \"972d360a-0998-4e41-94d6-88ee319573e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.728943 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.728860 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/972d360a-0998-4e41-94d6-88ee319573e2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wxtw7\" (UID: \"972d360a-0998-4e41-94d6-88ee319573e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.728943 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.728888 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/972d360a-0998-4e41-94d6-88ee319573e2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wxtw7\" (UID: \"972d360a-0998-4e41-94d6-88ee319573e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.728943 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.728931 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/972d360a-0998-4e41-94d6-88ee319573e2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wxtw7\" (UID: \"972d360a-0998-4e41-94d6-88ee319573e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.729285 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.728967 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/972d360a-0998-4e41-94d6-88ee319573e2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wxtw7\" (UID: \"972d360a-0998-4e41-94d6-88ee319573e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.729285 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.728993 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/972d360a-0998-4e41-94d6-88ee319573e2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wxtw7\" (UID: \"972d360a-0998-4e41-94d6-88ee319573e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.729285 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.729175 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/972d360a-0998-4e41-94d6-88ee319573e2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wxtw7\" (UID: \"972d360a-0998-4e41-94d6-88ee319573e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.729285 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.729210 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/972d360a-0998-4e41-94d6-88ee319573e2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wxtw7\" (UID: \"972d360a-0998-4e41-94d6-88ee319573e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.729495 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.729467 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/972d360a-0998-4e41-94d6-88ee319573e2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wxtw7\" (UID: \"972d360a-0998-4e41-94d6-88ee319573e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.729637 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.729616 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/972d360a-0998-4e41-94d6-88ee319573e2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wxtw7\" (UID: \"972d360a-0998-4e41-94d6-88ee319573e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.729726 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.729689 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/972d360a-0998-4e41-94d6-88ee319573e2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wxtw7\" (UID: \"972d360a-0998-4e41-94d6-88ee319573e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.731197 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.731176 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/972d360a-0998-4e41-94d6-88ee319573e2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wxtw7\" (UID: \"972d360a-0998-4e41-94d6-88ee319573e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.731331 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.731309 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/972d360a-0998-4e41-94d6-88ee319573e2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wxtw7\" (UID: \"972d360a-0998-4e41-94d6-88ee319573e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.739859 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.739824 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79spb\" (UniqueName: \"kubernetes.io/projected/972d360a-0998-4e41-94d6-88ee319573e2-kube-api-access-79spb\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wxtw7\" (UID: \"972d360a-0998-4e41-94d6-88ee319573e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.741120 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.741096 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/972d360a-0998-4e41-94d6-88ee319573e2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4wxtw7\" (UID: \"972d360a-0998-4e41-94d6-88ee319573e2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.818664 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.818555 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:43.901339 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:43.901306 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs"] Jul 08 17:26:44.237387 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:44.237352 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7"] Jul 08 17:26:44.298305 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:26:44.298207 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod972d360a_0998_4e41_94d6_88ee319573e2.slice/crio-84110e8f74117c5ea760575fcbd0ebb50c5fd16d3267c5c56dd798eea1550657 WatchSource:0}: Error finding container 84110e8f74117c5ea760575fcbd0ebb50c5fd16d3267c5c56dd798eea1550657: Status 404 returned error can't find the container with id 84110e8f74117c5ea760575fcbd0ebb50c5fd16d3267c5c56dd798eea1550657 Jul 08 17:26:44.334414 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:44.334326 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" event={"ID":"972d360a-0998-4e41-94d6-88ee319573e2","Type":"ContainerStarted","Data":"84110e8f74117c5ea760575fcbd0ebb50c5fd16d3267c5c56dd798eea1550657"} Jul 08 17:26:44.334888 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:44.334443 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" podUID="a66a4e58-b4b2-496d-98f2-a932cf0bfbfa" containerName="discovery" containerID="cri-o://73d8422273e41d995422bae87cccb7d909080cb8ee165423b4b48f10817a831d" gracePeriod=30 Jul 08 17:26:44.335149 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:44.335127 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" Jul 08 17:26:45.111968 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.111942 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" Jul 08 17:26:45.245363 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.245321 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-istio-token\") pod \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\" (UID: \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\") " Jul 08 17:26:45.245536 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.245404 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6r5f7\" (UniqueName: \"kubernetes.io/projected/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-kube-api-access-6r5f7\") pod \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\" (UID: \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\") " Jul 08 17:26:45.245536 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.245433 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-istio-csr-ca-configmap\") pod \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\" (UID: \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\") " Jul 08 17:26:45.245536 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.245458 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-istio-csr-dns-cert\") pod \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\" (UID: \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\") " Jul 08 17:26:45.245536 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.245497 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-local-certs\") pod \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\" (UID: \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\") " Jul 08 17:26:45.245536 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.245525 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-cacerts\") pod \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\" (UID: \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\") " Jul 08 17:26:45.245796 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.245574 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-istio-kubeconfig\") pod \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\" (UID: \"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa\") " Jul 08 17:26:45.246009 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.245844 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "a66a4e58-b4b2-496d-98f2-a932cf0bfbfa" (UID: "a66a4e58-b4b2-496d-98f2-a932cf0bfbfa"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:26:45.246146 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.246122 2556 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-istio-csr-ca-configmap\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:26:45.248285 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.248207 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-kube-api-access-6r5f7" (OuterVolumeSpecName: "kube-api-access-6r5f7") pod "a66a4e58-b4b2-496d-98f2-a932cf0bfbfa" (UID: "a66a4e58-b4b2-496d-98f2-a932cf0bfbfa"). InnerVolumeSpecName "kube-api-access-6r5f7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:26:45.248514 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.248489 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-istio-token" (OuterVolumeSpecName: "istio-token") pod "a66a4e58-b4b2-496d-98f2-a932cf0bfbfa" (UID: "a66a4e58-b4b2-496d-98f2-a932cf0bfbfa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:26:45.248514 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.248501 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-local-certs" (OuterVolumeSpecName: "local-certs") pod "a66a4e58-b4b2-496d-98f2-a932cf0bfbfa" (UID: "a66a4e58-b4b2-496d-98f2-a932cf0bfbfa"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:26:45.248679 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.248514 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "a66a4e58-b4b2-496d-98f2-a932cf0bfbfa" (UID: "a66a4e58-b4b2-496d-98f2-a932cf0bfbfa"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 17:26:45.248679 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.248538 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-cacerts" (OuterVolumeSpecName: "cacerts") pod "a66a4e58-b4b2-496d-98f2-a932cf0bfbfa" (UID: "a66a4e58-b4b2-496d-98f2-a932cf0bfbfa"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 17:26:45.248990 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.248967 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "a66a4e58-b4b2-496d-98f2-a932cf0bfbfa" (UID: "a66a4e58-b4b2-496d-98f2-a932cf0bfbfa"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 17:26:45.340639 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.340612 2556 generic.go:356] "Generic (PLEG): container finished" podID="a66a4e58-b4b2-496d-98f2-a932cf0bfbfa" containerID="73d8422273e41d995422bae87cccb7d909080cb8ee165423b4b48f10817a831d" exitCode=0 Jul 08 17:26:45.341114 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.340654 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" Jul 08 17:26:45.341114 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.340697 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" event={"ID":"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa","Type":"ContainerDied","Data":"73d8422273e41d995422bae87cccb7d909080cb8ee165423b4b48f10817a831d"} Jul 08 17:26:45.341114 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.340771 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs" event={"ID":"a66a4e58-b4b2-496d-98f2-a932cf0bfbfa","Type":"ContainerDied","Data":"9adf817819b47018c4568bf7f05feda7662ef19684c14eacd3d7adced45bbc0a"} Jul 08 17:26:45.341114 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.340811 2556 scope.go:117] "RemoveContainer" containerID="73d8422273e41d995422bae87cccb7d909080cb8ee165423b4b48f10817a831d" Jul 08 17:26:45.342975 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.342948 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-65ngj" event={"ID":"637a4b7f-6bf6-4f76-886a-390e04ec9273","Type":"ContainerStarted","Data":"59bad1346e1e390b7befa0679287c0448fd89f1b95e73f3b1f35bed0a212d7eb"} Jul 08 17:26:45.343090 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.343020 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-65ngj" Jul 08 17:26:45.346822 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.346801 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6r5f7\" (UniqueName: \"kubernetes.io/projected/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-kube-api-access-6r5f7\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:26:45.346938 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.346830 2556 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-istio-csr-dns-cert\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:26:45.346938 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.346845 2556 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-local-certs\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:26:45.346938 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.346858 2556 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-cacerts\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:26:45.346938 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.346869 2556 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-istio-kubeconfig\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:26:45.346938 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.346880 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa-istio-token\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:26:45.364860 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.364819 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-65ngj" podStartSLOduration=1.464516364 podStartE2EDuration="4.364803979s" totalImagesPullingTime="2.900287615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:26:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:26:45.363229356 +0000 UTC m=+617.774044733" watchObservedRunningTime="2026-07-08 17:26:45.364803979 +0000 UTC m=+617.775619357" Jul 08 17:26:45.381129 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.381103 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs"] Jul 08 17:26:45.386797 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.386766 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-kf8vs"] Jul 08 17:26:45.818920 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.818883 2556 scope.go:117] "RemoveContainer" containerID="73d8422273e41d995422bae87cccb7d909080cb8ee165423b4b48f10817a831d" Jul 08 17:26:45.819241 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:26:45.819219 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73d8422273e41d995422bae87cccb7d909080cb8ee165423b4b48f10817a831d\": container with ID starting with 73d8422273e41d995422bae87cccb7d909080cb8ee165423b4b48f10817a831d not found: ID does not exist" containerID="73d8422273e41d995422bae87cccb7d909080cb8ee165423b4b48f10817a831d" Jul 08 17:26:45.819323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:45.819257 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73d8422273e41d995422bae87cccb7d909080cb8ee165423b4b48f10817a831d"} err="failed to get container status \"73d8422273e41d995422bae87cccb7d909080cb8ee165423b4b48f10817a831d\": rpc error: code = NotFound desc = could not find container \"73d8422273e41d995422bae87cccb7d909080cb8ee165423b4b48f10817a831d\": container with ID starting with 73d8422273e41d995422bae87cccb7d909080cb8ee165423b4b48f10817a831d not found: ID does not exist" Jul 08 17:26:46.111928 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:46.111889 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a66a4e58-b4b2-496d-98f2-a932cf0bfbfa" path="/var/lib/kubelet/pods/a66a4e58-b4b2-496d-98f2-a932cf0bfbfa/volumes" Jul 08 17:26:46.349878 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:46.349846 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j5tc6" event={"ID":"602f6e2c-9ad1-458a-8577-1b108e330627","Type":"ContainerStarted","Data":"ec85398bc95f7252c72cd16b948097f4aeab426e62a3e2a825bb52b8f66263f4"} Jul 08 17:26:46.350394 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:46.350077 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j5tc6" Jul 08 17:26:46.366692 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:46.366597 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j5tc6" podStartSLOduration=2.252720651 podStartE2EDuration="5.36658075s" totalImagesPullingTime="3.113860099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:26:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:26:46.365650521 +0000 UTC m=+618.776465899" watchObservedRunningTime="2026-07-08 17:26:46.36658075 +0000 UTC m=+618.777396139" Jul 08 17:26:47.280484 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:47.280337 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-mp6s7" Jul 08 17:26:47.283890 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:47.283862 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-n9b4r" Jul 08 17:26:47.819478 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:47.814189 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:26:47.819478 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:47.814362 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:26:47.819478 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:47.814448 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:26:48.363905 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:48.363866 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" event={"ID":"972d360a-0998-4e41-94d6-88ee319573e2","Type":"ContainerStarted","Data":"7bc3746cf2a8a8bfff4802a915f396184f85b5dbb0cf3439e0dee86e246afd13"} Jul 08 17:26:48.384661 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:48.384602 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" podStartSLOduration=1.871765675 podStartE2EDuration="5.38458142s" totalImagesPullingTime="3.512815745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:26:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:26:48.382784248 +0000 UTC m=+620.793599627" watchObservedRunningTime="2026-07-08 17:26:48.38458142 +0000 UTC m=+620.795396796" Jul 08 17:26:48.818971 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:48.818876 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:48.824309 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:48.824282 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:49.368763 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:49.368733 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:26:49.369672 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:26:49.369648 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4wxtw7" Jul 08 17:27:16.356518 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:16.356482 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-65ngj" Jul 08 17:27:17.358524 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:17.358491 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-j5tc6" Jul 08 17:27:32.729785 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:32.729752 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fjrs5"] Jul 08 17:27:32.730176 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:32.730104 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a66a4e58-b4b2-496d-98f2-a932cf0bfbfa" containerName="discovery" Jul 08 17:27:32.730176 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:32.730117 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a66a4e58-b4b2-496d-98f2-a932cf0bfbfa" containerName="discovery" Jul 08 17:27:32.730249 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:32.730184 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a66a4e58-b4b2-496d-98f2-a932cf0bfbfa" containerName="discovery" Jul 08 17:27:32.732870 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:32.732851 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fjrs5" Jul 08 17:27:32.735273 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:32.735250 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 17:27:32.736249 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:32.736226 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-bbvrd\"" Jul 08 17:27:32.736414 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:32.736230 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 17:27:32.742184 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:32.742158 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fjrs5"] Jul 08 17:27:32.766688 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:32.766648 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98hvz\" (UniqueName: \"kubernetes.io/projected/408cd7dd-c120-413a-a827-f60e1f5daeb4-kube-api-access-98hvz\") pod \"kuadrant-operator-catalog-fjrs5\" (UID: \"408cd7dd-c120-413a-a827-f60e1f5daeb4\") " pod="kuadrant-system/kuadrant-operator-catalog-fjrs5" Jul 08 17:27:32.867706 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:32.867671 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98hvz\" (UniqueName: \"kubernetes.io/projected/408cd7dd-c120-413a-a827-f60e1f5daeb4-kube-api-access-98hvz\") pod \"kuadrant-operator-catalog-fjrs5\" (UID: \"408cd7dd-c120-413a-a827-f60e1f5daeb4\") " pod="kuadrant-system/kuadrant-operator-catalog-fjrs5" Jul 08 17:27:32.875778 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:32.875756 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98hvz\" (UniqueName: \"kubernetes.io/projected/408cd7dd-c120-413a-a827-f60e1f5daeb4-kube-api-access-98hvz\") pod \"kuadrant-operator-catalog-fjrs5\" (UID: \"408cd7dd-c120-413a-a827-f60e1f5daeb4\") " pod="kuadrant-system/kuadrant-operator-catalog-fjrs5" Jul 08 17:27:33.043833 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:33.043735 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fjrs5" Jul 08 17:27:33.083050 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:33.083017 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fjrs5"] Jul 08 17:27:33.177642 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:33.177611 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fjrs5"] Jul 08 17:27:33.179649 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:27:33.179621 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod408cd7dd_c120_413a_a827_f60e1f5daeb4.slice/crio-c21579f86964349d3aefd07d41a0efbfd63a708f495aa0e4ac0e90ec4c90a078 WatchSource:0}: Error finding container c21579f86964349d3aefd07d41a0efbfd63a708f495aa0e4ac0e90ec4c90a078: Status 404 returned error can't find the container with id c21579f86964349d3aefd07d41a0efbfd63a708f495aa0e4ac0e90ec4c90a078 Jul 08 17:27:33.293463 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:33.293430 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gc4st"] Jul 08 17:27:33.296263 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:33.296217 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gc4st" Jul 08 17:27:33.304712 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:33.304684 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gc4st"] Jul 08 17:27:33.372150 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:33.372109 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2849\" (UniqueName: \"kubernetes.io/projected/3271ae3b-b037-419f-84c0-afc1296d56e0-kube-api-access-x2849\") pod \"kuadrant-operator-catalog-gc4st\" (UID: \"3271ae3b-b037-419f-84c0-afc1296d56e0\") " pod="kuadrant-system/kuadrant-operator-catalog-gc4st" Jul 08 17:27:33.472906 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:33.472870 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2849\" (UniqueName: \"kubernetes.io/projected/3271ae3b-b037-419f-84c0-afc1296d56e0-kube-api-access-x2849\") pod \"kuadrant-operator-catalog-gc4st\" (UID: \"3271ae3b-b037-419f-84c0-afc1296d56e0\") " pod="kuadrant-system/kuadrant-operator-catalog-gc4st" Jul 08 17:27:33.480674 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:33.480644 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2849\" (UniqueName: \"kubernetes.io/projected/3271ae3b-b037-419f-84c0-afc1296d56e0-kube-api-access-x2849\") pod \"kuadrant-operator-catalog-gc4st\" (UID: \"3271ae3b-b037-419f-84c0-afc1296d56e0\") " pod="kuadrant-system/kuadrant-operator-catalog-gc4st" Jul 08 17:27:33.564009 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:33.563904 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fjrs5" event={"ID":"408cd7dd-c120-413a-a827-f60e1f5daeb4","Type":"ContainerStarted","Data":"c21579f86964349d3aefd07d41a0efbfd63a708f495aa0e4ac0e90ec4c90a078"} Jul 08 17:27:33.606156 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:33.606118 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-gc4st" Jul 08 17:27:33.873305 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:33.873276 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-gc4st"] Jul 08 17:27:33.883965 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:27:33.883925 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3271ae3b_b037_419f_84c0_afc1296d56e0.slice/crio-6752906b8992e7e67116be2e32308f28000f602a63d1fbcc4abe0028bae5775b WatchSource:0}: Error finding container 6752906b8992e7e67116be2e32308f28000f602a63d1fbcc4abe0028bae5775b: Status 404 returned error can't find the container with id 6752906b8992e7e67116be2e32308f28000f602a63d1fbcc4abe0028bae5775b Jul 08 17:27:34.570515 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:34.570472 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gc4st" event={"ID":"3271ae3b-b037-419f-84c0-afc1296d56e0","Type":"ContainerStarted","Data":"6752906b8992e7e67116be2e32308f28000f602a63d1fbcc4abe0028bae5775b"} Jul 08 17:27:35.576044 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:35.576006 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-gc4st" event={"ID":"3271ae3b-b037-419f-84c0-afc1296d56e0","Type":"ContainerStarted","Data":"bde5f60b13b250faa6c021784856319f8fc554b10b2ae6c6efac282c01cb52de"} Jul 08 17:27:35.577476 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:35.577451 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fjrs5" event={"ID":"408cd7dd-c120-413a-a827-f60e1f5daeb4","Type":"ContainerStarted","Data":"ae9213778206242b3fcc17aa7f85c6852f8eb9c2a19bf943baed29d0e38e368a"} Jul 08 17:27:35.577594 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:35.577494 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-fjrs5" podUID="408cd7dd-c120-413a-a827-f60e1f5daeb4" containerName="registry-server" containerID="cri-o://ae9213778206242b3fcc17aa7f85c6852f8eb9c2a19bf943baed29d0e38e368a" gracePeriod=2 Jul 08 17:27:35.592622 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:35.592562 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-gc4st" podStartSLOduration=1.5992007209999999 podStartE2EDuration="2.592537122s" totalImagesPullingTime="993.336401ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:27:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:27:35.590341583 +0000 UTC m=+668.001156963" watchObservedRunningTime="2026-07-08 17:27:35.592537122 +0000 UTC m=+668.003352500" Jul 08 17:27:35.605466 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:35.605415 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-fjrs5" podStartSLOduration=1.908101259 podStartE2EDuration="3.605395514s" totalImagesPullingTime="1.697294255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:27:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:27:35.604676042 +0000 UTC m=+668.015491419" watchObservedRunningTime="2026-07-08 17:27:35.605395514 +0000 UTC m=+668.016210893" Jul 08 17:27:35.837085 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:35.837016 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fjrs5" Jul 08 17:27:35.895391 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:35.895360 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98hvz\" (UniqueName: \"kubernetes.io/projected/408cd7dd-c120-413a-a827-f60e1f5daeb4-kube-api-access-98hvz\") pod \"408cd7dd-c120-413a-a827-f60e1f5daeb4\" (UID: \"408cd7dd-c120-413a-a827-f60e1f5daeb4\") " Jul 08 17:27:35.897606 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:35.897573 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/408cd7dd-c120-413a-a827-f60e1f5daeb4-kube-api-access-98hvz" (OuterVolumeSpecName: "kube-api-access-98hvz") pod "408cd7dd-c120-413a-a827-f60e1f5daeb4" (UID: "408cd7dd-c120-413a-a827-f60e1f5daeb4"). InnerVolumeSpecName "kube-api-access-98hvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:27:35.996460 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:35.996413 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98hvz\" (UniqueName: \"kubernetes.io/projected/408cd7dd-c120-413a-a827-f60e1f5daeb4-kube-api-access-98hvz\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:27:36.583623 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:36.583532 2556 generic.go:356] "Generic (PLEG): container finished" podID="408cd7dd-c120-413a-a827-f60e1f5daeb4" containerID="ae9213778206242b3fcc17aa7f85c6852f8eb9c2a19bf943baed29d0e38e368a" exitCode=0 Jul 08 17:27:36.583623 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:36.583577 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fjrs5" Jul 08 17:27:36.583623 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:36.583611 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fjrs5" event={"ID":"408cd7dd-c120-413a-a827-f60e1f5daeb4","Type":"ContainerDied","Data":"ae9213778206242b3fcc17aa7f85c6852f8eb9c2a19bf943baed29d0e38e368a"} Jul 08 17:27:36.584215 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:36.583668 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fjrs5" event={"ID":"408cd7dd-c120-413a-a827-f60e1f5daeb4","Type":"ContainerDied","Data":"c21579f86964349d3aefd07d41a0efbfd63a708f495aa0e4ac0e90ec4c90a078"} Jul 08 17:27:36.584215 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:36.583689 2556 scope.go:117] "RemoveContainer" containerID="ae9213778206242b3fcc17aa7f85c6852f8eb9c2a19bf943baed29d0e38e368a" Jul 08 17:27:36.592672 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:36.592656 2556 scope.go:117] "RemoveContainer" containerID="ae9213778206242b3fcc17aa7f85c6852f8eb9c2a19bf943baed29d0e38e368a" Jul 08 17:27:36.593003 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:27:36.592979 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae9213778206242b3fcc17aa7f85c6852f8eb9c2a19bf943baed29d0e38e368a\": container with ID starting with ae9213778206242b3fcc17aa7f85c6852f8eb9c2a19bf943baed29d0e38e368a not found: ID does not exist" containerID="ae9213778206242b3fcc17aa7f85c6852f8eb9c2a19bf943baed29d0e38e368a" Jul 08 17:27:36.593113 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:36.593010 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae9213778206242b3fcc17aa7f85c6852f8eb9c2a19bf943baed29d0e38e368a"} err="failed to get container status \"ae9213778206242b3fcc17aa7f85c6852f8eb9c2a19bf943baed29d0e38e368a\": rpc error: code = NotFound desc = could not find container \"ae9213778206242b3fcc17aa7f85c6852f8eb9c2a19bf943baed29d0e38e368a\": container with ID starting with ae9213778206242b3fcc17aa7f85c6852f8eb9c2a19bf943baed29d0e38e368a not found: ID does not exist" Jul 08 17:27:36.614726 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:36.614689 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fjrs5"] Jul 08 17:27:36.625570 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:36.625543 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fjrs5"] Jul 08 17:27:38.111704 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:38.111670 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="408cd7dd-c120-413a-a827-f60e1f5daeb4" path="/var/lib/kubelet/pods/408cd7dd-c120-413a-a827-f60e1f5daeb4/volumes" Jul 08 17:27:43.606991 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:43.606957 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-gc4st" Jul 08 17:27:43.607383 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:43.607017 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-gc4st" Jul 08 17:27:43.630254 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:43.630227 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-gc4st" Jul 08 17:27:43.652341 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:43.652313 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-gc4st" Jul 08 17:27:56.722420 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:56.722388 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f9f86db7d-lr7kp"] Jul 08 17:27:56.722931 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:56.722733 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="408cd7dd-c120-413a-a827-f60e1f5daeb4" containerName="registry-server" Jul 08 17:27:56.722931 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:56.722748 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="408cd7dd-c120-413a-a827-f60e1f5daeb4" containerName="registry-server" Jul 08 17:27:56.722931 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:56.722844 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="408cd7dd-c120-413a-a827-f60e1f5daeb4" containerName="registry-server" Jul 08 17:27:56.725144 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:56.725122 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f9f86db7d-lr7kp" Jul 08 17:27:56.736774 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:56.736748 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f9f86db7d-lr7kp"] Jul 08 17:27:56.883899 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:56.883862 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee22f102-be09-4cae-b210-ebb050c41121-console-serving-cert\") pod \"console-7f9f86db7d-lr7kp\" (UID: \"ee22f102-be09-4cae-b210-ebb050c41121\") " pod="openshift-console/console-7f9f86db7d-lr7kp" Jul 08 17:27:56.884078 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:56.883952 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee22f102-be09-4cae-b210-ebb050c41121-console-config\") pod \"console-7f9f86db7d-lr7kp\" (UID: \"ee22f102-be09-4cae-b210-ebb050c41121\") " pod="openshift-console/console-7f9f86db7d-lr7kp" Jul 08 17:27:56.884078 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:56.883974 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee22f102-be09-4cae-b210-ebb050c41121-trusted-ca-bundle\") pod \"console-7f9f86db7d-lr7kp\" (UID: \"ee22f102-be09-4cae-b210-ebb050c41121\") " pod="openshift-console/console-7f9f86db7d-lr7kp" Jul 08 17:27:56.884078 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:56.883994 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g55w5\" (UniqueName: \"kubernetes.io/projected/ee22f102-be09-4cae-b210-ebb050c41121-kube-api-access-g55w5\") pod \"console-7f9f86db7d-lr7kp\" (UID: \"ee22f102-be09-4cae-b210-ebb050c41121\") " pod="openshift-console/console-7f9f86db7d-lr7kp" Jul 08 17:27:56.884183 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:56.884107 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee22f102-be09-4cae-b210-ebb050c41121-service-ca\") pod \"console-7f9f86db7d-lr7kp\" (UID: \"ee22f102-be09-4cae-b210-ebb050c41121\") " pod="openshift-console/console-7f9f86db7d-lr7kp" Jul 08 17:27:56.884183 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:56.884147 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee22f102-be09-4cae-b210-ebb050c41121-console-oauth-config\") pod \"console-7f9f86db7d-lr7kp\" (UID: \"ee22f102-be09-4cae-b210-ebb050c41121\") " pod="openshift-console/console-7f9f86db7d-lr7kp" Jul 08 17:27:56.884183 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:56.884174 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee22f102-be09-4cae-b210-ebb050c41121-oauth-serving-cert\") pod \"console-7f9f86db7d-lr7kp\" (UID: \"ee22f102-be09-4cae-b210-ebb050c41121\") " pod="openshift-console/console-7f9f86db7d-lr7kp" Jul 08 17:27:56.985163 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:56.985073 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee22f102-be09-4cae-b210-ebb050c41121-console-serving-cert\") pod \"console-7f9f86db7d-lr7kp\" (UID: \"ee22f102-be09-4cae-b210-ebb050c41121\") " pod="openshift-console/console-7f9f86db7d-lr7kp" Jul 08 17:27:56.985163 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:56.985137 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee22f102-be09-4cae-b210-ebb050c41121-console-config\") pod \"console-7f9f86db7d-lr7kp\" (UID: \"ee22f102-be09-4cae-b210-ebb050c41121\") " pod="openshift-console/console-7f9f86db7d-lr7kp" Jul 08 17:27:56.985163 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:56.985154 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee22f102-be09-4cae-b210-ebb050c41121-trusted-ca-bundle\") pod \"console-7f9f86db7d-lr7kp\" (UID: \"ee22f102-be09-4cae-b210-ebb050c41121\") " pod="openshift-console/console-7f9f86db7d-lr7kp" Jul 08 17:27:56.985467 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:56.985177 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g55w5\" (UniqueName: \"kubernetes.io/projected/ee22f102-be09-4cae-b210-ebb050c41121-kube-api-access-g55w5\") pod \"console-7f9f86db7d-lr7kp\" (UID: \"ee22f102-be09-4cae-b210-ebb050c41121\") " pod="openshift-console/console-7f9f86db7d-lr7kp" Jul 08 17:27:56.985467 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:56.985210 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee22f102-be09-4cae-b210-ebb050c41121-service-ca\") pod \"console-7f9f86db7d-lr7kp\" (UID: \"ee22f102-be09-4cae-b210-ebb050c41121\") " pod="openshift-console/console-7f9f86db7d-lr7kp" Jul 08 17:27:56.985467 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:56.985359 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee22f102-be09-4cae-b210-ebb050c41121-console-oauth-config\") pod \"console-7f9f86db7d-lr7kp\" (UID: \"ee22f102-be09-4cae-b210-ebb050c41121\") " pod="openshift-console/console-7f9f86db7d-lr7kp" Jul 08 17:27:56.985467 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:56.985424 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee22f102-be09-4cae-b210-ebb050c41121-oauth-serving-cert\") pod \"console-7f9f86db7d-lr7kp\" (UID: \"ee22f102-be09-4cae-b210-ebb050c41121\") " pod="openshift-console/console-7f9f86db7d-lr7kp" Jul 08 17:27:56.986139 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:56.986105 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee22f102-be09-4cae-b210-ebb050c41121-service-ca\") pod \"console-7f9f86db7d-lr7kp\" (UID: \"ee22f102-be09-4cae-b210-ebb050c41121\") " pod="openshift-console/console-7f9f86db7d-lr7kp" Jul 08 17:27:56.986139 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:56.986123 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee22f102-be09-4cae-b210-ebb050c41121-console-config\") pod \"console-7f9f86db7d-lr7kp\" (UID: \"ee22f102-be09-4cae-b210-ebb050c41121\") " pod="openshift-console/console-7f9f86db7d-lr7kp" Jul 08 17:27:56.986317 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:56.986149 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee22f102-be09-4cae-b210-ebb050c41121-oauth-serving-cert\") pod \"console-7f9f86db7d-lr7kp\" (UID: \"ee22f102-be09-4cae-b210-ebb050c41121\") " pod="openshift-console/console-7f9f86db7d-lr7kp" Jul 08 17:27:56.986488 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:56.986466 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee22f102-be09-4cae-b210-ebb050c41121-trusted-ca-bundle\") pod \"console-7f9f86db7d-lr7kp\" (UID: \"ee22f102-be09-4cae-b210-ebb050c41121\") " pod="openshift-console/console-7f9f86db7d-lr7kp" Jul 08 17:27:56.987754 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:56.987725 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee22f102-be09-4cae-b210-ebb050c41121-console-serving-cert\") pod \"console-7f9f86db7d-lr7kp\" (UID: \"ee22f102-be09-4cae-b210-ebb050c41121\") " pod="openshift-console/console-7f9f86db7d-lr7kp" Jul 08 17:27:56.987862 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:56.987814 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee22f102-be09-4cae-b210-ebb050c41121-console-oauth-config\") pod \"console-7f9f86db7d-lr7kp\" (UID: \"ee22f102-be09-4cae-b210-ebb050c41121\") " pod="openshift-console/console-7f9f86db7d-lr7kp" Jul 08 17:27:56.997675 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:56.997652 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g55w5\" (UniqueName: \"kubernetes.io/projected/ee22f102-be09-4cae-b210-ebb050c41121-kube-api-access-g55w5\") pod \"console-7f9f86db7d-lr7kp\" (UID: \"ee22f102-be09-4cae-b210-ebb050c41121\") " pod="openshift-console/console-7f9f86db7d-lr7kp" Jul 08 17:27:57.034767 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:57.034730 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f9f86db7d-lr7kp" Jul 08 17:27:57.173461 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:57.173430 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f9f86db7d-lr7kp"] Jul 08 17:27:57.176217 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:27:57.176193 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee22f102_be09_4cae_b210_ebb050c41121.slice/crio-6ac35f334d27b6d540782314ceffe8d83d65e310dc2572d9e5e6eafd64f62d8a WatchSource:0}: Error finding container 6ac35f334d27b6d540782314ceffe8d83d65e310dc2572d9e5e6eafd64f62d8a: Status 404 returned error can't find the container with id 6ac35f334d27b6d540782314ceffe8d83d65e310dc2572d9e5e6eafd64f62d8a Jul 08 17:27:57.681067 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:57.681030 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f9f86db7d-lr7kp" event={"ID":"ee22f102-be09-4cae-b210-ebb050c41121","Type":"ContainerStarted","Data":"339776b7662357aaf6c3ba4d6616153820c771c28fb96939571194d07e08917b"} Jul 08 17:27:57.681239 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:57.681084 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f9f86db7d-lr7kp" event={"ID":"ee22f102-be09-4cae-b210-ebb050c41121","Type":"ContainerStarted","Data":"6ac35f334d27b6d540782314ceffe8d83d65e310dc2572d9e5e6eafd64f62d8a"} Jul 08 17:27:57.699933 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:57.699858 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f9f86db7d-lr7kp" podStartSLOduration=1.699840448 podStartE2EDuration="1.699840448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:27:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:27:57.697894187 +0000 UTC m=+690.108709569" watchObservedRunningTime="2026-07-08 17:27:57.699840448 +0000 UTC m=+690.110655877" Jul 08 17:27:59.269450 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:59.269406 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-p5s4q"] Jul 08 17:27:59.272032 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:59.272004 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-p5s4q" Jul 08 17:27:59.274406 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:59.274383 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-rvls5\"" Jul 08 17:27:59.285722 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:59.285695 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-p5s4q"] Jul 08 17:27:59.408020 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:59.407978 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjbvg\" (UniqueName: \"kubernetes.io/projected/237f9f01-bd06-4ca7-a34e-854ec0e05247-kube-api-access-xjbvg\") pod \"authorino-operator-75cc8d5cb7-p5s4q\" (UID: \"237f9f01-bd06-4ca7-a34e-854ec0e05247\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-p5s4q" Jul 08 17:27:59.508905 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:59.508872 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjbvg\" (UniqueName: \"kubernetes.io/projected/237f9f01-bd06-4ca7-a34e-854ec0e05247-kube-api-access-xjbvg\") pod \"authorino-operator-75cc8d5cb7-p5s4q\" (UID: \"237f9f01-bd06-4ca7-a34e-854ec0e05247\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-p5s4q" Jul 08 17:27:59.537080 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:59.536999 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjbvg\" (UniqueName: \"kubernetes.io/projected/237f9f01-bd06-4ca7-a34e-854ec0e05247-kube-api-access-xjbvg\") pod \"authorino-operator-75cc8d5cb7-p5s4q\" (UID: \"237f9f01-bd06-4ca7-a34e-854ec0e05247\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-p5s4q" Jul 08 17:27:59.582355 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:59.582317 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-p5s4q" Jul 08 17:27:59.714680 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:59.714616 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-p5s4q"] Jul 08 17:27:59.717005 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:27:59.716974 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod237f9f01_bd06_4ca7_a34e_854ec0e05247.slice/crio-1271723ffe2f43c2a955d7b7a1ea2789c8b585dee23b859c8056b8f6267cd7a1 WatchSource:0}: Error finding container 1271723ffe2f43c2a955d7b7a1ea2789c8b585dee23b859c8056b8f6267cd7a1: Status 404 returned error can't find the container with id 1271723ffe2f43c2a955d7b7a1ea2789c8b585dee23b859c8056b8f6267cd7a1 Jul 08 17:27:59.719269 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:27:59.719255 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 17:28:00.697366 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:00.697327 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-p5s4q" event={"ID":"237f9f01-bd06-4ca7-a34e-854ec0e05247","Type":"ContainerStarted","Data":"1271723ffe2f43c2a955d7b7a1ea2789c8b585dee23b859c8056b8f6267cd7a1"} Jul 08 17:28:02.709537 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:02.709500 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-p5s4q" event={"ID":"237f9f01-bd06-4ca7-a34e-854ec0e05247","Type":"ContainerStarted","Data":"d26203b48c211cf620b6403c5070ef1ecee9dde17cc854417d5065816639e1ad"} Jul 08 17:28:02.709958 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:02.709641 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-p5s4q" Jul 08 17:28:02.725032 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:02.724974 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-p5s4q" podStartSLOduration=1.27526669 podStartE2EDuration="3.724958278s" totalImagesPullingTime="2.449691588s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:27:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:28:02.724206742 +0000 UTC m=+695.135022119" watchObservedRunningTime="2026-07-08 17:28:02.724958278 +0000 UTC m=+695.135773652" Jul 08 17:28:03.136021 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:03.135979 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wx5r2"] Jul 08 17:28:03.138488 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:03.138468 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wx5r2" Jul 08 17:28:03.140838 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:03.140815 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 08 17:28:03.140972 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:03.140820 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-s47zw\"" Jul 08 17:28:03.152794 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:03.152764 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wx5r2"] Jul 08 17:28:03.247094 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:03.247052 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n86bl\" (UniqueName: \"kubernetes.io/projected/7ae0d829-7d14-4295-84b1-fcc50aaca570-kube-api-access-n86bl\") pod \"dns-operator-controller-manager-864dd78c4c-wx5r2\" (UID: \"7ae0d829-7d14-4295-84b1-fcc50aaca570\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wx5r2" Jul 08 17:28:03.348422 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:03.348375 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n86bl\" (UniqueName: \"kubernetes.io/projected/7ae0d829-7d14-4295-84b1-fcc50aaca570-kube-api-access-n86bl\") pod \"dns-operator-controller-manager-864dd78c4c-wx5r2\" (UID: \"7ae0d829-7d14-4295-84b1-fcc50aaca570\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wx5r2" Jul 08 17:28:03.358738 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:03.358700 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n86bl\" (UniqueName: \"kubernetes.io/projected/7ae0d829-7d14-4295-84b1-fcc50aaca570-kube-api-access-n86bl\") pod \"dns-operator-controller-manager-864dd78c4c-wx5r2\" (UID: \"7ae0d829-7d14-4295-84b1-fcc50aaca570\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wx5r2" Jul 08 17:28:03.449112 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:03.449017 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wx5r2" Jul 08 17:28:03.591278 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:03.591207 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-wx5r2"] Jul 08 17:28:03.593949 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:28:03.593899 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ae0d829_7d14_4295_84b1_fcc50aaca570.slice/crio-785078f157db5e9d782cf0257baa555210f25703760a9a4cb55ac3f8bd017a6e WatchSource:0}: Error finding container 785078f157db5e9d782cf0257baa555210f25703760a9a4cb55ac3f8bd017a6e: Status 404 returned error can't find the container with id 785078f157db5e9d782cf0257baa555210f25703760a9a4cb55ac3f8bd017a6e Jul 08 17:28:03.715186 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:03.715094 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wx5r2" event={"ID":"7ae0d829-7d14-4295-84b1-fcc50aaca570","Type":"ContainerStarted","Data":"785078f157db5e9d782cf0257baa555210f25703760a9a4cb55ac3f8bd017a6e"} Jul 08 17:28:05.725300 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:05.725267 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wx5r2" event={"ID":"7ae0d829-7d14-4295-84b1-fcc50aaca570","Type":"ContainerStarted","Data":"f47e596884903df5b77648f26c9ff0f10afc13c47f316fd28692f5a4f07608df"} Jul 08 17:28:05.725739 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:05.725511 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wx5r2" Jul 08 17:28:05.744489 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:05.744394 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wx5r2" podStartSLOduration=0.803773309 podStartE2EDuration="2.744366714s" totalImagesPullingTime="1.940593405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:28:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:28:05.742611769 +0000 UTC m=+698.153427138" watchObservedRunningTime="2026-07-08 17:28:05.744366714 +0000 UTC m=+698.155182081" Jul 08 17:28:06.217203 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:06.217167 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdbrc"] Jul 08 17:28:06.220508 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:06.220488 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdbrc" Jul 08 17:28:06.223268 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:06.223248 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-hx9ws\"" Jul 08 17:28:06.232382 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:06.232357 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdbrc"] Jul 08 17:28:06.375860 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:06.375812 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6wzm\" (UniqueName: \"kubernetes.io/projected/d8a16f09-6b51-4555-86b7-ada8d199fc57-kube-api-access-d6wzm\") pod \"limitador-operator-controller-manager-859d7b78bd-jdbrc\" (UID: \"d8a16f09-6b51-4555-86b7-ada8d199fc57\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdbrc" Jul 08 17:28:06.477136 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:06.477036 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6wzm\" (UniqueName: \"kubernetes.io/projected/d8a16f09-6b51-4555-86b7-ada8d199fc57-kube-api-access-d6wzm\") pod \"limitador-operator-controller-manager-859d7b78bd-jdbrc\" (UID: \"d8a16f09-6b51-4555-86b7-ada8d199fc57\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdbrc" Jul 08 17:28:06.486659 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:06.486631 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6wzm\" (UniqueName: \"kubernetes.io/projected/d8a16f09-6b51-4555-86b7-ada8d199fc57-kube-api-access-d6wzm\") pod \"limitador-operator-controller-manager-859d7b78bd-jdbrc\" (UID: \"d8a16f09-6b51-4555-86b7-ada8d199fc57\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdbrc" Jul 08 17:28:06.531597 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:06.531557 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdbrc" Jul 08 17:28:06.671709 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:06.671675 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdbrc"] Jul 08 17:28:06.675279 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:28:06.675244 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8a16f09_6b51_4555_86b7_ada8d199fc57.slice/crio-55a5b3113c07578e702cc06ac010cb2c53028dd32654886ade9b81184be97bba WatchSource:0}: Error finding container 55a5b3113c07578e702cc06ac010cb2c53028dd32654886ade9b81184be97bba: Status 404 returned error can't find the container with id 55a5b3113c07578e702cc06ac010cb2c53028dd32654886ade9b81184be97bba Jul 08 17:28:06.730685 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:06.730595 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdbrc" event={"ID":"d8a16f09-6b51-4555-86b7-ada8d199fc57","Type":"ContainerStarted","Data":"55a5b3113c07578e702cc06ac010cb2c53028dd32654886ade9b81184be97bba"} Jul 08 17:28:07.035887 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:07.035741 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f9f86db7d-lr7kp" Jul 08 17:28:07.035887 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:07.035806 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f9f86db7d-lr7kp" Jul 08 17:28:07.041128 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:07.041103 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f9f86db7d-lr7kp" Jul 08 17:28:07.743643 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:07.743606 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f9f86db7d-lr7kp" Jul 08 17:28:07.810882 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:07.810850 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6456df7688-47l9j"] Jul 08 17:28:08.746154 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:08.746115 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdbrc" event={"ID":"d8a16f09-6b51-4555-86b7-ada8d199fc57","Type":"ContainerStarted","Data":"825555d4453a36989faaba48c1e0f6e63d6557f9f0d5038b11c42ca25f3fb5bc"} Jul 08 17:28:08.746553 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:08.746230 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdbrc" Jul 08 17:28:08.766132 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:08.766073 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdbrc" podStartSLOduration=1.3374895549999999 podStartE2EDuration="2.766055375s" totalImagesPullingTime="1.42856582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:28:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:28:08.763636484 +0000 UTC m=+701.174451852" watchObservedRunningTime="2026-07-08 17:28:08.766055375 +0000 UTC m=+701.176870752" Jul 08 17:28:10.679942 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:10.679888 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cjtrw"] Jul 08 17:28:10.684808 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:10.684788 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cjtrw" Jul 08 17:28:10.687825 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:10.687797 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-psnw7\"" Jul 08 17:28:10.696672 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:10.696647 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cjtrw"] Jul 08 17:28:10.821132 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:10.821091 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f27a28e-3b61-4c26-ae45-1cb5e7a5b534-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cjtrw\" (UID: \"2f27a28e-3b61-4c26-ae45-1cb5e7a5b534\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cjtrw" Jul 08 17:28:10.821305 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:10.821140 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djg7f\" (UniqueName: \"kubernetes.io/projected/2f27a28e-3b61-4c26-ae45-1cb5e7a5b534-kube-api-access-djg7f\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cjtrw\" (UID: \"2f27a28e-3b61-4c26-ae45-1cb5e7a5b534\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cjtrw" Jul 08 17:28:10.922136 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:10.922094 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f27a28e-3b61-4c26-ae45-1cb5e7a5b534-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cjtrw\" (UID: \"2f27a28e-3b61-4c26-ae45-1cb5e7a5b534\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cjtrw" Jul 08 17:28:10.922136 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:10.922142 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djg7f\" (UniqueName: \"kubernetes.io/projected/2f27a28e-3b61-4c26-ae45-1cb5e7a5b534-kube-api-access-djg7f\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cjtrw\" (UID: \"2f27a28e-3b61-4c26-ae45-1cb5e7a5b534\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cjtrw" Jul 08 17:28:10.922497 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:10.922476 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f27a28e-3b61-4c26-ae45-1cb5e7a5b534-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cjtrw\" (UID: \"2f27a28e-3b61-4c26-ae45-1cb5e7a5b534\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cjtrw" Jul 08 17:28:10.930440 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:10.930366 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djg7f\" (UniqueName: \"kubernetes.io/projected/2f27a28e-3b61-4c26-ae45-1cb5e7a5b534-kube-api-access-djg7f\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cjtrw\" (UID: \"2f27a28e-3b61-4c26-ae45-1cb5e7a5b534\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cjtrw" Jul 08 17:28:10.996388 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:10.996349 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cjtrw" Jul 08 17:28:11.151182 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:11.151141 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cjtrw"] Jul 08 17:28:11.154711 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:28:11.154685 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f27a28e_3b61_4c26_ae45_1cb5e7a5b534.slice/crio-2e475a7eefada1e1ace5f81d94fb65b2b22a0586695945bd71f9fad676f97d3f WatchSource:0}: Error finding container 2e475a7eefada1e1ace5f81d94fb65b2b22a0586695945bd71f9fad676f97d3f: Status 404 returned error can't find the container with id 2e475a7eefada1e1ace5f81d94fb65b2b22a0586695945bd71f9fad676f97d3f Jul 08 17:28:11.763842 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:11.763804 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cjtrw" event={"ID":"2f27a28e-3b61-4c26-ae45-1cb5e7a5b534","Type":"ContainerStarted","Data":"2e475a7eefada1e1ace5f81d94fb65b2b22a0586695945bd71f9fad676f97d3f"} Jul 08 17:28:13.718448 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:13.718417 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-p5s4q" Jul 08 17:28:16.733251 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:16.733167 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-wx5r2" Jul 08 17:28:16.795291 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:16.795253 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cjtrw" event={"ID":"2f27a28e-3b61-4c26-ae45-1cb5e7a5b534","Type":"ContainerStarted","Data":"743ab3ba608fa8d6f1f35dac0005eab61e4404b4f7035eadf99da273de110862"} Jul 08 17:28:16.795462 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:16.795376 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cjtrw" Jul 08 17:28:16.813661 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:16.813596 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cjtrw" podStartSLOduration=1.517083479 podStartE2EDuration="6.813574154s" totalImagesPullingTime="5.296490675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:28:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:28:16.812972096 +0000 UTC m=+709.223787467" watchObservedRunningTime="2026-07-08 17:28:16.813574154 +0000 UTC m=+709.224389532" Jul 08 17:28:19.756612 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:19.756577 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdbrc" Jul 08 17:28:27.802160 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:27.802077 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cjtrw" Jul 08 17:28:29.654359 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.654325 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cjtrw"] Jul 08 17:28:29.654810 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.654499 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cjtrw" podUID="2f27a28e-3b61-4c26-ae45-1cb5e7a5b534" containerName="manager" containerID="cri-o://743ab3ba608fa8d6f1f35dac0005eab61e4404b4f7035eadf99da273de110862" gracePeriod=2 Jul 08 17:28:29.659658 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.659628 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cjtrw"] Jul 08 17:28:29.679046 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.678743 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdbrc"] Jul 08 17:28:29.679046 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.679012 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdbrc" podUID="d8a16f09-6b51-4555-86b7-ada8d199fc57" containerName="manager" containerID="cri-o://825555d4453a36989faaba48c1e0f6e63d6557f9f0d5038b11c42ca25f3fb5bc" gracePeriod=2 Jul 08 17:28:29.683829 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.683799 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r42ht"] Jul 08 17:28:29.684466 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.684437 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f27a28e-3b61-4c26-ae45-1cb5e7a5b534" containerName="manager" Jul 08 17:28:29.684466 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.684460 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f27a28e-3b61-4c26-ae45-1cb5e7a5b534" containerName="manager" Jul 08 17:28:29.684644 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.684576 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f27a28e-3b61-4c26-ae45-1cb5e7a5b534" containerName="manager" Jul 08 17:28:29.688039 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.688018 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r42ht" Jul 08 17:28:29.697189 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.697157 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdbrc"] Jul 08 17:28:29.702480 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:28:29.702441 2556 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d8a16f09-6b51-4555-86b7-ada8d199fc57\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-jdbrc\": pods \"limitador-operator-controller-manager-859d7b78bd-jdbrc\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdbrc" Jul 08 17:28:29.705078 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:28:29.704674 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cjtrw\" is forbidden: User \"system:node:ip-10-0-133-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-231.ec2.internal' and this object" podUID="2f27a28e-3b61-4c26-ae45-1cb5e7a5b534" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cjtrw" Jul 08 17:28:29.705865 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.705839 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r42ht"] Jul 08 17:28:29.707310 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:28:29.707221 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jdbrc\" is forbidden: User \"system:node:ip-10-0-133-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-231.ec2.internal' and this object" podUID="d8a16f09-6b51-4555-86b7-ada8d199fc57" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdbrc" Jul 08 17:28:29.709282 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:28:29.709247 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cjtrw\" is forbidden: User \"system:node:ip-10-0-133-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-231.ec2.internal' and this object" podUID="2f27a28e-3b61-4c26-ae45-1cb5e7a5b534" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cjtrw" Jul 08 17:28:29.722429 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.722402 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cnngp"] Jul 08 17:28:29.722890 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.722866 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8a16f09-6b51-4555-86b7-ada8d199fc57" containerName="manager" Jul 08 17:28:29.723015 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.722893 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8a16f09-6b51-4555-86b7-ada8d199fc57" containerName="manager" Jul 08 17:28:29.723015 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.723000 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8a16f09-6b51-4555-86b7-ada8d199fc57" containerName="manager" Jul 08 17:28:29.729033 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.729007 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cnngp" Jul 08 17:28:29.738465 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.738440 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cnngp"] Jul 08 17:28:29.754517 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:28:29.754481 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jdbrc\" is forbidden: User \"system:node:ip-10-0-133-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-231.ec2.internal' and this object" podUID="d8a16f09-6b51-4555-86b7-ada8d199fc57" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdbrc" Jul 08 17:28:29.756277 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:28:29.756253 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cjtrw\" is forbidden: User \"system:node:ip-10-0-133-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-231.ec2.internal' and this object" podUID="2f27a28e-3b61-4c26-ae45-1cb5e7a5b534" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cjtrw" Jul 08 17:28:29.798442 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.798407 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn64p\" (UniqueName: \"kubernetes.io/projected/fe2882a7-b8d0-4b80-83d4-517add410962-kube-api-access-pn64p\") pod \"limitador-operator-controller-manager-859d7b78bd-cnngp\" (UID: \"fe2882a7-b8d0-4b80-83d4-517add410962\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cnngp" Jul 08 17:28:29.798544 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.798484 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcshl\" (UniqueName: \"kubernetes.io/projected/6d720b7e-550f-4106-84f1-d5db6e21980c-kube-api-access-fcshl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r42ht\" (UID: \"6d720b7e-550f-4106-84f1-d5db6e21980c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r42ht" Jul 08 17:28:29.798596 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.798539 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d720b7e-550f-4106-84f1-d5db6e21980c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r42ht\" (UID: \"6d720b7e-550f-4106-84f1-d5db6e21980c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r42ht" Jul 08 17:28:29.861505 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.861470 2556 generic.go:356] "Generic (PLEG): container finished" podID="d8a16f09-6b51-4555-86b7-ada8d199fc57" containerID="825555d4453a36989faaba48c1e0f6e63d6557f9f0d5038b11c42ca25f3fb5bc" exitCode=0 Jul 08 17:28:29.863938 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.863882 2556 generic.go:356] "Generic (PLEG): container finished" podID="2f27a28e-3b61-4c26-ae45-1cb5e7a5b534" containerID="743ab3ba608fa8d6f1f35dac0005eab61e4404b4f7035eadf99da273de110862" exitCode=0 Jul 08 17:28:29.899256 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.899219 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d720b7e-550f-4106-84f1-d5db6e21980c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r42ht\" (UID: \"6d720b7e-550f-4106-84f1-d5db6e21980c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r42ht" Jul 08 17:28:29.899414 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.899372 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn64p\" (UniqueName: \"kubernetes.io/projected/fe2882a7-b8d0-4b80-83d4-517add410962-kube-api-access-pn64p\") pod \"limitador-operator-controller-manager-859d7b78bd-cnngp\" (UID: \"fe2882a7-b8d0-4b80-83d4-517add410962\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cnngp" Jul 08 17:28:29.899465 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.899420 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcshl\" (UniqueName: \"kubernetes.io/projected/6d720b7e-550f-4106-84f1-d5db6e21980c-kube-api-access-fcshl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r42ht\" (UID: \"6d720b7e-550f-4106-84f1-d5db6e21980c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r42ht" Jul 08 17:28:29.899617 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.899597 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d720b7e-550f-4106-84f1-d5db6e21980c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r42ht\" (UID: \"6d720b7e-550f-4106-84f1-d5db6e21980c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r42ht" Jul 08 17:28:29.907720 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.907687 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn64p\" (UniqueName: \"kubernetes.io/projected/fe2882a7-b8d0-4b80-83d4-517add410962-kube-api-access-pn64p\") pod \"limitador-operator-controller-manager-859d7b78bd-cnngp\" (UID: \"fe2882a7-b8d0-4b80-83d4-517add410962\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cnngp" Jul 08 17:28:29.908071 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.907883 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcshl\" (UniqueName: \"kubernetes.io/projected/6d720b7e-550f-4106-84f1-d5db6e21980c-kube-api-access-fcshl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r42ht\" (UID: \"6d720b7e-550f-4106-84f1-d5db6e21980c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r42ht" Jul 08 17:28:29.933941 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.933903 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cjtrw" Jul 08 17:28:29.936196 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:28:29.936163 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jdbrc\" is forbidden: User \"system:node:ip-10-0-133-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-231.ec2.internal' and this object" podUID="d8a16f09-6b51-4555-86b7-ada8d199fc57" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdbrc" Jul 08 17:28:29.936513 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:29.936497 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdbrc" Jul 08 17:28:29.938082 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:28:29.938060 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cjtrw\" is forbidden: User \"system:node:ip-10-0-133-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-231.ec2.internal' and this object" podUID="2f27a28e-3b61-4c26-ae45-1cb5e7a5b534" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cjtrw" Jul 08 17:28:29.940076 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:28:29.940058 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jdbrc\" is forbidden: User \"system:node:ip-10-0-133-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-231.ec2.internal' and this object" podUID="d8a16f09-6b51-4555-86b7-ada8d199fc57" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdbrc" Jul 08 17:28:29.941904 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:28:29.941884 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cjtrw\" is forbidden: User \"system:node:ip-10-0-133-231.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-231.ec2.internal' and this object" podUID="2f27a28e-3b61-4c26-ae45-1cb5e7a5b534" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cjtrw" Jul 08 17:28:30.000406 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:30.000372 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6wzm\" (UniqueName: \"kubernetes.io/projected/d8a16f09-6b51-4555-86b7-ada8d199fc57-kube-api-access-d6wzm\") pod \"d8a16f09-6b51-4555-86b7-ada8d199fc57\" (UID: \"d8a16f09-6b51-4555-86b7-ada8d199fc57\") " Jul 08 17:28:30.000553 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:30.000451 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djg7f\" (UniqueName: \"kubernetes.io/projected/2f27a28e-3b61-4c26-ae45-1cb5e7a5b534-kube-api-access-djg7f\") pod \"2f27a28e-3b61-4c26-ae45-1cb5e7a5b534\" (UID: \"2f27a28e-3b61-4c26-ae45-1cb5e7a5b534\") " Jul 08 17:28:30.000553 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:30.000494 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f27a28e-3b61-4c26-ae45-1cb5e7a5b534-extensions-socket-volume\") pod \"2f27a28e-3b61-4c26-ae45-1cb5e7a5b534\" (UID: \"2f27a28e-3b61-4c26-ae45-1cb5e7a5b534\") " Jul 08 17:28:30.000963 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:30.000901 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f27a28e-3b61-4c26-ae45-1cb5e7a5b534-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2f27a28e-3b61-4c26-ae45-1cb5e7a5b534" (UID: "2f27a28e-3b61-4c26-ae45-1cb5e7a5b534"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:28:30.002580 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:30.002552 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8a16f09-6b51-4555-86b7-ada8d199fc57-kube-api-access-d6wzm" (OuterVolumeSpecName: "kube-api-access-d6wzm") pod "d8a16f09-6b51-4555-86b7-ada8d199fc57" (UID: "d8a16f09-6b51-4555-86b7-ada8d199fc57"). InnerVolumeSpecName "kube-api-access-d6wzm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:28:30.002580 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:30.002570 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f27a28e-3b61-4c26-ae45-1cb5e7a5b534-kube-api-access-djg7f" (OuterVolumeSpecName: "kube-api-access-djg7f") pod "2f27a28e-3b61-4c26-ae45-1cb5e7a5b534" (UID: "2f27a28e-3b61-4c26-ae45-1cb5e7a5b534"). InnerVolumeSpecName "kube-api-access-djg7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:28:30.062985 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:30.062946 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r42ht" Jul 08 17:28:30.070505 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:30.070250 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cnngp" Jul 08 17:28:30.101288 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:30.101228 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djg7f\" (UniqueName: \"kubernetes.io/projected/2f27a28e-3b61-4c26-ae45-1cb5e7a5b534-kube-api-access-djg7f\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:28:30.101288 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:30.101255 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f27a28e-3b61-4c26-ae45-1cb5e7a5b534-extensions-socket-volume\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:28:30.101288 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:30.101267 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6wzm\" (UniqueName: \"kubernetes.io/projected/d8a16f09-6b51-4555-86b7-ada8d199fc57-kube-api-access-d6wzm\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:28:30.114726 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:30.114696 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f27a28e-3b61-4c26-ae45-1cb5e7a5b534" path="/var/lib/kubelet/pods/2f27a28e-3b61-4c26-ae45-1cb5e7a5b534/volumes" Jul 08 17:28:30.115278 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:30.115248 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8a16f09-6b51-4555-86b7-ada8d199fc57" path="/var/lib/kubelet/pods/d8a16f09-6b51-4555-86b7-ada8d199fc57/volumes" Jul 08 17:28:30.220149 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:30.220117 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r42ht"] Jul 08 17:28:30.224009 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:28:30.223969 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d720b7e_550f_4106_84f1_d5db6e21980c.slice/crio-e96df7f86b1d38191ec1b1ec7af64ae6ce65aa2721f13908229e1b7edf72d90e WatchSource:0}: Error finding container e96df7f86b1d38191ec1b1ec7af64ae6ce65aa2721f13908229e1b7edf72d90e: Status 404 returned error can't find the container with id e96df7f86b1d38191ec1b1ec7af64ae6ce65aa2721f13908229e1b7edf72d90e Jul 08 17:28:30.237181 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:30.237162 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cnngp"] Jul 08 17:28:30.239302 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:28:30.239273 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe2882a7_b8d0_4b80_83d4_517add410962.slice/crio-740e0530374bd93a45be66c5ce1436b45abfdfdbdc133d31be6103ce44ba8d05 WatchSource:0}: Error finding container 740e0530374bd93a45be66c5ce1436b45abfdfdbdc133d31be6103ce44ba8d05: Status 404 returned error can't find the container with id 740e0530374bd93a45be66c5ce1436b45abfdfdbdc133d31be6103ce44ba8d05 Jul 08 17:28:30.753966 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:30.753903 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdbrc" podUID="d8a16f09-6b51-4555-86b7-ada8d199fc57" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.39:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 08 17:28:30.869967 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:30.869925 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r42ht" event={"ID":"6d720b7e-550f-4106-84f1-d5db6e21980c","Type":"ContainerStarted","Data":"1d94935e88934e6049508fa19f305fa1d4218af1935ce20855f2415c03f1b536"} Jul 08 17:28:30.870144 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:30.869990 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r42ht" event={"ID":"6d720b7e-550f-4106-84f1-d5db6e21980c","Type":"ContainerStarted","Data":"e96df7f86b1d38191ec1b1ec7af64ae6ce65aa2721f13908229e1b7edf72d90e"} Jul 08 17:28:30.870144 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:30.870018 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r42ht" Jul 08 17:28:30.871253 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:30.871235 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jdbrc" Jul 08 17:28:30.871331 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:30.871254 2556 scope.go:117] "RemoveContainer" containerID="825555d4453a36989faaba48c1e0f6e63d6557f9f0d5038b11c42ca25f3fb5bc" Jul 08 17:28:30.872756 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:30.872733 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cjtrw" Jul 08 17:28:30.874499 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:30.874472 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cnngp" event={"ID":"fe2882a7-b8d0-4b80-83d4-517add410962","Type":"ContainerStarted","Data":"daf715ecfb3c90b8fed7633a0ebf243494933fededbad79b022d867750568b7d"} Jul 08 17:28:30.874608 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:30.874529 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cnngp" event={"ID":"fe2882a7-b8d0-4b80-83d4-517add410962","Type":"ContainerStarted","Data":"740e0530374bd93a45be66c5ce1436b45abfdfdbdc133d31be6103ce44ba8d05"} Jul 08 17:28:30.874608 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:30.874560 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cnngp" Jul 08 17:28:30.880370 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:30.880355 2556 scope.go:117] "RemoveContainer" containerID="743ab3ba608fa8d6f1f35dac0005eab61e4404b4f7035eadf99da273de110862" Jul 08 17:28:30.893163 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:30.893117 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r42ht" podStartSLOduration=1.8930993969999999 podStartE2EDuration="1.893099397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:28:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:28:30.891150116 +0000 UTC m=+723.301965496" watchObservedRunningTime="2026-07-08 17:28:30.893099397 +0000 UTC m=+723.303914828" Jul 08 17:28:30.915952 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:30.915871 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cnngp" podStartSLOduration=1.915850951 podStartE2EDuration="1.915850951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:28:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:28:30.915256401 +0000 UTC m=+723.326071777" watchObservedRunningTime="2026-07-08 17:28:30.915850951 +0000 UTC m=+723.326666330" Jul 08 17:28:32.841386 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:32.841345 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6456df7688-47l9j" podUID="701fa525-ff82-4e86-bf25-1b010809ce68" containerName="console" containerID="cri-o://8c65f21bf2e511987e7242ae05b38ec77259b573dafde3d128bb8bbaa95dd77b" gracePeriod=15 Jul 08 17:28:33.095609 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.095552 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:28:33.230172 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.230142 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/701fa525-ff82-4e86-bf25-1b010809ce68-service-ca\") pod \"701fa525-ff82-4e86-bf25-1b010809ce68\" (UID: \"701fa525-ff82-4e86-bf25-1b010809ce68\") " Jul 08 17:28:33.230355 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.230211 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/701fa525-ff82-4e86-bf25-1b010809ce68-console-serving-cert\") pod \"701fa525-ff82-4e86-bf25-1b010809ce68\" (UID: \"701fa525-ff82-4e86-bf25-1b010809ce68\") " Jul 08 17:28:33.230355 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.230237 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9bwx\" (UniqueName: \"kubernetes.io/projected/701fa525-ff82-4e86-bf25-1b010809ce68-kube-api-access-r9bwx\") pod \"701fa525-ff82-4e86-bf25-1b010809ce68\" (UID: \"701fa525-ff82-4e86-bf25-1b010809ce68\") " Jul 08 17:28:33.230355 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.230276 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/701fa525-ff82-4e86-bf25-1b010809ce68-oauth-serving-cert\") pod \"701fa525-ff82-4e86-bf25-1b010809ce68\" (UID: \"701fa525-ff82-4e86-bf25-1b010809ce68\") " Jul 08 17:28:33.230355 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.230336 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/701fa525-ff82-4e86-bf25-1b010809ce68-console-config\") pod \"701fa525-ff82-4e86-bf25-1b010809ce68\" (UID: \"701fa525-ff82-4e86-bf25-1b010809ce68\") " Jul 08 17:28:33.230544 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.230362 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/701fa525-ff82-4e86-bf25-1b010809ce68-console-oauth-config\") pod \"701fa525-ff82-4e86-bf25-1b010809ce68\" (UID: \"701fa525-ff82-4e86-bf25-1b010809ce68\") " Jul 08 17:28:33.230544 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.230501 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/701fa525-ff82-4e86-bf25-1b010809ce68-trusted-ca-bundle\") pod \"701fa525-ff82-4e86-bf25-1b010809ce68\" (UID: \"701fa525-ff82-4e86-bf25-1b010809ce68\") " Jul 08 17:28:33.230644 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.230567 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/701fa525-ff82-4e86-bf25-1b010809ce68-service-ca" (OuterVolumeSpecName: "service-ca") pod "701fa525-ff82-4e86-bf25-1b010809ce68" (UID: "701fa525-ff82-4e86-bf25-1b010809ce68"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:28:33.230828 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.230805 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/701fa525-ff82-4e86-bf25-1b010809ce68-console-config" (OuterVolumeSpecName: "console-config") pod "701fa525-ff82-4e86-bf25-1b010809ce68" (UID: "701fa525-ff82-4e86-bf25-1b010809ce68"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:28:33.230936 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.230840 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/701fa525-ff82-4e86-bf25-1b010809ce68-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "701fa525-ff82-4e86-bf25-1b010809ce68" (UID: "701fa525-ff82-4e86-bf25-1b010809ce68"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:28:33.230936 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.230902 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/701fa525-ff82-4e86-bf25-1b010809ce68-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "701fa525-ff82-4e86-bf25-1b010809ce68" (UID: "701fa525-ff82-4e86-bf25-1b010809ce68"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:28:33.231109 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.230972 2556 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/701fa525-ff82-4e86-bf25-1b010809ce68-console-config\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:28:33.231109 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.230992 2556 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/701fa525-ff82-4e86-bf25-1b010809ce68-service-ca\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:28:33.231109 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.231005 2556 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/701fa525-ff82-4e86-bf25-1b010809ce68-oauth-serving-cert\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:28:33.232596 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.232569 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/701fa525-ff82-4e86-bf25-1b010809ce68-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "701fa525-ff82-4e86-bf25-1b010809ce68" (UID: "701fa525-ff82-4e86-bf25-1b010809ce68"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 17:28:33.232715 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.232615 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/701fa525-ff82-4e86-bf25-1b010809ce68-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "701fa525-ff82-4e86-bf25-1b010809ce68" (UID: "701fa525-ff82-4e86-bf25-1b010809ce68"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 17:28:33.232715 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.232638 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/701fa525-ff82-4e86-bf25-1b010809ce68-kube-api-access-r9bwx" (OuterVolumeSpecName: "kube-api-access-r9bwx") pod "701fa525-ff82-4e86-bf25-1b010809ce68" (UID: "701fa525-ff82-4e86-bf25-1b010809ce68"). InnerVolumeSpecName "kube-api-access-r9bwx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:28:33.331576 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.331540 2556 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/701fa525-ff82-4e86-bf25-1b010809ce68-console-oauth-config\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:28:33.331576 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.331569 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/701fa525-ff82-4e86-bf25-1b010809ce68-trusted-ca-bundle\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:28:33.331576 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.331582 2556 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/701fa525-ff82-4e86-bf25-1b010809ce68-console-serving-cert\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:28:33.331803 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.331594 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9bwx\" (UniqueName: \"kubernetes.io/projected/701fa525-ff82-4e86-bf25-1b010809ce68-kube-api-access-r9bwx\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:28:33.891498 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.891462 2556 generic.go:356] "Generic (PLEG): container finished" podID="701fa525-ff82-4e86-bf25-1b010809ce68" containerID="8c65f21bf2e511987e7242ae05b38ec77259b573dafde3d128bb8bbaa95dd77b" exitCode=0 Jul 08 17:28:33.891971 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.891503 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6456df7688-47l9j" Jul 08 17:28:33.891971 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.891542 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6456df7688-47l9j" event={"ID":"701fa525-ff82-4e86-bf25-1b010809ce68","Type":"ContainerDied","Data":"8c65f21bf2e511987e7242ae05b38ec77259b573dafde3d128bb8bbaa95dd77b"} Jul 08 17:28:33.891971 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.891590 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6456df7688-47l9j" event={"ID":"701fa525-ff82-4e86-bf25-1b010809ce68","Type":"ContainerDied","Data":"79598e4355d8ad8f0a4705224b291ad41c12c6bd48250468f669eaababd0c141"} Jul 08 17:28:33.891971 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.891610 2556 scope.go:117] "RemoveContainer" containerID="8c65f21bf2e511987e7242ae05b38ec77259b573dafde3d128bb8bbaa95dd77b" Jul 08 17:28:33.900891 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.900873 2556 scope.go:117] "RemoveContainer" containerID="8c65f21bf2e511987e7242ae05b38ec77259b573dafde3d128bb8bbaa95dd77b" Jul 08 17:28:33.901195 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:28:33.901178 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c65f21bf2e511987e7242ae05b38ec77259b573dafde3d128bb8bbaa95dd77b\": container with ID starting with 8c65f21bf2e511987e7242ae05b38ec77259b573dafde3d128bb8bbaa95dd77b not found: ID does not exist" containerID="8c65f21bf2e511987e7242ae05b38ec77259b573dafde3d128bb8bbaa95dd77b" Jul 08 17:28:33.901239 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.901204 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c65f21bf2e511987e7242ae05b38ec77259b573dafde3d128bb8bbaa95dd77b"} err="failed to get container status \"8c65f21bf2e511987e7242ae05b38ec77259b573dafde3d128bb8bbaa95dd77b\": rpc error: code = NotFound desc = could not find container \"8c65f21bf2e511987e7242ae05b38ec77259b573dafde3d128bb8bbaa95dd77b\": container with ID starting with 8c65f21bf2e511987e7242ae05b38ec77259b573dafde3d128bb8bbaa95dd77b not found: ID does not exist" Jul 08 17:28:33.913375 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.913348 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6456df7688-47l9j"] Jul 08 17:28:33.916878 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:33.916854 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6456df7688-47l9j"] Jul 08 17:28:34.112519 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:34.112489 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="701fa525-ff82-4e86-bf25-1b010809ce68" path="/var/lib/kubelet/pods/701fa525-ff82-4e86-bf25-1b010809ce68/volumes" Jul 08 17:28:41.883636 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:41.883602 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r42ht" Jul 08 17:28:41.884141 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:41.883684 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cnngp" Jul 08 17:28:45.333874 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.333840 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r42ht"] Jul 08 17:28:45.334320 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.334036 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r42ht" podUID="6d720b7e-550f-4106-84f1-d5db6e21980c" containerName="manager" containerID="cri-o://1d94935e88934e6049508fa19f305fa1d4218af1935ce20855f2415c03f1b536" gracePeriod=10 Jul 08 17:28:45.587679 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.587620 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r42ht" Jul 08 17:28:45.643856 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.643825 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56mfv"] Jul 08 17:28:45.644224 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.644211 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="701fa525-ff82-4e86-bf25-1b010809ce68" containerName="console" Jul 08 17:28:45.644273 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.644225 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="701fa525-ff82-4e86-bf25-1b010809ce68" containerName="console" Jul 08 17:28:45.644273 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.644241 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d720b7e-550f-4106-84f1-d5db6e21980c" containerName="manager" Jul 08 17:28:45.644273 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.644247 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d720b7e-550f-4106-84f1-d5db6e21980c" containerName="manager" Jul 08 17:28:45.644367 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.644308 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d720b7e-550f-4106-84f1-d5db6e21980c" containerName="manager" Jul 08 17:28:45.644367 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.644319 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="701fa525-ff82-4e86-bf25-1b010809ce68" containerName="console" Jul 08 17:28:45.647435 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.647416 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56mfv" Jul 08 17:28:45.666160 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.666127 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56mfv"] Jul 08 17:28:45.747212 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.747176 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcshl\" (UniqueName: \"kubernetes.io/projected/6d720b7e-550f-4106-84f1-d5db6e21980c-kube-api-access-fcshl\") pod \"6d720b7e-550f-4106-84f1-d5db6e21980c\" (UID: \"6d720b7e-550f-4106-84f1-d5db6e21980c\") " Jul 08 17:28:45.747404 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.747242 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d720b7e-550f-4106-84f1-d5db6e21980c-extensions-socket-volume\") pod \"6d720b7e-550f-4106-84f1-d5db6e21980c\" (UID: \"6d720b7e-550f-4106-84f1-d5db6e21980c\") " Jul 08 17:28:45.747471 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.747408 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cq87\" (UniqueName: \"kubernetes.io/projected/2c43396b-51b4-4641-8805-32f18d421ca7-kube-api-access-4cq87\") pod \"kuadrant-operator-controller-manager-86878c769f-56mfv\" (UID: \"2c43396b-51b4-4641-8805-32f18d421ca7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56mfv" Jul 08 17:28:45.747545 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.747522 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c43396b-51b4-4641-8805-32f18d421ca7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-56mfv\" (UID: \"2c43396b-51b4-4641-8805-32f18d421ca7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56mfv" Jul 08 17:28:45.747590 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.747545 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d720b7e-550f-4106-84f1-d5db6e21980c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6d720b7e-550f-4106-84f1-d5db6e21980c" (UID: "6d720b7e-550f-4106-84f1-d5db6e21980c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:28:45.749299 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.749276 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d720b7e-550f-4106-84f1-d5db6e21980c-kube-api-access-fcshl" (OuterVolumeSpecName: "kube-api-access-fcshl") pod "6d720b7e-550f-4106-84f1-d5db6e21980c" (UID: "6d720b7e-550f-4106-84f1-d5db6e21980c"). InnerVolumeSpecName "kube-api-access-fcshl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:28:45.848662 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.848629 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cq87\" (UniqueName: \"kubernetes.io/projected/2c43396b-51b4-4641-8805-32f18d421ca7-kube-api-access-4cq87\") pod \"kuadrant-operator-controller-manager-86878c769f-56mfv\" (UID: \"2c43396b-51b4-4641-8805-32f18d421ca7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56mfv" Jul 08 17:28:45.848808 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.848694 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c43396b-51b4-4641-8805-32f18d421ca7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-56mfv\" (UID: \"2c43396b-51b4-4641-8805-32f18d421ca7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56mfv" Jul 08 17:28:45.848808 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.848738 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcshl\" (UniqueName: \"kubernetes.io/projected/6d720b7e-550f-4106-84f1-d5db6e21980c-kube-api-access-fcshl\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:28:45.848808 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.848750 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d720b7e-550f-4106-84f1-d5db6e21980c-extensions-socket-volume\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:28:45.849097 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.849080 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c43396b-51b4-4641-8805-32f18d421ca7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-56mfv\" (UID: \"2c43396b-51b4-4641-8805-32f18d421ca7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56mfv" Jul 08 17:28:45.857123 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.857092 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cq87\" (UniqueName: \"kubernetes.io/projected/2c43396b-51b4-4641-8805-32f18d421ca7-kube-api-access-4cq87\") pod \"kuadrant-operator-controller-manager-86878c769f-56mfv\" (UID: \"2c43396b-51b4-4641-8805-32f18d421ca7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56mfv" Jul 08 17:28:45.956685 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.956649 2556 generic.go:356] "Generic (PLEG): container finished" podID="6d720b7e-550f-4106-84f1-d5db6e21980c" containerID="1d94935e88934e6049508fa19f305fa1d4218af1935ce20855f2415c03f1b536" exitCode=0 Jul 08 17:28:45.956879 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.956695 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r42ht" Jul 08 17:28:45.956879 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.956734 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r42ht" event={"ID":"6d720b7e-550f-4106-84f1-d5db6e21980c","Type":"ContainerDied","Data":"1d94935e88934e6049508fa19f305fa1d4218af1935ce20855f2415c03f1b536"} Jul 08 17:28:45.956879 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.956788 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r42ht" event={"ID":"6d720b7e-550f-4106-84f1-d5db6e21980c","Type":"ContainerDied","Data":"e96df7f86b1d38191ec1b1ec7af64ae6ce65aa2721f13908229e1b7edf72d90e"} Jul 08 17:28:45.956879 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.956810 2556 scope.go:117] "RemoveContainer" containerID="1d94935e88934e6049508fa19f305fa1d4218af1935ce20855f2415c03f1b536" Jul 08 17:28:45.957138 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.956989 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56mfv" Jul 08 17:28:45.970586 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.970566 2556 scope.go:117] "RemoveContainer" containerID="1d94935e88934e6049508fa19f305fa1d4218af1935ce20855f2415c03f1b536" Jul 08 17:28:45.970869 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:28:45.970848 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d94935e88934e6049508fa19f305fa1d4218af1935ce20855f2415c03f1b536\": container with ID starting with 1d94935e88934e6049508fa19f305fa1d4218af1935ce20855f2415c03f1b536 not found: ID does not exist" containerID="1d94935e88934e6049508fa19f305fa1d4218af1935ce20855f2415c03f1b536" Jul 08 17:28:45.970963 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.970877 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d94935e88934e6049508fa19f305fa1d4218af1935ce20855f2415c03f1b536"} err="failed to get container status \"1d94935e88934e6049508fa19f305fa1d4218af1935ce20855f2415c03f1b536\": rpc error: code = NotFound desc = could not find container \"1d94935e88934e6049508fa19f305fa1d4218af1935ce20855f2415c03f1b536\": container with ID starting with 1d94935e88934e6049508fa19f305fa1d4218af1935ce20855f2415c03f1b536 not found: ID does not exist" Jul 08 17:28:45.984984 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.984956 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r42ht"] Jul 08 17:28:45.994431 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:45.994407 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r42ht"] Jul 08 17:28:46.111070 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:28:46.111045 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c43396b_51b4_4641_8805_32f18d421ca7.slice/crio-2b86b400850250f20fc16f1001363ae4fb81f56b8214ca9f0272f78b7db8f7f9 WatchSource:0}: Error finding container 2b86b400850250f20fc16f1001363ae4fb81f56b8214ca9f0272f78b7db8f7f9: Status 404 returned error can't find the container with id 2b86b400850250f20fc16f1001363ae4fb81f56b8214ca9f0272f78b7db8f7f9 Jul 08 17:28:46.112696 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:46.112673 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d720b7e-550f-4106-84f1-d5db6e21980c" path="/var/lib/kubelet/pods/6d720b7e-550f-4106-84f1-d5db6e21980c/volumes" Jul 08 17:28:46.113071 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:46.113052 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56mfv"] Jul 08 17:28:46.967848 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:46.967807 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56mfv" event={"ID":"2c43396b-51b4-4641-8805-32f18d421ca7","Type":"ContainerStarted","Data":"08900fa1ee836745a4202c36c305dad04a8539bfd905a10f2b9208cc9cc01841"} Jul 08 17:28:46.968309 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:46.967920 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56mfv" event={"ID":"2c43396b-51b4-4641-8805-32f18d421ca7","Type":"ContainerStarted","Data":"2b86b400850250f20fc16f1001363ae4fb81f56b8214ca9f0272f78b7db8f7f9"} Jul 08 17:28:46.968309 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:46.967954 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56mfv" Jul 08 17:28:46.988233 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:46.988178 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56mfv" podStartSLOduration=1.988158364 podStartE2EDuration="1.988158364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:28:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:28:46.987282448 +0000 UTC m=+739.398097828" watchObservedRunningTime="2026-07-08 17:28:46.988158364 +0000 UTC m=+739.398973738" Jul 08 17:28:57.975965 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:28:57.975905 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56mfv" Jul 08 17:29:01.937402 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:01.937366 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j"] Jul 08 17:29:01.941101 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:01.941066 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:01.943548 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:01.943522 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-2pwp4\"" Jul 08 17:29:01.954580 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:01.954550 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j"] Jul 08 17:29:01.992559 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:01.992518 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-54k9j\" (UID: \"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:01.992559 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:01.992567 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-54k9j\" (UID: \"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:01.992804 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:01.992582 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-54k9j\" (UID: \"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:01.992804 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:01.992630 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-54k9j\" (UID: \"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:01.992804 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:01.992723 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spxh8\" (UniqueName: \"kubernetes.io/projected/9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7-kube-api-access-spxh8\") pod \"maas-default-gateway-openshift-default-56654dcf7-54k9j\" (UID: \"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:01.992804 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:01.992773 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-54k9j\" (UID: \"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:01.992804 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:01.992798 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-54k9j\" (UID: \"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:01.993024 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:01.992840 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-54k9j\" (UID: \"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:01.993024 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:01.992857 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-54k9j\" (UID: \"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:02.093755 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:02.093714 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spxh8\" (UniqueName: \"kubernetes.io/projected/9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7-kube-api-access-spxh8\") pod \"maas-default-gateway-openshift-default-56654dcf7-54k9j\" (UID: \"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:02.093755 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:02.093762 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-54k9j\" (UID: \"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:02.094073 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:02.093784 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-54k9j\" (UID: \"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:02.094073 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:02.093816 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-54k9j\" (UID: \"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:02.094073 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:02.093831 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-54k9j\" (UID: \"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:02.094073 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:02.093857 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-54k9j\" (UID: \"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:02.094073 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:02.093884 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-54k9j\" (UID: \"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:02.094073 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:02.093934 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-54k9j\" (UID: \"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:02.094073 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:02.093978 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-54k9j\" (UID: \"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:02.094460 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:02.094378 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-54k9j\" (UID: \"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:02.094563 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:02.094538 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-54k9j\" (UID: \"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:02.094631 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:02.094571 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-54k9j\" (UID: \"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:02.094631 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:02.094614 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-54k9j\" (UID: \"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:02.094711 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:02.094650 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-54k9j\" (UID: \"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:02.096617 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:02.096598 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-54k9j\" (UID: \"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:02.096891 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:02.096871 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-54k9j\" (UID: \"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:02.104179 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:02.104155 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spxh8\" (UniqueName: \"kubernetes.io/projected/9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7-kube-api-access-spxh8\") pod \"maas-default-gateway-openshift-default-56654dcf7-54k9j\" (UID: \"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:02.107249 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:02.107221 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-54k9j\" (UID: \"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:02.252882 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:02.252775 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:02.396695 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:02.396596 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j"] Jul 08 17:29:02.408857 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:29:02.408830 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ce8d7b4_e674_4cc7_9df5_fc42d00fe4c7.slice/crio-79c9abfb1bb6d84e65038cbefe7af5a81f6c9cac4623e55ef412badae65a16b3 WatchSource:0}: Error finding container 79c9abfb1bb6d84e65038cbefe7af5a81f6c9cac4623e55ef412badae65a16b3: Status 404 returned error can't find the container with id 79c9abfb1bb6d84e65038cbefe7af5a81f6c9cac4623e55ef412badae65a16b3 Jul 08 17:29:02.410855 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:02.410824 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:29:02.410957 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:02.410891 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:29:02.410957 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:02.410941 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:29:03.048623 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:03.048581 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" event={"ID":"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7","Type":"ContainerStarted","Data":"d813013b1a2f97254153a467ec496569ebcb4685f6619203c67440e9f1095490"} Jul 08 17:29:03.049121 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:03.048638 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" event={"ID":"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7","Type":"ContainerStarted","Data":"79c9abfb1bb6d84e65038cbefe7af5a81f6c9cac4623e55ef412badae65a16b3"} Jul 08 17:29:03.076983 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:03.076923 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" podStartSLOduration=2.076891318 podStartE2EDuration="2.076891318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:29:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:29:03.075382925 +0000 UTC m=+755.486198303" watchObservedRunningTime="2026-07-08 17:29:03.076891318 +0000 UTC m=+755.487706759" Jul 08 17:29:03.253763 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:03.253724 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:03.258436 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:03.258408 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:04.053427 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:04.053399 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:04.054545 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:04.054525 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:29:17.053553 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:17.053519 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-wmwjn"] Jul 08 17:29:17.057234 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:17.057214 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wmwjn" Jul 08 17:29:17.060013 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:17.059991 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-x5klb\"" Jul 08 17:29:17.066103 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:17.066078 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wmwjn"] Jul 08 17:29:17.129737 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:17.129703 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-448ds\" (UniqueName: \"kubernetes.io/projected/7e56b5da-f692-44c8-8ee1-b3277c8d9f23-kube-api-access-448ds\") pod \"authorino-58cd955675-wmwjn\" (UID: \"7e56b5da-f692-44c8-8ee1-b3277c8d9f23\") " pod="kuadrant-system/authorino-58cd955675-wmwjn" Jul 08 17:29:17.231122 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:17.231082 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-448ds\" (UniqueName: \"kubernetes.io/projected/7e56b5da-f692-44c8-8ee1-b3277c8d9f23-kube-api-access-448ds\") pod \"authorino-58cd955675-wmwjn\" (UID: \"7e56b5da-f692-44c8-8ee1-b3277c8d9f23\") " pod="kuadrant-system/authorino-58cd955675-wmwjn" Jul 08 17:29:17.239406 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:17.239378 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-448ds\" (UniqueName: \"kubernetes.io/projected/7e56b5da-f692-44c8-8ee1-b3277c8d9f23-kube-api-access-448ds\") pod \"authorino-58cd955675-wmwjn\" (UID: \"7e56b5da-f692-44c8-8ee1-b3277c8d9f23\") " pod="kuadrant-system/authorino-58cd955675-wmwjn" Jul 08 17:29:17.368571 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:17.368541 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wmwjn" Jul 08 17:29:17.502451 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:17.502426 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wmwjn"] Jul 08 17:29:17.504613 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:29:17.504575 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e56b5da_f692_44c8_8ee1_b3277c8d9f23.slice/crio-1a1784baed654d3380adaf4a0367c6472094fd42fbfe32b5f4f6a56343942a6a WatchSource:0}: Error finding container 1a1784baed654d3380adaf4a0367c6472094fd42fbfe32b5f4f6a56343942a6a: Status 404 returned error can't find the container with id 1a1784baed654d3380adaf4a0367c6472094fd42fbfe32b5f4f6a56343942a6a Jul 08 17:29:18.126515 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:18.126474 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wmwjn" event={"ID":"7e56b5da-f692-44c8-8ee1-b3277c8d9f23","Type":"ContainerStarted","Data":"1a1784baed654d3380adaf4a0367c6472094fd42fbfe32b5f4f6a56343942a6a"} Jul 08 17:29:21.147325 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:21.147228 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wmwjn" event={"ID":"7e56b5da-f692-44c8-8ee1-b3277c8d9f23","Type":"ContainerStarted","Data":"199823808f8b8c7aaf2c058770a4648ecc5df0a33a2354afabf4f2b62fda6978"} Jul 08 17:29:21.163747 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:21.163697 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-wmwjn" podStartSLOduration=0.786788449 podStartE2EDuration="4.163676499s" totalImagesPullingTime="3.37688805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:29:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:29:21.162967329 +0000 UTC m=+773.573782704" watchObservedRunningTime="2026-07-08 17:29:21.163676499 +0000 UTC m=+773.574491876" Jul 08 17:29:22.540890 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:22.540851 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wmwjn"] Jul 08 17:29:23.157823 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:23.157779 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-wmwjn" podUID="7e56b5da-f692-44c8-8ee1-b3277c8d9f23" containerName="authorino" containerID="cri-o://199823808f8b8c7aaf2c058770a4648ecc5df0a33a2354afabf4f2b62fda6978" gracePeriod=30 Jul 08 17:29:23.411670 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:23.411603 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wmwjn" Jul 08 17:29:23.489692 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:23.489656 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-448ds\" (UniqueName: \"kubernetes.io/projected/7e56b5da-f692-44c8-8ee1-b3277c8d9f23-kube-api-access-448ds\") pod \"7e56b5da-f692-44c8-8ee1-b3277c8d9f23\" (UID: \"7e56b5da-f692-44c8-8ee1-b3277c8d9f23\") " Jul 08 17:29:23.491711 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:23.491679 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e56b5da-f692-44c8-8ee1-b3277c8d9f23-kube-api-access-448ds" (OuterVolumeSpecName: "kube-api-access-448ds") pod "7e56b5da-f692-44c8-8ee1-b3277c8d9f23" (UID: "7e56b5da-f692-44c8-8ee1-b3277c8d9f23"). InnerVolumeSpecName "kube-api-access-448ds". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:29:23.591255 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:23.591212 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-448ds\" (UniqueName: \"kubernetes.io/projected/7e56b5da-f692-44c8-8ee1-b3277c8d9f23-kube-api-access-448ds\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:29:24.163972 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:24.163937 2556 generic.go:356] "Generic (PLEG): container finished" podID="7e56b5da-f692-44c8-8ee1-b3277c8d9f23" containerID="199823808f8b8c7aaf2c058770a4648ecc5df0a33a2354afabf4f2b62fda6978" exitCode=0 Jul 08 17:29:24.164130 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:24.163983 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wmwjn" event={"ID":"7e56b5da-f692-44c8-8ee1-b3277c8d9f23","Type":"ContainerDied","Data":"199823808f8b8c7aaf2c058770a4648ecc5df0a33a2354afabf4f2b62fda6978"} Jul 08 17:29:24.164130 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:24.164015 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wmwjn" event={"ID":"7e56b5da-f692-44c8-8ee1-b3277c8d9f23","Type":"ContainerDied","Data":"1a1784baed654d3380adaf4a0367c6472094fd42fbfe32b5f4f6a56343942a6a"} Jul 08 17:29:24.164130 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:24.164024 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wmwjn" Jul 08 17:29:24.164130 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:24.164036 2556 scope.go:117] "RemoveContainer" containerID="199823808f8b8c7aaf2c058770a4648ecc5df0a33a2354afabf4f2b62fda6978" Jul 08 17:29:24.172669 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:24.172653 2556 scope.go:117] "RemoveContainer" containerID="199823808f8b8c7aaf2c058770a4648ecc5df0a33a2354afabf4f2b62fda6978" Jul 08 17:29:24.172921 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:29:24.172891 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"199823808f8b8c7aaf2c058770a4648ecc5df0a33a2354afabf4f2b62fda6978\": container with ID starting with 199823808f8b8c7aaf2c058770a4648ecc5df0a33a2354afabf4f2b62fda6978 not found: ID does not exist" containerID="199823808f8b8c7aaf2c058770a4648ecc5df0a33a2354afabf4f2b62fda6978" Jul 08 17:29:24.173042 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:24.172931 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"199823808f8b8c7aaf2c058770a4648ecc5df0a33a2354afabf4f2b62fda6978"} err="failed to get container status \"199823808f8b8c7aaf2c058770a4648ecc5df0a33a2354afabf4f2b62fda6978\": rpc error: code = NotFound desc = could not find container \"199823808f8b8c7aaf2c058770a4648ecc5df0a33a2354afabf4f2b62fda6978\": container with ID starting with 199823808f8b8c7aaf2c058770a4648ecc5df0a33a2354afabf4f2b62fda6978 not found: ID does not exist" Jul 08 17:29:24.179159 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:24.179126 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wmwjn"] Jul 08 17:29:24.183526 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:24.183502 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-wmwjn"] Jul 08 17:29:26.111732 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:29:26.111697 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e56b5da-f692-44c8-8ee1-b3277c8d9f23" path="/var/lib/kubelet/pods/7e56b5da-f692-44c8-8ee1-b3277c8d9f23/volumes" Jul 08 17:30:31.163462 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:31.163419 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-rdz5z"] Jul 08 17:30:31.163971 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:31.163798 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e56b5da-f692-44c8-8ee1-b3277c8d9f23" containerName="authorino" Jul 08 17:30:31.163971 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:31.163809 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e56b5da-f692-44c8-8ee1-b3277c8d9f23" containerName="authorino" Jul 08 17:30:31.163971 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:31.163886 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e56b5da-f692-44c8-8ee1-b3277c8d9f23" containerName="authorino" Jul 08 17:30:31.166866 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:31.166846 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-rdz5z" Jul 08 17:30:31.169267 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:31.169246 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-wnj5q\"" Jul 08 17:30:31.169398 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:31.169249 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 08 17:30:31.175223 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:31.175195 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-rdz5z"] Jul 08 17:30:31.212804 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:31.212762 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e0c622e-a441-40d2-8874-224955b428b4-plugins-config-volume\") pod \"payload-pre-processing-7964457696-rdz5z\" (UID: \"0e0c622e-a441-40d2-8874-224955b428b4\") " pod="openshift-ingress/payload-pre-processing-7964457696-rdz5z" Jul 08 17:30:31.213015 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:31.212875 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w29ln\" (UniqueName: \"kubernetes.io/projected/0e0c622e-a441-40d2-8874-224955b428b4-kube-api-access-w29ln\") pod \"payload-pre-processing-7964457696-rdz5z\" (UID: \"0e0c622e-a441-40d2-8874-224955b428b4\") " pod="openshift-ingress/payload-pre-processing-7964457696-rdz5z" Jul 08 17:30:31.314077 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:31.314028 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w29ln\" (UniqueName: \"kubernetes.io/projected/0e0c622e-a441-40d2-8874-224955b428b4-kube-api-access-w29ln\") pod \"payload-pre-processing-7964457696-rdz5z\" (UID: \"0e0c622e-a441-40d2-8874-224955b428b4\") " pod="openshift-ingress/payload-pre-processing-7964457696-rdz5z" Jul 08 17:30:31.314256 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:31.314100 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e0c622e-a441-40d2-8874-224955b428b4-plugins-config-volume\") pod \"payload-pre-processing-7964457696-rdz5z\" (UID: \"0e0c622e-a441-40d2-8874-224955b428b4\") " pod="openshift-ingress/payload-pre-processing-7964457696-rdz5z" Jul 08 17:30:31.314852 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:31.314831 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e0c622e-a441-40d2-8874-224955b428b4-plugins-config-volume\") pod \"payload-pre-processing-7964457696-rdz5z\" (UID: \"0e0c622e-a441-40d2-8874-224955b428b4\") " pod="openshift-ingress/payload-pre-processing-7964457696-rdz5z" Jul 08 17:30:31.322160 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:31.322131 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w29ln\" (UniqueName: \"kubernetes.io/projected/0e0c622e-a441-40d2-8874-224955b428b4-kube-api-access-w29ln\") pod \"payload-pre-processing-7964457696-rdz5z\" (UID: \"0e0c622e-a441-40d2-8874-224955b428b4\") " pod="openshift-ingress/payload-pre-processing-7964457696-rdz5z" Jul 08 17:30:31.478402 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:31.478311 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-rdz5z" Jul 08 17:30:31.626788 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:31.626751 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-rdz5z"] Jul 08 17:30:31.630568 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:30:31.630535 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e0c622e_a441_40d2_8874_224955b428b4.slice/crio-b678618993739201d41da41e8e77c91ba4b1d307e0029b8cb7bd6c8bef691cc8 WatchSource:0}: Error finding container b678618993739201d41da41e8e77c91ba4b1d307e0029b8cb7bd6c8bef691cc8: Status 404 returned error can't find the container with id b678618993739201d41da41e8e77c91ba4b1d307e0029b8cb7bd6c8bef691cc8 Jul 08 17:30:32.514302 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:32.514262 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-rdz5z" event={"ID":"0e0c622e-a441-40d2-8874-224955b428b4","Type":"ContainerStarted","Data":"b678618993739201d41da41e8e77c91ba4b1d307e0029b8cb7bd6c8bef691cc8"} Jul 08 17:30:33.520686 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:33.520601 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-rdz5z" event={"ID":"0e0c622e-a441-40d2-8874-224955b428b4","Type":"ContainerStarted","Data":"484b31296d0010754c8f04733c2fc29f9d9b73d214418dd691a86121608a0614"} Jul 08 17:30:33.521095 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:33.520729 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-rdz5z" Jul 08 17:30:33.540710 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:33.540547 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-rdz5z" podStartSLOduration=0.963129243 podStartE2EDuration="2.54052685s" totalImagesPullingTime="1.577397607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:30:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:30:33.539272031 +0000 UTC m=+845.950087422" watchObservedRunningTime="2026-07-08 17:30:33.54052685 +0000 UTC m=+845.951342228" Jul 08 17:30:39.552852 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:39.552814 2556 generic.go:356] "Generic (PLEG): container finished" podID="9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7" containerID="d813013b1a2f97254153a467ec496569ebcb4685f6619203c67440e9f1095490" exitCode=0 Jul 08 17:30:39.553325 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:39.552891 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" event={"ID":"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7","Type":"ContainerDied","Data":"d813013b1a2f97254153a467ec496569ebcb4685f6619203c67440e9f1095490"} Jul 08 17:30:39.553325 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:39.553305 2556 scope.go:117] "RemoveContainer" containerID="d813013b1a2f97254153a467ec496569ebcb4685f6619203c67440e9f1095490" Jul 08 17:30:39.554301 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:39.554272 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:30:39.554416 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:39.554347 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:30:39.554416 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:39.554381 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:30:40.559663 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:40.559625 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" event={"ID":"9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7","Type":"ContainerStarted","Data":"6ba685c1378b6397d2fd0b3da0df1f0ca4a18bc4c241a6114abf8787b1081a57"} Jul 08 17:30:41.253841 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:41.253800 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:30:41.254089 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:41.254068 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-54k9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 08 17:30:41.254150 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:41.254130 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" podUID="9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 08 17:30:42.253442 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:42.253399 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-54k9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 08 17:30:42.253856 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:42.253470 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" podUID="9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 08 17:30:43.253337 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:43.253293 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-54k9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 08 17:30:43.253537 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:43.253358 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" podUID="9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 08 17:30:44.253777 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:44.253733 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-54k9j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 08 17:30:44.254199 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:44.253801 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" podUID="9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 08 17:30:44.528057 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:44.527972 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-rdz5z" Jul 08 17:30:45.257536 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:45.257503 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:30:45.257897 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:45.257786 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:30:45.258443 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:45.258428 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-54k9j" Jul 08 17:30:52.958101 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:52.958064 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw"] Jul 08 17:30:52.961275 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:52.961255 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw" Jul 08 17:30:52.964038 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:52.964005 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mzzmx\"" Jul 08 17:30:52.964038 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:52.964012 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 08 17:30:52.964711 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:52.964696 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 08 17:30:52.964779 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:52.964761 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 08 17:30:52.975147 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:52.975120 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw"] Jul 08 17:30:53.124324 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:53.124283 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56b89306-7e7c-4f1e-b5bf-44bbf7f02218-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw\" (UID: \"56b89306-7e7c-4f1e-b5bf-44bbf7f02218\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw" Jul 08 17:30:53.124324 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:53.124319 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56b89306-7e7c-4f1e-b5bf-44bbf7f02218-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw\" (UID: \"56b89306-7e7c-4f1e-b5bf-44bbf7f02218\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw" Jul 08 17:30:53.124543 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:53.124349 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srhzx\" (UniqueName: \"kubernetes.io/projected/56b89306-7e7c-4f1e-b5bf-44bbf7f02218-kube-api-access-srhzx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw\" (UID: \"56b89306-7e7c-4f1e-b5bf-44bbf7f02218\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw" Jul 08 17:30:53.124543 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:53.124378 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56b89306-7e7c-4f1e-b5bf-44bbf7f02218-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw\" (UID: \"56b89306-7e7c-4f1e-b5bf-44bbf7f02218\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw" Jul 08 17:30:53.124543 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:53.124425 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56b89306-7e7c-4f1e-b5bf-44bbf7f02218-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw\" (UID: \"56b89306-7e7c-4f1e-b5bf-44bbf7f02218\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw" Jul 08 17:30:53.124543 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:53.124450 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56b89306-7e7c-4f1e-b5bf-44bbf7f02218-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw\" (UID: \"56b89306-7e7c-4f1e-b5bf-44bbf7f02218\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw" Jul 08 17:30:53.225411 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:53.225306 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56b89306-7e7c-4f1e-b5bf-44bbf7f02218-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw\" (UID: \"56b89306-7e7c-4f1e-b5bf-44bbf7f02218\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw" Jul 08 17:30:53.225411 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:53.225351 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56b89306-7e7c-4f1e-b5bf-44bbf7f02218-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw\" (UID: \"56b89306-7e7c-4f1e-b5bf-44bbf7f02218\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw" Jul 08 17:30:53.225411 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:53.225394 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srhzx\" (UniqueName: \"kubernetes.io/projected/56b89306-7e7c-4f1e-b5bf-44bbf7f02218-kube-api-access-srhzx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw\" (UID: \"56b89306-7e7c-4f1e-b5bf-44bbf7f02218\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw" Jul 08 17:30:53.225671 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:53.225432 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56b89306-7e7c-4f1e-b5bf-44bbf7f02218-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw\" (UID: \"56b89306-7e7c-4f1e-b5bf-44bbf7f02218\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw" Jul 08 17:30:53.225671 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:53.225465 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56b89306-7e7c-4f1e-b5bf-44bbf7f02218-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw\" (UID: \"56b89306-7e7c-4f1e-b5bf-44bbf7f02218\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw" Jul 08 17:30:53.225671 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:53.225489 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56b89306-7e7c-4f1e-b5bf-44bbf7f02218-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw\" (UID: \"56b89306-7e7c-4f1e-b5bf-44bbf7f02218\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw" Jul 08 17:30:53.225836 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:53.225818 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/56b89306-7e7c-4f1e-b5bf-44bbf7f02218-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw\" (UID: \"56b89306-7e7c-4f1e-b5bf-44bbf7f02218\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw" Jul 08 17:30:53.225940 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:53.225888 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56b89306-7e7c-4f1e-b5bf-44bbf7f02218-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw\" (UID: \"56b89306-7e7c-4f1e-b5bf-44bbf7f02218\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw" Jul 08 17:30:53.226011 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:53.225937 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/56b89306-7e7c-4f1e-b5bf-44bbf7f02218-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw\" (UID: \"56b89306-7e7c-4f1e-b5bf-44bbf7f02218\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw" Jul 08 17:30:53.227657 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:53.227627 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/56b89306-7e7c-4f1e-b5bf-44bbf7f02218-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw\" (UID: \"56b89306-7e7c-4f1e-b5bf-44bbf7f02218\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw" Jul 08 17:30:53.227905 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:53.227888 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56b89306-7e7c-4f1e-b5bf-44bbf7f02218-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw\" (UID: \"56b89306-7e7c-4f1e-b5bf-44bbf7f02218\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw" Jul 08 17:30:53.233857 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:53.233822 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srhzx\" (UniqueName: \"kubernetes.io/projected/56b89306-7e7c-4f1e-b5bf-44bbf7f02218-kube-api-access-srhzx\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw\" (UID: \"56b89306-7e7c-4f1e-b5bf-44bbf7f02218\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw" Jul 08 17:30:53.271700 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:53.271665 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw" Jul 08 17:30:53.414664 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:53.414476 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw"] Jul 08 17:30:53.417169 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:30:53.417140 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56b89306_7e7c_4f1e_b5bf_44bbf7f02218.slice/crio-75e9c1216e41ce57b1837a0fec8ccb022c7466f5adfa0439c61174f444b581fb WatchSource:0}: Error finding container 75e9c1216e41ce57b1837a0fec8ccb022c7466f5adfa0439c61174f444b581fb: Status 404 returned error can't find the container with id 75e9c1216e41ce57b1837a0fec8ccb022c7466f5adfa0439c61174f444b581fb Jul 08 17:30:53.624701 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:53.624657 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw" event={"ID":"56b89306-7e7c-4f1e-b5bf-44bbf7f02218","Type":"ContainerStarted","Data":"75e9c1216e41ce57b1837a0fec8ccb022c7466f5adfa0439c61174f444b581fb"} Jul 08 17:30:54.632622 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:54.632585 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw" event={"ID":"56b89306-7e7c-4f1e-b5bf-44bbf7f02218","Type":"ContainerStarted","Data":"0955c7cc4d07310fdecc39db019c8e6bdb8bfaa636401db5406ba44d99f0ac3b"} Jul 08 17:30:54.653146 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:30:54.653089 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw" podStartSLOduration=1.509189015 podStartE2EDuration="2.653073449s" totalImagesPullingTime="1.143884434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:30:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:30:54.651435821 +0000 UTC m=+867.062251199" watchObservedRunningTime="2026-07-08 17:30:54.653073449 +0000 UTC m=+867.063888826" Jul 08 17:31:03.272614 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:03.272564 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw" Jul 08 17:31:03.273192 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:03.272679 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw" Jul 08 17:31:03.285375 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:03.285345 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw" Jul 08 17:31:03.689999 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:03.689968 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw" Jul 08 17:31:05.536776 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:05.536735 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5286j"] Jul 08 17:31:05.540641 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:05.540621 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5286j" Jul 08 17:31:05.543019 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:05.542997 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 08 17:31:05.550138 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:05.550113 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5286j"] Jul 08 17:31:05.740228 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:05.740183 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c89d5c2-c81f-4e63-960b-9eb14a4b62ff-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5286j\" (UID: \"4c89d5c2-c81f-4e63-960b-9eb14a4b62ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5286j" Jul 08 17:31:05.740228 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:05.740231 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c89d5c2-c81f-4e63-960b-9eb14a4b62ff-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5286j\" (UID: \"4c89d5c2-c81f-4e63-960b-9eb14a4b62ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5286j" Jul 08 17:31:05.740497 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:05.740305 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c89d5c2-c81f-4e63-960b-9eb14a4b62ff-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5286j\" (UID: \"4c89d5c2-c81f-4e63-960b-9eb14a4b62ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5286j" Jul 08 17:31:05.740497 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:05.740374 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c89d5c2-c81f-4e63-960b-9eb14a4b62ff-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5286j\" (UID: \"4c89d5c2-c81f-4e63-960b-9eb14a4b62ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5286j" Jul 08 17:31:05.740497 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:05.740400 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c89d5c2-c81f-4e63-960b-9eb14a4b62ff-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5286j\" (UID: \"4c89d5c2-c81f-4e63-960b-9eb14a4b62ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5286j" Jul 08 17:31:05.740497 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:05.740427 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fvbt\" (UniqueName: \"kubernetes.io/projected/4c89d5c2-c81f-4e63-960b-9eb14a4b62ff-kube-api-access-8fvbt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5286j\" (UID: \"4c89d5c2-c81f-4e63-960b-9eb14a4b62ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5286j" Jul 08 17:31:05.841138 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:05.841101 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c89d5c2-c81f-4e63-960b-9eb14a4b62ff-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5286j\" (UID: \"4c89d5c2-c81f-4e63-960b-9eb14a4b62ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5286j" Jul 08 17:31:05.841300 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:05.841149 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c89d5c2-c81f-4e63-960b-9eb14a4b62ff-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5286j\" (UID: \"4c89d5c2-c81f-4e63-960b-9eb14a4b62ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5286j" Jul 08 17:31:05.841300 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:05.841187 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c89d5c2-c81f-4e63-960b-9eb14a4b62ff-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5286j\" (UID: \"4c89d5c2-c81f-4e63-960b-9eb14a4b62ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5286j" Jul 08 17:31:05.841300 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:05.841240 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c89d5c2-c81f-4e63-960b-9eb14a4b62ff-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5286j\" (UID: \"4c89d5c2-c81f-4e63-960b-9eb14a4b62ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5286j" Jul 08 17:31:05.841300 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:05.841266 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c89d5c2-c81f-4e63-960b-9eb14a4b62ff-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5286j\" (UID: \"4c89d5c2-c81f-4e63-960b-9eb14a4b62ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5286j" Jul 08 17:31:05.841300 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:05.841296 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fvbt\" (UniqueName: \"kubernetes.io/projected/4c89d5c2-c81f-4e63-960b-9eb14a4b62ff-kube-api-access-8fvbt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5286j\" (UID: \"4c89d5c2-c81f-4e63-960b-9eb14a4b62ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5286j" Jul 08 17:31:05.841666 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:05.841625 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c89d5c2-c81f-4e63-960b-9eb14a4b62ff-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5286j\" (UID: \"4c89d5c2-c81f-4e63-960b-9eb14a4b62ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5286j" Jul 08 17:31:05.841666 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:05.841647 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c89d5c2-c81f-4e63-960b-9eb14a4b62ff-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5286j\" (UID: \"4c89d5c2-c81f-4e63-960b-9eb14a4b62ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5286j" Jul 08 17:31:05.841842 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:05.841685 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c89d5c2-c81f-4e63-960b-9eb14a4b62ff-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5286j\" (UID: \"4c89d5c2-c81f-4e63-960b-9eb14a4b62ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5286j" Jul 08 17:31:05.843385 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:05.843359 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c89d5c2-c81f-4e63-960b-9eb14a4b62ff-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5286j\" (UID: \"4c89d5c2-c81f-4e63-960b-9eb14a4b62ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5286j" Jul 08 17:31:05.843681 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:05.843662 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c89d5c2-c81f-4e63-960b-9eb14a4b62ff-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5286j\" (UID: \"4c89d5c2-c81f-4e63-960b-9eb14a4b62ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5286j" Jul 08 17:31:05.849104 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:05.849086 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fvbt\" (UniqueName: \"kubernetes.io/projected/4c89d5c2-c81f-4e63-960b-9eb14a4b62ff-kube-api-access-8fvbt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5286j\" (UID: \"4c89d5c2-c81f-4e63-960b-9eb14a4b62ff\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5286j" Jul 08 17:31:05.851899 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:05.851883 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5286j" Jul 08 17:31:05.993798 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:05.993770 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5286j"] Jul 08 17:31:05.996666 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:31:05.996636 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c89d5c2_c81f_4e63_960b_9eb14a4b62ff.slice/crio-97e3dfe4f77a31be70009459aa85a08a98acfc7307c7d7e1a1d363619090f1f2 WatchSource:0}: Error finding container 97e3dfe4f77a31be70009459aa85a08a98acfc7307c7d7e1a1d363619090f1f2: Status 404 returned error can't find the container with id 97e3dfe4f77a31be70009459aa85a08a98acfc7307c7d7e1a1d363619090f1f2 Jul 08 17:31:06.695572 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:06.695538 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5286j" event={"ID":"4c89d5c2-c81f-4e63-960b-9eb14a4b62ff","Type":"ContainerStarted","Data":"c920e5f1ccc1fd344968c993d0793edfdeafb4522154fc623c45d06ea6e1eb28"} Jul 08 17:31:06.695997 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:06.695588 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5286j" event={"ID":"4c89d5c2-c81f-4e63-960b-9eb14a4b62ff","Type":"ContainerStarted","Data":"97e3dfe4f77a31be70009459aa85a08a98acfc7307c7d7e1a1d363619090f1f2"} Jul 08 17:31:06.722569 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:06.722501 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5286j" podStartSLOduration=1.523071437 podStartE2EDuration="1.722483223s" totalImagesPullingTime="199.411786ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:31:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:31:06.721123304 +0000 UTC m=+879.131938696" watchObservedRunningTime="2026-07-08 17:31:06.722483223 +0000 UTC m=+879.133298599" Jul 08 17:31:14.021290 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:14.021252 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w"] Jul 08 17:31:14.026820 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:14.026797 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w" Jul 08 17:31:14.030153 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:14.030128 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 08 17:31:14.035467 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:14.035435 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w"] Jul 08 17:31:14.208957 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:14.208885 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b29e0a43-3da7-4bca-b580-60f37576c2b3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w\" (UID: \"b29e0a43-3da7-4bca-b580-60f37576c2b3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w" Jul 08 17:31:14.209120 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:14.208992 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b29e0a43-3da7-4bca-b580-60f37576c2b3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w\" (UID: \"b29e0a43-3da7-4bca-b580-60f37576c2b3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w" Jul 08 17:31:14.209120 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:14.209066 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b29e0a43-3da7-4bca-b580-60f37576c2b3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w\" (UID: \"b29e0a43-3da7-4bca-b580-60f37576c2b3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w" Jul 08 17:31:14.209231 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:14.209155 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb2sx\" (UniqueName: \"kubernetes.io/projected/b29e0a43-3da7-4bca-b580-60f37576c2b3-kube-api-access-bb2sx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w\" (UID: \"b29e0a43-3da7-4bca-b580-60f37576c2b3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w" Jul 08 17:31:14.209231 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:14.209201 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b29e0a43-3da7-4bca-b580-60f37576c2b3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w\" (UID: \"b29e0a43-3da7-4bca-b580-60f37576c2b3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w" Jul 08 17:31:14.209316 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:14.209238 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b29e0a43-3da7-4bca-b580-60f37576c2b3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w\" (UID: \"b29e0a43-3da7-4bca-b580-60f37576c2b3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w" Jul 08 17:31:14.309975 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:14.309852 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b29e0a43-3da7-4bca-b580-60f37576c2b3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w\" (UID: \"b29e0a43-3da7-4bca-b580-60f37576c2b3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w" Jul 08 17:31:14.310153 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:14.309979 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb2sx\" (UniqueName: \"kubernetes.io/projected/b29e0a43-3da7-4bca-b580-60f37576c2b3-kube-api-access-bb2sx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w\" (UID: \"b29e0a43-3da7-4bca-b580-60f37576c2b3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w" Jul 08 17:31:14.310153 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:14.310013 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b29e0a43-3da7-4bca-b580-60f37576c2b3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w\" (UID: \"b29e0a43-3da7-4bca-b580-60f37576c2b3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w" Jul 08 17:31:14.310153 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:14.310044 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b29e0a43-3da7-4bca-b580-60f37576c2b3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w\" (UID: \"b29e0a43-3da7-4bca-b580-60f37576c2b3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w" Jul 08 17:31:14.310153 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:14.310088 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b29e0a43-3da7-4bca-b580-60f37576c2b3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w\" (UID: \"b29e0a43-3da7-4bca-b580-60f37576c2b3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w" Jul 08 17:31:14.310442 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:14.310209 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b29e0a43-3da7-4bca-b580-60f37576c2b3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w\" (UID: \"b29e0a43-3da7-4bca-b580-60f37576c2b3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w" Jul 08 17:31:14.310442 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:14.310256 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b29e0a43-3da7-4bca-b580-60f37576c2b3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w\" (UID: \"b29e0a43-3da7-4bca-b580-60f37576c2b3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w" Jul 08 17:31:14.310442 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:14.310346 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b29e0a43-3da7-4bca-b580-60f37576c2b3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w\" (UID: \"b29e0a43-3da7-4bca-b580-60f37576c2b3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w" Jul 08 17:31:14.310442 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:14.310396 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b29e0a43-3da7-4bca-b580-60f37576c2b3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w\" (UID: \"b29e0a43-3da7-4bca-b580-60f37576c2b3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w" Jul 08 17:31:14.312334 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:14.312312 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b29e0a43-3da7-4bca-b580-60f37576c2b3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w\" (UID: \"b29e0a43-3da7-4bca-b580-60f37576c2b3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w" Jul 08 17:31:14.312642 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:14.312624 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b29e0a43-3da7-4bca-b580-60f37576c2b3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w\" (UID: \"b29e0a43-3da7-4bca-b580-60f37576c2b3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w" Jul 08 17:31:14.318074 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:14.318046 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb2sx\" (UniqueName: \"kubernetes.io/projected/b29e0a43-3da7-4bca-b580-60f37576c2b3-kube-api-access-bb2sx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w\" (UID: \"b29e0a43-3da7-4bca-b580-60f37576c2b3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w" Jul 08 17:31:14.366116 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:14.366072 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w" Jul 08 17:31:14.503234 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:14.503202 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w"] Jul 08 17:31:14.505624 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:31:14.505596 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb29e0a43_3da7_4bca_b580_60f37576c2b3.slice/crio-1e2a37791b39472408f54e26a6538bcfef104ce87b9fc72d393f2f3aa015e159 WatchSource:0}: Error finding container 1e2a37791b39472408f54e26a6538bcfef104ce87b9fc72d393f2f3aa015e159: Status 404 returned error can't find the container with id 1e2a37791b39472408f54e26a6538bcfef104ce87b9fc72d393f2f3aa015e159 Jul 08 17:31:14.740088 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:14.740054 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w" event={"ID":"b29e0a43-3da7-4bca-b580-60f37576c2b3","Type":"ContainerStarted","Data":"1e2a37791b39472408f54e26a6538bcfef104ce87b9fc72d393f2f3aa015e159"} Jul 08 17:31:15.746077 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:15.746042 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w" event={"ID":"b29e0a43-3da7-4bca-b580-60f37576c2b3","Type":"ContainerStarted","Data":"c165d70747de696c64dae29d7c977e3bae5e85e191b7fd573738f812f31ea92e"} Jul 08 17:31:15.763646 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:15.763587 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w" podStartSLOduration=1.578036773 podStartE2EDuration="1.763572062s" totalImagesPullingTime="185.535289ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:31:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:31:15.761181408 +0000 UTC m=+888.171996786" watchObservedRunningTime="2026-07-08 17:31:15.763572062 +0000 UTC m=+888.174387439" Jul 08 17:31:15.852299 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:15.852258 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5286j" Jul 08 17:31:15.852500 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:15.852341 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5286j" Jul 08 17:31:15.864919 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:15.864883 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5286j" Jul 08 17:31:16.762419 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:16.762391 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5286j" Jul 08 17:31:24.367265 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:24.367179 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w" Jul 08 17:31:24.367265 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:24.367265 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w" Jul 08 17:31:24.379609 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:24.379584 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w" Jul 08 17:31:24.804023 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:24.803943 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w" Jul 08 17:31:28.263889 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:28.263861 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gsn8l_c2541cd3-af4f-4de5-b042-3611d02a80ab/console-operator/1.log" Jul 08 17:31:28.267026 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:31:28.267001 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gsn8l_c2541cd3-af4f-4de5-b042-3611d02a80ab/console-operator/1.log" Jul 08 17:36:28.295011 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:36:28.294974 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gsn8l_c2541cd3-af4f-4de5-b042-3611d02a80ab/console-operator/1.log" Jul 08 17:36:28.297956 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:36:28.297935 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gsn8l_c2541cd3-af4f-4de5-b042-3611d02a80ab/console-operator/1.log" Jul 08 17:39:12.636747 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:39:12.636678 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56mfv"] Jul 08 17:39:12.637460 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:39:12.637079 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56mfv" podUID="2c43396b-51b4-4641-8805-32f18d421ca7" containerName="manager" containerID="cri-o://08900fa1ee836745a4202c36c305dad04a8539bfd905a10f2b9208cc9cc01841" gracePeriod=10 Jul 08 17:39:17.102451 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:39:17.102423 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56mfv" Jul 08 17:39:17.226063 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:39:17.225965 2556 generic.go:356] "Generic (PLEG): container finished" podID="2c43396b-51b4-4641-8805-32f18d421ca7" containerID="08900fa1ee836745a4202c36c305dad04a8539bfd905a10f2b9208cc9cc01841" exitCode=0 Jul 08 17:39:17.226063 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:39:17.226011 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56mfv" Jul 08 17:39:17.226063 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:39:17.226034 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56mfv" event={"ID":"2c43396b-51b4-4641-8805-32f18d421ca7","Type":"ContainerDied","Data":"08900fa1ee836745a4202c36c305dad04a8539bfd905a10f2b9208cc9cc01841"} Jul 08 17:39:17.226302 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:39:17.226085 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56mfv" event={"ID":"2c43396b-51b4-4641-8805-32f18d421ca7","Type":"ContainerDied","Data":"2b86b400850250f20fc16f1001363ae4fb81f56b8214ca9f0272f78b7db8f7f9"} Jul 08 17:39:17.226302 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:39:17.226107 2556 scope.go:117] "RemoveContainer" containerID="08900fa1ee836745a4202c36c305dad04a8539bfd905a10f2b9208cc9cc01841" Jul 08 17:39:17.236298 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:39:17.236278 2556 scope.go:117] "RemoveContainer" containerID="08900fa1ee836745a4202c36c305dad04a8539bfd905a10f2b9208cc9cc01841" Jul 08 17:39:17.236588 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:39:17.236569 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08900fa1ee836745a4202c36c305dad04a8539bfd905a10f2b9208cc9cc01841\": container with ID starting with 08900fa1ee836745a4202c36c305dad04a8539bfd905a10f2b9208cc9cc01841 not found: ID does not exist" containerID="08900fa1ee836745a4202c36c305dad04a8539bfd905a10f2b9208cc9cc01841" Jul 08 17:39:17.236646 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:39:17.236604 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08900fa1ee836745a4202c36c305dad04a8539bfd905a10f2b9208cc9cc01841"} err="failed to get container status \"08900fa1ee836745a4202c36c305dad04a8539bfd905a10f2b9208cc9cc01841\": rpc error: code = NotFound desc = could not find container \"08900fa1ee836745a4202c36c305dad04a8539bfd905a10f2b9208cc9cc01841\": container with ID starting with 08900fa1ee836745a4202c36c305dad04a8539bfd905a10f2b9208cc9cc01841 not found: ID does not exist" Jul 08 17:39:17.257214 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:39:17.257175 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cq87\" (UniqueName: \"kubernetes.io/projected/2c43396b-51b4-4641-8805-32f18d421ca7-kube-api-access-4cq87\") pod \"2c43396b-51b4-4641-8805-32f18d421ca7\" (UID: \"2c43396b-51b4-4641-8805-32f18d421ca7\") " Jul 08 17:39:17.257405 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:39:17.257231 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c43396b-51b4-4641-8805-32f18d421ca7-extensions-socket-volume\") pod \"2c43396b-51b4-4641-8805-32f18d421ca7\" (UID: \"2c43396b-51b4-4641-8805-32f18d421ca7\") " Jul 08 17:39:17.257651 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:39:17.257625 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c43396b-51b4-4641-8805-32f18d421ca7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2c43396b-51b4-4641-8805-32f18d421ca7" (UID: "2c43396b-51b4-4641-8805-32f18d421ca7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:39:17.259455 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:39:17.259423 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c43396b-51b4-4641-8805-32f18d421ca7-kube-api-access-4cq87" (OuterVolumeSpecName: "kube-api-access-4cq87") pod "2c43396b-51b4-4641-8805-32f18d421ca7" (UID: "2c43396b-51b4-4641-8805-32f18d421ca7"). InnerVolumeSpecName "kube-api-access-4cq87". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:39:17.358022 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:39:17.357984 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cq87\" (UniqueName: \"kubernetes.io/projected/2c43396b-51b4-4641-8805-32f18d421ca7-kube-api-access-4cq87\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:39:17.358022 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:39:17.358019 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c43396b-51b4-4641-8805-32f18d421ca7-extensions-socket-volume\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:39:17.549714 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:39:17.549681 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56mfv"] Jul 08 17:39:17.553568 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:39:17.553539 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-56mfv"] Jul 08 17:39:18.112334 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:39:18.112297 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c43396b-51b4-4641-8805-32f18d421ca7" path="/var/lib/kubelet/pods/2c43396b-51b4-4641-8805-32f18d421ca7/volumes" Jul 08 17:40:13.892523 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:40:13.892483 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frkz8"] Jul 08 17:40:13.893050 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:40:13.892878 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c43396b-51b4-4641-8805-32f18d421ca7" containerName="manager" Jul 08 17:40:13.893050 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:40:13.892889 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c43396b-51b4-4641-8805-32f18d421ca7" containerName="manager" Jul 08 17:40:13.893050 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:40:13.893026 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c43396b-51b4-4641-8805-32f18d421ca7" containerName="manager" Jul 08 17:40:13.896162 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:40:13.896145 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frkz8" Jul 08 17:40:13.903407 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:40:13.903383 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-psnw7\"" Jul 08 17:40:13.923439 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:40:13.923409 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frkz8"] Jul 08 17:40:13.981860 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:40:13.981816 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgvg2\" (UniqueName: \"kubernetes.io/projected/0456f6fb-ea29-442f-bba3-784bcf7591d7-kube-api-access-lgvg2\") pod \"kuadrant-operator-controller-manager-86878c769f-frkz8\" (UID: \"0456f6fb-ea29-442f-bba3-784bcf7591d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frkz8" Jul 08 17:40:13.982080 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:40:13.981944 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0456f6fb-ea29-442f-bba3-784bcf7591d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-frkz8\" (UID: \"0456f6fb-ea29-442f-bba3-784bcf7591d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frkz8" Jul 08 17:40:14.082449 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:40:14.082392 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgvg2\" (UniqueName: \"kubernetes.io/projected/0456f6fb-ea29-442f-bba3-784bcf7591d7-kube-api-access-lgvg2\") pod \"kuadrant-operator-controller-manager-86878c769f-frkz8\" (UID: \"0456f6fb-ea29-442f-bba3-784bcf7591d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frkz8" Jul 08 17:40:14.082634 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:40:14.082484 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0456f6fb-ea29-442f-bba3-784bcf7591d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-frkz8\" (UID: \"0456f6fb-ea29-442f-bba3-784bcf7591d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frkz8" Jul 08 17:40:14.082868 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:40:14.082851 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0456f6fb-ea29-442f-bba3-784bcf7591d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-frkz8\" (UID: \"0456f6fb-ea29-442f-bba3-784bcf7591d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frkz8" Jul 08 17:40:14.091506 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:40:14.091476 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgvg2\" (UniqueName: \"kubernetes.io/projected/0456f6fb-ea29-442f-bba3-784bcf7591d7-kube-api-access-lgvg2\") pod \"kuadrant-operator-controller-manager-86878c769f-frkz8\" (UID: \"0456f6fb-ea29-442f-bba3-784bcf7591d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frkz8" Jul 08 17:40:14.207058 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:40:14.206960 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frkz8" Jul 08 17:40:14.350752 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:40:14.350682 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frkz8"] Jul 08 17:40:14.353436 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:40:14.353411 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0456f6fb_ea29_442f_bba3_784bcf7591d7.slice/crio-6c6d08db6ff531e0c19001ce51757c57fe8438546939f8fa84570d7f63413bf3 WatchSource:0}: Error finding container 6c6d08db6ff531e0c19001ce51757c57fe8438546939f8fa84570d7f63413bf3: Status 404 returned error can't find the container with id 6c6d08db6ff531e0c19001ce51757c57fe8438546939f8fa84570d7f63413bf3 Jul 08 17:40:14.509642 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:40:14.509548 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frkz8" event={"ID":"0456f6fb-ea29-442f-bba3-784bcf7591d7","Type":"ContainerStarted","Data":"3a2d663d4150eef97febffdd01ee168afce7f432cf90d9b9bfd7b4565e9c0dc9"} Jul 08 17:40:14.509642 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:40:14.509604 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frkz8" event={"ID":"0456f6fb-ea29-442f-bba3-784bcf7591d7","Type":"ContainerStarted","Data":"6c6d08db6ff531e0c19001ce51757c57fe8438546939f8fa84570d7f63413bf3"} Jul 08 17:40:14.509642 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:40:14.509633 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frkz8" Jul 08 17:40:14.531015 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:40:14.530963 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frkz8" podStartSLOduration=1.5309476229999999 podStartE2EDuration="1.530947623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:40:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:40:14.52925083 +0000 UTC m=+1426.940066221" watchObservedRunningTime="2026-07-08 17:40:14.530947623 +0000 UTC m=+1426.941763000" Jul 08 17:40:25.516318 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:40:25.516234 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-frkz8" Jul 08 17:41:28.326288 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:41:28.326169 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gsn8l_c2541cd3-af4f-4de5-b042-3611d02a80ab/console-operator/1.log" Jul 08 17:41:28.330463 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:41:28.330439 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gsn8l_c2541cd3-af4f-4de5-b042-3611d02a80ab/console-operator/1.log" Jul 08 17:45:00.140235 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:45:00.140196 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725545-zgs5x"] Jul 08 17:45:00.144154 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:45:00.144129 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725545-zgs5x" Jul 08 17:45:00.146409 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:45:00.146374 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 08 17:45:00.146617 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:45:00.146595 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 08 17:45:00.147288 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:45:00.147272 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8btv6\"" Jul 08 17:45:00.158185 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:45:00.158157 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725545-zgs5x"] Jul 08 17:45:00.187942 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:45:00.187885 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpx5b\" (UniqueName: \"kubernetes.io/projected/13586c62-417e-4345-8f16-797d7bca40b2-kube-api-access-gpx5b\") pod \"maas-api-key-cleanup-29725545-zgs5x\" (UID: \"13586c62-417e-4345-8f16-797d7bca40b2\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725545-zgs5x" Jul 08 17:45:00.288984 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:45:00.288944 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpx5b\" (UniqueName: \"kubernetes.io/projected/13586c62-417e-4345-8f16-797d7bca40b2-kube-api-access-gpx5b\") pod \"maas-api-key-cleanup-29725545-zgs5x\" (UID: \"13586c62-417e-4345-8f16-797d7bca40b2\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725545-zgs5x" Jul 08 17:45:00.297993 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:45:00.297965 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpx5b\" (UniqueName: \"kubernetes.io/projected/13586c62-417e-4345-8f16-797d7bca40b2-kube-api-access-gpx5b\") pod \"maas-api-key-cleanup-29725545-zgs5x\" (UID: \"13586c62-417e-4345-8f16-797d7bca40b2\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725545-zgs5x" Jul 08 17:45:00.455486 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:45:00.455393 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725545-zgs5x" Jul 08 17:45:00.598119 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:45:00.598088 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725545-zgs5x"] Jul 08 17:45:00.601426 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:45:00.601391 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13586c62_417e_4345_8f16_797d7bca40b2.slice/crio-ee99dbdc4144fb39dc668af2f37e6cf23d9dddbda390f05eac9b2bf20e53f9ad WatchSource:0}: Error finding container ee99dbdc4144fb39dc668af2f37e6cf23d9dddbda390f05eac9b2bf20e53f9ad: Status 404 returned error can't find the container with id ee99dbdc4144fb39dc668af2f37e6cf23d9dddbda390f05eac9b2bf20e53f9ad Jul 08 17:45:00.603783 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:45:00.603760 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 17:45:00.979730 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:45:00.979694 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725545-zgs5x" event={"ID":"13586c62-417e-4345-8f16-797d7bca40b2","Type":"ContainerStarted","Data":"ee99dbdc4144fb39dc668af2f37e6cf23d9dddbda390f05eac9b2bf20e53f9ad"} Jul 08 17:45:03.998946 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:45:03.998883 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725545-zgs5x" event={"ID":"13586c62-417e-4345-8f16-797d7bca40b2","Type":"ContainerStarted","Data":"0b4d3de770071822aab1dc517c4e112cdf6715d187867fb7c7858d8ea68720dd"} Jul 08 17:45:04.016360 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:45:04.016304 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725545-zgs5x" podStartSLOduration=1.764558043 podStartE2EDuration="4.016283583s" totalImagesPullingTime="2.25172554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:45:04.014792484 +0000 UTC m=+1716.425607873" watchObservedRunningTime="2026-07-08 17:45:04.016283583 +0000 UTC m=+1716.427098960" Jul 08 17:46:00.011358 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:00.011318 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725545-zgs5x"] Jul 08 17:46:00.011958 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:00.011534 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725545-zgs5x" podUID="13586c62-417e-4345-8f16-797d7bca40b2" containerName="cleanup" containerID="cri-o://0b4d3de770071822aab1dc517c4e112cdf6715d187867fb7c7858d8ea68720dd" gracePeriod=30 Jul 08 17:46:28.357025 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:28.356996 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gsn8l_c2541cd3-af4f-4de5-b042-3611d02a80ab/console-operator/1.log" Jul 08 17:46:28.362154 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:28.362126 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gsn8l_c2541cd3-af4f-4de5-b042-3611d02a80ab/console-operator/1.log" Jul 08 17:46:30.203386 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:30.203359 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725545-zgs5x" Jul 08 17:46:30.343450 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:30.343418 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpx5b\" (UniqueName: \"kubernetes.io/projected/13586c62-417e-4345-8f16-797d7bca40b2-kube-api-access-gpx5b\") pod \"13586c62-417e-4345-8f16-797d7bca40b2\" (UID: \"13586c62-417e-4345-8f16-797d7bca40b2\") " Jul 08 17:46:30.345679 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:30.345649 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13586c62-417e-4345-8f16-797d7bca40b2-kube-api-access-gpx5b" (OuterVolumeSpecName: "kube-api-access-gpx5b") pod "13586c62-417e-4345-8f16-797d7bca40b2" (UID: "13586c62-417e-4345-8f16-797d7bca40b2"). InnerVolumeSpecName "kube-api-access-gpx5b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:46:30.444969 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:30.444936 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpx5b\" (UniqueName: \"kubernetes.io/projected/13586c62-417e-4345-8f16-797d7bca40b2-kube-api-access-gpx5b\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:46:30.464725 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:30.464685 2556 generic.go:356] "Generic (PLEG): container finished" podID="13586c62-417e-4345-8f16-797d7bca40b2" containerID="0b4d3de770071822aab1dc517c4e112cdf6715d187867fb7c7858d8ea68720dd" exitCode=137 Jul 08 17:46:30.464725 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:30.464724 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725545-zgs5x" Jul 08 17:46:30.464999 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:30.464774 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725545-zgs5x" event={"ID":"13586c62-417e-4345-8f16-797d7bca40b2","Type":"ContainerDied","Data":"0b4d3de770071822aab1dc517c4e112cdf6715d187867fb7c7858d8ea68720dd"} Jul 08 17:46:30.464999 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:30.464825 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725545-zgs5x" event={"ID":"13586c62-417e-4345-8f16-797d7bca40b2","Type":"ContainerDied","Data":"ee99dbdc4144fb39dc668af2f37e6cf23d9dddbda390f05eac9b2bf20e53f9ad"} Jul 08 17:46:30.464999 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:30.464851 2556 scope.go:117] "RemoveContainer" containerID="0b4d3de770071822aab1dc517c4e112cdf6715d187867fb7c7858d8ea68720dd" Jul 08 17:46:30.474546 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:30.474524 2556 scope.go:117] "RemoveContainer" containerID="0b4d3de770071822aab1dc517c4e112cdf6715d187867fb7c7858d8ea68720dd" Jul 08 17:46:30.474826 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:46:30.474807 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b4d3de770071822aab1dc517c4e112cdf6715d187867fb7c7858d8ea68720dd\": container with ID starting with 0b4d3de770071822aab1dc517c4e112cdf6715d187867fb7c7858d8ea68720dd not found: ID does not exist" containerID="0b4d3de770071822aab1dc517c4e112cdf6715d187867fb7c7858d8ea68720dd" Jul 08 17:46:30.474893 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:30.474834 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b4d3de770071822aab1dc517c4e112cdf6715d187867fb7c7858d8ea68720dd"} err="failed to get container status \"0b4d3de770071822aab1dc517c4e112cdf6715d187867fb7c7858d8ea68720dd\": rpc error: code = NotFound desc = could not find container \"0b4d3de770071822aab1dc517c4e112cdf6715d187867fb7c7858d8ea68720dd\": container with ID starting with 0b4d3de770071822aab1dc517c4e112cdf6715d187867fb7c7858d8ea68720dd not found: ID does not exist" Jul 08 17:46:30.487735 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:30.487705 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725545-zgs5x"] Jul 08 17:46:30.489733 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:30.489710 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725545-zgs5x"] Jul 08 17:46:31.679019 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.678971 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66"] Jul 08 17:46:31.679482 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.679396 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13586c62-417e-4345-8f16-797d7bca40b2" containerName="cleanup" Jul 08 17:46:31.679482 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.679407 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="13586c62-417e-4345-8f16-797d7bca40b2" containerName="cleanup" Jul 08 17:46:31.679482 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.679462 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="13586c62-417e-4345-8f16-797d7bca40b2" containerName="cleanup" Jul 08 17:46:31.684393 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.684315 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:31.688481 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.688451 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-068fee65-openshift-default-dockercfg-b7w8q\"" Jul 08 17:46:31.699324 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.699281 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66"] Jul 08 17:46:31.758021 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.757980 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istio-podinfo\") pod \"e2e-ait-068fee65-openshift-default-5db4697cbf-trb66\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:31.758021 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.758031 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istio-envoy\") pod \"e2e-ait-068fee65-openshift-default-5db4697cbf-trb66\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:31.758260 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.758066 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istio-data\") pod \"e2e-ait-068fee65-openshift-default-5db4697cbf-trb66\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:31.758260 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.758154 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-credential-socket\") pod \"e2e-ait-068fee65-openshift-default-5db4697cbf-trb66\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:31.758260 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.758190 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-workload-certs\") pod \"e2e-ait-068fee65-openshift-default-5db4697cbf-trb66\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:31.758260 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.758218 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istiod-ca-cert\") pod \"e2e-ait-068fee65-openshift-default-5db4697cbf-trb66\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:31.758409 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.758266 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-workload-socket\") pod \"e2e-ait-068fee65-openshift-default-5db4697cbf-trb66\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:31.758409 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.758318 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istio-token\") pod \"e2e-ait-068fee65-openshift-default-5db4697cbf-trb66\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:31.758409 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.758352 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpvq5\" (UniqueName: \"kubernetes.io/projected/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-kube-api-access-cpvq5\") pod \"e2e-ait-068fee65-openshift-default-5db4697cbf-trb66\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:31.859719 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.859673 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istiod-ca-cert\") pod \"e2e-ait-068fee65-openshift-default-5db4697cbf-trb66\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:31.859978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.859743 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-workload-socket\") pod \"e2e-ait-068fee65-openshift-default-5db4697cbf-trb66\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:31.859978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.859793 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istio-token\") pod \"e2e-ait-068fee65-openshift-default-5db4697cbf-trb66\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:31.859978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.859826 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpvq5\" (UniqueName: \"kubernetes.io/projected/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-kube-api-access-cpvq5\") pod \"e2e-ait-068fee65-openshift-default-5db4697cbf-trb66\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:31.859978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.859867 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istio-podinfo\") pod \"e2e-ait-068fee65-openshift-default-5db4697cbf-trb66\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:31.860233 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.859906 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istio-envoy\") pod \"e2e-ait-068fee65-openshift-default-5db4697cbf-trb66\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:31.860233 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.860059 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istio-data\") pod \"e2e-ait-068fee65-openshift-default-5db4697cbf-trb66\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:31.860233 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.860095 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-credential-socket\") pod \"e2e-ait-068fee65-openshift-default-5db4697cbf-trb66\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:31.860233 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.860129 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-workload-certs\") pod \"e2e-ait-068fee65-openshift-default-5db4697cbf-trb66\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:31.860449 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.860261 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-workload-socket\") pod \"e2e-ait-068fee65-openshift-default-5db4697cbf-trb66\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:31.860509 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.860476 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-workload-certs\") pod \"e2e-ait-068fee65-openshift-default-5db4697cbf-trb66\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:31.860562 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.860509 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istiod-ca-cert\") pod \"e2e-ait-068fee65-openshift-default-5db4697cbf-trb66\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:31.860562 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.860517 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istio-data\") pod \"e2e-ait-068fee65-openshift-default-5db4697cbf-trb66\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:31.860648 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.860583 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-credential-socket\") pod \"e2e-ait-068fee65-openshift-default-5db4697cbf-trb66\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:31.862354 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.862335 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istio-envoy\") pod \"e2e-ait-068fee65-openshift-default-5db4697cbf-trb66\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:31.862581 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.862563 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istio-podinfo\") pod \"e2e-ait-068fee65-openshift-default-5db4697cbf-trb66\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:31.868545 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.868518 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istio-token\") pod \"e2e-ait-068fee65-openshift-default-5db4697cbf-trb66\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:31.869364 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.869347 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpvq5\" (UniqueName: \"kubernetes.io/projected/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-kube-api-access-cpvq5\") pod \"e2e-ait-068fee65-openshift-default-5db4697cbf-trb66\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:31.995866 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:31.995770 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:32.114585 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:32.114537 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13586c62-417e-4345-8f16-797d7bca40b2" path="/var/lib/kubelet/pods/13586c62-417e-4345-8f16-797d7bca40b2/volumes" Jul 08 17:46:32.149152 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:32.149028 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66"] Jul 08 17:46:32.151446 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:46:32.151421 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccbd83d3_1f6f_4d01_83fc_aa24fae37e35.slice/crio-10b4b080746b2c535565b484448ba3631058316761ab9ae7bacb525a3b9569e6 WatchSource:0}: Error finding container 10b4b080746b2c535565b484448ba3631058316761ab9ae7bacb525a3b9569e6: Status 404 returned error can't find the container with id 10b4b080746b2c535565b484448ba3631058316761ab9ae7bacb525a3b9569e6 Jul 08 17:46:32.153727 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:32.153683 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:46:32.153800 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:32.153778 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:46:32.153839 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:32.153818 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:46:32.478899 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:32.478862 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" event={"ID":"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35","Type":"ContainerStarted","Data":"77d30b0491275e2c5d79987b91e6896a10c0f335a2418160bc0045bb6dff79b5"} Jul 08 17:46:32.479140 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:32.478943 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" event={"ID":"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35","Type":"ContainerStarted","Data":"10b4b080746b2c535565b484448ba3631058316761ab9ae7bacb525a3b9569e6"} Jul 08 17:46:32.500215 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:32.500160 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" podStartSLOduration=1.50014078 podStartE2EDuration="1.50014078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:46:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:46:32.497833177 +0000 UTC m=+1804.908648555" watchObservedRunningTime="2026-07-08 17:46:32.50014078 +0000 UTC m=+1804.910956157" Jul 08 17:46:32.996521 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:32.996489 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:34.001771 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:34.001736 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:34.490677 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:34.490640 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:34.491551 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:34.491528 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:38.186762 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:38.186723 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66"] Jul 08 17:46:38.187266 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:38.186982 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" podUID="ccbd83d3-1f6f-4d01-83fc-aa24fae37e35" containerName="istio-proxy" containerID="cri-o://77d30b0491275e2c5d79987b91e6896a10c0f335a2418160bc0045bb6dff79b5" gracePeriod=30 Jul 08 17:46:43.451481 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.451407 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:43.539262 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.539220 2556 generic.go:356] "Generic (PLEG): container finished" podID="ccbd83d3-1f6f-4d01-83fc-aa24fae37e35" containerID="77d30b0491275e2c5d79987b91e6896a10c0f335a2418160bc0045bb6dff79b5" exitCode=0 Jul 08 17:46:43.539438 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.539268 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" Jul 08 17:46:43.539438 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.539289 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" event={"ID":"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35","Type":"ContainerDied","Data":"77d30b0491275e2c5d79987b91e6896a10c0f335a2418160bc0045bb6dff79b5"} Jul 08 17:46:43.539438 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.539345 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66" event={"ID":"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35","Type":"ContainerDied","Data":"10b4b080746b2c535565b484448ba3631058316761ab9ae7bacb525a3b9569e6"} Jul 08 17:46:43.539438 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.539377 2556 scope.go:117] "RemoveContainer" containerID="77d30b0491275e2c5d79987b91e6896a10c0f335a2418160bc0045bb6dff79b5" Jul 08 17:46:43.550158 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.550048 2556 scope.go:117] "RemoveContainer" containerID="77d30b0491275e2c5d79987b91e6896a10c0f335a2418160bc0045bb6dff79b5" Jul 08 17:46:43.550565 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:46:43.550487 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77d30b0491275e2c5d79987b91e6896a10c0f335a2418160bc0045bb6dff79b5\": container with ID starting with 77d30b0491275e2c5d79987b91e6896a10c0f335a2418160bc0045bb6dff79b5 not found: ID does not exist" containerID="77d30b0491275e2c5d79987b91e6896a10c0f335a2418160bc0045bb6dff79b5" Jul 08 17:46:43.550565 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.550525 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77d30b0491275e2c5d79987b91e6896a10c0f335a2418160bc0045bb6dff79b5"} err="failed to get container status \"77d30b0491275e2c5d79987b91e6896a10c0f335a2418160bc0045bb6dff79b5\": rpc error: code = NotFound desc = could not find container \"77d30b0491275e2c5d79987b91e6896a10c0f335a2418160bc0045bb6dff79b5\": container with ID starting with 77d30b0491275e2c5d79987b91e6896a10c0f335a2418160bc0045bb6dff79b5 not found: ID does not exist" Jul 08 17:46:43.574304 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.574274 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istio-token\") pod \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " Jul 08 17:46:43.574454 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.574321 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-workload-certs\") pod \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " Jul 08 17:46:43.574454 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.574371 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpvq5\" (UniqueName: \"kubernetes.io/projected/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-kube-api-access-cpvq5\") pod \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " Jul 08 17:46:43.574454 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.574405 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-credential-socket\") pod \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " Jul 08 17:46:43.574454 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.574442 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istiod-ca-cert\") pod \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " Jul 08 17:46:43.574636 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.574467 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istio-podinfo\") pod \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " Jul 08 17:46:43.574636 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.574504 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istio-envoy\") pod \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " Jul 08 17:46:43.574636 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.574523 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istio-data\") pod \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " Jul 08 17:46:43.574636 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.574540 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-workload-socket\") pod \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\" (UID: \"ccbd83d3-1f6f-4d01-83fc-aa24fae37e35\") " Jul 08 17:46:43.576394 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.576215 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ccbd83d3-1f6f-4d01-83fc-aa24fae37e35" (UID: "ccbd83d3-1f6f-4d01-83fc-aa24fae37e35"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:46:43.576394 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.576242 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ccbd83d3-1f6f-4d01-83fc-aa24fae37e35" (UID: "ccbd83d3-1f6f-4d01-83fc-aa24fae37e35"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:46:43.576394 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.576306 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istio-data" (OuterVolumeSpecName: "istio-data") pod "ccbd83d3-1f6f-4d01-83fc-aa24fae37e35" (UID: "ccbd83d3-1f6f-4d01-83fc-aa24fae37e35"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:46:43.576628 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.576434 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ccbd83d3-1f6f-4d01-83fc-aa24fae37e35" (UID: "ccbd83d3-1f6f-4d01-83fc-aa24fae37e35"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:46:43.576628 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.576445 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ccbd83d3-1f6f-4d01-83fc-aa24fae37e35" (UID: "ccbd83d3-1f6f-4d01-83fc-aa24fae37e35"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:46:43.578175 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.578146 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ccbd83d3-1f6f-4d01-83fc-aa24fae37e35" (UID: "ccbd83d3-1f6f-4d01-83fc-aa24fae37e35"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:46:43.578350 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.578325 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ccbd83d3-1f6f-4d01-83fc-aa24fae37e35" (UID: "ccbd83d3-1f6f-4d01-83fc-aa24fae37e35"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 17:46:43.578437 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.578374 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-kube-api-access-cpvq5" (OuterVolumeSpecName: "kube-api-access-cpvq5") pod "ccbd83d3-1f6f-4d01-83fc-aa24fae37e35" (UID: "ccbd83d3-1f6f-4d01-83fc-aa24fae37e35"). InnerVolumeSpecName "kube-api-access-cpvq5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:46:43.578437 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.578395 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istio-token" (OuterVolumeSpecName: "istio-token") pod "ccbd83d3-1f6f-4d01-83fc-aa24fae37e35" (UID: "ccbd83d3-1f6f-4d01-83fc-aa24fae37e35"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:46:43.675571 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.675529 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-workload-certs\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:46:43.675571 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.675566 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpvq5\" (UniqueName: \"kubernetes.io/projected/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-kube-api-access-cpvq5\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:46:43.675571 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.675576 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-credential-socket\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:46:43.675816 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.675585 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istiod-ca-cert\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:46:43.675816 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.675594 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istio-podinfo\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:46:43.675816 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.675602 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istio-envoy\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:46:43.675816 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.675609 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istio-data\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:46:43.675816 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.675616 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-workload-socket\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:46:43.675816 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.675624 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35-istio-token\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:46:43.865815 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.865781 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66"] Jul 08 17:46:43.871869 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:43.871842 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-068fee65-openshift-default-5db4697cbf-trb66"] Jul 08 17:46:44.112836 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:44.112753 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccbd83d3-1f6f-4d01-83fc-aa24fae37e35" path="/var/lib/kubelet/pods/ccbd83d3-1f6f-4d01-83fc-aa24fae37e35/volumes" Jul 08 17:46:44.827009 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:44.826964 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n"] Jul 08 17:46:44.827620 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:44.827597 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccbd83d3-1f6f-4d01-83fc-aa24fae37e35" containerName="istio-proxy" Jul 08 17:46:44.827692 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:44.827623 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccbd83d3-1f6f-4d01-83fc-aa24fae37e35" containerName="istio-proxy" Jul 08 17:46:44.827796 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:44.827783 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccbd83d3-1f6f-4d01-83fc-aa24fae37e35" containerName="istio-proxy" Jul 08 17:46:44.832748 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:44.832724 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:44.837366 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:44.837332 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-7f7fa9dc-openshift-default-dockercfg-qjpk2\"" Jul 08 17:46:44.865118 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:44.865085 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n"] Jul 08 17:46:44.987520 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:44.987481 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istio-data\") pod \"e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:44.987718 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:44.987541 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrzrt\" (UniqueName: \"kubernetes.io/projected/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-kube-api-access-vrzrt\") pod \"e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:44.987718 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:44.987596 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istio-envoy\") pod \"e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:44.987718 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:44.987659 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istio-podinfo\") pod \"e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:44.987864 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:44.987752 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-credential-socket\") pod \"e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:44.987864 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:44.987790 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-workload-socket\") pod \"e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:44.987864 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:44.987820 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istio-token\") pod \"e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:44.987864 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:44.987852 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istiod-ca-cert\") pod \"e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:44.988020 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:44.987883 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-workload-certs\") pod \"e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:45.089210 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:45.089121 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrzrt\" (UniqueName: \"kubernetes.io/projected/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-kube-api-access-vrzrt\") pod \"e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:45.089210 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:45.089168 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istio-envoy\") pod \"e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:45.089446 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:45.089217 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istio-podinfo\") pod \"e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:45.089446 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:45.089301 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-credential-socket\") pod \"e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:45.089446 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:45.089338 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-workload-socket\") pod \"e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:45.089446 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:45.089364 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istio-token\") pod \"e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:45.089446 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:45.089410 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istiod-ca-cert\") pod \"e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:45.089760 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:45.089711 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-workload-certs\") pod \"e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:45.090160 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:45.090120 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istio-data\") pod \"e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:45.090298 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:45.089789 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-credential-socket\") pod \"e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:45.090298 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:45.090034 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-workload-certs\") pod \"e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:45.090298 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:45.089770 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-workload-socket\") pod \"e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:45.090298 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:45.090220 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istiod-ca-cert\") pod \"e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:45.090667 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:45.090411 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istio-data\") pod \"e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:45.091698 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:45.091674 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istio-envoy\") pod \"e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:45.091997 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:45.091980 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istio-podinfo\") pod \"e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:45.104261 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:45.104233 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istio-token\") pod \"e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:45.104410 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:45.104305 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrzrt\" (UniqueName: \"kubernetes.io/projected/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-kube-api-access-vrzrt\") pod \"e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:45.144560 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:45.144519 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:45.298499 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:45.298470 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n"] Jul 08 17:46:45.300291 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:46:45.300267 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bac03b9_8938_4ca4_8ce7_1acf3819cc7a.slice/crio-16683d4ed6e5e4667bd31ab2bf995c47af23e32fead6d14a1da4510b3c505afb WatchSource:0}: Error finding container 16683d4ed6e5e4667bd31ab2bf995c47af23e32fead6d14a1da4510b3c505afb: Status 404 returned error can't find the container with id 16683d4ed6e5e4667bd31ab2bf995c47af23e32fead6d14a1da4510b3c505afb Jul 08 17:46:45.302459 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:45.302425 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:46:45.302550 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:45.302496 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:46:45.302550 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:45.302528 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:46:45.552248 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:45.552208 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" event={"ID":"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a","Type":"ContainerStarted","Data":"7806e4a78a09736fb82d73ce614e1d7905c44013e3cd82d9c9a3ff0d7c7661dc"} Jul 08 17:46:45.552460 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:45.552317 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" event={"ID":"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a","Type":"ContainerStarted","Data":"16683d4ed6e5e4667bd31ab2bf995c47af23e32fead6d14a1da4510b3c505afb"} Jul 08 17:46:45.577136 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:45.577082 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" podStartSLOduration=1.5770641159999998 podStartE2EDuration="1.577064116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:46:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:46:45.575309657 +0000 UTC m=+1817.986125035" watchObservedRunningTime="2026-07-08 17:46:45.577064116 +0000 UTC m=+1817.987879492" Jul 08 17:46:46.145024 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:46.144987 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:46.150385 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:46.150357 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:46.557443 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:46.557355 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:46.558519 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:46.558496 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:46:56.617261 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:56.617227 2556 generic.go:356] "Generic (PLEG): container finished" podID="6bac03b9-8938-4ca4-8ce7-1acf3819cc7a" containerID="7806e4a78a09736fb82d73ce614e1d7905c44013e3cd82d9c9a3ff0d7c7661dc" exitCode=0 Jul 08 17:46:56.617684 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:56.617310 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" event={"ID":"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a","Type":"ContainerDied","Data":"7806e4a78a09736fb82d73ce614e1d7905c44013e3cd82d9c9a3ff0d7c7661dc"} Jul 08 17:46:56.617829 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:56.617813 2556 scope.go:117] "RemoveContainer" containerID="7806e4a78a09736fb82d73ce614e1d7905c44013e3cd82d9c9a3ff0d7c7661dc" Jul 08 17:46:56.618997 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:56.618959 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:46:56.619132 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:56.619044 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:46:56.619132 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:56.619096 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:46:57.412169 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:57.412133 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n"] Jul 08 17:46:57.624677 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:57.624639 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" event={"ID":"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a","Type":"ContainerStarted","Data":"9d4c5a37b544eb9e529abbd2533eaaeabf1ff15a29a172c0c52539b292350ede"} Jul 08 17:46:57.625128 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:46:57.624701 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" podUID="6bac03b9-8938-4ca4-8ce7-1acf3819cc7a" containerName="istio-proxy" containerID="cri-o://9d4c5a37b544eb9e529abbd2533eaaeabf1ff15a29a172c0c52539b292350ede" gracePeriod=30 Jul 08 17:47:01.557503 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:01.557457 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:47:02.887221 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:02.887152 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:47:02.962888 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:02.962850 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istiod-ca-cert\") pod \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " Jul 08 17:47:02.963110 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:02.962902 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istio-token\") pod \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " Jul 08 17:47:02.963110 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:02.962957 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istio-data\") pod \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " Jul 08 17:47:02.963110 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:02.962983 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istio-envoy\") pod \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " Jul 08 17:47:02.963110 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:02.963011 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istio-podinfo\") pod \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " Jul 08 17:47:02.963110 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:02.963049 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-workload-certs\") pod \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " Jul 08 17:47:02.963110 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:02.963074 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-credential-socket\") pod \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " Jul 08 17:47:02.963110 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:02.963103 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrzrt\" (UniqueName: \"kubernetes.io/projected/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-kube-api-access-vrzrt\") pod \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " Jul 08 17:47:02.963446 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:02.963184 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-workload-socket\") pod \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\" (UID: \"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a\") " Jul 08 17:47:02.963446 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:02.963429 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6bac03b9-8938-4ca4-8ce7-1acf3819cc7a" (UID: "6bac03b9-8938-4ca4-8ce7-1acf3819cc7a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:47:02.963751 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:02.963660 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6bac03b9-8938-4ca4-8ce7-1acf3819cc7a" (UID: "6bac03b9-8938-4ca4-8ce7-1acf3819cc7a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:47:02.963751 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:02.963693 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6bac03b9-8938-4ca4-8ce7-1acf3819cc7a" (UID: "6bac03b9-8938-4ca4-8ce7-1acf3819cc7a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:47:02.963751 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:02.963718 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istiod-ca-cert\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:47:02.964027 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:02.963877 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6bac03b9-8938-4ca4-8ce7-1acf3819cc7a" (UID: "6bac03b9-8938-4ca4-8ce7-1acf3819cc7a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:47:02.964027 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:02.963894 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istio-data" (OuterVolumeSpecName: "istio-data") pod "6bac03b9-8938-4ca4-8ce7-1acf3819cc7a" (UID: "6bac03b9-8938-4ca4-8ce7-1acf3819cc7a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:47:02.965444 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:02.965417 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istio-token" (OuterVolumeSpecName: "istio-token") pod "6bac03b9-8938-4ca4-8ce7-1acf3819cc7a" (UID: "6bac03b9-8938-4ca4-8ce7-1acf3819cc7a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:47:02.965541 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:02.965439 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6bac03b9-8938-4ca4-8ce7-1acf3819cc7a" (UID: "6bac03b9-8938-4ca4-8ce7-1acf3819cc7a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 17:47:02.965733 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:02.965713 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6bac03b9-8938-4ca4-8ce7-1acf3819cc7a" (UID: "6bac03b9-8938-4ca4-8ce7-1acf3819cc7a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:47:02.965778 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:02.965745 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-kube-api-access-vrzrt" (OuterVolumeSpecName: "kube-api-access-vrzrt") pod "6bac03b9-8938-4ca4-8ce7-1acf3819cc7a" (UID: "6bac03b9-8938-4ca4-8ce7-1acf3819cc7a"). InnerVolumeSpecName "kube-api-access-vrzrt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:47:03.064672 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.064632 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istio-token\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:47:03.064672 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.064663 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istio-data\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:47:03.064672 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.064672 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istio-envoy\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:47:03.064672 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.064681 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-istio-podinfo\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:47:03.065013 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.064689 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-workload-certs\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:47:03.065013 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.064698 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-credential-socket\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:47:03.065013 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.064707 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrzrt\" (UniqueName: \"kubernetes.io/projected/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-kube-api-access-vrzrt\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:47:03.065013 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.064716 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a-workload-socket\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:47:03.481201 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.481163 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6"] Jul 08 17:47:03.481789 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.481759 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bac03b9-8938-4ca4-8ce7-1acf3819cc7a" containerName="istio-proxy" Jul 08 17:47:03.481789 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.481789 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bac03b9-8938-4ca4-8ce7-1acf3819cc7a" containerName="istio-proxy" Jul 08 17:47:03.482103 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.481993 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bac03b9-8938-4ca4-8ce7-1acf3819cc7a" containerName="istio-proxy" Jul 08 17:47:03.482103 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.482010 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bac03b9-8938-4ca4-8ce7-1acf3819cc7a" containerName="istio-proxy" Jul 08 17:47:03.491571 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.491543 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.494721 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.494692 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-8af199d6-openshift-default-dockercfg-bpgbv\"" Jul 08 17:47:03.498774 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.498745 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6"] Jul 08 17:47:03.568723 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.568684 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6914a33-4faa-4ba2-8998-cde2412bdd18-istio-podinfo\") pod \"e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.568963 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.568733 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mqrz\" (UniqueName: \"kubernetes.io/projected/e6914a33-4faa-4ba2-8998-cde2412bdd18-kube-api-access-5mqrz\") pod \"e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.568963 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.568760 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-credential-socket\") pod \"e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.568963 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.568859 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6914a33-4faa-4ba2-8998-cde2412bdd18-istiod-ca-cert\") pod \"e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.568963 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.568898 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-istio-envoy\") pod \"e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.568963 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.568938 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-workload-socket\") pod \"e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.569177 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.569020 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6914a33-4faa-4ba2-8998-cde2412bdd18-istio-token\") pod \"e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.569177 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.569046 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-workload-certs\") pod \"e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.569177 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.569073 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-istio-data\") pod \"e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.656127 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.656095 2556 generic.go:356] "Generic (PLEG): container finished" podID="6bac03b9-8938-4ca4-8ce7-1acf3819cc7a" containerID="9d4c5a37b544eb9e529abbd2533eaaeabf1ff15a29a172c0c52539b292350ede" exitCode=0 Jul 08 17:47:03.656298 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.656139 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" Jul 08 17:47:03.656298 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.656174 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" event={"ID":"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a","Type":"ContainerDied","Data":"9d4c5a37b544eb9e529abbd2533eaaeabf1ff15a29a172c0c52539b292350ede"} Jul 08 17:47:03.656298 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.656239 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n" event={"ID":"6bac03b9-8938-4ca4-8ce7-1acf3819cc7a","Type":"ContainerDied","Data":"16683d4ed6e5e4667bd31ab2bf995c47af23e32fead6d14a1da4510b3c505afb"} Jul 08 17:47:03.656298 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.656267 2556 scope.go:117] "RemoveContainer" containerID="9d4c5a37b544eb9e529abbd2533eaaeabf1ff15a29a172c0c52539b292350ede" Jul 08 17:47:03.666351 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.666331 2556 scope.go:117] "RemoveContainer" containerID="7806e4a78a09736fb82d73ce614e1d7905c44013e3cd82d9c9a3ff0d7c7661dc" Jul 08 17:47:03.670113 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.670085 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6914a33-4faa-4ba2-8998-cde2412bdd18-istiod-ca-cert\") pod \"e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.670222 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.670142 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-istio-envoy\") pod \"e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.670222 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.670184 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-workload-socket\") pod \"e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.670301 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.670248 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6914a33-4faa-4ba2-8998-cde2412bdd18-istio-token\") pod \"e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.670301 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.670274 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-workload-certs\") pod \"e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.670458 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.670308 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-istio-data\") pod \"e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.670458 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.670359 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6914a33-4faa-4ba2-8998-cde2412bdd18-istio-podinfo\") pod \"e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.670458 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.670401 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mqrz\" (UniqueName: \"kubernetes.io/projected/e6914a33-4faa-4ba2-8998-cde2412bdd18-kube-api-access-5mqrz\") pod \"e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.670458 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.670441 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-credential-socket\") pod \"e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.670710 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.670593 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-workload-socket\") pod \"e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.670879 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.670805 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6914a33-4faa-4ba2-8998-cde2412bdd18-istiod-ca-cert\") pod \"e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.670879 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.670804 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-workload-certs\") pod \"e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.670879 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.670809 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-istio-data\") pod \"e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.671096 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.671075 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-credential-socket\") pod \"e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.672487 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.672465 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-istio-envoy\") pod \"e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.673042 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.673026 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6914a33-4faa-4ba2-8998-cde2412bdd18-istio-podinfo\") pod \"e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.676176 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.676156 2556 scope.go:117] "RemoveContainer" containerID="9d4c5a37b544eb9e529abbd2533eaaeabf1ff15a29a172c0c52539b292350ede" Jul 08 17:47:03.676503 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:47:03.676480 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d4c5a37b544eb9e529abbd2533eaaeabf1ff15a29a172c0c52539b292350ede\": container with ID starting with 9d4c5a37b544eb9e529abbd2533eaaeabf1ff15a29a172c0c52539b292350ede not found: ID does not exist" containerID="9d4c5a37b544eb9e529abbd2533eaaeabf1ff15a29a172c0c52539b292350ede" Jul 08 17:47:03.676578 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.676518 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4c5a37b544eb9e529abbd2533eaaeabf1ff15a29a172c0c52539b292350ede"} err="failed to get container status \"9d4c5a37b544eb9e529abbd2533eaaeabf1ff15a29a172c0c52539b292350ede\": rpc error: code = NotFound desc = could not find container \"9d4c5a37b544eb9e529abbd2533eaaeabf1ff15a29a172c0c52539b292350ede\": container with ID starting with 9d4c5a37b544eb9e529abbd2533eaaeabf1ff15a29a172c0c52539b292350ede not found: ID does not exist" Jul 08 17:47:03.676578 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.676543 2556 scope.go:117] "RemoveContainer" containerID="7806e4a78a09736fb82d73ce614e1d7905c44013e3cd82d9c9a3ff0d7c7661dc" Jul 08 17:47:03.676879 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:47:03.676845 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7806e4a78a09736fb82d73ce614e1d7905c44013e3cd82d9c9a3ff0d7c7661dc\": container with ID starting with 7806e4a78a09736fb82d73ce614e1d7905c44013e3cd82d9c9a3ff0d7c7661dc not found: ID does not exist" containerID="7806e4a78a09736fb82d73ce614e1d7905c44013e3cd82d9c9a3ff0d7c7661dc" Jul 08 17:47:03.676951 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.676878 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7806e4a78a09736fb82d73ce614e1d7905c44013e3cd82d9c9a3ff0d7c7661dc"} err="failed to get container status \"7806e4a78a09736fb82d73ce614e1d7905c44013e3cd82d9c9a3ff0d7c7661dc\": rpc error: code = NotFound desc = could not find container \"7806e4a78a09736fb82d73ce614e1d7905c44013e3cd82d9c9a3ff0d7c7661dc\": container with ID starting with 7806e4a78a09736fb82d73ce614e1d7905c44013e3cd82d9c9a3ff0d7c7661dc not found: ID does not exist" Jul 08 17:47:03.683825 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.683761 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6914a33-4faa-4ba2-8998-cde2412bdd18-istio-token\") pod \"e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.684020 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.683827 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mqrz\" (UniqueName: \"kubernetes.io/projected/e6914a33-4faa-4ba2-8998-cde2412bdd18-kube-api-access-5mqrz\") pod \"e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.692102 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.692061 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n"] Jul 08 17:47:03.692867 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.692816 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-7f7fa9dc-openshift-default-cb69cd5df-g5n6n"] Jul 08 17:47:03.806508 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.806414 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:03.960944 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.960885 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6"] Jul 08 17:47:03.963647 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:47:03.963619 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6914a33_4faa_4ba2_8998_cde2412bdd18.slice/crio-c12b177c9ed275af8a403fb56304c6778ad5871e9cb62d5620cfaed6471da170 WatchSource:0}: Error finding container c12b177c9ed275af8a403fb56304c6778ad5871e9cb62d5620cfaed6471da170: Status 404 returned error can't find the container with id c12b177c9ed275af8a403fb56304c6778ad5871e9cb62d5620cfaed6471da170 Jul 08 17:47:03.965802 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.965763 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:47:03.965885 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.965838 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:47:03.965885 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:03.965868 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:47:04.113768 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:04.113729 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bac03b9-8938-4ca4-8ce7-1acf3819cc7a" path="/var/lib/kubelet/pods/6bac03b9-8938-4ca4-8ce7-1acf3819cc7a/volumes" Jul 08 17:47:04.664227 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:04.664177 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" event={"ID":"e6914a33-4faa-4ba2-8998-cde2412bdd18","Type":"ContainerStarted","Data":"a6a8d3183c263b03b9c3acb940b298b839c46b80bba37851f928b8224599681a"} Jul 08 17:47:04.664430 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:04.664245 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" event={"ID":"e6914a33-4faa-4ba2-8998-cde2412bdd18","Type":"ContainerStarted","Data":"c12b177c9ed275af8a403fb56304c6778ad5871e9cb62d5620cfaed6471da170"} Jul 08 17:47:04.691648 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:04.691435 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" podStartSLOduration=1.691411412 podStartE2EDuration="1.691411412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:47:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:47:04.687186816 +0000 UTC m=+1837.098002193" watchObservedRunningTime="2026-07-08 17:47:04.691411412 +0000 UTC m=+1837.102226791" Jul 08 17:47:04.807391 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:04.807358 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:05.812146 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:05.812113 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:06.675066 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:06.675030 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:06.676031 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:06.676004 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:09.298061 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:09.298023 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6"] Jul 08 17:47:09.695236 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:09.695164 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" podUID="e6914a33-4faa-4ba2-8998-cde2412bdd18" containerName="istio-proxy" containerID="cri-o://a6a8d3183c263b03b9c3acb940b298b839c46b80bba37851f928b8224599681a" gracePeriod=30 Jul 08 17:47:16.352205 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.352171 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:16.503598 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.503494 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-workload-certs\") pod \"e6914a33-4faa-4ba2-8998-cde2412bdd18\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " Jul 08 17:47:16.503598 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.503550 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-workload-socket\") pod \"e6914a33-4faa-4ba2-8998-cde2412bdd18\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " Jul 08 17:47:16.503598 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.503600 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6914a33-4faa-4ba2-8998-cde2412bdd18-istiod-ca-cert\") pod \"e6914a33-4faa-4ba2-8998-cde2412bdd18\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " Jul 08 17:47:16.503891 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.503627 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6914a33-4faa-4ba2-8998-cde2412bdd18-istio-podinfo\") pod \"e6914a33-4faa-4ba2-8998-cde2412bdd18\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " Jul 08 17:47:16.503891 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.503656 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6914a33-4faa-4ba2-8998-cde2412bdd18-istio-token\") pod \"e6914a33-4faa-4ba2-8998-cde2412bdd18\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " Jul 08 17:47:16.503891 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.503703 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-credential-socket\") pod \"e6914a33-4faa-4ba2-8998-cde2412bdd18\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " Jul 08 17:47:16.503891 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.503754 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-istio-envoy\") pod \"e6914a33-4faa-4ba2-8998-cde2412bdd18\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " Jul 08 17:47:16.503891 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.503779 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-istio-data\") pod \"e6914a33-4faa-4ba2-8998-cde2412bdd18\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " Jul 08 17:47:16.503891 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.503793 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e6914a33-4faa-4ba2-8998-cde2412bdd18" (UID: "e6914a33-4faa-4ba2-8998-cde2412bdd18"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:47:16.503891 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.503824 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mqrz\" (UniqueName: \"kubernetes.io/projected/e6914a33-4faa-4ba2-8998-cde2412bdd18-kube-api-access-5mqrz\") pod \"e6914a33-4faa-4ba2-8998-cde2412bdd18\" (UID: \"e6914a33-4faa-4ba2-8998-cde2412bdd18\") " Jul 08 17:47:16.504305 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.503882 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e6914a33-4faa-4ba2-8998-cde2412bdd18" (UID: "e6914a33-4faa-4ba2-8998-cde2412bdd18"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:47:16.504305 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.504049 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6914a33-4faa-4ba2-8998-cde2412bdd18-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e6914a33-4faa-4ba2-8998-cde2412bdd18" (UID: "e6914a33-4faa-4ba2-8998-cde2412bdd18"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:47:16.504305 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.504248 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6914a33-4faa-4ba2-8998-cde2412bdd18-istiod-ca-cert\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:47:16.504305 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.504274 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-workload-certs\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:47:16.504305 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.504290 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-workload-socket\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:47:16.504695 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.504665 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e6914a33-4faa-4ba2-8998-cde2412bdd18" (UID: "e6914a33-4faa-4ba2-8998-cde2412bdd18"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:47:16.504988 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.504959 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-istio-data" (OuterVolumeSpecName: "istio-data") pod "e6914a33-4faa-4ba2-8998-cde2412bdd18" (UID: "e6914a33-4faa-4ba2-8998-cde2412bdd18"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:47:16.506033 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.505998 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6914a33-4faa-4ba2-8998-cde2412bdd18-istio-token" (OuterVolumeSpecName: "istio-token") pod "e6914a33-4faa-4ba2-8998-cde2412bdd18" (UID: "e6914a33-4faa-4ba2-8998-cde2412bdd18"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:47:16.506131 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.506042 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e6914a33-4faa-4ba2-8998-cde2412bdd18-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e6914a33-4faa-4ba2-8998-cde2412bdd18" (UID: "e6914a33-4faa-4ba2-8998-cde2412bdd18"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 17:47:16.506131 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.506072 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e6914a33-4faa-4ba2-8998-cde2412bdd18" (UID: "e6914a33-4faa-4ba2-8998-cde2412bdd18"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:47:16.506131 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.506125 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6914a33-4faa-4ba2-8998-cde2412bdd18-kube-api-access-5mqrz" (OuterVolumeSpecName: "kube-api-access-5mqrz") pod "e6914a33-4faa-4ba2-8998-cde2412bdd18" (UID: "e6914a33-4faa-4ba2-8998-cde2412bdd18"). InnerVolumeSpecName "kube-api-access-5mqrz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:47:16.605623 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.605584 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mqrz\" (UniqueName: \"kubernetes.io/projected/e6914a33-4faa-4ba2-8998-cde2412bdd18-kube-api-access-5mqrz\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:47:16.605623 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.605617 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6914a33-4faa-4ba2-8998-cde2412bdd18-istio-podinfo\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:47:16.605623 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.605628 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6914a33-4faa-4ba2-8998-cde2412bdd18-istio-token\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:47:16.605866 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.605637 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-credential-socket\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:47:16.605866 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.605645 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-istio-envoy\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:47:16.605866 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.605653 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6914a33-4faa-4ba2-8998-cde2412bdd18-istio-data\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:47:16.740675 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.740635 2556 generic.go:356] "Generic (PLEG): container finished" podID="e6914a33-4faa-4ba2-8998-cde2412bdd18" containerID="a6a8d3183c263b03b9c3acb940b298b839c46b80bba37851f928b8224599681a" exitCode=0 Jul 08 17:47:16.740865 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.740685 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" Jul 08 17:47:16.740865 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.740723 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" event={"ID":"e6914a33-4faa-4ba2-8998-cde2412bdd18","Type":"ContainerDied","Data":"a6a8d3183c263b03b9c3acb940b298b839c46b80bba37851f928b8224599681a"} Jul 08 17:47:16.740865 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.740782 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6" event={"ID":"e6914a33-4faa-4ba2-8998-cde2412bdd18","Type":"ContainerDied","Data":"c12b177c9ed275af8a403fb56304c6778ad5871e9cb62d5620cfaed6471da170"} Jul 08 17:47:16.740865 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.740796 2556 scope.go:117] "RemoveContainer" containerID="a6a8d3183c263b03b9c3acb940b298b839c46b80bba37851f928b8224599681a" Jul 08 17:47:16.750664 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.750643 2556 scope.go:117] "RemoveContainer" containerID="a6a8d3183c263b03b9c3acb940b298b839c46b80bba37851f928b8224599681a" Jul 08 17:47:16.750934 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:47:16.750895 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6a8d3183c263b03b9c3acb940b298b839c46b80bba37851f928b8224599681a\": container with ID starting with a6a8d3183c263b03b9c3acb940b298b839c46b80bba37851f928b8224599681a not found: ID does not exist" containerID="a6a8d3183c263b03b9c3acb940b298b839c46b80bba37851f928b8224599681a" Jul 08 17:47:16.750988 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.750945 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6a8d3183c263b03b9c3acb940b298b839c46b80bba37851f928b8224599681a"} err="failed to get container status \"a6a8d3183c263b03b9c3acb940b298b839c46b80bba37851f928b8224599681a\": rpc error: code = NotFound desc = could not find container \"a6a8d3183c263b03b9c3acb940b298b839c46b80bba37851f928b8224599681a\": container with ID starting with a6a8d3183c263b03b9c3acb940b298b839c46b80bba37851f928b8224599681a not found: ID does not exist" Jul 08 17:47:16.763199 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.763133 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6"] Jul 08 17:47:16.769546 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:16.769518 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-8af199d6-openshift-default-9f47f76f5-qz2p6"] Jul 08 17:47:18.112478 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:47:18.112444 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6914a33-4faa-4ba2-8998-cde2412bdd18" path="/var/lib/kubelet/pods/e6914a33-4faa-4ba2-8998-cde2412bdd18/volumes" Jul 08 17:48:51.083317 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.083277 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq"] Jul 08 17:48:51.084008 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.083986 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bac03b9-8938-4ca4-8ce7-1acf3819cc7a" containerName="istio-proxy" Jul 08 17:48:51.084096 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.084011 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bac03b9-8938-4ca4-8ce7-1acf3819cc7a" containerName="istio-proxy" Jul 08 17:48:51.084096 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.084033 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6914a33-4faa-4ba2-8998-cde2412bdd18" containerName="istio-proxy" Jul 08 17:48:51.084096 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.084042 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6914a33-4faa-4ba2-8998-cde2412bdd18" containerName="istio-proxy" Jul 08 17:48:51.084191 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.084140 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6914a33-4faa-4ba2-8998-cde2412bdd18" containerName="istio-proxy" Jul 08 17:48:51.087797 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.087774 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.090185 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.090159 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-1028bef5-openshift-default-dockercfg-qt4nr\"" Jul 08 17:48:51.108002 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.107976 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq"] Jul 08 17:48:51.215014 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.214973 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-workload-certs\") pod \"e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.215208 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.215022 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istio-data\") pod \"e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.215208 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.215050 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-workload-socket\") pod \"e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.215208 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.215075 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istio-podinfo\") pod \"e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.215208 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.215117 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-credential-socket\") pod \"e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.215208 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.215172 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istiod-ca-cert\") pod \"e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.215375 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.215221 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsqdw\" (UniqueName: \"kubernetes.io/projected/a5edec18-4ac5-4770-bb3e-efc4de1b328a-kube-api-access-nsqdw\") pod \"e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.215375 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.215258 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istio-token\") pod \"e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.215375 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.215348 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istio-envoy\") pod \"e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.317036 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.316991 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsqdw\" (UniqueName: \"kubernetes.io/projected/a5edec18-4ac5-4770-bb3e-efc4de1b328a-kube-api-access-nsqdw\") pod \"e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.317253 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.317052 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istio-token\") pod \"e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.317253 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.317095 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istio-envoy\") pod \"e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.317253 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.317114 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-workload-certs\") pod \"e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.317253 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.317138 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istio-data\") pod \"e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.317253 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.317156 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-workload-socket\") pod \"e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.317533 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.317396 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istio-podinfo\") pod \"e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.317533 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.317478 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-credential-socket\") pod \"e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.317644 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.317548 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istiod-ca-cert\") pod \"e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.317644 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.317586 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istio-data\") pod \"e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.317644 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.317620 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-workload-certs\") pod \"e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.317809 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.317655 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-workload-socket\") pod \"e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.317894 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.317870 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-credential-socket\") pod \"e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.318252 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.318234 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istiod-ca-cert\") pod \"e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.319646 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.319628 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istio-envoy\") pod \"e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.319877 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.319856 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istio-podinfo\") pod \"e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.325591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.325560 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istio-token\") pod \"e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.325836 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.325807 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsqdw\" (UniqueName: \"kubernetes.io/projected/a5edec18-4ac5-4770-bb3e-efc4de1b328a-kube-api-access-nsqdw\") pod \"e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.399740 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.399664 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:51.546901 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.546876 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq"] Jul 08 17:48:51.549192 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:48:51.549151 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5edec18_4ac5_4770_bb3e_efc4de1b328a.slice/crio-069e039b79d1b91fd5056a2a36459bb2bf26d67169fd786172b3392e70989b35 WatchSource:0}: Error finding container 069e039b79d1b91fd5056a2a36459bb2bf26d67169fd786172b3392e70989b35: Status 404 returned error can't find the container with id 069e039b79d1b91fd5056a2a36459bb2bf26d67169fd786172b3392e70989b35 Jul 08 17:48:51.551420 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.551385 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:48:51.551500 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.551468 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:48:51.551538 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:51.551498 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:48:52.230149 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:52.230104 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" event={"ID":"a5edec18-4ac5-4770-bb3e-efc4de1b328a","Type":"ContainerStarted","Data":"23122b0c3a863a489ae1d79f762791a839e7d1500e43edd00ca1c10de7230cc1"} Jul 08 17:48:52.230556 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:52.230175 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" event={"ID":"a5edec18-4ac5-4770-bb3e-efc4de1b328a","Type":"ContainerStarted","Data":"069e039b79d1b91fd5056a2a36459bb2bf26d67169fd786172b3392e70989b35"} Jul 08 17:48:52.254330 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:52.254266 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" podStartSLOduration=1.254249645 podStartE2EDuration="1.254249645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:48:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:48:52.253052901 +0000 UTC m=+1944.663868278" watchObservedRunningTime="2026-07-08 17:48:52.254249645 +0000 UTC m=+1944.665065022" Jul 08 17:48:52.400789 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:52.400752 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:52.405604 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:52.405579 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:53.235355 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:53.235319 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:48:53.236318 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:48:53.236298 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:49:08.944924 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:08.944704 2556 patch_prober.go:28] interesting pod/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": read tcp 10.134.0.2:44406->10.134.0.55:15021: read: connection reset by peer" start-of-body= Jul 08 17:49:08.944924 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:08.944789 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" podUID="a5edec18-4ac5-4770-bb3e-efc4de1b328a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": read tcp 10.134.0.2:44406->10.134.0.55:15021: read: connection reset by peer" Jul 08 17:49:09.332244 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:09.332148 2556 generic.go:356] "Generic (PLEG): container finished" podID="a5edec18-4ac5-4770-bb3e-efc4de1b328a" containerID="23122b0c3a863a489ae1d79f762791a839e7d1500e43edd00ca1c10de7230cc1" exitCode=0 Jul 08 17:49:09.332244 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:09.332195 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" event={"ID":"a5edec18-4ac5-4770-bb3e-efc4de1b328a","Type":"ContainerDied","Data":"23122b0c3a863a489ae1d79f762791a839e7d1500e43edd00ca1c10de7230cc1"} Jul 08 17:49:09.332636 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:09.332621 2556 scope.go:117] "RemoveContainer" containerID="23122b0c3a863a489ae1d79f762791a839e7d1500e43edd00ca1c10de7230cc1" Jul 08 17:49:09.333691 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:09.333657 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:49:09.333806 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:09.333749 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:49:09.333806 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:09.333798 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:49:10.339324 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:10.339287 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" event={"ID":"a5edec18-4ac5-4770-bb3e-efc4de1b328a","Type":"ContainerStarted","Data":"aa638bf44c85099e48bffb9bf30fffdf5d4b5a6b0911f37477728c6404f0d102"} Jul 08 17:49:10.400437 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:10.400395 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:49:10.400623 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:10.400590 2556 patch_prober.go:28] interesting pod/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Jul 08 17:49:10.400723 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:10.400685 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" podUID="a5edec18-4ac5-4770-bb3e-efc4de1b328a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Jul 08 17:49:11.400991 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:11.400949 2556 patch_prober.go:28] interesting pod/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Jul 08 17:49:11.401522 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:11.401039 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" podUID="a5edec18-4ac5-4770-bb3e-efc4de1b328a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Jul 08 17:49:12.400333 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:12.400274 2556 patch_prober.go:28] interesting pod/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Jul 08 17:49:12.400555 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:12.400366 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" podUID="a5edec18-4ac5-4770-bb3e-efc4de1b328a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Jul 08 17:49:12.532235 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:12.532183 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq"] Jul 08 17:49:12.532696 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:12.532451 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" podUID="a5edec18-4ac5-4770-bb3e-efc4de1b328a" containerName="istio-proxy" containerID="cri-o://aa638bf44c85099e48bffb9bf30fffdf5d4b5a6b0911f37477728c6404f0d102" gracePeriod=30 Jul 08 17:49:20.695689 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:20.695661 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:49:20.813049 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:20.812954 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istio-envoy\") pod \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " Jul 08 17:49:20.813049 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:20.813015 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsqdw\" (UniqueName: \"kubernetes.io/projected/a5edec18-4ac5-4770-bb3e-efc4de1b328a-kube-api-access-nsqdw\") pod \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " Jul 08 17:49:20.813049 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:20.813039 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istio-podinfo\") pod \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " Jul 08 17:49:20.813339 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:20.813099 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istiod-ca-cert\") pod \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " Jul 08 17:49:20.813339 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:20.813137 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istio-data\") pod \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " Jul 08 17:49:20.813339 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:20.813174 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-credential-socket\") pod \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " Jul 08 17:49:20.813339 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:20.813215 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istio-token\") pod \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " Jul 08 17:49:20.813339 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:20.813298 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-workload-socket\") pod \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " Jul 08 17:49:20.813339 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:20.813330 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-workload-certs\") pod \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\" (UID: \"a5edec18-4ac5-4770-bb3e-efc4de1b328a\") " Jul 08 17:49:20.813732 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:20.813542 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a5edec18-4ac5-4770-bb3e-efc4de1b328a" (UID: "a5edec18-4ac5-4770-bb3e-efc4de1b328a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:49:20.813732 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:20.813568 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a5edec18-4ac5-4770-bb3e-efc4de1b328a" (UID: "a5edec18-4ac5-4770-bb3e-efc4de1b328a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:49:20.813853 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:20.813761 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istiod-ca-cert\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:49:20.813853 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:20.813784 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-credential-socket\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:49:20.813853 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:20.813780 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a5edec18-4ac5-4770-bb3e-efc4de1b328a" (UID: "a5edec18-4ac5-4770-bb3e-efc4de1b328a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:49:20.814061 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:20.813852 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a5edec18-4ac5-4770-bb3e-efc4de1b328a" (UID: "a5edec18-4ac5-4770-bb3e-efc4de1b328a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:49:20.814654 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:20.814619 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istio-data" (OuterVolumeSpecName: "istio-data") pod "a5edec18-4ac5-4770-bb3e-efc4de1b328a" (UID: "a5edec18-4ac5-4770-bb3e-efc4de1b328a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:49:20.815359 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:20.815334 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a5edec18-4ac5-4770-bb3e-efc4de1b328a" (UID: "a5edec18-4ac5-4770-bb3e-efc4de1b328a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:49:20.815478 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:20.815380 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a5edec18-4ac5-4770-bb3e-efc4de1b328a" (UID: "a5edec18-4ac5-4770-bb3e-efc4de1b328a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 17:49:20.815478 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:20.815415 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5edec18-4ac5-4770-bb3e-efc4de1b328a-kube-api-access-nsqdw" (OuterVolumeSpecName: "kube-api-access-nsqdw") pod "a5edec18-4ac5-4770-bb3e-efc4de1b328a" (UID: "a5edec18-4ac5-4770-bb3e-efc4de1b328a"). InnerVolumeSpecName "kube-api-access-nsqdw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:49:20.815556 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:20.815475 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istio-token" (OuterVolumeSpecName: "istio-token") pod "a5edec18-4ac5-4770-bb3e-efc4de1b328a" (UID: "a5edec18-4ac5-4770-bb3e-efc4de1b328a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:49:20.914591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:20.914541 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istio-token\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:49:20.914591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:20.914585 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-workload-socket\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:49:20.914591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:20.914596 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-workload-certs\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:49:20.914591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:20.914606 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istio-envoy\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:49:20.914591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:20.914614 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsqdw\" (UniqueName: \"kubernetes.io/projected/a5edec18-4ac5-4770-bb3e-efc4de1b328a-kube-api-access-nsqdw\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:49:20.914951 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:20.914624 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istio-podinfo\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:49:20.914951 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:20.914631 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5edec18-4ac5-4770-bb3e-efc4de1b328a-istio-data\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:49:21.396602 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:21.396567 2556 generic.go:356] "Generic (PLEG): container finished" podID="a5edec18-4ac5-4770-bb3e-efc4de1b328a" containerID="aa638bf44c85099e48bffb9bf30fffdf5d4b5a6b0911f37477728c6404f0d102" exitCode=0 Jul 08 17:49:21.396819 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:21.396611 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" Jul 08 17:49:21.396819 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:21.396648 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" event={"ID":"a5edec18-4ac5-4770-bb3e-efc4de1b328a","Type":"ContainerDied","Data":"aa638bf44c85099e48bffb9bf30fffdf5d4b5a6b0911f37477728c6404f0d102"} Jul 08 17:49:21.396819 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:21.396714 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq" event={"ID":"a5edec18-4ac5-4770-bb3e-efc4de1b328a","Type":"ContainerDied","Data":"069e039b79d1b91fd5056a2a36459bb2bf26d67169fd786172b3392e70989b35"} Jul 08 17:49:21.396819 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:21.396746 2556 scope.go:117] "RemoveContainer" containerID="aa638bf44c85099e48bffb9bf30fffdf5d4b5a6b0911f37477728c6404f0d102" Jul 08 17:49:21.410197 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:21.408042 2556 scope.go:117] "RemoveContainer" containerID="23122b0c3a863a489ae1d79f762791a839e7d1500e43edd00ca1c10de7230cc1" Jul 08 17:49:21.419029 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:21.419009 2556 scope.go:117] "RemoveContainer" containerID="aa638bf44c85099e48bffb9bf30fffdf5d4b5a6b0911f37477728c6404f0d102" Jul 08 17:49:21.419278 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:49:21.419256 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa638bf44c85099e48bffb9bf30fffdf5d4b5a6b0911f37477728c6404f0d102\": container with ID starting with aa638bf44c85099e48bffb9bf30fffdf5d4b5a6b0911f37477728c6404f0d102 not found: ID does not exist" containerID="aa638bf44c85099e48bffb9bf30fffdf5d4b5a6b0911f37477728c6404f0d102" Jul 08 17:49:21.419329 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:21.419287 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa638bf44c85099e48bffb9bf30fffdf5d4b5a6b0911f37477728c6404f0d102"} err="failed to get container status \"aa638bf44c85099e48bffb9bf30fffdf5d4b5a6b0911f37477728c6404f0d102\": rpc error: code = NotFound desc = could not find container \"aa638bf44c85099e48bffb9bf30fffdf5d4b5a6b0911f37477728c6404f0d102\": container with ID starting with aa638bf44c85099e48bffb9bf30fffdf5d4b5a6b0911f37477728c6404f0d102 not found: ID does not exist" Jul 08 17:49:21.419329 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:21.419304 2556 scope.go:117] "RemoveContainer" containerID="23122b0c3a863a489ae1d79f762791a839e7d1500e43edd00ca1c10de7230cc1" Jul 08 17:49:21.419560 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:49:21.419545 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23122b0c3a863a489ae1d79f762791a839e7d1500e43edd00ca1c10de7230cc1\": container with ID starting with 23122b0c3a863a489ae1d79f762791a839e7d1500e43edd00ca1c10de7230cc1 not found: ID does not exist" containerID="23122b0c3a863a489ae1d79f762791a839e7d1500e43edd00ca1c10de7230cc1" Jul 08 17:49:21.419606 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:21.419564 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23122b0c3a863a489ae1d79f762791a839e7d1500e43edd00ca1c10de7230cc1"} err="failed to get container status \"23122b0c3a863a489ae1d79f762791a839e7d1500e43edd00ca1c10de7230cc1\": rpc error: code = NotFound desc = could not find container \"23122b0c3a863a489ae1d79f762791a839e7d1500e43edd00ca1c10de7230cc1\": container with ID starting with 23122b0c3a863a489ae1d79f762791a839e7d1500e43edd00ca1c10de7230cc1 not found: ID does not exist" Jul 08 17:49:21.426578 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:21.426548 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq"] Jul 08 17:49:21.429996 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:21.429974 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-1028bef5-openshift-default-59bf6c7699-k6pxq"] Jul 08 17:49:22.112663 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:22.112626 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5edec18-4ac5-4770-bb3e-efc4de1b328a" path="/var/lib/kubelet/pods/a5edec18-4ac5-4770-bb3e-efc4de1b328a/volumes" Jul 08 17:49:32.363138 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.363098 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb"] Jul 08 17:49:32.363538 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.363522 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5edec18-4ac5-4770-bb3e-efc4de1b328a" containerName="istio-proxy" Jul 08 17:49:32.363583 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.363540 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5edec18-4ac5-4770-bb3e-efc4de1b328a" containerName="istio-proxy" Jul 08 17:49:32.363648 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.363639 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5edec18-4ac5-4770-bb3e-efc4de1b328a" containerName="istio-proxy" Jul 08 17:49:32.363685 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.363649 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5edec18-4ac5-4770-bb3e-efc4de1b328a" containerName="istio-proxy" Jul 08 17:49:32.365722 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.365703 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.368808 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.368788 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-525288bb-openshift-default-dockercfg-f84z8\"" Jul 08 17:49:32.382720 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.382671 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb"] Jul 08 17:49:32.526864 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.526821 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istio-data\") pod \"e2e-mt-525288bb-openshift-default-6997db9695-r5xdb\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.526864 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.526867 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istio-envoy\") pod \"e2e-mt-525288bb-openshift-default-6997db9695-r5xdb\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.527201 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.526886 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-credential-socket\") pod \"e2e-mt-525288bb-openshift-default-6997db9695-r5xdb\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.527201 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.526991 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istio-podinfo\") pod \"e2e-mt-525288bb-openshift-default-6997db9695-r5xdb\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.527201 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.527059 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istio-token\") pod \"e2e-mt-525288bb-openshift-default-6997db9695-r5xdb\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.527201 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.527127 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwc2k\" (UniqueName: \"kubernetes.io/projected/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-kube-api-access-rwc2k\") pod \"e2e-mt-525288bb-openshift-default-6997db9695-r5xdb\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.527201 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.527162 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istiod-ca-cert\") pod \"e2e-mt-525288bb-openshift-default-6997db9695-r5xdb\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.527435 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.527253 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-workload-certs\") pod \"e2e-mt-525288bb-openshift-default-6997db9695-r5xdb\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.527435 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.527298 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-workload-socket\") pod \"e2e-mt-525288bb-openshift-default-6997db9695-r5xdb\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.628805 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.628682 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwc2k\" (UniqueName: \"kubernetes.io/projected/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-kube-api-access-rwc2k\") pod \"e2e-mt-525288bb-openshift-default-6997db9695-r5xdb\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.628805 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.628739 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istiod-ca-cert\") pod \"e2e-mt-525288bb-openshift-default-6997db9695-r5xdb\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.628805 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.628785 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-workload-certs\") pod \"e2e-mt-525288bb-openshift-default-6997db9695-r5xdb\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.629170 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.628819 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-workload-socket\") pod \"e2e-mt-525288bb-openshift-default-6997db9695-r5xdb\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.629170 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.628867 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istio-data\") pod \"e2e-mt-525288bb-openshift-default-6997db9695-r5xdb\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.629170 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.628899 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istio-envoy\") pod \"e2e-mt-525288bb-openshift-default-6997db9695-r5xdb\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.629170 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.628958 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-credential-socket\") pod \"e2e-mt-525288bb-openshift-default-6997db9695-r5xdb\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.629170 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.628996 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istio-podinfo\") pod \"e2e-mt-525288bb-openshift-default-6997db9695-r5xdb\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.629170 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.629032 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istio-token\") pod \"e2e-mt-525288bb-openshift-default-6997db9695-r5xdb\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.629490 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.629299 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-workload-socket\") pod \"e2e-mt-525288bb-openshift-default-6997db9695-r5xdb\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.629490 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.629372 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istio-data\") pod \"e2e-mt-525288bb-openshift-default-6997db9695-r5xdb\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.629490 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.629389 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-workload-certs\") pod \"e2e-mt-525288bb-openshift-default-6997db9695-r5xdb\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.629651 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.629547 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-credential-socket\") pod \"e2e-mt-525288bb-openshift-default-6997db9695-r5xdb\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.630004 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.629983 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istiod-ca-cert\") pod \"e2e-mt-525288bb-openshift-default-6997db9695-r5xdb\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.631543 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.631520 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istio-envoy\") pod \"e2e-mt-525288bb-openshift-default-6997db9695-r5xdb\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.631662 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.631645 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istio-podinfo\") pod \"e2e-mt-525288bb-openshift-default-6997db9695-r5xdb\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.639547 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.639504 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istio-token\") pod \"e2e-mt-525288bb-openshift-default-6997db9695-r5xdb\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.639752 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.639619 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwc2k\" (UniqueName: \"kubernetes.io/projected/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-kube-api-access-rwc2k\") pod \"e2e-mt-525288bb-openshift-default-6997db9695-r5xdb\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.676213 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.676151 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:32.835193 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:49:32.835159 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f8cc13d_b3d6_49a4_8340_48805dc5ea97.slice/crio-7034ac580783e249ea3cb5669de6f713590ca1493182f48a5238c566c84276ea WatchSource:0}: Error finding container 7034ac580783e249ea3cb5669de6f713590ca1493182f48a5238c566c84276ea: Status 404 returned error can't find the container with id 7034ac580783e249ea3cb5669de6f713590ca1493182f48a5238c566c84276ea Jul 08 17:49:32.836631 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.836597 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb"] Jul 08 17:49:32.837358 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.837315 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:49:32.837457 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.837401 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:49:32.837457 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:32.837443 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:49:33.461655 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:33.461621 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" event={"ID":"9f8cc13d-b3d6-49a4-8340-48805dc5ea97","Type":"ContainerStarted","Data":"e1101b1d80c7d9f877ab50e9571eb04d2ce6950b6cc83c41598f28beb5bbbd4a"} Jul 08 17:49:33.462098 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:33.461677 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" event={"ID":"9f8cc13d-b3d6-49a4-8340-48805dc5ea97","Type":"ContainerStarted","Data":"7034ac580783e249ea3cb5669de6f713590ca1493182f48a5238c566c84276ea"} Jul 08 17:49:33.480673 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:33.480609 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" podStartSLOduration=1.4805913290000001 podStartE2EDuration="1.480591329s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:49:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:49:33.48013211 +0000 UTC m=+1985.890947487" watchObservedRunningTime="2026-07-08 17:49:33.480591329 +0000 UTC m=+1985.891406704" Jul 08 17:49:33.676623 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:33.676579 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:33.682645 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:33.682614 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:34.466790 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:34.466757 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:34.467721 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:34.467699 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:49.468863 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:49.468817 2556 patch_prober.go:28] interesting pod/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Jul 08 17:49:49.469290 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:49.468923 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" podUID="9f8cc13d-b3d6-49a4-8340-48805dc5ea97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Jul 08 17:49:49.551226 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:49.551194 2556 generic.go:356] "Generic (PLEG): container finished" podID="9f8cc13d-b3d6-49a4-8340-48805dc5ea97" containerID="e1101b1d80c7d9f877ab50e9571eb04d2ce6950b6cc83c41598f28beb5bbbd4a" exitCode=0 Jul 08 17:49:49.551431 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:49.551270 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" event={"ID":"9f8cc13d-b3d6-49a4-8340-48805dc5ea97","Type":"ContainerDied","Data":"e1101b1d80c7d9f877ab50e9571eb04d2ce6950b6cc83c41598f28beb5bbbd4a"} Jul 08 17:49:49.551800 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:49.551778 2556 scope.go:117] "RemoveContainer" containerID="e1101b1d80c7d9f877ab50e9571eb04d2ce6950b6cc83c41598f28beb5bbbd4a" Jul 08 17:49:49.552924 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:49.552878 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:49:49.553022 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:49.552974 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:49:49.553022 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:49.553014 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:49:50.559313 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:50.559280 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" event={"ID":"9f8cc13d-b3d6-49a4-8340-48805dc5ea97","Type":"ContainerStarted","Data":"8b6da8125c66201041bb66b0ec050bbaa079a9e292d8f648a04202a68691ff2b"} Jul 08 17:49:50.676752 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:50.676711 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:50.677035 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:50.677010 2556 patch_prober.go:28] interesting pod/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Jul 08 17:49:50.677100 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:50.677063 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" podUID="9f8cc13d-b3d6-49a4-8340-48805dc5ea97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Jul 08 17:49:51.676790 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:51.676743 2556 patch_prober.go:28] interesting pod/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Jul 08 17:49:51.677240 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:51.676808 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" podUID="9f8cc13d-b3d6-49a4-8340-48805dc5ea97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Jul 08 17:49:52.676996 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:52.676956 2556 patch_prober.go:28] interesting pod/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Jul 08 17:49:52.677399 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:52.677017 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" podUID="9f8cc13d-b3d6-49a4-8340-48805dc5ea97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Jul 08 17:49:53.677121 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:53.677083 2556 patch_prober.go:28] interesting pod/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Jul 08 17:49:53.677555 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:53.677141 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" podUID="9f8cc13d-b3d6-49a4-8340-48805dc5ea97" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Jul 08 17:49:54.681149 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:54.681113 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:54.681623 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:54.681504 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:49:54.682317 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:49:54.682296 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:51:11.520243 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:11.520203 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb"] Jul 08 17:51:11.520756 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:11.520497 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" podUID="9f8cc13d-b3d6-49a4-8340-48805dc5ea97" containerName="istio-proxy" containerID="cri-o://8b6da8125c66201041bb66b0ec050bbaa079a9e292d8f648a04202a68691ff2b" gracePeriod=30 Jul 08 17:51:16.782525 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:16.782452 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:51:16.884174 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:16.884133 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-workload-certs\") pod \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " Jul 08 17:51:16.884368 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:16.884231 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-workload-socket\") pod \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " Jul 08 17:51:16.884368 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:16.884258 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istio-envoy\") pod \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " Jul 08 17:51:16.884368 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:16.884294 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwc2k\" (UniqueName: \"kubernetes.io/projected/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-kube-api-access-rwc2k\") pod \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " Jul 08 17:51:16.884368 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:16.884334 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istio-token\") pod \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " Jul 08 17:51:16.884595 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:16.884378 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-credential-socket\") pod \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " Jul 08 17:51:16.884595 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:16.884406 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istio-data\") pod \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " Jul 08 17:51:16.884595 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:16.884408 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9f8cc13d-b3d6-49a4-8340-48805dc5ea97" (UID: "9f8cc13d-b3d6-49a4-8340-48805dc5ea97"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:51:16.884595 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:16.884440 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istio-podinfo\") pod \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " Jul 08 17:51:16.884595 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:16.884498 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istiod-ca-cert\") pod \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\" (UID: \"9f8cc13d-b3d6-49a4-8340-48805dc5ea97\") " Jul 08 17:51:16.884860 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:16.884599 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9f8cc13d-b3d6-49a4-8340-48805dc5ea97" (UID: "9f8cc13d-b3d6-49a4-8340-48805dc5ea97"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:51:16.884860 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:16.884611 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9f8cc13d-b3d6-49a4-8340-48805dc5ea97" (UID: "9f8cc13d-b3d6-49a4-8340-48805dc5ea97"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:51:16.885005 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:16.884879 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-workload-socket\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:51:16.885005 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:16.884899 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-credential-socket\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:51:16.885005 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:16.884929 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-workload-certs\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:51:16.885005 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:16.884950 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9f8cc13d-b3d6-49a4-8340-48805dc5ea97" (UID: "9f8cc13d-b3d6-49a4-8340-48805dc5ea97"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:51:16.885615 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:16.885575 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istio-data" (OuterVolumeSpecName: "istio-data") pod "9f8cc13d-b3d6-49a4-8340-48805dc5ea97" (UID: "9f8cc13d-b3d6-49a4-8340-48805dc5ea97"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:51:16.886963 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:16.886899 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9f8cc13d-b3d6-49a4-8340-48805dc5ea97" (UID: "9f8cc13d-b3d6-49a4-8340-48805dc5ea97"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:51:16.887183 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:16.887157 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-kube-api-access-rwc2k" (OuterVolumeSpecName: "kube-api-access-rwc2k") pod "9f8cc13d-b3d6-49a4-8340-48805dc5ea97" (UID: "9f8cc13d-b3d6-49a4-8340-48805dc5ea97"). InnerVolumeSpecName "kube-api-access-rwc2k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:51:16.887269 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:16.887252 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9f8cc13d-b3d6-49a4-8340-48805dc5ea97" (UID: "9f8cc13d-b3d6-49a4-8340-48805dc5ea97"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 17:51:16.887329 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:16.887272 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istio-token" (OuterVolumeSpecName: "istio-token") pod "9f8cc13d-b3d6-49a4-8340-48805dc5ea97" (UID: "9f8cc13d-b3d6-49a4-8340-48805dc5ea97"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:51:16.986130 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:16.986084 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istiod-ca-cert\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:51:16.986130 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:16.986125 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istio-envoy\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:51:16.986328 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:16.986141 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwc2k\" (UniqueName: \"kubernetes.io/projected/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-kube-api-access-rwc2k\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:51:16.986328 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:16.986155 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istio-token\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:51:16.986328 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:16.986167 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istio-data\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:51:16.986328 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:16.986180 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f8cc13d-b3d6-49a4-8340-48805dc5ea97-istio-podinfo\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:51:17.013953 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:17.013891 2556 generic.go:356] "Generic (PLEG): container finished" podID="9f8cc13d-b3d6-49a4-8340-48805dc5ea97" containerID="8b6da8125c66201041bb66b0ec050bbaa079a9e292d8f648a04202a68691ff2b" exitCode=0 Jul 08 17:51:17.014150 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:17.013972 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" Jul 08 17:51:17.014150 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:17.013981 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" event={"ID":"9f8cc13d-b3d6-49a4-8340-48805dc5ea97","Type":"ContainerDied","Data":"8b6da8125c66201041bb66b0ec050bbaa079a9e292d8f648a04202a68691ff2b"} Jul 08 17:51:17.014150 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:17.014046 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb" event={"ID":"9f8cc13d-b3d6-49a4-8340-48805dc5ea97","Type":"ContainerDied","Data":"7034ac580783e249ea3cb5669de6f713590ca1493182f48a5238c566c84276ea"} Jul 08 17:51:17.014150 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:17.014063 2556 scope.go:117] "RemoveContainer" containerID="8b6da8125c66201041bb66b0ec050bbaa079a9e292d8f648a04202a68691ff2b" Jul 08 17:51:17.027738 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:17.027713 2556 scope.go:117] "RemoveContainer" containerID="e1101b1d80c7d9f877ab50e9571eb04d2ce6950b6cc83c41598f28beb5bbbd4a" Jul 08 17:51:17.037267 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:17.037244 2556 scope.go:117] "RemoveContainer" containerID="8b6da8125c66201041bb66b0ec050bbaa079a9e292d8f648a04202a68691ff2b" Jul 08 17:51:17.037632 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:51:17.037596 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b6da8125c66201041bb66b0ec050bbaa079a9e292d8f648a04202a68691ff2b\": container with ID starting with 8b6da8125c66201041bb66b0ec050bbaa079a9e292d8f648a04202a68691ff2b not found: ID does not exist" containerID="8b6da8125c66201041bb66b0ec050bbaa079a9e292d8f648a04202a68691ff2b" Jul 08 17:51:17.037713 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:17.037638 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b6da8125c66201041bb66b0ec050bbaa079a9e292d8f648a04202a68691ff2b"} err="failed to get container status \"8b6da8125c66201041bb66b0ec050bbaa079a9e292d8f648a04202a68691ff2b\": rpc error: code = NotFound desc = could not find container \"8b6da8125c66201041bb66b0ec050bbaa079a9e292d8f648a04202a68691ff2b\": container with ID starting with 8b6da8125c66201041bb66b0ec050bbaa079a9e292d8f648a04202a68691ff2b not found: ID does not exist" Jul 08 17:51:17.037713 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:17.037658 2556 scope.go:117] "RemoveContainer" containerID="e1101b1d80c7d9f877ab50e9571eb04d2ce6950b6cc83c41598f28beb5bbbd4a" Jul 08 17:51:17.037984 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:51:17.037966 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1101b1d80c7d9f877ab50e9571eb04d2ce6950b6cc83c41598f28beb5bbbd4a\": container with ID starting with e1101b1d80c7d9f877ab50e9571eb04d2ce6950b6cc83c41598f28beb5bbbd4a not found: ID does not exist" containerID="e1101b1d80c7d9f877ab50e9571eb04d2ce6950b6cc83c41598f28beb5bbbd4a" Jul 08 17:51:17.038053 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:17.037990 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1101b1d80c7d9f877ab50e9571eb04d2ce6950b6cc83c41598f28beb5bbbd4a"} err="failed to get container status \"e1101b1d80c7d9f877ab50e9571eb04d2ce6950b6cc83c41598f28beb5bbbd4a\": rpc error: code = NotFound desc = could not find container \"e1101b1d80c7d9f877ab50e9571eb04d2ce6950b6cc83c41598f28beb5bbbd4a\": container with ID starting with e1101b1d80c7d9f877ab50e9571eb04d2ce6950b6cc83c41598f28beb5bbbd4a not found: ID does not exist" Jul 08 17:51:17.039007 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:17.038979 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb"] Jul 08 17:51:17.043007 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:17.042985 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-525288bb-openshift-default-6997db9695-r5xdb"] Jul 08 17:51:18.112966 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:18.112930 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f8cc13d-b3d6-49a4-8340-48805dc5ea97" path="/var/lib/kubelet/pods/9f8cc13d-b3d6-49a4-8340-48805dc5ea97/volumes" Jul 08 17:51:28.386700 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:28.386665 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gsn8l_c2541cd3-af4f-4de5-b042-3611d02a80ab/console-operator/1.log" Jul 08 17:51:28.395027 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:51:28.394992 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gsn8l_c2541cd3-af4f-4de5-b042-3611d02a80ab/console-operator/1.log" Jul 08 17:52:06.327391 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.327354 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl"] Jul 08 17:52:06.328031 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.327793 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f8cc13d-b3d6-49a4-8340-48805dc5ea97" containerName="istio-proxy" Jul 08 17:52:06.328031 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.327808 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f8cc13d-b3d6-49a4-8340-48805dc5ea97" containerName="istio-proxy" Jul 08 17:52:06.328031 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.327838 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5edec18-4ac5-4770-bb3e-efc4de1b328a" containerName="istio-proxy" Jul 08 17:52:06.328031 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.327848 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5edec18-4ac5-4770-bb3e-efc4de1b328a" containerName="istio-proxy" Jul 08 17:52:06.328031 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.327970 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f8cc13d-b3d6-49a4-8340-48805dc5ea97" containerName="istio-proxy" Jul 08 17:52:06.331247 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.331226 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.333556 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.333534 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-a1ffe7-openshift-default-dockercfg-jpkqt\"" Jul 08 17:52:06.343030 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.343003 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl"] Jul 08 17:52:06.450441 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.450401 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-workload-certs\") pod \"e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.450441 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.450450 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-istio-data\") pod \"e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.450677 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.450485 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-credential-socket\") pod \"e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.450677 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.450506 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-istio-envoy\") pod \"e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.450677 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.450549 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-workload-socket\") pod \"e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.450677 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.450574 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drt58\" (UniqueName: \"kubernetes.io/projected/f6118a3c-2719-40e4-aa6f-853890a8bc22-kube-api-access-drt58\") pod \"e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.450677 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.450598 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6118a3c-2719-40e4-aa6f-853890a8bc22-istio-podinfo\") pod \"e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.450677 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.450622 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6118a3c-2719-40e4-aa6f-853890a8bc22-istiod-ca-cert\") pod \"e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.450871 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.450706 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6118a3c-2719-40e4-aa6f-853890a8bc22-istio-token\") pod \"e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.551887 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.551845 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6118a3c-2719-40e4-aa6f-853890a8bc22-istio-token\") pod \"e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.552104 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.551897 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-workload-certs\") pod \"e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.552104 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.552059 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-istio-data\") pod \"e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.552202 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.552112 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-credential-socket\") pod \"e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.552202 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.552142 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-istio-envoy\") pod \"e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.552307 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.552201 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-workload-socket\") pod \"e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.552307 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.552228 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drt58\" (UniqueName: \"kubernetes.io/projected/f6118a3c-2719-40e4-aa6f-853890a8bc22-kube-api-access-drt58\") pod \"e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.552307 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.552274 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6118a3c-2719-40e4-aa6f-853890a8bc22-istio-podinfo\") pod \"e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.552307 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.552296 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-workload-certs\") pod \"e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.552516 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.552308 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6118a3c-2719-40e4-aa6f-853890a8bc22-istiod-ca-cert\") pod \"e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.552516 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.552385 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-istio-data\") pod \"e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.552516 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.552443 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-credential-socket\") pod \"e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.552680 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.552644 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-workload-socket\") pod \"e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.552975 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.552952 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6118a3c-2719-40e4-aa6f-853890a8bc22-istiod-ca-cert\") pod \"e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.554611 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.554590 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-istio-envoy\") pod \"e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.554826 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.554809 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6118a3c-2719-40e4-aa6f-853890a8bc22-istio-podinfo\") pod \"e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.561714 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.561682 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6118a3c-2719-40e4-aa6f-853890a8bc22-istio-token\") pod \"e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.561866 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.561842 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drt58\" (UniqueName: \"kubernetes.io/projected/f6118a3c-2719-40e4-aa6f-853890a8bc22-kube-api-access-drt58\") pod \"e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.642511 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.642468 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:06.797609 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.797581 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl"] Jul 08 17:52:06.800122 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:52:06.800087 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6118a3c_2719_40e4_aa6f_853890a8bc22.slice/crio-f049334822768ea5e7d6380d5723a9465a40abfe1eb221275d4e13da35638abb WatchSource:0}: Error finding container f049334822768ea5e7d6380d5723a9465a40abfe1eb221275d4e13da35638abb: Status 404 returned error can't find the container with id f049334822768ea5e7d6380d5723a9465a40abfe1eb221275d4e13da35638abb Jul 08 17:52:06.802718 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.802680 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:52:06.802806 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.802758 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:52:06.802806 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:06.802788 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:52:07.279857 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:07.279817 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" event={"ID":"f6118a3c-2719-40e4-aa6f-853890a8bc22","Type":"ContainerStarted","Data":"344acb6760bf18382c4914d4db34872bbe3542ce6ce478d347b09464aa62903f"} Jul 08 17:52:07.280104 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:07.279887 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" event={"ID":"f6118a3c-2719-40e4-aa6f-853890a8bc22","Type":"ContainerStarted","Data":"f049334822768ea5e7d6380d5723a9465a40abfe1eb221275d4e13da35638abb"} Jul 08 17:52:07.299505 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:07.299435 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" podStartSLOduration=1.299412633 podStartE2EDuration="1.299412633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:52:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:52:07.298791333 +0000 UTC m=+2139.709606737" watchObservedRunningTime="2026-07-08 17:52:07.299412633 +0000 UTC m=+2139.710228012" Jul 08 17:52:07.643028 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:07.642984 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:07.647946 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:07.647906 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:08.286217 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:08.286185 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:08.287163 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:08.287139 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:14.476184 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.476148 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4"] Jul 08 17:52:14.476721 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.476671 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f8cc13d-b3d6-49a4-8340-48805dc5ea97" containerName="istio-proxy" Jul 08 17:52:14.476721 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.476690 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f8cc13d-b3d6-49a4-8340-48805dc5ea97" containerName="istio-proxy" Jul 08 17:52:14.476876 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.476812 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f8cc13d-b3d6-49a4-8340-48805dc5ea97" containerName="istio-proxy" Jul 08 17:52:14.480242 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.480214 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.482984 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.482957 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-446c79-openshift-default-dockercfg-ghx7s\"" Jul 08 17:52:14.491720 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.491690 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4"] Jul 08 17:52:14.528543 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.528505 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istio-podinfo\") pod \"e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.528749 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.528557 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-credential-socket\") pod \"e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.528749 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.528587 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istio-data\") pod \"e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.528749 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.528630 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz8xd\" (UniqueName: \"kubernetes.io/projected/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-kube-api-access-jz8xd\") pod \"e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.528749 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.528706 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istio-envoy\") pod \"e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.528749 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.528734 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-workload-certs\") pod \"e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.528973 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.528794 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istio-token\") pod \"e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.528973 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.528899 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istiod-ca-cert\") pod \"e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.528973 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.528963 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-workload-socket\") pod \"e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.629845 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.629807 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istiod-ca-cert\") pod \"e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.629845 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.629856 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-workload-socket\") pod \"e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.630174 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.629897 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istio-podinfo\") pod \"e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.630174 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.629951 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-credential-socket\") pod \"e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.630174 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.629973 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istio-data\") pod \"e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.630174 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.630007 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz8xd\" (UniqueName: \"kubernetes.io/projected/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-kube-api-access-jz8xd\") pod \"e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.630174 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.630045 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istio-envoy\") pod \"e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.630174 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.630061 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-workload-certs\") pod \"e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.630174 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.630122 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istio-token\") pod \"e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.630532 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.630351 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-workload-socket\") pod \"e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.630532 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.630382 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-credential-socket\") pod \"e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.630615 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.630595 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istio-data\") pod \"e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.630684 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.630662 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-workload-certs\") pod \"e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.630820 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.630803 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istiod-ca-cert\") pod \"e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.632458 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.632434 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istio-envoy\") pod \"e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.632640 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.632620 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istio-podinfo\") pod \"e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.638375 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.638346 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz8xd\" (UniqueName: \"kubernetes.io/projected/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-kube-api-access-jz8xd\") pod \"e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.638629 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.638612 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istio-token\") pod \"e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.793968 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.793850 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:14.956013 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.955980 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4"] Jul 08 17:52:14.958405 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:52:14.958379 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb51ab69_73f1_4264_9f3e_99ec4c63a94d.slice/crio-a7fe6f41431bd145e4b36665f534cc27c7167fc2d7bc775c695a6ec3665b40de WatchSource:0}: Error finding container a7fe6f41431bd145e4b36665f534cc27c7167fc2d7bc775c695a6ec3665b40de: Status 404 returned error can't find the container with id a7fe6f41431bd145e4b36665f534cc27c7167fc2d7bc775c695a6ec3665b40de Jul 08 17:52:14.960675 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.960640 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:52:14.960770 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.960711 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:52:14.960770 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:14.960742 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:52:15.326259 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:15.326209 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" event={"ID":"bb51ab69-73f1-4264-9f3e-99ec4c63a94d","Type":"ContainerStarted","Data":"38dfafaa9e0f32d406e5783fe5052a73491d60cf14579efba36c5cc57e639525"} Jul 08 17:52:15.326485 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:15.326289 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" event={"ID":"bb51ab69-73f1-4264-9f3e-99ec4c63a94d","Type":"ContainerStarted","Data":"a7fe6f41431bd145e4b36665f534cc27c7167fc2d7bc775c695a6ec3665b40de"} Jul 08 17:52:15.348853 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:15.348791 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" podStartSLOduration=1.348772197 podStartE2EDuration="1.348772197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:52:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:52:15.348046112 +0000 UTC m=+2147.758861502" watchObservedRunningTime="2026-07-08 17:52:15.348772197 +0000 UTC m=+2147.759587574" Jul 08 17:52:15.794860 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:15.794821 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:16.799872 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:16.799841 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:17.338007 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:17.337977 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:17.339198 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:17.339178 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:24.327143 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:24.327096 2556 patch_prober.go:28] interesting pod/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 08 17:52:24.327605 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:24.327181 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" podUID="f6118a3c-2719-40e4-aa6f-853890a8bc22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 08 17:52:26.387566 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:26.387529 2556 generic.go:356] "Generic (PLEG): container finished" podID="f6118a3c-2719-40e4-aa6f-853890a8bc22" containerID="344acb6760bf18382c4914d4db34872bbe3542ce6ce478d347b09464aa62903f" exitCode=0 Jul 08 17:52:26.388098 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:26.387599 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" event={"ID":"f6118a3c-2719-40e4-aa6f-853890a8bc22","Type":"ContainerDied","Data":"344acb6760bf18382c4914d4db34872bbe3542ce6ce478d347b09464aa62903f"} Jul 08 17:52:26.388098 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:26.388082 2556 scope.go:117] "RemoveContainer" containerID="344acb6760bf18382c4914d4db34872bbe3542ce6ce478d347b09464aa62903f" Jul 08 17:52:26.389264 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:26.389227 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:52:26.389347 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:26.389309 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:52:26.389347 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:26.389342 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:52:27.404023 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:27.403982 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" event={"ID":"f6118a3c-2719-40e4-aa6f-853890a8bc22","Type":"ContainerStarted","Data":"d23519d7ea97e7a9455e517a74b9ad4c8f62690a848d830e46a87530f5c4c05b"} Jul 08 17:52:27.642783 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:27.642737 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:27.643039 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:27.643017 2556 patch_prober.go:28] interesting pod/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Jul 08 17:52:27.643095 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:27.643067 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" podUID="f6118a3c-2719-40e4-aa6f-853890a8bc22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Jul 08 17:52:28.642929 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:28.642873 2556 patch_prober.go:28] interesting pod/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Jul 08 17:52:28.643400 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:28.642961 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" podUID="f6118a3c-2719-40e4-aa6f-853890a8bc22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Jul 08 17:52:29.643788 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:29.643745 2556 patch_prober.go:28] interesting pod/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Jul 08 17:52:29.644227 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:29.643809 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" podUID="f6118a3c-2719-40e4-aa6f-853890a8bc22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Jul 08 17:52:30.643855 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:30.643818 2556 patch_prober.go:28] interesting pod/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Jul 08 17:52:30.644284 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:30.643877 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" podUID="f6118a3c-2719-40e4-aa6f-853890a8bc22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Jul 08 17:52:31.643498 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:31.643454 2556 patch_prober.go:28] interesting pod/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Jul 08 17:52:31.643690 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:31.643516 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" podUID="f6118a3c-2719-40e4-aa6f-853890a8bc22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Jul 08 17:52:32.647106 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:32.647061 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:32.647575 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:32.647440 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:32.648195 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:32.648173 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:52:33.380112 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:33.380064 2556 patch_prober.go:28] interesting pod/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 08 17:52:33.380330 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:33.380116 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" podUID="bb51ab69-73f1-4264-9f3e-99ec4c63a94d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 08 17:52:34.453339 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:34.453304 2556 generic.go:356] "Generic (PLEG): container finished" podID="bb51ab69-73f1-4264-9f3e-99ec4c63a94d" containerID="38dfafaa9e0f32d406e5783fe5052a73491d60cf14579efba36c5cc57e639525" exitCode=0 Jul 08 17:52:34.453817 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:34.453376 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" event={"ID":"bb51ab69-73f1-4264-9f3e-99ec4c63a94d","Type":"ContainerDied","Data":"38dfafaa9e0f32d406e5783fe5052a73491d60cf14579efba36c5cc57e639525"} Jul 08 17:52:34.453890 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:34.453875 2556 scope.go:117] "RemoveContainer" containerID="38dfafaa9e0f32d406e5783fe5052a73491d60cf14579efba36c5cc57e639525" Jul 08 17:52:34.454904 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:34.454865 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:52:34.455030 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:34.454966 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:52:34.455100 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:34.455029 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:52:35.460927 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:35.460876 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" event={"ID":"bb51ab69-73f1-4264-9f3e-99ec4c63a94d","Type":"ContainerStarted","Data":"f2bee3d022ffba5d03904d915f1a18ececc0819315842266226da57f1c93009a"} Jul 08 17:52:35.794472 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:35.794372 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:35.794797 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:35.794768 2556 patch_prober.go:28] interesting pod/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Jul 08 17:52:35.795029 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:35.795001 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" podUID="bb51ab69-73f1-4264-9f3e-99ec4c63a94d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Jul 08 17:52:36.795377 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:36.795325 2556 patch_prober.go:28] interesting pod/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Jul 08 17:52:36.795953 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:36.795416 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" podUID="bb51ab69-73f1-4264-9f3e-99ec4c63a94d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Jul 08 17:52:37.795816 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:37.795351 2556 patch_prober.go:28] interesting pod/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Jul 08 17:52:37.795816 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:37.795417 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" podUID="bb51ab69-73f1-4264-9f3e-99ec4c63a94d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Jul 08 17:52:38.795260 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:38.795217 2556 patch_prober.go:28] interesting pod/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Jul 08 17:52:38.795608 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:38.795574 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" podUID="bb51ab69-73f1-4264-9f3e-99ec4c63a94d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Jul 08 17:52:39.798538 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:39.798495 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:39.798982 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:39.798784 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:52:39.799636 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:52:39.799618 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:54:05.178271 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:05.178237 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl"] Jul 08 17:54:05.178812 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:05.178446 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" podUID="f6118a3c-2719-40e4-aa6f-853890a8bc22" containerName="istio-proxy" containerID="cri-o://d23519d7ea97e7a9455e517a74b9ad4c8f62690a848d830e46a87530f5c4c05b" gracePeriod=30 Jul 08 17:54:10.433541 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.433513 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:54:10.531209 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.531113 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-istio-envoy\") pod \"f6118a3c-2719-40e4-aa6f-853890a8bc22\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " Jul 08 17:54:10.531209 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.531178 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-workload-socket\") pod \"f6118a3c-2719-40e4-aa6f-853890a8bc22\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " Jul 08 17:54:10.531404 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.531296 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drt58\" (UniqueName: \"kubernetes.io/projected/f6118a3c-2719-40e4-aa6f-853890a8bc22-kube-api-access-drt58\") pod \"f6118a3c-2719-40e4-aa6f-853890a8bc22\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " Jul 08 17:54:10.531404 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.531336 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6118a3c-2719-40e4-aa6f-853890a8bc22-istio-podinfo\") pod \"f6118a3c-2719-40e4-aa6f-853890a8bc22\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " Jul 08 17:54:10.531404 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.531369 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-workload-certs\") pod \"f6118a3c-2719-40e4-aa6f-853890a8bc22\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " Jul 08 17:54:10.531501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.531405 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-credential-socket\") pod \"f6118a3c-2719-40e4-aa6f-853890a8bc22\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " Jul 08 17:54:10.531501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.531444 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f6118a3c-2719-40e4-aa6f-853890a8bc22" (UID: "f6118a3c-2719-40e4-aa6f-853890a8bc22"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:54:10.531501 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.531486 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6118a3c-2719-40e4-aa6f-853890a8bc22-istio-token\") pod \"f6118a3c-2719-40e4-aa6f-853890a8bc22\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " Jul 08 17:54:10.531606 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.531573 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-istio-data\") pod \"f6118a3c-2719-40e4-aa6f-853890a8bc22\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " Jul 08 17:54:10.531640 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.531605 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6118a3c-2719-40e4-aa6f-853890a8bc22-istiod-ca-cert\") pod \"f6118a3c-2719-40e4-aa6f-853890a8bc22\" (UID: \"f6118a3c-2719-40e4-aa6f-853890a8bc22\") " Jul 08 17:54:10.531966 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.531903 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f6118a3c-2719-40e4-aa6f-853890a8bc22" (UID: "f6118a3c-2719-40e4-aa6f-853890a8bc22"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:54:10.531966 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.531952 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f6118a3c-2719-40e4-aa6f-853890a8bc22" (UID: "f6118a3c-2719-40e4-aa6f-853890a8bc22"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:54:10.532223 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.531995 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-workload-socket\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:10.532299 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.532268 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6118a3c-2719-40e4-aa6f-853890a8bc22-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f6118a3c-2719-40e4-aa6f-853890a8bc22" (UID: "f6118a3c-2719-40e4-aa6f-853890a8bc22"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:54:10.532796 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.532769 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-istio-data" (OuterVolumeSpecName: "istio-data") pod "f6118a3c-2719-40e4-aa6f-853890a8bc22" (UID: "f6118a3c-2719-40e4-aa6f-853890a8bc22"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:54:10.533727 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.533700 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6118a3c-2719-40e4-aa6f-853890a8bc22-kube-api-access-drt58" (OuterVolumeSpecName: "kube-api-access-drt58") pod "f6118a3c-2719-40e4-aa6f-853890a8bc22" (UID: "f6118a3c-2719-40e4-aa6f-853890a8bc22"). InnerVolumeSpecName "kube-api-access-drt58". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:54:10.533888 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.533870 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f6118a3c-2719-40e4-aa6f-853890a8bc22-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f6118a3c-2719-40e4-aa6f-853890a8bc22" (UID: "f6118a3c-2719-40e4-aa6f-853890a8bc22"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 17:54:10.533998 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.533879 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f6118a3c-2719-40e4-aa6f-853890a8bc22" (UID: "f6118a3c-2719-40e4-aa6f-853890a8bc22"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:54:10.533998 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.533892 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6118a3c-2719-40e4-aa6f-853890a8bc22-istio-token" (OuterVolumeSpecName: "istio-token") pod "f6118a3c-2719-40e4-aa6f-853890a8bc22" (UID: "f6118a3c-2719-40e4-aa6f-853890a8bc22"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:54:10.632747 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.632709 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drt58\" (UniqueName: \"kubernetes.io/projected/f6118a3c-2719-40e4-aa6f-853890a8bc22-kube-api-access-drt58\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:10.632747 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.632742 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6118a3c-2719-40e4-aa6f-853890a8bc22-istio-podinfo\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:10.632747 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.632754 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-workload-certs\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:10.633034 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.632770 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-credential-socket\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:10.633034 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.632779 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6118a3c-2719-40e4-aa6f-853890a8bc22-istio-token\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:10.633034 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.632787 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-istio-data\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:10.633034 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.632795 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6118a3c-2719-40e4-aa6f-853890a8bc22-istiod-ca-cert\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:10.633034 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.632802 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6118a3c-2719-40e4-aa6f-853890a8bc22-istio-envoy\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:10.968160 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.968125 2556 generic.go:356] "Generic (PLEG): container finished" podID="f6118a3c-2719-40e4-aa6f-853890a8bc22" containerID="d23519d7ea97e7a9455e517a74b9ad4c8f62690a848d830e46a87530f5c4c05b" exitCode=0 Jul 08 17:54:10.968346 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.968178 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" Jul 08 17:54:10.968346 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.968215 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" event={"ID":"f6118a3c-2719-40e4-aa6f-853890a8bc22","Type":"ContainerDied","Data":"d23519d7ea97e7a9455e517a74b9ad4c8f62690a848d830e46a87530f5c4c05b"} Jul 08 17:54:10.968346 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.968275 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl" event={"ID":"f6118a3c-2719-40e4-aa6f-853890a8bc22","Type":"ContainerDied","Data":"f049334822768ea5e7d6380d5723a9465a40abfe1eb221275d4e13da35638abb"} Jul 08 17:54:10.968346 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.968298 2556 scope.go:117] "RemoveContainer" containerID="d23519d7ea97e7a9455e517a74b9ad4c8f62690a848d830e46a87530f5c4c05b" Jul 08 17:54:10.978500 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.978480 2556 scope.go:117] "RemoveContainer" containerID="344acb6760bf18382c4914d4db34872bbe3542ce6ce478d347b09464aa62903f" Jul 08 17:54:10.987484 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.987466 2556 scope.go:117] "RemoveContainer" containerID="d23519d7ea97e7a9455e517a74b9ad4c8f62690a848d830e46a87530f5c4c05b" Jul 08 17:54:10.987787 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:54:10.987767 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d23519d7ea97e7a9455e517a74b9ad4c8f62690a848d830e46a87530f5c4c05b\": container with ID starting with d23519d7ea97e7a9455e517a74b9ad4c8f62690a848d830e46a87530f5c4c05b not found: ID does not exist" containerID="d23519d7ea97e7a9455e517a74b9ad4c8f62690a848d830e46a87530f5c4c05b" Jul 08 17:54:10.987848 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.987797 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d23519d7ea97e7a9455e517a74b9ad4c8f62690a848d830e46a87530f5c4c05b"} err="failed to get container status \"d23519d7ea97e7a9455e517a74b9ad4c8f62690a848d830e46a87530f5c4c05b\": rpc error: code = NotFound desc = could not find container \"d23519d7ea97e7a9455e517a74b9ad4c8f62690a848d830e46a87530f5c4c05b\": container with ID starting with d23519d7ea97e7a9455e517a74b9ad4c8f62690a848d830e46a87530f5c4c05b not found: ID does not exist" Jul 08 17:54:10.987848 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.987816 2556 scope.go:117] "RemoveContainer" containerID="344acb6760bf18382c4914d4db34872bbe3542ce6ce478d347b09464aa62903f" Jul 08 17:54:10.988184 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:54:10.988139 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"344acb6760bf18382c4914d4db34872bbe3542ce6ce478d347b09464aa62903f\": container with ID starting with 344acb6760bf18382c4914d4db34872bbe3542ce6ce478d347b09464aa62903f not found: ID does not exist" containerID="344acb6760bf18382c4914d4db34872bbe3542ce6ce478d347b09464aa62903f" Jul 08 17:54:10.988383 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.988196 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"344acb6760bf18382c4914d4db34872bbe3542ce6ce478d347b09464aa62903f"} err="failed to get container status \"344acb6760bf18382c4914d4db34872bbe3542ce6ce478d347b09464aa62903f\": rpc error: code = NotFound desc = could not find container \"344acb6760bf18382c4914d4db34872bbe3542ce6ce478d347b09464aa62903f\": container with ID starting with 344acb6760bf18382c4914d4db34872bbe3542ce6ce478d347b09464aa62903f not found: ID does not exist" Jul 08 17:54:10.990722 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.990702 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl"] Jul 08 17:54:10.994433 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:10.994414 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-a1ffe7-openshift-default-7cfb8c5c7-5jqkl"] Jul 08 17:54:12.112695 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:12.112662 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6118a3c-2719-40e4-aa6f-853890a8bc22" path="/var/lib/kubelet/pods/f6118a3c-2719-40e4-aa6f-853890a8bc22/volumes" Jul 08 17:54:12.359463 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:12.359429 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4"] Jul 08 17:54:12.359648 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:12.359626 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" podUID="bb51ab69-73f1-4264-9f3e-99ec4c63a94d" containerName="istio-proxy" containerID="cri-o://f2bee3d022ffba5d03904d915f1a18ececc0819315842266226da57f1c93009a" gracePeriod=30 Jul 08 17:54:13.300677 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.300637 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj"] Jul 08 17:54:13.301283 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.301262 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6118a3c-2719-40e4-aa6f-853890a8bc22" containerName="istio-proxy" Jul 08 17:54:13.301374 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.301286 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6118a3c-2719-40e4-aa6f-853890a8bc22" containerName="istio-proxy" Jul 08 17:54:13.301374 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.301301 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6118a3c-2719-40e4-aa6f-853890a8bc22" containerName="istio-proxy" Jul 08 17:54:13.301374 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.301309 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6118a3c-2719-40e4-aa6f-853890a8bc22" containerName="istio-proxy" Jul 08 17:54:13.301539 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.301419 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6118a3c-2719-40e4-aa6f-853890a8bc22" containerName="istio-proxy" Jul 08 17:54:13.306340 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.306316 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.311479 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.309049 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-7e76ff-openshift-default-dockercfg-9j5bd\"" Jul 08 17:54:13.320749 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.320716 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj"] Jul 08 17:54:13.358443 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.358403 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-workload-certs\") pod \"e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.358443 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.358448 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-istio-envoy\") pod \"e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.358663 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.358536 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-istio-data\") pod \"e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.358663 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.358574 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a354e11-cad0-4983-97de-1cf40b3f99df-istio-token\") pod \"e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.358663 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.358606 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crzpv\" (UniqueName: \"kubernetes.io/projected/3a354e11-cad0-4983-97de-1cf40b3f99df-kube-api-access-crzpv\") pod \"e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.358663 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.358627 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a354e11-cad0-4983-97de-1cf40b3f99df-istio-podinfo\") pod \"e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.358799 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.358715 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-workload-socket\") pod \"e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.358799 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.358742 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-credential-socket\") pod \"e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.358865 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.358824 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a354e11-cad0-4983-97de-1cf40b3f99df-istiod-ca-cert\") pod \"e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.459855 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.459815 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a354e11-cad0-4983-97de-1cf40b3f99df-istiod-ca-cert\") pod \"e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.459855 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.459861 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-workload-certs\") pod \"e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.460144 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.459882 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-istio-envoy\") pod \"e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.460144 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.459945 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-istio-data\") pod \"e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.460144 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.459967 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a354e11-cad0-4983-97de-1cf40b3f99df-istio-token\") pod \"e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.460144 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.460002 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crzpv\" (UniqueName: \"kubernetes.io/projected/3a354e11-cad0-4983-97de-1cf40b3f99df-kube-api-access-crzpv\") pod \"e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.460354 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.460140 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a354e11-cad0-4983-97de-1cf40b3f99df-istio-podinfo\") pod \"e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.460354 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.460228 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-workload-socket\") pod \"e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.460354 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.460255 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-credential-socket\") pod \"e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.460521 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.460369 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-workload-certs\") pod \"e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.460645 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.460620 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-credential-socket\") pod \"e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.460731 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.460649 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-workload-socket\") pod \"e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.460731 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.460698 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a354e11-cad0-4983-97de-1cf40b3f99df-istiod-ca-cert\") pod \"e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.460835 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.460727 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-istio-data\") pod \"e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.462434 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.462412 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-istio-envoy\") pod \"e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.462615 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.462597 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a354e11-cad0-4983-97de-1cf40b3f99df-istio-podinfo\") pod \"e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.471117 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.471091 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a354e11-cad0-4983-97de-1cf40b3f99df-istio-token\") pod \"e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.471336 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.471307 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crzpv\" (UniqueName: \"kubernetes.io/projected/3a354e11-cad0-4983-97de-1cf40b3f99df-kube-api-access-crzpv\") pod \"e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.624656 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.624622 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:13.778012 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.777985 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj"] Jul 08 17:54:13.780378 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:54:13.780349 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a354e11_cad0_4983_97de_1cf40b3f99df.slice/crio-3b6d5025d18b840180c6d1038afd125f73580889b44e62bf13861626d3c03011 WatchSource:0}: Error finding container 3b6d5025d18b840180c6d1038afd125f73580889b44e62bf13861626d3c03011: Status 404 returned error can't find the container with id 3b6d5025d18b840180c6d1038afd125f73580889b44e62bf13861626d3c03011 Jul 08 17:54:13.782820 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.782785 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:54:13.782950 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.782855 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:54:13.782950 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.782884 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:54:13.988943 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.988799 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" event={"ID":"3a354e11-cad0-4983-97de-1cf40b3f99df","Type":"ContainerStarted","Data":"aee9d89f79f46e88210b9f74996ca9c1a7ff88fdc57d67d1b09fd1935eaac52e"} Jul 08 17:54:13.988943 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:13.988878 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" event={"ID":"3a354e11-cad0-4983-97de-1cf40b3f99df","Type":"ContainerStarted","Data":"3b6d5025d18b840180c6d1038afd125f73580889b44e62bf13861626d3c03011"} Jul 08 17:54:14.023071 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:14.023003 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" podStartSLOduration=1.022981312 podStartE2EDuration="1.022981312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:54:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:54:14.020162529 +0000 UTC m=+2266.430977906" watchObservedRunningTime="2026-07-08 17:54:14.022981312 +0000 UTC m=+2266.433796691" Jul 08 17:54:14.625795 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:14.625755 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:14.631081 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:14.631054 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:14.994744 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:14.994659 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:14.995664 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:14.995644 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:17.626507 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:17.626434 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:54:17.704856 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:17.704808 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istio-data\") pod \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " Jul 08 17:54:17.704856 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:17.704862 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-workload-socket\") pod \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " Jul 08 17:54:17.705155 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:17.704896 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istiod-ca-cert\") pod \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " Jul 08 17:54:17.705155 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:17.704944 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jz8xd\" (UniqueName: \"kubernetes.io/projected/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-kube-api-access-jz8xd\") pod \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " Jul 08 17:54:17.705155 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:17.705011 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istio-envoy\") pod \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " Jul 08 17:54:17.705155 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:17.705035 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istio-token\") pod \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " Jul 08 17:54:17.705155 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:17.705085 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istio-podinfo\") pod \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " Jul 08 17:54:17.705155 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:17.705112 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-workload-certs\") pod \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " Jul 08 17:54:17.705155 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:17.705151 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-credential-socket\") pod \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\" (UID: \"bb51ab69-73f1-4264-9f3e-99ec4c63a94d\") " Jul 08 17:54:17.705514 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:17.705186 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bb51ab69-73f1-4264-9f3e-99ec4c63a94d" (UID: "bb51ab69-73f1-4264-9f3e-99ec4c63a94d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:54:17.705514 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:17.705363 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bb51ab69-73f1-4264-9f3e-99ec4c63a94d" (UID: "bb51ab69-73f1-4264-9f3e-99ec4c63a94d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:54:17.705514 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:17.705491 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bb51ab69-73f1-4264-9f3e-99ec4c63a94d" (UID: "bb51ab69-73f1-4264-9f3e-99ec4c63a94d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:54:17.705706 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:17.705672 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bb51ab69-73f1-4264-9f3e-99ec4c63a94d" (UID: "bb51ab69-73f1-4264-9f3e-99ec4c63a94d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:54:17.705827 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:17.705804 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istiod-ca-cert\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:17.705885 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:17.705828 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-workload-certs\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:17.705885 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:17.705826 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istio-data" (OuterVolumeSpecName: "istio-data") pod "bb51ab69-73f1-4264-9f3e-99ec4c63a94d" (UID: "bb51ab69-73f1-4264-9f3e-99ec4c63a94d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:54:17.705885 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:17.705841 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-credential-socket\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:17.705885 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:17.705857 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-workload-socket\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:17.707332 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:17.707307 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bb51ab69-73f1-4264-9f3e-99ec4c63a94d" (UID: "bb51ab69-73f1-4264-9f3e-99ec4c63a94d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 17:54:17.707428 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:17.707386 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istio-token" (OuterVolumeSpecName: "istio-token") pod "bb51ab69-73f1-4264-9f3e-99ec4c63a94d" (UID: "bb51ab69-73f1-4264-9f3e-99ec4c63a94d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:54:17.707684 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:17.707657 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-kube-api-access-jz8xd" (OuterVolumeSpecName: "kube-api-access-jz8xd") pod "bb51ab69-73f1-4264-9f3e-99ec4c63a94d" (UID: "bb51ab69-73f1-4264-9f3e-99ec4c63a94d"). InnerVolumeSpecName "kube-api-access-jz8xd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:54:17.707684 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:17.707662 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bb51ab69-73f1-4264-9f3e-99ec4c63a94d" (UID: "bb51ab69-73f1-4264-9f3e-99ec4c63a94d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:54:17.806686 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:17.806647 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jz8xd\" (UniqueName: \"kubernetes.io/projected/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-kube-api-access-jz8xd\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:17.806686 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:17.806681 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istio-envoy\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:17.806686 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:17.806691 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istio-token\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:17.806958 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:17.806701 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istio-podinfo\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:17.806958 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:17.806709 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bb51ab69-73f1-4264-9f3e-99ec4c63a94d-istio-data\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:18.013500 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:18.013408 2556 generic.go:356] "Generic (PLEG): container finished" podID="bb51ab69-73f1-4264-9f3e-99ec4c63a94d" containerID="f2bee3d022ffba5d03904d915f1a18ececc0819315842266226da57f1c93009a" exitCode=0 Jul 08 17:54:18.013500 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:18.013463 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" Jul 08 17:54:18.013500 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:18.013470 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" event={"ID":"bb51ab69-73f1-4264-9f3e-99ec4c63a94d","Type":"ContainerDied","Data":"f2bee3d022ffba5d03904d915f1a18ececc0819315842266226da57f1c93009a"} Jul 08 17:54:18.013761 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:18.013541 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4" event={"ID":"bb51ab69-73f1-4264-9f3e-99ec4c63a94d","Type":"ContainerDied","Data":"a7fe6f41431bd145e4b36665f534cc27c7167fc2d7bc775c695a6ec3665b40de"} Jul 08 17:54:18.013761 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:18.013563 2556 scope.go:117] "RemoveContainer" containerID="f2bee3d022ffba5d03904d915f1a18ececc0819315842266226da57f1c93009a" Jul 08 17:54:18.023597 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:18.023575 2556 scope.go:117] "RemoveContainer" containerID="38dfafaa9e0f32d406e5783fe5052a73491d60cf14579efba36c5cc57e639525" Jul 08 17:54:18.032342 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:18.032323 2556 scope.go:117] "RemoveContainer" containerID="f2bee3d022ffba5d03904d915f1a18ececc0819315842266226da57f1c93009a" Jul 08 17:54:18.032619 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:54:18.032599 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2bee3d022ffba5d03904d915f1a18ececc0819315842266226da57f1c93009a\": container with ID starting with f2bee3d022ffba5d03904d915f1a18ececc0819315842266226da57f1c93009a not found: ID does not exist" containerID="f2bee3d022ffba5d03904d915f1a18ececc0819315842266226da57f1c93009a" Jul 08 17:54:18.032707 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:18.032626 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2bee3d022ffba5d03904d915f1a18ececc0819315842266226da57f1c93009a"} err="failed to get container status \"f2bee3d022ffba5d03904d915f1a18ececc0819315842266226da57f1c93009a\": rpc error: code = NotFound desc = could not find container \"f2bee3d022ffba5d03904d915f1a18ececc0819315842266226da57f1c93009a\": container with ID starting with f2bee3d022ffba5d03904d915f1a18ececc0819315842266226da57f1c93009a not found: ID does not exist" Jul 08 17:54:18.032707 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:18.032642 2556 scope.go:117] "RemoveContainer" containerID="38dfafaa9e0f32d406e5783fe5052a73491d60cf14579efba36c5cc57e639525" Jul 08 17:54:18.032883 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:54:18.032863 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38dfafaa9e0f32d406e5783fe5052a73491d60cf14579efba36c5cc57e639525\": container with ID starting with 38dfafaa9e0f32d406e5783fe5052a73491d60cf14579efba36c5cc57e639525 not found: ID does not exist" containerID="38dfafaa9e0f32d406e5783fe5052a73491d60cf14579efba36c5cc57e639525" Jul 08 17:54:18.032961 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:18.032890 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38dfafaa9e0f32d406e5783fe5052a73491d60cf14579efba36c5cc57e639525"} err="failed to get container status \"38dfafaa9e0f32d406e5783fe5052a73491d60cf14579efba36c5cc57e639525\": rpc error: code = NotFound desc = could not find container \"38dfafaa9e0f32d406e5783fe5052a73491d60cf14579efba36c5cc57e639525\": container with ID starting with 38dfafaa9e0f32d406e5783fe5052a73491d60cf14579efba36c5cc57e639525 not found: ID does not exist" Jul 08 17:54:18.037748 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:18.037725 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4"] Jul 08 17:54:18.042292 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:18.042257 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-446c79-openshift-default-5d9bf656b9-zs5d4"] Jul 08 17:54:18.112864 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:18.112832 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb51ab69-73f1-4264-9f3e-99ec4c63a94d" path="/var/lib/kubelet/pods/bb51ab69-73f1-4264-9f3e-99ec4c63a94d/volumes" Jul 08 17:54:21.419210 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.416987 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn"] Jul 08 17:54:21.419210 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.417951 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb51ab69-73f1-4264-9f3e-99ec4c63a94d" containerName="istio-proxy" Jul 08 17:54:21.419210 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.417972 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb51ab69-73f1-4264-9f3e-99ec4c63a94d" containerName="istio-proxy" Jul 08 17:54:21.419210 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.417996 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb51ab69-73f1-4264-9f3e-99ec4c63a94d" containerName="istio-proxy" Jul 08 17:54:21.419210 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.418005 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb51ab69-73f1-4264-9f3e-99ec4c63a94d" containerName="istio-proxy" Jul 08 17:54:21.419210 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.418215 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb51ab69-73f1-4264-9f3e-99ec4c63a94d" containerName="istio-proxy" Jul 08 17:54:21.419210 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.418227 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6118a3c-2719-40e4-aa6f-853890a8bc22" containerName="istio-proxy" Jul 08 17:54:21.419210 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.418246 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb51ab69-73f1-4264-9f3e-99ec4c63a94d" containerName="istio-proxy" Jul 08 17:54:21.424016 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.423987 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.426691 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.426669 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-e3904d-openshift-default-dockercfg-tqkqs\"" Jul 08 17:54:21.431386 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.431356 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn"] Jul 08 17:54:21.544785 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.544748 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8377a81b-43d3-4c47-8100-e1278c6fefac-istiod-ca-cert\") pod \"e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.544785 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.544795 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-istio-envoy\") pod \"e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.545091 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.544858 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8377a81b-43d3-4c47-8100-e1278c6fefac-istio-token\") pod \"e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.545091 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.544884 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-workload-socket\") pod \"e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.545091 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.544980 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h24g5\" (UniqueName: \"kubernetes.io/projected/8377a81b-43d3-4c47-8100-e1278c6fefac-kube-api-access-h24g5\") pod \"e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.545262 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.545098 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8377a81b-43d3-4c47-8100-e1278c6fefac-istio-podinfo\") pod \"e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.545262 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.545153 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-credential-socket\") pod \"e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.545262 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.545214 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-workload-certs\") pod \"e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.545262 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.545257 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-istio-data\") pod \"e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.646726 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.646690 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-workload-certs\") pod \"e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.646726 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.646729 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-istio-data\") pod \"e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.647053 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.646752 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8377a81b-43d3-4c47-8100-e1278c6fefac-istiod-ca-cert\") pod \"e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.647053 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.646778 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-istio-envoy\") pod \"e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.647053 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.646819 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8377a81b-43d3-4c47-8100-e1278c6fefac-istio-token\") pod \"e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.647053 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.646848 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-workload-socket\") pod \"e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.647053 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.646881 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h24g5\" (UniqueName: \"kubernetes.io/projected/8377a81b-43d3-4c47-8100-e1278c6fefac-kube-api-access-h24g5\") pod \"e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.647053 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.646946 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8377a81b-43d3-4c47-8100-e1278c6fefac-istio-podinfo\") pod \"e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.647053 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.646991 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-credential-socket\") pod \"e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.647375 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.647217 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-istio-data\") pod \"e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.647375 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.647302 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-workload-socket\") pod \"e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.647375 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.647320 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-workload-certs\") pod \"e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.647375 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.647369 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-credential-socket\") pod \"e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.647782 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.647761 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8377a81b-43d3-4c47-8100-e1278c6fefac-istiod-ca-cert\") pod \"e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.649523 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.649495 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8377a81b-43d3-4c47-8100-e1278c6fefac-istio-podinfo\") pod \"e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.649624 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.649568 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-istio-envoy\") pod \"e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.655404 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.655376 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8377a81b-43d3-4c47-8100-e1278c6fefac-istio-token\") pod \"e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.655563 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.655543 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h24g5\" (UniqueName: \"kubernetes.io/projected/8377a81b-43d3-4c47-8100-e1278c6fefac-kube-api-access-h24g5\") pod \"e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.736732 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.736639 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:21.885936 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.885892 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn"] Jul 08 17:54:21.887803 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:54:21.887775 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8377a81b_43d3_4c47_8100_e1278c6fefac.slice/crio-e9cdded3e9a1ab6bb893de5305123dc4f60fe14ea8c0cdda622aaf40342e1ce2 WatchSource:0}: Error finding container e9cdded3e9a1ab6bb893de5305123dc4f60fe14ea8c0cdda622aaf40342e1ce2: Status 404 returned error can't find the container with id e9cdded3e9a1ab6bb893de5305123dc4f60fe14ea8c0cdda622aaf40342e1ce2 Jul 08 17:54:21.890474 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.890440 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:54:21.890566 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.890506 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:54:21.890566 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:21.890535 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:54:22.039180 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:22.039085 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" event={"ID":"8377a81b-43d3-4c47-8100-e1278c6fefac","Type":"ContainerStarted","Data":"1cc28faa71b5092935ba57c245380df840014861add982dcc69eb78aa6825e44"} Jul 08 17:54:22.039180 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:22.039152 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" event={"ID":"8377a81b-43d3-4c47-8100-e1278c6fefac","Type":"ContainerStarted","Data":"e9cdded3e9a1ab6bb893de5305123dc4f60fe14ea8c0cdda622aaf40342e1ce2"} Jul 08 17:54:22.060035 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:22.059979 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" podStartSLOduration=1.059962325 podStartE2EDuration="1.059962325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:54:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:54:22.057379564 +0000 UTC m=+2274.468194942" watchObservedRunningTime="2026-07-08 17:54:22.059962325 +0000 UTC m=+2274.470777701" Jul 08 17:54:22.737264 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:22.737214 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:22.742828 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:22.742800 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:23.044596 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:23.044515 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:23.045614 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:23.045592 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:29.996088 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:29.996043 2556 patch_prober.go:28] interesting pod/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body= Jul 08 17:54:29.996519 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:29.996120 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" podUID="3a354e11-cad0-4983-97de-1cf40b3f99df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" Jul 08 17:54:30.083512 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:30.083477 2556 generic.go:356] "Generic (PLEG): container finished" podID="3a354e11-cad0-4983-97de-1cf40b3f99df" containerID="aee9d89f79f46e88210b9f74996ca9c1a7ff88fdc57d67d1b09fd1935eaac52e" exitCode=0 Jul 08 17:54:30.083696 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:30.083543 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" event={"ID":"3a354e11-cad0-4983-97de-1cf40b3f99df","Type":"ContainerDied","Data":"aee9d89f79f46e88210b9f74996ca9c1a7ff88fdc57d67d1b09fd1935eaac52e"} Jul 08 17:54:30.084054 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:30.084037 2556 scope.go:117] "RemoveContainer" containerID="aee9d89f79f46e88210b9f74996ca9c1a7ff88fdc57d67d1b09fd1935eaac52e" Jul 08 17:54:30.085133 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:30.085101 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:54:30.085199 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:30.085182 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:54:30.085241 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:30.085218 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:54:31.092293 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:31.092251 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" event={"ID":"3a354e11-cad0-4983-97de-1cf40b3f99df","Type":"ContainerStarted","Data":"e365b6ba9142ac95a927a0fccb0ef0de7ae1b2806161100719fdf78da363accb"} Jul 08 17:54:31.625660 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:31.625620 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:31.625861 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:31.625838 2556 patch_prober.go:28] interesting pod/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body= Jul 08 17:54:31.625933 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:31.625891 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" podUID="3a354e11-cad0-4983-97de-1cf40b3f99df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" Jul 08 17:54:32.626173 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:32.626129 2556 patch_prober.go:28] interesting pod/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body= Jul 08 17:54:32.626667 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:32.626205 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" podUID="3a354e11-cad0-4983-97de-1cf40b3f99df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" Jul 08 17:54:33.625935 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:33.625715 2556 patch_prober.go:28] interesting pod/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body= Jul 08 17:54:33.625935 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:33.625787 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" podUID="3a354e11-cad0-4983-97de-1cf40b3f99df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" Jul 08 17:54:34.625748 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:34.625699 2556 patch_prober.go:28] interesting pod/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body= Jul 08 17:54:34.626317 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:34.625774 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" podUID="3a354e11-cad0-4983-97de-1cf40b3f99df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" Jul 08 17:54:35.629010 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:35.628975 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:35.629460 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:35.629441 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:35.630294 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:35.630276 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:39.086166 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:39.086113 2556 patch_prober.go:28] interesting pod/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 08 17:54:39.086638 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:39.086195 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" podUID="8377a81b-43d3-4c47-8100-e1278c6fefac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 08 17:54:41.165126 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:41.165093 2556 generic.go:356] "Generic (PLEG): container finished" podID="8377a81b-43d3-4c47-8100-e1278c6fefac" containerID="1cc28faa71b5092935ba57c245380df840014861add982dcc69eb78aa6825e44" exitCode=0 Jul 08 17:54:41.165557 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:41.165170 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" event={"ID":"8377a81b-43d3-4c47-8100-e1278c6fefac","Type":"ContainerDied","Data":"1cc28faa71b5092935ba57c245380df840014861add982dcc69eb78aa6825e44"} Jul 08 17:54:41.165629 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:41.165614 2556 scope.go:117] "RemoveContainer" containerID="1cc28faa71b5092935ba57c245380df840014861add982dcc69eb78aa6825e44" Jul 08 17:54:41.166612 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:41.166585 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:54:41.166661 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:41.166653 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:54:41.166707 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:41.166686 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:54:42.172701 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:42.172666 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" event={"ID":"8377a81b-43d3-4c47-8100-e1278c6fefac","Type":"ContainerStarted","Data":"c0548614ef4942ab1747f5da63ba079283bc6f97d0e4772cd932d408066c2253"} Jul 08 17:54:42.736884 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:42.736846 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:42.737116 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:42.737094 2556 patch_prober.go:28] interesting pod/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body= Jul 08 17:54:42.737176 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:42.737156 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" podUID="8377a81b-43d3-4c47-8100-e1278c6fefac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" Jul 08 17:54:43.621353 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:43.621166 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj"] Jul 08 17:54:43.622564 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:43.622012 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" podUID="3a354e11-cad0-4983-97de-1cf40b3f99df" containerName="istio-proxy" containerID="cri-o://e365b6ba9142ac95a927a0fccb0ef0de7ae1b2806161100719fdf78da363accb" gracePeriod=30 Jul 08 17:54:43.737123 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:43.737085 2556 patch_prober.go:28] interesting pod/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body= Jul 08 17:54:43.737313 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:43.737143 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" podUID="8377a81b-43d3-4c47-8100-e1278c6fefac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" Jul 08 17:54:44.737812 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:44.737773 2556 patch_prober.go:28] interesting pod/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body= Jul 08 17:54:44.738213 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:44.737836 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" podUID="8377a81b-43d3-4c47-8100-e1278c6fefac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" Jul 08 17:54:45.737251 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:45.737212 2556 patch_prober.go:28] interesting pod/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body= Jul 08 17:54:45.737451 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:45.737276 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" podUID="8377a81b-43d3-4c47-8100-e1278c6fefac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" Jul 08 17:54:46.740785 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:46.740746 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:46.741313 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:46.741171 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:46.742063 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:46.742038 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:48.892944 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:48.892855 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:48.945188 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:48.945145 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-istio-data\") pod \"3a354e11-cad0-4983-97de-1cf40b3f99df\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " Jul 08 17:54:48.945402 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:48.945203 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-istio-envoy\") pod \"3a354e11-cad0-4983-97de-1cf40b3f99df\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " Jul 08 17:54:48.945402 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:48.945222 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crzpv\" (UniqueName: \"kubernetes.io/projected/3a354e11-cad0-4983-97de-1cf40b3f99df-kube-api-access-crzpv\") pod \"3a354e11-cad0-4983-97de-1cf40b3f99df\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " Jul 08 17:54:48.945402 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:48.945260 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a354e11-cad0-4983-97de-1cf40b3f99df-istio-token\") pod \"3a354e11-cad0-4983-97de-1cf40b3f99df\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " Jul 08 17:54:48.945402 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:48.945320 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-workload-socket\") pod \"3a354e11-cad0-4983-97de-1cf40b3f99df\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " Jul 08 17:54:48.945402 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:48.945340 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a354e11-cad0-4983-97de-1cf40b3f99df-istio-podinfo\") pod \"3a354e11-cad0-4983-97de-1cf40b3f99df\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " Jul 08 17:54:48.945402 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:48.945369 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-workload-certs\") pod \"3a354e11-cad0-4983-97de-1cf40b3f99df\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " Jul 08 17:54:48.945733 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:48.945470 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a354e11-cad0-4983-97de-1cf40b3f99df-istiod-ca-cert\") pod \"3a354e11-cad0-4983-97de-1cf40b3f99df\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " Jul 08 17:54:48.945733 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:48.945503 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-credential-socket\") pod \"3a354e11-cad0-4983-97de-1cf40b3f99df\" (UID: \"3a354e11-cad0-4983-97de-1cf40b3f99df\") " Jul 08 17:54:48.945829 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:48.945789 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3a354e11-cad0-4983-97de-1cf40b3f99df" (UID: "3a354e11-cad0-4983-97de-1cf40b3f99df"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:54:48.945963 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:48.945901 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-workload-certs\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:48.946045 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:48.946005 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3a354e11-cad0-4983-97de-1cf40b3f99df" (UID: "3a354e11-cad0-4983-97de-1cf40b3f99df"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:54:48.946045 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:48.946004 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3a354e11-cad0-4983-97de-1cf40b3f99df" (UID: "3a354e11-cad0-4983-97de-1cf40b3f99df"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:54:48.946328 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:48.946304 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a354e11-cad0-4983-97de-1cf40b3f99df-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3a354e11-cad0-4983-97de-1cf40b3f99df" (UID: "3a354e11-cad0-4983-97de-1cf40b3f99df"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:54:48.946396 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:48.946302 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-istio-data" (OuterVolumeSpecName: "istio-data") pod "3a354e11-cad0-4983-97de-1cf40b3f99df" (UID: "3a354e11-cad0-4983-97de-1cf40b3f99df"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:54:48.947840 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:48.947811 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a354e11-cad0-4983-97de-1cf40b3f99df-kube-api-access-crzpv" (OuterVolumeSpecName: "kube-api-access-crzpv") pod "3a354e11-cad0-4983-97de-1cf40b3f99df" (UID: "3a354e11-cad0-4983-97de-1cf40b3f99df"). InnerVolumeSpecName "kube-api-access-crzpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:54:48.948081 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:48.947858 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3a354e11-cad0-4983-97de-1cf40b3f99df" (UID: "3a354e11-cad0-4983-97de-1cf40b3f99df"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:54:48.948156 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:48.948119 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3a354e11-cad0-4983-97de-1cf40b3f99df-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3a354e11-cad0-4983-97de-1cf40b3f99df" (UID: "3a354e11-cad0-4983-97de-1cf40b3f99df"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 17:54:48.948587 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:48.948542 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a354e11-cad0-4983-97de-1cf40b3f99df-istio-token" (OuterVolumeSpecName: "istio-token") pod "3a354e11-cad0-4983-97de-1cf40b3f99df" (UID: "3a354e11-cad0-4983-97de-1cf40b3f99df"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:54:49.047321 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:49.047284 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a354e11-cad0-4983-97de-1cf40b3f99df-istio-token\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:49.047321 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:49.047316 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-workload-socket\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:49.047321 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:49.047326 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a354e11-cad0-4983-97de-1cf40b3f99df-istio-podinfo\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:49.047321 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:49.047334 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a354e11-cad0-4983-97de-1cf40b3f99df-istiod-ca-cert\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:49.047618 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:49.047342 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-credential-socket\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:49.047618 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:49.047360 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-istio-data\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:49.047618 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:49.047368 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a354e11-cad0-4983-97de-1cf40b3f99df-istio-envoy\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:49.047618 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:49.047395 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crzpv\" (UniqueName: \"kubernetes.io/projected/3a354e11-cad0-4983-97de-1cf40b3f99df-kube-api-access-crzpv\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:49.228106 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:49.228018 2556 generic.go:356] "Generic (PLEG): container finished" podID="3a354e11-cad0-4983-97de-1cf40b3f99df" containerID="e365b6ba9142ac95a927a0fccb0ef0de7ae1b2806161100719fdf78da363accb" exitCode=0 Jul 08 17:54:49.228106 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:49.228058 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" event={"ID":"3a354e11-cad0-4983-97de-1cf40b3f99df","Type":"ContainerDied","Data":"e365b6ba9142ac95a927a0fccb0ef0de7ae1b2806161100719fdf78da363accb"} Jul 08 17:54:49.228106 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:49.228091 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" Jul 08 17:54:49.228106 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:49.228103 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj" event={"ID":"3a354e11-cad0-4983-97de-1cf40b3f99df","Type":"ContainerDied","Data":"3b6d5025d18b840180c6d1038afd125f73580889b44e62bf13861626d3c03011"} Jul 08 17:54:49.228403 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:49.228124 2556 scope.go:117] "RemoveContainer" containerID="e365b6ba9142ac95a927a0fccb0ef0de7ae1b2806161100719fdf78da363accb" Jul 08 17:54:49.238031 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:49.238008 2556 scope.go:117] "RemoveContainer" containerID="aee9d89f79f46e88210b9f74996ca9c1a7ff88fdc57d67d1b09fd1935eaac52e" Jul 08 17:54:49.246669 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:49.246642 2556 scope.go:117] "RemoveContainer" containerID="e365b6ba9142ac95a927a0fccb0ef0de7ae1b2806161100719fdf78da363accb" Jul 08 17:54:49.246964 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:54:49.246942 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e365b6ba9142ac95a927a0fccb0ef0de7ae1b2806161100719fdf78da363accb\": container with ID starting with e365b6ba9142ac95a927a0fccb0ef0de7ae1b2806161100719fdf78da363accb not found: ID does not exist" containerID="e365b6ba9142ac95a927a0fccb0ef0de7ae1b2806161100719fdf78da363accb" Jul 08 17:54:49.247068 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:49.246978 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e365b6ba9142ac95a927a0fccb0ef0de7ae1b2806161100719fdf78da363accb"} err="failed to get container status \"e365b6ba9142ac95a927a0fccb0ef0de7ae1b2806161100719fdf78da363accb\": rpc error: code = NotFound desc = could not find container \"e365b6ba9142ac95a927a0fccb0ef0de7ae1b2806161100719fdf78da363accb\": container with ID starting with e365b6ba9142ac95a927a0fccb0ef0de7ae1b2806161100719fdf78da363accb not found: ID does not exist" Jul 08 17:54:49.247068 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:49.247003 2556 scope.go:117] "RemoveContainer" containerID="aee9d89f79f46e88210b9f74996ca9c1a7ff88fdc57d67d1b09fd1935eaac52e" Jul 08 17:54:49.247240 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:54:49.247222 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aee9d89f79f46e88210b9f74996ca9c1a7ff88fdc57d67d1b09fd1935eaac52e\": container with ID starting with aee9d89f79f46e88210b9f74996ca9c1a7ff88fdc57d67d1b09fd1935eaac52e not found: ID does not exist" containerID="aee9d89f79f46e88210b9f74996ca9c1a7ff88fdc57d67d1b09fd1935eaac52e" Jul 08 17:54:49.247280 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:49.247247 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aee9d89f79f46e88210b9f74996ca9c1a7ff88fdc57d67d1b09fd1935eaac52e"} err="failed to get container status \"aee9d89f79f46e88210b9f74996ca9c1a7ff88fdc57d67d1b09fd1935eaac52e\": rpc error: code = NotFound desc = could not find container \"aee9d89f79f46e88210b9f74996ca9c1a7ff88fdc57d67d1b09fd1935eaac52e\": container with ID starting with aee9d89f79f46e88210b9f74996ca9c1a7ff88fdc57d67d1b09fd1935eaac52e not found: ID does not exist" Jul 08 17:54:49.255552 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:49.255521 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj"] Jul 08 17:54:49.263631 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:49.263592 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-7e76ff-openshift-default-b4fcdb8cc-t4vwj"] Jul 08 17:54:50.114272 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:50.114235 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a354e11-cad0-4983-97de-1cf40b3f99df" path="/var/lib/kubelet/pods/3a354e11-cad0-4983-97de-1cf40b3f99df/volumes" Jul 08 17:54:50.475310 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:50.475211 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn"] Jul 08 17:54:50.475516 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:50.475485 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" podUID="8377a81b-43d3-4c47-8100-e1278c6fefac" containerName="istio-proxy" containerID="cri-o://c0548614ef4942ab1747f5da63ba079283bc6f97d0e4772cd932d408066c2253" gracePeriod=30 Jul 08 17:54:51.380880 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.380845 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg"] Jul 08 17:54:51.381609 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.381585 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a354e11-cad0-4983-97de-1cf40b3f99df" containerName="istio-proxy" Jul 08 17:54:51.381713 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.381612 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a354e11-cad0-4983-97de-1cf40b3f99df" containerName="istio-proxy" Jul 08 17:54:51.381770 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.381762 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a354e11-cad0-4983-97de-1cf40b3f99df" containerName="istio-proxy" Jul 08 17:54:51.381821 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.381778 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a354e11-cad0-4983-97de-1cf40b3f99df" containerName="istio-proxy" Jul 08 17:54:51.386476 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.386451 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.389586 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.389559 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-67c226-openshift-default-dockercfg-vggk7\"" Jul 08 17:54:51.398141 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.398108 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg"] Jul 08 17:54:51.472931 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.472886 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-istio-envoy\") pod \"e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.473147 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.473004 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z57xk\" (UniqueName: \"kubernetes.io/projected/8aae4896-24d4-40e7-976c-69d019c0c072-kube-api-access-z57xk\") pod \"e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.473147 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.473051 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-credential-socket\") pod \"e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.473147 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.473091 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8aae4896-24d4-40e7-976c-69d019c0c072-istio-podinfo\") pod \"e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.473280 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.473181 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-workload-certs\") pod \"e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.473280 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.473212 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8aae4896-24d4-40e7-976c-69d019c0c072-istiod-ca-cert\") pod \"e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.473280 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.473229 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8aae4896-24d4-40e7-976c-69d019c0c072-istio-token\") pod \"e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.473418 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.473278 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-istio-data\") pod \"e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.473418 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.473324 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-workload-socket\") pod \"e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.574743 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.574704 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-credential-socket\") pod \"e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.574978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.574824 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8aae4896-24d4-40e7-976c-69d019c0c072-istio-podinfo\") pod \"e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.574978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.574882 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-workload-certs\") pod \"e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.574978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.574964 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8aae4896-24d4-40e7-976c-69d019c0c072-istiod-ca-cert\") pod \"e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.575184 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.574994 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8aae4896-24d4-40e7-976c-69d019c0c072-istio-token\") pod \"e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.575184 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.575030 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-istio-data\") pod \"e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.575184 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.575079 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-workload-socket\") pod \"e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.575184 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.575144 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-istio-envoy\") pod \"e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.575184 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.575172 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z57xk\" (UniqueName: \"kubernetes.io/projected/8aae4896-24d4-40e7-976c-69d019c0c072-kube-api-access-z57xk\") pod \"e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.575449 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.575197 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-credential-socket\") pod \"e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.575449 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.575299 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-workload-certs\") pod \"e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.575449 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.575368 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-istio-data\") pod \"e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.575637 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.575620 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-workload-socket\") pod \"e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.575728 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.575708 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8aae4896-24d4-40e7-976c-69d019c0c072-istiod-ca-cert\") pod \"e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.577383 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.577361 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-istio-envoy\") pod \"e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.577521 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.577504 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8aae4896-24d4-40e7-976c-69d019c0c072-istio-podinfo\") pod \"e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.583886 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.583857 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8aae4896-24d4-40e7-976c-69d019c0c072-istio-token\") pod \"e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.584036 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.584014 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z57xk\" (UniqueName: \"kubernetes.io/projected/8aae4896-24d4-40e7-976c-69d019c0c072-kube-api-access-z57xk\") pod \"e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.700255 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.700154 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:51.848966 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.848938 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg"] Jul 08 17:54:51.851190 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:54:51.851160 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aae4896_24d4_40e7_976c_69d019c0c072.slice/crio-ceb85e242be1bc6efa9a65e3ab80f2791e05b7c779675a3a2cdc2e590ed89021 WatchSource:0}: Error finding container ceb85e242be1bc6efa9a65e3ab80f2791e05b7c779675a3a2cdc2e590ed89021: Status 404 returned error can't find the container with id ceb85e242be1bc6efa9a65e3ab80f2791e05b7c779675a3a2cdc2e590ed89021 Jul 08 17:54:51.853496 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.853448 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:54:51.853597 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.853557 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:54:51.853639 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:51.853608 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:54:52.247625 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:52.247589 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" event={"ID":"8aae4896-24d4-40e7-976c-69d019c0c072","Type":"ContainerStarted","Data":"826cbbefed96b2bc3f66a01473728c34315df80ade41d68e0faef8781a68c66f"} Jul 08 17:54:52.247788 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:52.247655 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" event={"ID":"8aae4896-24d4-40e7-976c-69d019c0c072","Type":"ContainerStarted","Data":"ceb85e242be1bc6efa9a65e3ab80f2791e05b7c779675a3a2cdc2e590ed89021"} Jul 08 17:54:52.271864 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:52.271795 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" podStartSLOduration=1.271770166 podStartE2EDuration="1.271770166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:54:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:54:52.27135713 +0000 UTC m=+2304.682172511" watchObservedRunningTime="2026-07-08 17:54:52.271770166 +0000 UTC m=+2304.682585544" Jul 08 17:54:52.700592 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:52.700554 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:52.705563 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:52.705535 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:53.254053 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:53.254021 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:53.255111 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:53.255086 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:54:55.743761 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:55.743696 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:55.826054 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:55.826019 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-credential-socket\") pod \"8377a81b-43d3-4c47-8100-e1278c6fefac\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " Jul 08 17:54:55.826236 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:55.826092 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8377a81b-43d3-4c47-8100-e1278c6fefac-istiod-ca-cert\") pod \"8377a81b-43d3-4c47-8100-e1278c6fefac\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " Jul 08 17:54:55.826236 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:55.826116 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8377a81b-43d3-4c47-8100-e1278c6fefac-istio-token\") pod \"8377a81b-43d3-4c47-8100-e1278c6fefac\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " Jul 08 17:54:55.826236 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:55.826171 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-workload-certs\") pod \"8377a81b-43d3-4c47-8100-e1278c6fefac\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " Jul 08 17:54:55.826236 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:55.826214 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h24g5\" (UniqueName: \"kubernetes.io/projected/8377a81b-43d3-4c47-8100-e1278c6fefac-kube-api-access-h24g5\") pod \"8377a81b-43d3-4c47-8100-e1278c6fefac\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " Jul 08 17:54:55.826442 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:55.826266 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-workload-socket\") pod \"8377a81b-43d3-4c47-8100-e1278c6fefac\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " Jul 08 17:54:55.826442 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:55.826294 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8377a81b-43d3-4c47-8100-e1278c6fefac-istio-podinfo\") pod \"8377a81b-43d3-4c47-8100-e1278c6fefac\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " Jul 08 17:54:55.826442 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:55.826338 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-istio-envoy\") pod \"8377a81b-43d3-4c47-8100-e1278c6fefac\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " Jul 08 17:54:55.826442 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:55.826368 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8377a81b-43d3-4c47-8100-e1278c6fefac" (UID: "8377a81b-43d3-4c47-8100-e1278c6fefac"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:54:55.826442 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:55.826381 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-istio-data\") pod \"8377a81b-43d3-4c47-8100-e1278c6fefac\" (UID: \"8377a81b-43d3-4c47-8100-e1278c6fefac\") " Jul 08 17:54:55.826708 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:55.826522 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8377a81b-43d3-4c47-8100-e1278c6fefac" (UID: "8377a81b-43d3-4c47-8100-e1278c6fefac"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:54:55.826708 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:55.826545 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8377a81b-43d3-4c47-8100-e1278c6fefac" (UID: "8377a81b-43d3-4c47-8100-e1278c6fefac"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:54:55.826708 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:55.826613 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8377a81b-43d3-4c47-8100-e1278c6fefac-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8377a81b-43d3-4c47-8100-e1278c6fefac" (UID: "8377a81b-43d3-4c47-8100-e1278c6fefac"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:54:55.826953 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:55.826885 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-workload-socket\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:55.827082 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:55.826959 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-credential-socket\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:55.827082 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:55.826976 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8377a81b-43d3-4c47-8100-e1278c6fefac-istiod-ca-cert\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:55.827082 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:55.826991 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-workload-certs\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:55.827486 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:55.827458 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-istio-data" (OuterVolumeSpecName: "istio-data") pod "8377a81b-43d3-4c47-8100-e1278c6fefac" (UID: "8377a81b-43d3-4c47-8100-e1278c6fefac"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:54:55.828489 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:55.828465 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8377a81b-43d3-4c47-8100-e1278c6fefac-istio-token" (OuterVolumeSpecName: "istio-token") pod "8377a81b-43d3-4c47-8100-e1278c6fefac" (UID: "8377a81b-43d3-4c47-8100-e1278c6fefac"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:54:55.828592 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:55.828496 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8377a81b-43d3-4c47-8100-e1278c6fefac-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8377a81b-43d3-4c47-8100-e1278c6fefac" (UID: "8377a81b-43d3-4c47-8100-e1278c6fefac"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 17:54:55.828592 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:55.828548 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8377a81b-43d3-4c47-8100-e1278c6fefac" (UID: "8377a81b-43d3-4c47-8100-e1278c6fefac"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:54:55.828787 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:55.828769 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8377a81b-43d3-4c47-8100-e1278c6fefac-kube-api-access-h24g5" (OuterVolumeSpecName: "kube-api-access-h24g5") pod "8377a81b-43d3-4c47-8100-e1278c6fefac" (UID: "8377a81b-43d3-4c47-8100-e1278c6fefac"). InnerVolumeSpecName "kube-api-access-h24g5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:54:55.928171 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:55.928129 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8377a81b-43d3-4c47-8100-e1278c6fefac-istio-podinfo\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:55.928171 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:55.928165 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-istio-envoy\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:55.928171 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:55.928176 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8377a81b-43d3-4c47-8100-e1278c6fefac-istio-data\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:55.928171 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:55.928184 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8377a81b-43d3-4c47-8100-e1278c6fefac-istio-token\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:55.928458 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:55.928192 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h24g5\" (UniqueName: \"kubernetes.io/projected/8377a81b-43d3-4c47-8100-e1278c6fefac-kube-api-access-h24g5\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:54:56.276763 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:56.276726 2556 generic.go:356] "Generic (PLEG): container finished" podID="8377a81b-43d3-4c47-8100-e1278c6fefac" containerID="c0548614ef4942ab1747f5da63ba079283bc6f97d0e4772cd932d408066c2253" exitCode=0 Jul 08 17:54:56.276763 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:56.276759 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" event={"ID":"8377a81b-43d3-4c47-8100-e1278c6fefac","Type":"ContainerDied","Data":"c0548614ef4942ab1747f5da63ba079283bc6f97d0e4772cd932d408066c2253"} Jul 08 17:54:56.277046 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:56.276779 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" Jul 08 17:54:56.277046 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:56.276820 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn" event={"ID":"8377a81b-43d3-4c47-8100-e1278c6fefac","Type":"ContainerDied","Data":"e9cdded3e9a1ab6bb893de5305123dc4f60fe14ea8c0cdda622aaf40342e1ce2"} Jul 08 17:54:56.277046 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:56.276856 2556 scope.go:117] "RemoveContainer" containerID="c0548614ef4942ab1747f5da63ba079283bc6f97d0e4772cd932d408066c2253" Jul 08 17:54:56.285967 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:56.285936 2556 scope.go:117] "RemoveContainer" containerID="1cc28faa71b5092935ba57c245380df840014861add982dcc69eb78aa6825e44" Jul 08 17:54:56.295903 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:56.295865 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn"] Jul 08 17:54:56.297412 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:56.297377 2556 scope.go:117] "RemoveContainer" containerID="c0548614ef4942ab1747f5da63ba079283bc6f97d0e4772cd932d408066c2253" Jul 08 17:54:56.297732 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:54:56.297709 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0548614ef4942ab1747f5da63ba079283bc6f97d0e4772cd932d408066c2253\": container with ID starting with c0548614ef4942ab1747f5da63ba079283bc6f97d0e4772cd932d408066c2253 not found: ID does not exist" containerID="c0548614ef4942ab1747f5da63ba079283bc6f97d0e4772cd932d408066c2253" Jul 08 17:54:56.297818 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:56.297742 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0548614ef4942ab1747f5da63ba079283bc6f97d0e4772cd932d408066c2253"} err="failed to get container status \"c0548614ef4942ab1747f5da63ba079283bc6f97d0e4772cd932d408066c2253\": rpc error: code = NotFound desc = could not find container \"c0548614ef4942ab1747f5da63ba079283bc6f97d0e4772cd932d408066c2253\": container with ID starting with c0548614ef4942ab1747f5da63ba079283bc6f97d0e4772cd932d408066c2253 not found: ID does not exist" Jul 08 17:54:56.297818 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:56.297790 2556 scope.go:117] "RemoveContainer" containerID="1cc28faa71b5092935ba57c245380df840014861add982dcc69eb78aa6825e44" Jul 08 17:54:56.298140 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:54:56.298119 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cc28faa71b5092935ba57c245380df840014861add982dcc69eb78aa6825e44\": container with ID starting with 1cc28faa71b5092935ba57c245380df840014861add982dcc69eb78aa6825e44 not found: ID does not exist" containerID="1cc28faa71b5092935ba57c245380df840014861add982dcc69eb78aa6825e44" Jul 08 17:54:56.298212 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:56.298147 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cc28faa71b5092935ba57c245380df840014861add982dcc69eb78aa6825e44"} err="failed to get container status \"1cc28faa71b5092935ba57c245380df840014861add982dcc69eb78aa6825e44\": rpc error: code = NotFound desc = could not find container \"1cc28faa71b5092935ba57c245380df840014861add982dcc69eb78aa6825e44\": container with ID starting with 1cc28faa71b5092935ba57c245380df840014861add982dcc69eb78aa6825e44 not found: ID does not exist" Jul 08 17:54:56.299520 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:56.299501 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-e3904d-openshift-default-6b648c6f79-6jqwn"] Jul 08 17:54:58.112722 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:58.112688 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8377a81b-43d3-4c47-8100-e1278c6fefac" path="/var/lib/kubelet/pods/8377a81b-43d3-4c47-8100-e1278c6fefac/volumes" Jul 08 17:54:59.415976 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.415941 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n"] Jul 08 17:54:59.416393 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.416376 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a354e11-cad0-4983-97de-1cf40b3f99df" containerName="istio-proxy" Jul 08 17:54:59.416437 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.416395 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a354e11-cad0-4983-97de-1cf40b3f99df" containerName="istio-proxy" Jul 08 17:54:59.416437 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.416416 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8377a81b-43d3-4c47-8100-e1278c6fefac" containerName="istio-proxy" Jul 08 17:54:59.416437 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.416421 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8377a81b-43d3-4c47-8100-e1278c6fefac" containerName="istio-proxy" Jul 08 17:54:59.416531 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.416495 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="8377a81b-43d3-4c47-8100-e1278c6fefac" containerName="istio-proxy" Jul 08 17:54:59.416531 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.416507 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="8377a81b-43d3-4c47-8100-e1278c6fefac" containerName="istio-proxy" Jul 08 17:54:59.421196 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.421166 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.423880 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.423853 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-9fde78-openshift-default-dockercfg-dkflp\"" Jul 08 17:54:59.432691 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.432660 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n"] Jul 08 17:54:59.562882 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.562844 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f69ef0f-83a4-419d-bdec-325b657db116-istiod-ca-cert\") pod \"e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.563091 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.562902 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-istio-envoy\") pod \"e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.563091 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.562953 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-istio-data\") pod \"e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.563091 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.563020 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f69ef0f-83a4-419d-bdec-325b657db116-istio-podinfo\") pod \"e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.563091 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.563048 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmnjr\" (UniqueName: \"kubernetes.io/projected/5f69ef0f-83a4-419d-bdec-325b657db116-kube-api-access-mmnjr\") pod \"e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.563311 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.563092 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-workload-socket\") pod \"e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.563311 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.563121 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f69ef0f-83a4-419d-bdec-325b657db116-istio-token\") pod \"e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.563311 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.563173 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-workload-certs\") pod \"e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.563311 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.563211 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-credential-socket\") pod \"e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.664003 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.663970 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f69ef0f-83a4-419d-bdec-325b657db116-istiod-ca-cert\") pod \"e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.664200 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.664034 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-istio-envoy\") pod \"e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.664200 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.664055 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-istio-data\") pod \"e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.664200 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.664088 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f69ef0f-83a4-419d-bdec-325b657db116-istio-podinfo\") pod \"e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.664200 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.664106 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmnjr\" (UniqueName: \"kubernetes.io/projected/5f69ef0f-83a4-419d-bdec-325b657db116-kube-api-access-mmnjr\") pod \"e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.664200 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.664152 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-workload-socket\") pod \"e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.664200 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.664194 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f69ef0f-83a4-419d-bdec-325b657db116-istio-token\") pod \"e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.664538 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.664223 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-workload-certs\") pod \"e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.664538 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.664248 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-credential-socket\") pod \"e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.664538 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.664521 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-istio-data\") pod \"e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.664691 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.664678 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f69ef0f-83a4-419d-bdec-325b657db116-istiod-ca-cert\") pod \"e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.664872 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.664851 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-workload-certs\") pod \"e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.664971 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.664852 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-credential-socket\") pod \"e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.664971 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.664897 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-workload-socket\") pod \"e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.666559 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.666509 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-istio-envoy\") pod \"e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.666747 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.666730 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f69ef0f-83a4-419d-bdec-325b657db116-istio-podinfo\") pod \"e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.677261 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.673429 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f69ef0f-83a4-419d-bdec-325b657db116-istio-token\") pod \"e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.677261 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.673575 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmnjr\" (UniqueName: \"kubernetes.io/projected/5f69ef0f-83a4-419d-bdec-325b657db116-kube-api-access-mmnjr\") pod \"e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.733336 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.733291 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:54:59.886239 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.886040 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n"] Jul 08 17:54:59.890481 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:54:59.890447 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f69ef0f_83a4_419d_bdec_325b657db116.slice/crio-559e05de1f261091b5fcdc89c4d8bfa6097a0ab9c9ee1bc1f2cb5236b101e2bd WatchSource:0}: Error finding container 559e05de1f261091b5fcdc89c4d8bfa6097a0ab9c9ee1bc1f2cb5236b101e2bd: Status 404 returned error can't find the container with id 559e05de1f261091b5fcdc89c4d8bfa6097a0ab9c9ee1bc1f2cb5236b101e2bd Jul 08 17:54:59.893477 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.893426 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:54:59.894267 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.893520 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:54:59.894267 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:54:59.893565 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:55:00.303682 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:00.303579 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" event={"ID":"5f69ef0f-83a4-419d-bdec-325b657db116","Type":"ContainerStarted","Data":"b5d9395c1fb9aa9f9f66eea57620263a0b228ef7a2439f2d13d92c783d0303d6"} Jul 08 17:55:00.303682 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:00.303643 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" event={"ID":"5f69ef0f-83a4-419d-bdec-325b657db116","Type":"ContainerStarted","Data":"559e05de1f261091b5fcdc89c4d8bfa6097a0ab9c9ee1bc1f2cb5236b101e2bd"} Jul 08 17:55:00.323871 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:00.323816 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" podStartSLOduration=1.3238003329999999 podStartE2EDuration="1.323800333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:54:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:55:00.322448429 +0000 UTC m=+2312.733263807" watchObservedRunningTime="2026-07-08 17:55:00.323800333 +0000 UTC m=+2312.734615711" Jul 08 17:55:00.733726 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:00.733686 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:55:00.739427 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:00.739396 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:55:01.310825 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:01.310762 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:55:01.311955 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:01.311904 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:55:08.256055 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:08.256011 2556 patch_prober.go:28] interesting pod/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body= Jul 08 17:55:08.256488 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:08.256071 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" podUID="8aae4896-24d4-40e7-976c-69d019c0c072" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" Jul 08 17:55:08.355552 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:08.355516 2556 generic.go:356] "Generic (PLEG): container finished" podID="8aae4896-24d4-40e7-976c-69d019c0c072" containerID="826cbbefed96b2bc3f66a01473728c34315df80ade41d68e0faef8781a68c66f" exitCode=0 Jul 08 17:55:08.355728 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:08.355588 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" event={"ID":"8aae4896-24d4-40e7-976c-69d019c0c072","Type":"ContainerDied","Data":"826cbbefed96b2bc3f66a01473728c34315df80ade41d68e0faef8781a68c66f"} Jul 08 17:55:08.356103 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:08.356084 2556 scope.go:117] "RemoveContainer" containerID="826cbbefed96b2bc3f66a01473728c34315df80ade41d68e0faef8781a68c66f" Jul 08 17:55:08.357287 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:08.357257 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:55:08.357360 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:08.357335 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:55:08.357398 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:08.357370 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:55:09.363416 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:09.363381 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" event={"ID":"8aae4896-24d4-40e7-976c-69d019c0c072","Type":"ContainerStarted","Data":"b16023f75d9c09ffe0291101363b70cc9c9f57b8fcf8520fa5d2af257e14711b"} Jul 08 17:55:09.701637 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:09.701544 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:55:09.701996 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:09.701972 2556 patch_prober.go:28] interesting pod/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body= Jul 08 17:55:09.702171 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:09.702146 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" podUID="8aae4896-24d4-40e7-976c-69d019c0c072" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" Jul 08 17:55:10.709071 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:10.703401 2556 patch_prober.go:28] interesting pod/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body= Jul 08 17:55:10.709071 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:10.703498 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" podUID="8aae4896-24d4-40e7-976c-69d019c0c072" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" Jul 08 17:55:11.701574 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:11.701529 2556 patch_prober.go:28] interesting pod/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body= Jul 08 17:55:11.701936 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:11.701876 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" podUID="8aae4896-24d4-40e7-976c-69d019c0c072" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" Jul 08 17:55:12.701323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:12.700845 2556 patch_prober.go:28] interesting pod/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body= Jul 08 17:55:12.701323 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:12.700944 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" podUID="8aae4896-24d4-40e7-976c-69d019c0c072" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" Jul 08 17:55:13.700686 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:13.700639 2556 patch_prober.go:28] interesting pod/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body= Jul 08 17:55:13.700931 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:13.700723 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" podUID="8aae4896-24d4-40e7-976c-69d019c0c072" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" Jul 08 17:55:14.705813 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:14.705778 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:55:14.706248 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:14.706184 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:55:14.706873 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:14.706854 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:55:15.401965 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:15.401892 2556 generic.go:356] "Generic (PLEG): container finished" podID="5f69ef0f-83a4-419d-bdec-325b657db116" containerID="b5d9395c1fb9aa9f9f66eea57620263a0b228ef7a2439f2d13d92c783d0303d6" exitCode=0 Jul 08 17:55:15.402216 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:15.401967 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" event={"ID":"5f69ef0f-83a4-419d-bdec-325b657db116","Type":"ContainerDied","Data":"b5d9395c1fb9aa9f9f66eea57620263a0b228ef7a2439f2d13d92c783d0303d6"} Jul 08 17:55:15.402482 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:15.402467 2556 scope.go:117] "RemoveContainer" containerID="b5d9395c1fb9aa9f9f66eea57620263a0b228ef7a2439f2d13d92c783d0303d6" Jul 08 17:55:15.403431 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:15.403407 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:55:15.403506 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:15.403493 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:55:15.403546 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:15.403535 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 17:55:16.310884 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:16.310829 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:55:16.414205 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:16.414150 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" event={"ID":"5f69ef0f-83a4-419d-bdec-325b657db116","Type":"ContainerStarted","Data":"b096401ff3f71c603efba1f1079154c069fca883d22eed889da0ae20207d6422"} Jul 08 17:55:16.733559 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:16.733522 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:55:16.734690 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:16.734663 2556 patch_prober.go:28] interesting pod/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body= Jul 08 17:55:16.734821 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:16.734717 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" podUID="5f69ef0f-83a4-419d-bdec-325b657db116" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" Jul 08 17:55:17.733989 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:17.733946 2556 patch_prober.go:28] interesting pod/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body= Jul 08 17:55:17.734410 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:17.734007 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" podUID="5f69ef0f-83a4-419d-bdec-325b657db116" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" Jul 08 17:55:18.734305 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:18.734263 2556 patch_prober.go:28] interesting pod/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body= Jul 08 17:55:18.734734 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:18.734325 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" podUID="5f69ef0f-83a4-419d-bdec-325b657db116" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" Jul 08 17:55:19.733978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:19.733932 2556 patch_prober.go:28] interesting pod/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body= Jul 08 17:55:19.734165 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:19.733990 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" podUID="5f69ef0f-83a4-419d-bdec-325b657db116" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" Jul 08 17:55:20.738291 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:20.738202 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:55:20.738687 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:20.738540 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:55:20.739183 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:55:20.739167 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:56:28.417902 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:56:28.417872 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gsn8l_c2541cd3-af4f-4de5-b042-3611d02a80ab/console-operator/1.log" Jul 08 17:56:28.427444 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:56:28.427419 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gsn8l_c2541cd3-af4f-4de5-b042-3611d02a80ab/console-operator/1.log" Jul 08 17:58:18.611011 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:18.610961 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg"] Jul 08 17:58:18.611572 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:18.611227 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" podUID="8aae4896-24d4-40e7-976c-69d019c0c072" containerName="istio-proxy" containerID="cri-o://b16023f75d9c09ffe0291101363b70cc9c9f57b8fcf8520fa5d2af257e14711b" gracePeriod=30 Jul 08 17:58:23.866929 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:23.866886 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:58:23.971117 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:23.971012 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8aae4896-24d4-40e7-976c-69d019c0c072-istiod-ca-cert\") pod \"8aae4896-24d4-40e7-976c-69d019c0c072\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " Jul 08 17:58:23.971117 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:23.971091 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-istio-data\") pod \"8aae4896-24d4-40e7-976c-69d019c0c072\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " Jul 08 17:58:23.971340 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:23.971121 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-istio-envoy\") pod \"8aae4896-24d4-40e7-976c-69d019c0c072\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " Jul 08 17:58:23.971340 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:23.971194 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-credential-socket\") pod \"8aae4896-24d4-40e7-976c-69d019c0c072\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " Jul 08 17:58:23.971340 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:23.971225 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z57xk\" (UniqueName: \"kubernetes.io/projected/8aae4896-24d4-40e7-976c-69d019c0c072-kube-api-access-z57xk\") pod \"8aae4896-24d4-40e7-976c-69d019c0c072\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " Jul 08 17:58:23.971340 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:23.971257 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8aae4896-24d4-40e7-976c-69d019c0c072-istio-token\") pod \"8aae4896-24d4-40e7-976c-69d019c0c072\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " Jul 08 17:58:23.971340 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:23.971285 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-workload-socket\") pod \"8aae4896-24d4-40e7-976c-69d019c0c072\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " Jul 08 17:58:23.971607 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:23.971373 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8aae4896-24d4-40e7-976c-69d019c0c072-istio-podinfo\") pod \"8aae4896-24d4-40e7-976c-69d019c0c072\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " Jul 08 17:58:23.971607 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:23.971411 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-workload-certs\") pod \"8aae4896-24d4-40e7-976c-69d019c0c072\" (UID: \"8aae4896-24d4-40e7-976c-69d019c0c072\") " Jul 08 17:58:23.971607 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:23.971475 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8aae4896-24d4-40e7-976c-69d019c0c072-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8aae4896-24d4-40e7-976c-69d019c0c072" (UID: "8aae4896-24d4-40e7-976c-69d019c0c072"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:58:23.971607 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:23.971586 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8aae4896-24d4-40e7-976c-69d019c0c072" (UID: "8aae4896-24d4-40e7-976c-69d019c0c072"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:58:23.971807 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:23.971760 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8aae4896-24d4-40e7-976c-69d019c0c072" (UID: "8aae4896-24d4-40e7-976c-69d019c0c072"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:58:23.971807 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:23.971786 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8aae4896-24d4-40e7-976c-69d019c0c072" (UID: "8aae4896-24d4-40e7-976c-69d019c0c072"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:58:23.971961 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:23.971833 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8aae4896-24d4-40e7-976c-69d019c0c072-istiod-ca-cert\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:58:23.971961 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:23.971847 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-credential-socket\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:58:23.972145 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:23.972119 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-istio-data" (OuterVolumeSpecName: "istio-data") pod "8aae4896-24d4-40e7-976c-69d019c0c072" (UID: "8aae4896-24d4-40e7-976c-69d019c0c072"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:58:23.973756 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:23.973724 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8aae4896-24d4-40e7-976c-69d019c0c072-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8aae4896-24d4-40e7-976c-69d019c0c072" (UID: "8aae4896-24d4-40e7-976c-69d019c0c072"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 17:58:23.973881 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:23.973785 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8aae4896-24d4-40e7-976c-69d019c0c072-istio-token" (OuterVolumeSpecName: "istio-token") pod "8aae4896-24d4-40e7-976c-69d019c0c072" (UID: "8aae4896-24d4-40e7-976c-69d019c0c072"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:58:23.973959 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:23.973872 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8aae4896-24d4-40e7-976c-69d019c0c072-kube-api-access-z57xk" (OuterVolumeSpecName: "kube-api-access-z57xk") pod "8aae4896-24d4-40e7-976c-69d019c0c072" (UID: "8aae4896-24d4-40e7-976c-69d019c0c072"). InnerVolumeSpecName "kube-api-access-z57xk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:58:23.974011 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:23.973986 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8aae4896-24d4-40e7-976c-69d019c0c072" (UID: "8aae4896-24d4-40e7-976c-69d019c0c072"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:58:24.072796 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:24.072753 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8aae4896-24d4-40e7-976c-69d019c0c072-istio-podinfo\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:58:24.072796 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:24.072792 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-workload-certs\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:58:24.072796 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:24.072801 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-istio-data\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:58:24.072796 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:24.072808 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-istio-envoy\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:58:24.073117 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:24.072817 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z57xk\" (UniqueName: \"kubernetes.io/projected/8aae4896-24d4-40e7-976c-69d019c0c072-kube-api-access-z57xk\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:58:24.073117 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:24.072835 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8aae4896-24d4-40e7-976c-69d019c0c072-istio-token\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:58:24.073117 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:24.072844 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8aae4896-24d4-40e7-976c-69d019c0c072-workload-socket\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:58:24.394414 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:24.394374 2556 generic.go:356] "Generic (PLEG): container finished" podID="8aae4896-24d4-40e7-976c-69d019c0c072" containerID="b16023f75d9c09ffe0291101363b70cc9c9f57b8fcf8520fa5d2af257e14711b" exitCode=0 Jul 08 17:58:24.394646 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:24.394419 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" Jul 08 17:58:24.394646 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:24.394454 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" event={"ID":"8aae4896-24d4-40e7-976c-69d019c0c072","Type":"ContainerDied","Data":"b16023f75d9c09ffe0291101363b70cc9c9f57b8fcf8520fa5d2af257e14711b"} Jul 08 17:58:24.394646 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:24.394516 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg" event={"ID":"8aae4896-24d4-40e7-976c-69d019c0c072","Type":"ContainerDied","Data":"ceb85e242be1bc6efa9a65e3ab80f2791e05b7c779675a3a2cdc2e590ed89021"} Jul 08 17:58:24.394646 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:24.394539 2556 scope.go:117] "RemoveContainer" containerID="b16023f75d9c09ffe0291101363b70cc9c9f57b8fcf8520fa5d2af257e14711b" Jul 08 17:58:24.404083 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:24.404069 2556 scope.go:117] "RemoveContainer" containerID="826cbbefed96b2bc3f66a01473728c34315df80ade41d68e0faef8781a68c66f" Jul 08 17:58:24.412786 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:24.412762 2556 scope.go:117] "RemoveContainer" containerID="b16023f75d9c09ffe0291101363b70cc9c9f57b8fcf8520fa5d2af257e14711b" Jul 08 17:58:24.413171 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:58:24.413147 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b16023f75d9c09ffe0291101363b70cc9c9f57b8fcf8520fa5d2af257e14711b\": container with ID starting with b16023f75d9c09ffe0291101363b70cc9c9f57b8fcf8520fa5d2af257e14711b not found: ID does not exist" containerID="b16023f75d9c09ffe0291101363b70cc9c9f57b8fcf8520fa5d2af257e14711b" Jul 08 17:58:24.413255 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:24.413177 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b16023f75d9c09ffe0291101363b70cc9c9f57b8fcf8520fa5d2af257e14711b"} err="failed to get container status \"b16023f75d9c09ffe0291101363b70cc9c9f57b8fcf8520fa5d2af257e14711b\": rpc error: code = NotFound desc = could not find container \"b16023f75d9c09ffe0291101363b70cc9c9f57b8fcf8520fa5d2af257e14711b\": container with ID starting with b16023f75d9c09ffe0291101363b70cc9c9f57b8fcf8520fa5d2af257e14711b not found: ID does not exist" Jul 08 17:58:24.413255 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:24.413197 2556 scope.go:117] "RemoveContainer" containerID="826cbbefed96b2bc3f66a01473728c34315df80ade41d68e0faef8781a68c66f" Jul 08 17:58:24.413447 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:58:24.413432 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"826cbbefed96b2bc3f66a01473728c34315df80ade41d68e0faef8781a68c66f\": container with ID starting with 826cbbefed96b2bc3f66a01473728c34315df80ade41d68e0faef8781a68c66f not found: ID does not exist" containerID="826cbbefed96b2bc3f66a01473728c34315df80ade41d68e0faef8781a68c66f" Jul 08 17:58:24.413488 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:24.413453 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"826cbbefed96b2bc3f66a01473728c34315df80ade41d68e0faef8781a68c66f"} err="failed to get container status \"826cbbefed96b2bc3f66a01473728c34315df80ade41d68e0faef8781a68c66f\": rpc error: code = NotFound desc = could not find container \"826cbbefed96b2bc3f66a01473728c34315df80ade41d68e0faef8781a68c66f\": container with ID starting with 826cbbefed96b2bc3f66a01473728c34315df80ade41d68e0faef8781a68c66f not found: ID does not exist" Jul 08 17:58:24.414305 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:24.414286 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg"] Jul 08 17:58:24.418328 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:24.418294 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-67c226-openshift-default-7bf765fb99-9jvfg"] Jul 08 17:58:25.572696 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:25.572655 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n"] Jul 08 17:58:25.573640 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:25.573604 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" podUID="5f69ef0f-83a4-419d-bdec-325b657db116" containerName="istio-proxy" containerID="cri-o://b096401ff3f71c603efba1f1079154c069fca883d22eed889da0ae20207d6422" gracePeriod=30 Jul 08 17:58:26.113074 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:26.113038 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8aae4896-24d4-40e7-976c-69d019c0c072" path="/var/lib/kubelet/pods/8aae4896-24d4-40e7-976c-69d019c0c072/volumes" Jul 08 17:58:30.849048 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:30.849017 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:58:30.939250 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:30.939210 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-workload-socket\") pod \"5f69ef0f-83a4-419d-bdec-325b657db116\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " Jul 08 17:58:30.939446 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:30.939261 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f69ef0f-83a4-419d-bdec-325b657db116-istiod-ca-cert\") pod \"5f69ef0f-83a4-419d-bdec-325b657db116\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " Jul 08 17:58:30.939446 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:30.939294 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-credential-socket\") pod \"5f69ef0f-83a4-419d-bdec-325b657db116\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " Jul 08 17:58:30.939446 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:30.939356 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f69ef0f-83a4-419d-bdec-325b657db116-istio-token\") pod \"5f69ef0f-83a4-419d-bdec-325b657db116\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " Jul 08 17:58:30.939446 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:30.939389 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-istio-envoy\") pod \"5f69ef0f-83a4-419d-bdec-325b657db116\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " Jul 08 17:58:30.939666 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:30.939455 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmnjr\" (UniqueName: \"kubernetes.io/projected/5f69ef0f-83a4-419d-bdec-325b657db116-kube-api-access-mmnjr\") pod \"5f69ef0f-83a4-419d-bdec-325b657db116\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " Jul 08 17:58:30.939666 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:30.939503 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-workload-certs\") pod \"5f69ef0f-83a4-419d-bdec-325b657db116\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " Jul 08 17:58:30.939666 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:30.939542 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-istio-data\") pod \"5f69ef0f-83a4-419d-bdec-325b657db116\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " Jul 08 17:58:30.939666 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:30.939577 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f69ef0f-83a4-419d-bdec-325b657db116-istio-podinfo\") pod \"5f69ef0f-83a4-419d-bdec-325b657db116\" (UID: \"5f69ef0f-83a4-419d-bdec-325b657db116\") " Jul 08 17:58:30.939899 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:30.939544 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5f69ef0f-83a4-419d-bdec-325b657db116" (UID: "5f69ef0f-83a4-419d-bdec-325b657db116"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:58:30.939899 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:30.939724 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f69ef0f-83a4-419d-bdec-325b657db116-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5f69ef0f-83a4-419d-bdec-325b657db116" (UID: "5f69ef0f-83a4-419d-bdec-325b657db116"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:58:30.939899 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:30.939725 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5f69ef0f-83a4-419d-bdec-325b657db116" (UID: "5f69ef0f-83a4-419d-bdec-325b657db116"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:58:30.939899 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:30.939761 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5f69ef0f-83a4-419d-bdec-325b657db116" (UID: "5f69ef0f-83a4-419d-bdec-325b657db116"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:58:30.940446 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:30.940423 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-istio-data" (OuterVolumeSpecName: "istio-data") pod "5f69ef0f-83a4-419d-bdec-325b657db116" (UID: "5f69ef0f-83a4-419d-bdec-325b657db116"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:58:30.941768 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:30.941744 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f69ef0f-83a4-419d-bdec-325b657db116-kube-api-access-mmnjr" (OuterVolumeSpecName: "kube-api-access-mmnjr") pod "5f69ef0f-83a4-419d-bdec-325b657db116" (UID: "5f69ef0f-83a4-419d-bdec-325b657db116"). InnerVolumeSpecName "kube-api-access-mmnjr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:58:30.941768 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:30.941761 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5f69ef0f-83a4-419d-bdec-325b657db116-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5f69ef0f-83a4-419d-bdec-325b657db116" (UID: "5f69ef0f-83a4-419d-bdec-325b657db116"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 17:58:30.942064 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:30.942041 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5f69ef0f-83a4-419d-bdec-325b657db116" (UID: "5f69ef0f-83a4-419d-bdec-325b657db116"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:58:30.942157 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:30.942070 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f69ef0f-83a4-419d-bdec-325b657db116-istio-token" (OuterVolumeSpecName: "istio-token") pod "5f69ef0f-83a4-419d-bdec-325b657db116" (UID: "5f69ef0f-83a4-419d-bdec-325b657db116"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:58:31.041295 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:31.041256 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmnjr\" (UniqueName: \"kubernetes.io/projected/5f69ef0f-83a4-419d-bdec-325b657db116-kube-api-access-mmnjr\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:58:31.041295 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:31.041288 2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-workload-certs\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:58:31.041295 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:31.041299 2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-istio-data\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:58:31.041551 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:31.041307 2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f69ef0f-83a4-419d-bdec-325b657db116-istio-podinfo\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:58:31.041551 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:31.041315 2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-workload-socket\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:58:31.041551 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:31.041323 2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f69ef0f-83a4-419d-bdec-325b657db116-istiod-ca-cert\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:58:31.041551 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:31.041331 2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-credential-socket\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:58:31.041551 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:31.041339 2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f69ef0f-83a4-419d-bdec-325b657db116-istio-token\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:58:31.041551 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:31.041347 2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f69ef0f-83a4-419d-bdec-325b657db116-istio-envoy\") on node \"ip-10-0-133-231.ec2.internal\" DevicePath \"\"" Jul 08 17:58:31.438373 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:31.438338 2556 generic.go:356] "Generic (PLEG): container finished" podID="5f69ef0f-83a4-419d-bdec-325b657db116" containerID="b096401ff3f71c603efba1f1079154c069fca883d22eed889da0ae20207d6422" exitCode=0 Jul 08 17:58:31.438596 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:31.438399 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" Jul 08 17:58:31.438596 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:31.438421 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" event={"ID":"5f69ef0f-83a4-419d-bdec-325b657db116","Type":"ContainerDied","Data":"b096401ff3f71c603efba1f1079154c069fca883d22eed889da0ae20207d6422"} Jul 08 17:58:31.438596 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:31.438478 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n" event={"ID":"5f69ef0f-83a4-419d-bdec-325b657db116","Type":"ContainerDied","Data":"559e05de1f261091b5fcdc89c4d8bfa6097a0ab9c9ee1bc1f2cb5236b101e2bd"} Jul 08 17:58:31.438596 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:31.438500 2556 scope.go:117] "RemoveContainer" containerID="b096401ff3f71c603efba1f1079154c069fca883d22eed889da0ae20207d6422" Jul 08 17:58:31.448462 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:31.448440 2556 scope.go:117] "RemoveContainer" containerID="b5d9395c1fb9aa9f9f66eea57620263a0b228ef7a2439f2d13d92c783d0303d6" Jul 08 17:58:31.457006 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:31.456986 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-65ngj_637a4b7f-6bf6-4f76-886a-390e04ec9273/manager/0.log" Jul 08 17:58:31.457381 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:31.457367 2556 scope.go:117] "RemoveContainer" containerID="b096401ff3f71c603efba1f1079154c069fca883d22eed889da0ae20207d6422" Jul 08 17:58:31.457623 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:58:31.457604 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b096401ff3f71c603efba1f1079154c069fca883d22eed889da0ae20207d6422\": container with ID starting with b096401ff3f71c603efba1f1079154c069fca883d22eed889da0ae20207d6422 not found: ID does not exist" containerID="b096401ff3f71c603efba1f1079154c069fca883d22eed889da0ae20207d6422" Jul 08 17:58:31.457671 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:31.457634 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b096401ff3f71c603efba1f1079154c069fca883d22eed889da0ae20207d6422"} err="failed to get container status \"b096401ff3f71c603efba1f1079154c069fca883d22eed889da0ae20207d6422\": rpc error: code = NotFound desc = could not find container \"b096401ff3f71c603efba1f1079154c069fca883d22eed889da0ae20207d6422\": container with ID starting with b096401ff3f71c603efba1f1079154c069fca883d22eed889da0ae20207d6422 not found: ID does not exist" Jul 08 17:58:31.457671 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:31.457652 2556 scope.go:117] "RemoveContainer" containerID="b5d9395c1fb9aa9f9f66eea57620263a0b228ef7a2439f2d13d92c783d0303d6" Jul 08 17:58:31.457855 ip-10-0-133-231 kubenswrapper[2556]: E0708 17:58:31.457840 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5d9395c1fb9aa9f9f66eea57620263a0b228ef7a2439f2d13d92c783d0303d6\": container with ID starting with b5d9395c1fb9aa9f9f66eea57620263a0b228ef7a2439f2d13d92c783d0303d6 not found: ID does not exist" containerID="b5d9395c1fb9aa9f9f66eea57620263a0b228ef7a2439f2d13d92c783d0303d6" Jul 08 17:58:31.457893 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:31.457861 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5d9395c1fb9aa9f9f66eea57620263a0b228ef7a2439f2d13d92c783d0303d6"} err="failed to get container status \"b5d9395c1fb9aa9f9f66eea57620263a0b228ef7a2439f2d13d92c783d0303d6\": rpc error: code = NotFound desc = could not find container \"b5d9395c1fb9aa9f9f66eea57620263a0b228ef7a2439f2d13d92c783d0303d6\": container with ID starting with b5d9395c1fb9aa9f9f66eea57620263a0b228ef7a2439f2d13d92c783d0303d6 not found: ID does not exist" Jul 08 17:58:31.461594 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:31.461570 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n"] Jul 08 17:58:31.465698 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:31.465674 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-9fde78-openshift-default-7d4579465f-d2l8n"] Jul 08 17:58:31.603355 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:31.603324 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-j5tc6_602f6e2c-9ad1-458a-8577-1b108e330627/manager/0.log" Jul 08 17:58:31.878763 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:31.878735 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-n9b4r_f411d0c3-f9c6-4694-8ef3-f05d4ab17686/server/0.log" Jul 08 17:58:32.007837 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:32.007808 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-mp6s7_920516cd-cf90-4582-9d41-1c38a837befe/manager/0.log" Jul 08 17:58:32.112697 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:32.112662 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f69ef0f-83a4-419d-bdec-325b657db116" path="/var/lib/kubelet/pods/5f69ef0f-83a4-419d-bdec-325b657db116/volumes" Jul 08 17:58:32.316389 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:32.316307 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-564755f94b-ggcd4_ad8a8664-2aa8-4055-9998-995e2f1a8235/copy-manifests/0.log" Jul 08 17:58:32.324438 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:32.324413 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-564755f94b-ggcd4_ad8a8664-2aa8-4055-9998-995e2f1a8235/manager/0.log" Jul 08 17:58:34.043767 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:34.043720 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-p5s4q_237f9f01-bd06-4ca7-a34e-854ec0e05247/manager/0.log" Jul 08 17:58:34.172628 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:34.172594 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-wx5r2_7ae0d829-7d14-4295-84b1-fcc50aaca570/manager/0.log" Jul 08 17:58:34.426100 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:34.426066 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gc4st_3271ae3b-b037-419f-84c0-afc1296d56e0/registry-server/0.log" Jul 08 17:58:34.561934 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:34.561879 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-frkz8_0456f6fb-ea29-442f-bba3-784bcf7591d7/manager/0.log" Jul 08 17:58:34.826933 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:34.826820 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-cnngp_fe2882a7-b8d0-4b80-83d4-517add410962/manager/0.log" Jul 08 17:58:35.210879 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:35.210848 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4wxtw7_972d360a-0998-4e41-94d6-88ee319573e2/istio-proxy/0.log" Jul 08 17:58:35.471306 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:35.471224 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d86b88db9-fxf62_8a8452a4-3b7e-43c8-a84e-0a5ac684609c/kube-auth-proxy/0.log" Jul 08 17:58:35.719828 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:35.719797 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-54k9j_9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7/istio-proxy/1.log" Jul 08 17:58:35.852578 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:35.852548 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-rdz5z_0e0c622e-a441-40d2-8874-224955b428b4/payload-pre-processing/0.log" Jul 08 17:58:36.479447 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:36.479414 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-tmxvw_56b89306-7e7c-4f1e-b5bf-44bbf7f02218/main/0.log" Jul 08 17:58:36.721006 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:36.720977 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-5286j_4c89d5c2-c81f-4e63-960b-9eb14a4b62ff/main/0.log" Jul 08 17:58:36.847838 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:36.847807 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbft74w_b29e0a43-3da7-4bca-b580-60f37576c2b3/main/0.log" Jul 08 17:58:44.779310 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:44.779278 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-v55sp_6d0a9a22-a290-4cd1-9e16-8c4a6ca4b9e1/global-pull-secret-syncer/0.log" Jul 08 17:58:44.898613 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:44.898575 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-x524h_101444d0-efcc-4185-9566-452b0a26d513/konnectivity-agent/0.log" Jul 08 17:58:44.970294 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:44.970250 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-231.ec2.internal_e2575db7186b136a83984c343389bd0f/haproxy/0.log" Jul 08 17:58:49.569671 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:49.569632 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-p5s4q_237f9f01-bd06-4ca7-a34e-854ec0e05247/manager/0.log" Jul 08 17:58:49.625334 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:49.625305 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-wx5r2_7ae0d829-7d14-4295-84b1-fcc50aaca570/manager/0.log" Jul 08 17:58:49.692043 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:49.692012 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-gc4st_3271ae3b-b037-419f-84c0-afc1296d56e0/registry-server/0.log" Jul 08 17:58:49.800986 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:49.800948 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-frkz8_0456f6fb-ea29-442f-bba3-784bcf7591d7/manager/0.log" Jul 08 17:58:49.916236 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:49.916198 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-cnngp_fe2882a7-b8d0-4b80-83d4-517add410962/manager/0.log" Jul 08 17:58:51.624799 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:51.624769 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-q5blw_fd143acd-7f5c-4000-a499-9f5d4e79106e/kube-state-metrics/0.log" Jul 08 17:58:51.644897 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:51.644865 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-q5blw_fd143acd-7f5c-4000-a499-9f5d4e79106e/kube-rbac-proxy-main/0.log" Jul 08 17:58:51.667591 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:51.667563 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-q5blw_fd143acd-7f5c-4000-a499-9f5d4e79106e/kube-rbac-proxy-self/0.log" Jul 08 17:58:51.702430 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:51.702400 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5567f76648-9rzhz_34af209a-3652-436c-8b89-6cc5dd471e53/metrics-server/0.log" Jul 08 17:58:51.739433 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:51.739400 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-vsxbh_6e6a75b7-5705-4905-965c-29aad57f9008/monitoring-plugin/0.log" Jul 08 17:58:51.944723 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:51.944693 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tczzm_d7c42d04-3fd1-404c-86d0-642e9cb6189a/node-exporter/0.log" Jul 08 17:58:51.966937 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:51.966891 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tczzm_d7c42d04-3fd1-404c-86d0-642e9cb6189a/kube-rbac-proxy/0.log" Jul 08 17:58:52.010146 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:52.010118 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tczzm_d7c42d04-3fd1-404c-86d0-642e9cb6189a/init-textfile/0.log" Jul 08 17:58:54.415836 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.415773 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gsn8l_c2541cd3-af4f-4de5-b042-3611d02a80ab/console-operator/1.log" Jul 08 17:58:54.420355 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.420324 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-gsn8l_c2541cd3-af4f-4de5-b042-3611d02a80ab/console-operator/2.log" Jul 08 17:58:54.684308 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.684225 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ksr2v/perf-node-gather-daemonset-pt7m2"] Jul 08 17:58:54.684641 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.684628 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f69ef0f-83a4-419d-bdec-325b657db116" containerName="istio-proxy" Jul 08 17:58:54.684696 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.684644 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f69ef0f-83a4-419d-bdec-325b657db116" containerName="istio-proxy" Jul 08 17:58:54.684696 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.684657 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aae4896-24d4-40e7-976c-69d019c0c072" containerName="istio-proxy" Jul 08 17:58:54.684696 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.684663 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aae4896-24d4-40e7-976c-69d019c0c072" containerName="istio-proxy" Jul 08 17:58:54.684696 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.684675 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f69ef0f-83a4-419d-bdec-325b657db116" containerName="istio-proxy" Jul 08 17:58:54.684696 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.684681 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f69ef0f-83a4-419d-bdec-325b657db116" containerName="istio-proxy" Jul 08 17:58:54.684696 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.684690 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8377a81b-43d3-4c47-8100-e1278c6fefac" containerName="istio-proxy" Jul 08 17:58:54.684696 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.684695 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8377a81b-43d3-4c47-8100-e1278c6fefac" containerName="istio-proxy" Jul 08 17:58:54.684951 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.684762 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="8aae4896-24d4-40e7-976c-69d019c0c072" containerName="istio-proxy" Jul 08 17:58:54.684951 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.684773 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f69ef0f-83a4-419d-bdec-325b657db116" containerName="istio-proxy" Jul 08 17:58:54.684951 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.684780 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f69ef0f-83a4-419d-bdec-325b657db116" containerName="istio-proxy" Jul 08 17:58:54.688396 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.688371 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-pt7m2" Jul 08 17:58:54.690863 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.690836 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ksr2v\"/\"openshift-service-ca.crt\"" Jul 08 17:58:54.691035 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.690876 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ksr2v\"/\"default-dockercfg-wqkzb\"" Jul 08 17:58:54.691035 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.690879 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ksr2v\"/\"kube-root-ca.crt\"" Jul 08 17:58:54.695162 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.695113 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ksr2v/perf-node-gather-daemonset-pt7m2"] Jul 08 17:58:54.777524 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.777481 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/634ff2d4-598e-4790-baad-87f4f42d0241-proc\") pod \"perf-node-gather-daemonset-pt7m2\" (UID: \"634ff2d4-598e-4790-baad-87f4f42d0241\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-pt7m2" Jul 08 17:58:54.777524 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.777530 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tclwt\" (UniqueName: \"kubernetes.io/projected/634ff2d4-598e-4790-baad-87f4f42d0241-kube-api-access-tclwt\") pod \"perf-node-gather-daemonset-pt7m2\" (UID: \"634ff2d4-598e-4790-baad-87f4f42d0241\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-pt7m2" Jul 08 17:58:54.777753 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.777588 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/634ff2d4-598e-4790-baad-87f4f42d0241-sys\") pod \"perf-node-gather-daemonset-pt7m2\" (UID: \"634ff2d4-598e-4790-baad-87f4f42d0241\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-pt7m2" Jul 08 17:58:54.777753 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.777614 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/634ff2d4-598e-4790-baad-87f4f42d0241-lib-modules\") pod \"perf-node-gather-daemonset-pt7m2\" (UID: \"634ff2d4-598e-4790-baad-87f4f42d0241\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-pt7m2" Jul 08 17:58:54.777753 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.777731 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/634ff2d4-598e-4790-baad-87f4f42d0241-podres\") pod \"perf-node-gather-daemonset-pt7m2\" (UID: \"634ff2d4-598e-4790-baad-87f4f42d0241\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-pt7m2" Jul 08 17:58:54.879181 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.879141 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/634ff2d4-598e-4790-baad-87f4f42d0241-sys\") pod \"perf-node-gather-daemonset-pt7m2\" (UID: \"634ff2d4-598e-4790-baad-87f4f42d0241\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-pt7m2" Jul 08 17:58:54.879181 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.879186 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/634ff2d4-598e-4790-baad-87f4f42d0241-lib-modules\") pod \"perf-node-gather-daemonset-pt7m2\" (UID: \"634ff2d4-598e-4790-baad-87f4f42d0241\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-pt7m2" Jul 08 17:58:54.879412 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.879265 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/634ff2d4-598e-4790-baad-87f4f42d0241-podres\") pod \"perf-node-gather-daemonset-pt7m2\" (UID: \"634ff2d4-598e-4790-baad-87f4f42d0241\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-pt7m2" Jul 08 17:58:54.879412 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.879275 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/634ff2d4-598e-4790-baad-87f4f42d0241-sys\") pod \"perf-node-gather-daemonset-pt7m2\" (UID: \"634ff2d4-598e-4790-baad-87f4f42d0241\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-pt7m2" Jul 08 17:58:54.879412 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.879306 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/634ff2d4-598e-4790-baad-87f4f42d0241-proc\") pod \"perf-node-gather-daemonset-pt7m2\" (UID: \"634ff2d4-598e-4790-baad-87f4f42d0241\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-pt7m2" Jul 08 17:58:54.879412 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.879342 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tclwt\" (UniqueName: \"kubernetes.io/projected/634ff2d4-598e-4790-baad-87f4f42d0241-kube-api-access-tclwt\") pod \"perf-node-gather-daemonset-pt7m2\" (UID: \"634ff2d4-598e-4790-baad-87f4f42d0241\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-pt7m2" Jul 08 17:58:54.879412 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.879382 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/634ff2d4-598e-4790-baad-87f4f42d0241-podres\") pod \"perf-node-gather-daemonset-pt7m2\" (UID: \"634ff2d4-598e-4790-baad-87f4f42d0241\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-pt7m2" Jul 08 17:58:54.879412 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.879405 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/634ff2d4-598e-4790-baad-87f4f42d0241-lib-modules\") pod \"perf-node-gather-daemonset-pt7m2\" (UID: \"634ff2d4-598e-4790-baad-87f4f42d0241\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-pt7m2" Jul 08 17:58:54.879624 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.879410 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/634ff2d4-598e-4790-baad-87f4f42d0241-proc\") pod \"perf-node-gather-daemonset-pt7m2\" (UID: \"634ff2d4-598e-4790-baad-87f4f42d0241\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-pt7m2" Jul 08 17:58:54.887113 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.887084 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tclwt\" (UniqueName: \"kubernetes.io/projected/634ff2d4-598e-4790-baad-87f4f42d0241-kube-api-access-tclwt\") pod \"perf-node-gather-daemonset-pt7m2\" (UID: \"634ff2d4-598e-4790-baad-87f4f42d0241\") " pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-pt7m2" Jul 08 17:58:54.946935 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.946833 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f9f86db7d-lr7kp_ee22f102-be09-4cae-b210-ebb050c41121/console/0.log" Jul 08 17:58:54.980959 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.980898 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-dlxx4_e7706413-170b-45a9-b7d5-ac5178927c7a/download-server/0.log" Jul 08 17:58:54.999288 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:54.999258 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-pt7m2" Jul 08 17:58:55.142455 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:55.142431 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ksr2v/perf-node-gather-daemonset-pt7m2"] Jul 08 17:58:55.144701 ip-10-0-133-231 kubenswrapper[2556]: W0708 17:58:55.144670 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod634ff2d4_598e_4790_baad_87f4f42d0241.slice/crio-09f300511555228fa4134d12a0c4b238f5aded4de5831da24daa82fb43654dfa WatchSource:0}: Error finding container 09f300511555228fa4134d12a0c4b238f5aded4de5831da24daa82fb43654dfa: Status 404 returned error can't find the container with id 09f300511555228fa4134d12a0c4b238f5aded4de5831da24daa82fb43654dfa Jul 08 17:58:55.563815 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:55.563716 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-pt7m2" event={"ID":"634ff2d4-598e-4790-baad-87f4f42d0241","Type":"ContainerStarted","Data":"c050bf29c811806955845e43a4212f5c71dd65f8a9ede7f65b4e87605dc03dc2"} Jul 08 17:58:55.563815 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:55.563782 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-pt7m2" event={"ID":"634ff2d4-598e-4790-baad-87f4f42d0241","Type":"ContainerStarted","Data":"09f300511555228fa4134d12a0c4b238f5aded4de5831da24daa82fb43654dfa"} Jul 08 17:58:55.564266 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:55.563902 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-pt7m2" Jul 08 17:58:55.578723 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:55.578665 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-pt7m2" podStartSLOduration=1.578646717 podStartE2EDuration="1.578646717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:58:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:58:55.57784852 +0000 UTC m=+2547.988663899" watchObservedRunningTime="2026-07-08 17:58:55.578646717 +0000 UTC m=+2547.989462124" Jul 08 17:58:56.623425 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:56.623395 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x6rq9_63232d67-ba2c-4954-8d14-6d057af2f3bc/dns/0.log" Jul 08 17:58:56.642786 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:56.642758 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x6rq9_63232d67-ba2c-4954-8d14-6d057af2f3bc/kube-rbac-proxy/0.log" Jul 08 17:58:56.687953 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:56.687904 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-prs9n_15835642-65cd-4a89-a1a1-1950d6130bd1/dns-node-resolver/0.log" Jul 08 17:58:57.210978 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:57.210949 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-75dd8c987d-vrgvh_b5ce1039-f0d0-4337-8eee-093ccd762b8d/registry/0.log" Jul 08 17:58:57.273474 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:57.273442 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cppc4_8f7a5c3b-9cee-4f0c-b5d0-dbf3d4d4b7af/node-ca/0.log" Jul 08 17:58:58.138896 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:58.138866 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4wxtw7_972d360a-0998-4e41-94d6-88ee319573e2/istio-proxy/0.log" Jul 08 17:58:58.329998 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:58.329966 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d86b88db9-fxf62_8a8452a4-3b7e-43c8-a84e-0a5ac684609c/kube-auth-proxy/0.log" Jul 08 17:58:58.381661 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:58.381629 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-54k9j_9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7/istio-proxy/0.log" Jul 08 17:58:58.408281 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:58.408194 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-54k9j_9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7/istio-proxy/1.log" Jul 08 17:58:58.445408 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:58.445381 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-rdz5z_0e0c622e-a441-40d2-8874-224955b428b4/payload-pre-processing/0.log" Jul 08 17:58:59.202761 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:59.202732 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jh42n_e45622c1-3192-42a3-aeef-56cf942bcc63/serve-healthcheck-canary/0.log" Jul 08 17:58:59.732432 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:59.732402 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-25r84_c12acef5-40a9-4e66-932a-d26dcf75aa4e/kube-rbac-proxy/0.log" Jul 08 17:58:59.755437 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:59.755409 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-25r84_c12acef5-40a9-4e66-932a-d26dcf75aa4e/exporter/0.log" Jul 08 17:58:59.777347 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:58:59.777322 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-25r84_c12acef5-40a9-4e66-932a-d26dcf75aa4e/extractor/0.log" Jul 08 17:59:01.579968 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:01.579940 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ksr2v/perf-node-gather-daemonset-pt7m2" Jul 08 17:59:01.925848 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:01.925820 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-65ngj_637a4b7f-6bf6-4f76-886a-390e04ec9273/manager/0.log" Jul 08 17:59:02.032841 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:02.032799 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-j5tc6_602f6e2c-9ad1-458a-8577-1b108e330627/manager/0.log" Jul 08 17:59:02.204453 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:02.204365 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-n9b4r_f411d0c3-f9c6-4694-8ef3-f05d4ab17686/server/0.log" Jul 08 17:59:02.266277 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:02.266246 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-mp6s7_920516cd-cf90-4582-9d41-1c38a837befe/manager/0.log" Jul 08 17:59:02.399346 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:02.399316 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-564755f94b-ggcd4_ad8a8664-2aa8-4055-9998-995e2f1a8235/manager/0.log" Jul 08 17:59:02.423357 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:02.423330 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-564755f94b-ggcd4_ad8a8664-2aa8-4055-9998-995e2f1a8235/copy-manifests/0.log" Jul 08 17:59:04.501188 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:04.501149 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4wxtw7_972d360a-0998-4e41-94d6-88ee319573e2/istio-proxy/0.log" Jul 08 17:59:04.686376 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:04.686342 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d86b88db9-fxf62_8a8452a4-3b7e-43c8-a84e-0a5ac684609c/kube-auth-proxy/0.log" Jul 08 17:59:04.741647 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:04.741617 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-54k9j_9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7/istio-proxy/0.log" Jul 08 17:59:04.769928 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:04.769888 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-54k9j_9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7/istio-proxy/1.log" Jul 08 17:59:04.808106 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:04.808016 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-rdz5z_0e0c622e-a441-40d2-8874-224955b428b4/payload-pre-processing/0.log" Jul 08 17:59:05.950367 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:05.950338 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4wxtw7_972d360a-0998-4e41-94d6-88ee319573e2/istio-proxy/0.log" Jul 08 17:59:06.126003 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:06.125903 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d86b88db9-fxf62_8a8452a4-3b7e-43c8-a84e-0a5ac684609c/kube-auth-proxy/0.log" Jul 08 17:59:06.164132 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:06.164102 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-54k9j_9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7/istio-proxy/0.log" Jul 08 17:59:06.192678 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:06.192639 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-54k9j_9ce8d7b4-e674-4cc7-9df5-fc42d00fe4c7/istio-proxy/1.log" Jul 08 17:59:06.233951 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:06.233891 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-rdz5z_0e0c622e-a441-40d2-8874-224955b428b4/payload-pre-processing/0.log" Jul 08 17:59:08.992456 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:08.992426 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-blmwx_e0ad491d-2559-4336-98b8-78d3ccf57ffc/migrator/0.log" Jul 08 17:59:09.014172 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:09.014141 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-blmwx_e0ad491d-2559-4336-98b8-78d3ccf57ffc/graceful-termination/0.log" Jul 08 17:59:10.310727 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:10.310695 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9sl22_b61baec6-f2dc-424c-99e3-b82a8ab1c73d/kube-multus/0.log" Jul 08 17:59:10.683128 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:10.683098 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h4mm8_beee831c-cfd3-4511-9a7c-e4ce7c3d87ab/kube-multus-additional-cni-plugins/0.log" Jul 08 17:59:10.703230 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:10.703200 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h4mm8_beee831c-cfd3-4511-9a7c-e4ce7c3d87ab/egress-router-binary-copy/0.log" Jul 08 17:59:10.722807 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:10.722772 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h4mm8_beee831c-cfd3-4511-9a7c-e4ce7c3d87ab/cni-plugins/0.log" Jul 08 17:59:10.745033 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:10.744994 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h4mm8_beee831c-cfd3-4511-9a7c-e4ce7c3d87ab/bond-cni-plugin/0.log" Jul 08 17:59:10.765007 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:10.764977 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h4mm8_beee831c-cfd3-4511-9a7c-e4ce7c3d87ab/routeoverride-cni/0.log" Jul 08 17:59:10.785637 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:10.785609 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h4mm8_beee831c-cfd3-4511-9a7c-e4ce7c3d87ab/whereabouts-cni-bincopy/0.log" Jul 08 17:59:10.806133 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:10.806105 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h4mm8_beee831c-cfd3-4511-9a7c-e4ce7c3d87ab/whereabouts-cni/0.log" Jul 08 17:59:10.862701 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:10.862663 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-84tqr_6408e7f4-87d3-48a2-943f-7971adbf51f8/network-metrics-daemon/0.log" Jul 08 17:59:10.880783 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:10.880755 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-84tqr_6408e7f4-87d3-48a2-943f-7971adbf51f8/kube-rbac-proxy/0.log" Jul 08 17:59:11.802317 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:11.802284 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpkll_0c0dd73b-3891-4196-8e1c-be8560620dda/ovn-controller/0.log" Jul 08 17:59:11.819455 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:11.819430 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpkll_0c0dd73b-3891-4196-8e1c-be8560620dda/ovn-acl-logging/0.log" Jul 08 17:59:11.847789 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:11.847759 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpkll_0c0dd73b-3891-4196-8e1c-be8560620dda/kube-rbac-proxy-node/0.log" Jul 08 17:59:11.869281 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:11.869251 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpkll_0c0dd73b-3891-4196-8e1c-be8560620dda/kube-rbac-proxy-ovn-metrics/0.log" Jul 08 17:59:11.885839 ip-10-0-133-231 kubenswrapper[2556]: I0708 17:59:11.885803 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cpkll_0c0dd73b-3891-4196-8e1c-be8560620dda/northd/0.log"