Jul 11 23:57:15.171509 ip-10-0-132-227 systemd[1]: Starting Kubernetes Kubelet... Jul 11 23:57:17.081652 ip-10-0-132-227 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 11 23:57:17.081652 ip-10-0-132-227 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 11 23:57:17.081652 ip-10-0-132-227 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 11 23:57:17.081652 ip-10-0-132-227 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 11 23:57:17.081652 ip-10-0-132-227 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 11 23:57:17.082387 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.082310 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 11 23:57:17.085652 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085630 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 11 23:57:17.085652 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085654 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 11 23:57:17.085652 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085658 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 11 23:57:17.085652 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085661 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 11 23:57:17.085769 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085665 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 11 23:57:17.085769 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085668 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 11 23:57:17.085769 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085671 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 11 23:57:17.085769 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085673 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 11 23:57:17.085769 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085676 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 11 23:57:17.085769 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085679 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 11 23:57:17.085769 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085681 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 11 23:57:17.085769 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085685 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 11 23:57:17.085769 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085689 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 11 23:57:17.085769 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085692 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 11 23:57:17.085769 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085695 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 11 23:57:17.085769 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085698 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 11 23:57:17.085769 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085700 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 11 23:57:17.085769 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085703 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 11 23:57:17.085769 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085705 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 11 23:57:17.085769 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085708 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 11 23:57:17.085769 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085711 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 11 23:57:17.085769 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085713 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 11 23:57:17.085769 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085716 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 11 23:57:17.086223 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085718 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 11 23:57:17.086223 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085721 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 11 23:57:17.086223 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085723 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 11 23:57:17.086223 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085726 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 11 23:57:17.086223 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085729 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 11 23:57:17.086223 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085731 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 11 23:57:17.086223 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085736 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 11 23:57:17.086223 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085739 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 11 23:57:17.086223 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085742 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 11 23:57:17.086223 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085744 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 11 23:57:17.086223 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085747 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 11 23:57:17.086223 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085749 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 11 23:57:17.086223 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085752 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 11 23:57:17.086223 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085755 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 11 23:57:17.086223 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085759 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 11 23:57:17.086223 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085762 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 11 23:57:17.086223 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085764 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 11 23:57:17.086223 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085768 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 11 23:57:17.086223 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085772 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 11 23:57:17.086690 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085775 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 11 23:57:17.086690 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085778 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 11 23:57:17.086690 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085781 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 11 23:57:17.086690 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085784 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 11 23:57:17.086690 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085787 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 11 23:57:17.086690 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085790 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 11 23:57:17.086690 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085792 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 11 23:57:17.086690 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085795 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 11 23:57:17.086690 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085799 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 11 23:57:17.086690 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085802 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 11 23:57:17.086690 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085805 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 11 23:57:17.086690 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085807 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 11 23:57:17.086690 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085810 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 11 23:57:17.086690 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085813 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 11 23:57:17.086690 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085815 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 11 23:57:17.086690 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085818 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 11 23:57:17.086690 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085820 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 11 23:57:17.086690 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085823 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 11 23:57:17.086690 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085825 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 11 23:57:17.087167 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085828 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 11 23:57:17.087167 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085830 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 11 23:57:17.087167 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085833 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 11 23:57:17.087167 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085836 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 11 23:57:17.087167 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085838 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 11 23:57:17.087167 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085841 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 11 23:57:17.087167 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085843 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 11 23:57:17.087167 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085846 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 11 23:57:17.087167 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085849 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 11 23:57:17.087167 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085852 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 11 23:57:17.087167 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085855 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 11 23:57:17.087167 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085858 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 11 23:57:17.087167 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085860 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 11 23:57:17.087167 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085863 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 11 23:57:17.087167 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085865 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 11 23:57:17.087167 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085868 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 11 23:57:17.087167 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085870 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 11 23:57:17.087167 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085873 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 11 23:57:17.087167 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085878 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 11 23:57:17.087167 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085880 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 11 23:57:17.087636 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085883 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 11 23:57:17.087636 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085886 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 11 23:57:17.087636 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085888 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 11 23:57:17.087636 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085891 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 11 23:57:17.087636 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085893 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 11 23:57:17.087636 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085896 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 11 23:57:17.087636 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085899 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 11 23:57:17.087636 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085901 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 11 23:57:17.087636 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085904 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 11 23:57:17.087636 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085906 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 11 23:57:17.087636 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085909 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 11 23:57:17.087636 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085912 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 11 23:57:17.087636 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085914 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 11 23:57:17.087636 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085917 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 11 23:57:17.087636 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085919 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 11 23:57:17.087636 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085922 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 11 23:57:17.087636 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085924 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 11 23:57:17.087636 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.085927 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 11 23:57:17.087636 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086638 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 11 23:57:17.087636 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086645 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 11 23:57:17.088122 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086648 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 11 23:57:17.088122 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086651 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 11 23:57:17.088122 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086654 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 11 23:57:17.088122 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086657 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 11 23:57:17.088122 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086659 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 11 23:57:17.088122 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086664 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 11 23:57:17.088122 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086667 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 11 23:57:17.088122 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086670 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 11 23:57:17.088122 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086673 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 11 23:57:17.088122 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086676 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 11 23:57:17.088122 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086679 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 11 23:57:17.088122 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086682 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 11 23:57:17.088122 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086685 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 11 23:57:17.088122 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086688 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 11 23:57:17.088122 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086690 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 11 23:57:17.088122 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086693 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 11 23:57:17.088122 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086696 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 11 23:57:17.088122 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086699 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 11 23:57:17.088122 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086703 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 11 23:57:17.088588 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086706 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 11 23:57:17.088588 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086709 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 11 23:57:17.088588 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086711 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 11 23:57:17.088588 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086714 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 11 23:57:17.088588 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086716 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 11 23:57:17.088588 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086719 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 11 23:57:17.088588 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086722 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 11 23:57:17.088588 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086724 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 11 23:57:17.088588 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086727 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 11 23:57:17.088588 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086730 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 11 23:57:17.088588 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086732 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 11 23:57:17.088588 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086735 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 11 23:57:17.088588 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086738 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 11 23:57:17.088588 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086741 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 11 23:57:17.088588 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086744 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 11 23:57:17.088588 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086746 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 11 23:57:17.088588 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086749 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 11 23:57:17.088588 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086751 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 11 23:57:17.088588 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086753 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 11 23:57:17.089049 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086756 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 11 23:57:17.089049 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086758 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 11 23:57:17.089049 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086761 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 11 23:57:17.089049 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086763 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 11 23:57:17.089049 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086766 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 11 23:57:17.089049 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086768 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 11 23:57:17.089049 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086771 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 11 23:57:17.089049 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086773 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 11 23:57:17.089049 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086776 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 11 23:57:17.089049 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086778 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 11 23:57:17.089049 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086781 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 11 23:57:17.089049 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086783 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 11 23:57:17.089049 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086785 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 11 23:57:17.089049 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086788 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 11 23:57:17.089049 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086790 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 11 23:57:17.089049 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086793 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 11 23:57:17.089049 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086795 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 11 23:57:17.089049 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086797 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 11 23:57:17.089049 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086801 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 11 23:57:17.089049 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086803 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 11 23:57:17.089539 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086806 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 11 23:57:17.089539 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086808 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 11 23:57:17.089539 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086811 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 11 23:57:17.089539 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086813 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 11 23:57:17.089539 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086815 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 11 23:57:17.089539 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086818 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 11 23:57:17.089539 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086821 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 11 23:57:17.089539 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086824 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 11 23:57:17.089539 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086826 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 11 23:57:17.089539 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086829 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 11 23:57:17.089539 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086832 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 11 23:57:17.089539 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086834 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 11 23:57:17.089539 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086837 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 11 23:57:17.089539 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086840 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 11 23:57:17.089539 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086842 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 11 23:57:17.089539 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086845 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 11 23:57:17.089539 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086847 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 11 23:57:17.089539 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086850 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 11 23:57:17.089539 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086852 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 11 23:57:17.089539 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086855 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 11 23:57:17.090001 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086871 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 11 23:57:17.090001 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086874 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 11 23:57:17.090001 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086877 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 11 23:57:17.090001 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086880 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 11 23:57:17.090001 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086883 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 11 23:57:17.090001 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086888 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 11 23:57:17.090001 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086894 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 11 23:57:17.090001 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086897 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 11 23:57:17.090001 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086900 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 11 23:57:17.090001 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086903 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 11 23:57:17.090001 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086906 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 11 23:57:17.090001 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086909 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 11 23:57:17.090001 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086912 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 11 23:57:17.090001 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086915 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 11 23:57:17.090001 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086918 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 11 23:57:17.090001 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086921 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 11 23:57:17.090001 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086923 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 11 23:57:17.090001 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086926 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 11 23:57:17.090001 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.086928 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 11 23:57:17.090001 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087285 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 11 23:57:17.090500 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087290 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 11 23:57:17.090500 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087293 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 11 23:57:17.090500 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087296 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 11 23:57:17.090500 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087299 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 11 23:57:17.090500 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087301 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 11 23:57:17.090500 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087304 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 11 23:57:17.090500 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087306 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 11 23:57:17.090500 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087309 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 11 23:57:17.090500 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087311 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 11 23:57:17.090500 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087314 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 11 23:57:17.090500 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087316 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 11 23:57:17.090500 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087319 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 11 23:57:17.090500 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087322 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 11 23:57:17.090500 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087324 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 11 23:57:17.090500 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087327 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 11 23:57:17.090500 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087329 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 11 23:57:17.090500 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087332 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 11 23:57:17.090500 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087334 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 11 23:57:17.090500 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087339 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 11 23:57:17.090500 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087342 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 11 23:57:17.090956 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087345 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 11 23:57:17.090956 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087348 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 11 23:57:17.090956 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087350 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 11 23:57:17.090956 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087353 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 11 23:57:17.090956 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087355 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 11 23:57:17.090956 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087358 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 11 23:57:17.090956 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087361 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 11 23:57:17.090956 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087364 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 11 23:57:17.090956 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087368 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 11 23:57:17.090956 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087371 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 11 23:57:17.090956 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087374 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 11 23:57:17.090956 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087376 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 11 23:57:17.090956 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087378 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 11 23:57:17.090956 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087381 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 11 23:57:17.090956 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087384 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 11 23:57:17.090956 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087386 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 11 23:57:17.090956 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087388 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 11 23:57:17.090956 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087391 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 11 23:57:17.090956 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087393 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 11 23:57:17.090956 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087396 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 11 23:57:17.091471 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087399 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 11 23:57:17.091471 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087401 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 11 23:57:17.091471 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087403 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 11 23:57:17.091471 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087406 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 11 23:57:17.091471 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087409 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 11 23:57:17.091471 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087411 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 11 23:57:17.091471 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087414 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 11 23:57:17.091471 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087416 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 11 23:57:17.091471 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087419 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 11 23:57:17.091471 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087423 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 11 23:57:17.091471 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087428 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 11 23:57:17.091471 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087431 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 11 23:57:17.091471 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087433 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 11 23:57:17.091471 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087437 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 11 23:57:17.091471 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087440 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 11 23:57:17.091471 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087443 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 11 23:57:17.091471 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087446 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 11 23:57:17.091471 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087449 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 11 23:57:17.091471 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087451 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 11 23:57:17.091925 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087454 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 11 23:57:17.091925 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087456 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 11 23:57:17.091925 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087459 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 11 23:57:17.091925 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087461 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 11 23:57:17.091925 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087464 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 11 23:57:17.091925 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087466 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 11 23:57:17.091925 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087469 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 11 23:57:17.091925 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087472 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 11 23:57:17.091925 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087474 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 11 23:57:17.091925 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087477 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 11 23:57:17.091925 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087479 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 11 23:57:17.091925 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087481 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 11 23:57:17.091925 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087484 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 11 23:57:17.091925 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087487 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 11 23:57:17.091925 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087489 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 11 23:57:17.091925 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087491 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 11 23:57:17.091925 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087494 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 11 23:57:17.091925 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087496 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 11 23:57:17.091925 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087499 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 11 23:57:17.091925 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087502 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 11 23:57:17.092430 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087505 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 11 23:57:17.092430 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087507 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 11 23:57:17.092430 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087510 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 11 23:57:17.092430 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087515 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 11 23:57:17.092430 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087517 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 11 23:57:17.092430 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087520 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 11 23:57:17.092430 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087522 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 11 23:57:17.092430 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087525 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 11 23:57:17.092430 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087528 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 11 23:57:17.092430 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087531 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 11 23:57:17.092430 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087534 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 11 23:57:17.092430 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087536 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 11 23:57:17.092430 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087539 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 11 23:57:17.092430 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087541 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 11 23:57:17.092430 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087544 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 11 23:57:17.092430 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087546 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 11 23:57:17.092430 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087549 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 11 23:57:17.092430 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087551 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 11 23:57:17.092430 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.087555 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 11 23:57:17.092430 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087621 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 11 23:57:17.092926 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087627 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 11 23:57:17.092926 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087632 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 11 23:57:17.092926 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087637 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 11 23:57:17.092926 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087641 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 11 23:57:17.092926 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087644 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 11 23:57:17.092926 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087648 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 11 23:57:17.092926 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087652 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 11 23:57:17.092926 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087655 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 11 23:57:17.092926 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087658 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 11 23:57:17.092926 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087662 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 11 23:57:17.092926 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087665 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 11 23:57:17.092926 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087669 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 11 23:57:17.092926 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087672 2564 flags.go:64] FLAG: --cgroup-root="" Jul 11 23:57:17.092926 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087675 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 11 23:57:17.092926 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087678 2564 flags.go:64] FLAG: --client-ca-file="" Jul 11 23:57:17.092926 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087681 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 11 23:57:17.092926 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087684 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 11 23:57:17.092926 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087687 2564 flags.go:64] FLAG: --cluster-domain="" Jul 11 23:57:17.092926 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087690 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 11 23:57:17.092926 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087693 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 11 23:57:17.092926 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087696 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 11 23:57:17.092926 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087700 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 11 23:57:17.092926 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087703 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 11 23:57:17.092926 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087705 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 11 23:57:17.093514 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087708 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 11 23:57:17.093514 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087712 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 11 23:57:17.093514 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087714 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 11 23:57:17.093514 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087717 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 11 23:57:17.093514 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087720 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 11 23:57:17.093514 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087723 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 11 23:57:17.093514 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087726 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 11 23:57:17.093514 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087730 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 11 23:57:17.093514 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087733 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 11 23:57:17.093514 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087736 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 11 23:57:17.093514 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087738 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 11 23:57:17.093514 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087741 2564 flags.go:64] FLAG: --enable-server="true" Jul 11 23:57:17.093514 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087744 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 11 23:57:17.093514 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087748 2564 flags.go:64] FLAG: --event-burst="100" Jul 11 23:57:17.093514 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087750 2564 flags.go:64] FLAG: --event-qps="50" Jul 11 23:57:17.093514 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087753 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 11 23:57:17.093514 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087756 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 11 23:57:17.093514 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087759 2564 flags.go:64] FLAG: --eviction-hard="" Jul 11 23:57:17.093514 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087762 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 11 23:57:17.093514 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087765 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 11 23:57:17.093514 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087769 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 11 23:57:17.093514 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087772 2564 flags.go:64] FLAG: --eviction-soft="" Jul 11 23:57:17.093514 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087775 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 11 23:57:17.093514 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087778 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 11 23:57:17.093514 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087781 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 11 23:57:17.094191 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087784 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 11 23:57:17.094191 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087787 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 11 23:57:17.094191 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087790 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 11 23:57:17.094191 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087793 2564 flags.go:64] FLAG: --feature-gates="" Jul 11 23:57:17.094191 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087796 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 11 23:57:17.094191 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087799 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 11 23:57:17.094191 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087802 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 11 23:57:17.094191 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087805 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 11 23:57:17.094191 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087808 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 11 23:57:17.094191 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087811 2564 flags.go:64] FLAG: --help="false" Jul 11 23:57:17.094191 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087814 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-132-227.ec2.internal" Jul 11 23:57:17.094191 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087817 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 11 23:57:17.094191 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087820 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 11 23:57:17.094191 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087823 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 11 23:57:17.094191 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087826 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 11 23:57:17.094191 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087829 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 11 23:57:17.094191 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087832 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 11 23:57:17.094191 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087834 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 11 23:57:17.094191 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087837 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 11 23:57:17.094191 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087840 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 11 23:57:17.094191 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087843 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 11 23:57:17.094191 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087846 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 11 23:57:17.094191 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087849 2564 flags.go:64] FLAG: --kube-reserved="" Jul 11 23:57:17.094191 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087851 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 11 23:57:17.095241 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087854 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 11 23:57:17.095241 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087857 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 11 23:57:17.095241 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087860 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 11 23:57:17.095241 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087863 2564 flags.go:64] FLAG: --lock-file="" Jul 11 23:57:17.095241 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087866 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 11 23:57:17.095241 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087868 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 11 23:57:17.095241 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087871 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 11 23:57:17.095241 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087876 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 11 23:57:17.095241 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087879 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 11 23:57:17.095241 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087884 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 11 23:57:17.095241 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087887 2564 flags.go:64] FLAG: --logging-format="text" Jul 11 23:57:17.095241 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087889 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 11 23:57:17.095241 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087893 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 11 23:57:17.095241 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087895 2564 flags.go:64] FLAG: --manifest-url="" Jul 11 23:57:17.095241 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087898 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 11 23:57:17.095241 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087902 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 11 23:57:17.095241 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087905 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 11 23:57:17.095241 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087909 2564 flags.go:64] FLAG: --max-pods="110" Jul 11 23:57:17.095241 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087912 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 11 23:57:17.095241 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087915 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 11 23:57:17.095241 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087917 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 11 23:57:17.095241 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087920 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 11 23:57:17.095241 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087923 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 11 23:57:17.095241 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087925 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 11 23:57:17.095241 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087928 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 11 23:57:17.096302 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087934 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 11 23:57:17.096302 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087936 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 11 23:57:17.096302 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087939 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 11 23:57:17.096302 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087942 2564 flags.go:64] FLAG: --pod-cidr="" Jul 11 23:57:17.096302 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087945 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 11 23:57:17.096302 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087950 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 11 23:57:17.096302 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087953 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 11 23:57:17.096302 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087955 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 11 23:57:17.096302 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087958 2564 flags.go:64] FLAG: --port="10250" Jul 11 23:57:17.096302 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087961 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 11 23:57:17.096302 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087964 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00e81b2735b142e49" Jul 11 23:57:17.096302 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087967 2564 flags.go:64] FLAG: --qos-reserved="" Jul 11 23:57:17.096302 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087970 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 11 23:57:17.096302 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087973 2564 flags.go:64] FLAG: --register-node="true" Jul 11 23:57:17.096302 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087977 2564 flags.go:64] FLAG: --register-with-taints="" Jul 11 23:57:17.096302 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087980 2564 flags.go:64] FLAG: --registry-burst="10" Jul 11 23:57:17.096302 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087984 2564 flags.go:64] FLAG: --registry-qps="5" Jul 11 23:57:17.096302 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087987 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 11 23:57:17.096302 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087990 2564 flags.go:64] FLAG: --reserved-memory="" Jul 11 23:57:17.096302 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087993 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 11 23:57:17.096302 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087996 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 11 23:57:17.096302 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.087999 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 11 23:57:17.096302 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088002 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 11 23:57:17.096302 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088004 2564 flags.go:64] FLAG: --runonce="false" Jul 11 23:57:17.096302 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088007 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 11 23:57:17.097435 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088011 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 11 23:57:17.097435 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088014 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 11 23:57:17.097435 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088016 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 11 23:57:17.097435 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088019 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 11 23:57:17.097435 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088022 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 11 23:57:17.097435 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088025 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 11 23:57:17.097435 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088028 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 11 23:57:17.097435 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088030 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 11 23:57:17.097435 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088033 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 11 23:57:17.097435 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088036 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 11 23:57:17.097435 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088038 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 11 23:57:17.097435 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088041 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 11 23:57:17.097435 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088044 2564 flags.go:64] FLAG: --system-cgroups="" Jul 11 23:57:17.097435 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088047 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 11 23:57:17.097435 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088051 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 11 23:57:17.097435 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088054 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 11 23:57:17.097435 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088057 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 11 23:57:17.097435 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088060 2564 flags.go:64] FLAG: --tls-min-version="" Jul 11 23:57:17.097435 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088063 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 11 23:57:17.097435 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088065 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 11 23:57:17.097435 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088069 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 11 23:57:17.097435 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088073 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 11 23:57:17.097435 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088076 2564 flags.go:64] FLAG: --v="2" Jul 11 23:57:17.097435 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088081 2564 flags.go:64] FLAG: --version="false" Jul 11 23:57:17.097435 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088085 2564 flags.go:64] FLAG: --vmodule="" Jul 11 23:57:17.098261 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088089 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 11 23:57:17.098261 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.088092 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 11 23:57:17.098261 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088225 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 11 23:57:17.098261 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088230 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 11 23:57:17.098261 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088233 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 11 23:57:17.098261 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088236 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 11 23:57:17.098261 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088239 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 11 23:57:17.098261 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088242 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 11 23:57:17.098261 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088244 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 11 23:57:17.098261 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088247 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 11 23:57:17.098261 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088249 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 11 23:57:17.098261 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088252 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 11 23:57:17.098261 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088255 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 11 23:57:17.098261 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088257 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 11 23:57:17.098261 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088260 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 11 23:57:17.098261 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088262 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 11 23:57:17.098261 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088265 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 11 23:57:17.098261 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088268 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 11 23:57:17.098261 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088270 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 11 23:57:17.098261 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088273 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 11 23:57:17.099065 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088275 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 11 23:57:17.099065 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088278 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 11 23:57:17.099065 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088281 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 11 23:57:17.099065 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088283 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 11 23:57:17.099065 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088286 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 11 23:57:17.099065 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088288 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 11 23:57:17.099065 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088290 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 11 23:57:17.099065 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088293 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 11 23:57:17.099065 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088297 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 11 23:57:17.099065 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088300 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 11 23:57:17.099065 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088303 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 11 23:57:17.099065 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088306 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 11 23:57:17.099065 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088309 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 11 23:57:17.099065 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088311 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 11 23:57:17.099065 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088314 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 11 23:57:17.099065 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088317 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 11 23:57:17.099065 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088320 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 11 23:57:17.099065 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088322 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 11 23:57:17.099065 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088325 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 11 23:57:17.099065 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088328 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 11 23:57:17.099857 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088330 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 11 23:57:17.099857 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088332 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 11 23:57:17.099857 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088335 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 11 23:57:17.099857 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088337 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 11 23:57:17.099857 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088340 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 11 23:57:17.099857 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088343 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 11 23:57:17.099857 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088345 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 11 23:57:17.099857 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088348 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 11 23:57:17.099857 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088350 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 11 23:57:17.099857 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088353 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 11 23:57:17.099857 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088355 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 11 23:57:17.099857 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088358 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 11 23:57:17.099857 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088360 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 11 23:57:17.099857 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088363 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 11 23:57:17.099857 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088365 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 11 23:57:17.099857 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088368 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 11 23:57:17.099857 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088370 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 11 23:57:17.099857 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088374 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 11 23:57:17.099857 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088377 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 11 23:57:17.100455 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088380 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 11 23:57:17.100455 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088385 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 11 23:57:17.100455 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088389 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 11 23:57:17.100455 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088393 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 11 23:57:17.100455 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088395 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 11 23:57:17.100455 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088398 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 11 23:57:17.100455 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088400 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 11 23:57:17.100455 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088403 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 11 23:57:17.100455 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088405 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 11 23:57:17.100455 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088408 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 11 23:57:17.100455 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088410 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 11 23:57:17.100455 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088413 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 11 23:57:17.100455 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088415 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 11 23:57:17.100455 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088418 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 11 23:57:17.100455 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088420 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 11 23:57:17.100455 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088423 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 11 23:57:17.100455 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088425 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 11 23:57:17.100455 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088428 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 11 23:57:17.100455 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088430 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 11 23:57:17.100455 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088433 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 11 23:57:17.100970 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088435 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 11 23:57:17.100970 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088438 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 11 23:57:17.100970 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088440 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 11 23:57:17.100970 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088443 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 11 23:57:17.100970 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088445 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 11 23:57:17.100970 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088448 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 11 23:57:17.100970 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088450 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 11 23:57:17.100970 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088453 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 11 23:57:17.100970 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088457 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 11 23:57:17.100970 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088460 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 11 23:57:17.100970 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088463 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 11 23:57:17.100970 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088466 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 11 23:57:17.100970 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088469 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 11 23:57:17.100970 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088472 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 11 23:57:17.100970 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088475 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 11 23:57:17.100970 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088480 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 11 23:57:17.100970 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088483 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 11 23:57:17.100970 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088486 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 11 23:57:17.100970 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088488 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 11 23:57:17.100970 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088491 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 11 23:57:17.101489 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088494 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 11 23:57:17.101489 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.088498 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 11 23:57:17.101489 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.089123 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 11 23:57:17.101489 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.096364 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 11 23:57:17.101489 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.096381 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 11 23:57:17.101489 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.096405 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 11 23:57:17.101489 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.096414 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 11 23:57:17.101489 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096497 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 11 23:57:17.101489 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096505 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 11 23:57:17.101489 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096510 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 11 23:57:17.101489 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096514 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 11 23:57:17.101489 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096518 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 11 23:57:17.101489 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096523 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 11 23:57:17.101489 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096527 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 11 23:57:17.101863 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096531 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 11 23:57:17.101863 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096535 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 11 23:57:17.101863 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096540 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 11 23:57:17.101863 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096545 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 11 23:57:17.101863 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096549 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 11 23:57:17.101863 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096553 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 11 23:57:17.101863 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096557 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 11 23:57:17.101863 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096562 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 11 23:57:17.101863 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096566 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 11 23:57:17.101863 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096570 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 11 23:57:17.101863 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096574 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 11 23:57:17.101863 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096579 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 11 23:57:17.101863 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096583 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 11 23:57:17.101863 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096588 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 11 23:57:17.101863 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096592 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 11 23:57:17.101863 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096596 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 11 23:57:17.101863 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096614 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 11 23:57:17.101863 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096619 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 11 23:57:17.101863 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096623 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 11 23:57:17.101863 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096628 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 11 23:57:17.102501 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096632 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 11 23:57:17.102501 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096637 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 11 23:57:17.102501 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096642 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 11 23:57:17.102501 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096646 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 11 23:57:17.102501 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096650 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 11 23:57:17.102501 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096655 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 11 23:57:17.102501 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096659 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 11 23:57:17.102501 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096664 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 11 23:57:17.102501 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096668 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 11 23:57:17.102501 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096672 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 11 23:57:17.102501 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096676 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 11 23:57:17.102501 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096680 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 11 23:57:17.102501 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096684 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 11 23:57:17.102501 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096688 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 11 23:57:17.102501 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096693 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 11 23:57:17.102501 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096697 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 11 23:57:17.102501 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096701 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 11 23:57:17.102501 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096706 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 11 23:57:17.102501 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096710 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 11 23:57:17.103012 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096714 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 11 23:57:17.103012 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096718 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 11 23:57:17.103012 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096723 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 11 23:57:17.103012 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096727 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 11 23:57:17.103012 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096731 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 11 23:57:17.103012 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096735 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 11 23:57:17.103012 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096739 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 11 23:57:17.103012 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096744 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 11 23:57:17.103012 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096748 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 11 23:57:17.103012 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096752 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 11 23:57:17.103012 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096756 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 11 23:57:17.103012 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096761 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 11 23:57:17.103012 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096766 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 11 23:57:17.103012 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096770 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 11 23:57:17.103012 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096774 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 11 23:57:17.103012 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096781 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 11 23:57:17.103012 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096786 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 11 23:57:17.103012 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096790 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 11 23:57:17.103012 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096795 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 11 23:57:17.103012 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096800 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 11 23:57:17.103513 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096804 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 11 23:57:17.103513 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096809 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 11 23:57:17.103513 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096813 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 11 23:57:17.103513 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096817 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 11 23:57:17.103513 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096821 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 11 23:57:17.103513 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096825 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 11 23:57:17.103513 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096829 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 11 23:57:17.103513 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096833 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 11 23:57:17.103513 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096838 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 11 23:57:17.103513 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096842 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 11 23:57:17.103513 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096846 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 11 23:57:17.103513 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096850 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 11 23:57:17.103513 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096855 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 11 23:57:17.103513 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096859 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 11 23:57:17.103513 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096863 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 11 23:57:17.103513 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096867 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 11 23:57:17.103513 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096871 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 11 23:57:17.103513 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096878 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 11 23:57:17.103513 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096883 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 11 23:57:17.103996 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096889 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 11 23:57:17.103996 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096895 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 11 23:57:17.103996 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096900 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 11 23:57:17.103996 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096904 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 11 23:57:17.103996 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096909 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 11 23:57:17.103996 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096914 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 11 23:57:17.103996 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096919 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 11 23:57:17.103996 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096924 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 11 23:57:17.103996 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096929 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 11 23:57:17.103996 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096933 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 11 23:57:17.103996 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096937 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 11 23:57:17.103996 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096942 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 11 23:57:17.103996 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096946 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 11 23:57:17.103996 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.096950 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 11 23:57:17.103996 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.096958 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 11 23:57:17.104408 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097140 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 11 23:57:17.104408 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097149 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 11 23:57:17.104408 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097154 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 11 23:57:17.104408 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097157 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 11 23:57:17.104408 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097161 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 11 23:57:17.104408 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097165 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 11 23:57:17.104408 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097169 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 11 23:57:17.104408 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097174 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 11 23:57:17.104408 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097178 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 11 23:57:17.104408 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097183 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 11 23:57:17.104408 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097187 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 11 23:57:17.104408 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097191 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 11 23:57:17.104408 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097195 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 11 23:57:17.104408 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097200 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 11 23:57:17.104408 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097207 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 11 23:57:17.104408 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097213 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 11 23:57:17.104408 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097217 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 11 23:57:17.104408 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097222 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 11 23:57:17.104408 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097226 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 11 23:57:17.105213 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097231 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 11 23:57:17.105213 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097235 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 11 23:57:17.105213 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097239 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 11 23:57:17.105213 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097244 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 11 23:57:17.105213 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097249 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 11 23:57:17.105213 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097253 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 11 23:57:17.105213 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097257 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 11 23:57:17.105213 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097261 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 11 23:57:17.105213 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097266 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 11 23:57:17.105213 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097271 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 11 23:57:17.105213 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097275 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 11 23:57:17.105213 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097279 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 11 23:57:17.105213 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097283 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 11 23:57:17.105213 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097288 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 11 23:57:17.105213 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097292 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 11 23:57:17.105213 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097296 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 11 23:57:17.105213 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097300 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 11 23:57:17.105213 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097304 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 11 23:57:17.105213 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097308 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 11 23:57:17.105979 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097312 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 11 23:57:17.105979 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097317 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 11 23:57:17.105979 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097321 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 11 23:57:17.105979 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097325 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 11 23:57:17.105979 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097329 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 11 23:57:17.105979 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097333 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 11 23:57:17.105979 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097337 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 11 23:57:17.105979 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097341 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 11 23:57:17.105979 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097346 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 11 23:57:17.105979 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097350 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 11 23:57:17.105979 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097354 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 11 23:57:17.105979 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097358 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 11 23:57:17.105979 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097363 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 11 23:57:17.105979 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097369 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 11 23:57:17.105979 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097374 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 11 23:57:17.105979 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097378 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 11 23:57:17.105979 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097382 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 11 23:57:17.105979 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097387 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 11 23:57:17.105979 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097391 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 11 23:57:17.105979 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097394 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 11 23:57:17.106516 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097399 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 11 23:57:17.106516 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097404 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 11 23:57:17.106516 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097408 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 11 23:57:17.106516 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097412 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 11 23:57:17.106516 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097416 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 11 23:57:17.106516 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097420 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 11 23:57:17.106516 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097424 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 11 23:57:17.106516 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097428 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 11 23:57:17.106516 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097432 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 11 23:57:17.106516 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097435 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 11 23:57:17.106516 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097439 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 11 23:57:17.106516 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097443 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 11 23:57:17.106516 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097447 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 11 23:57:17.106516 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097451 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 11 23:57:17.106516 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097455 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 11 23:57:17.106516 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097458 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 11 23:57:17.106516 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097462 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 11 23:57:17.106516 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097466 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 11 23:57:17.106516 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097473 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 11 23:57:17.107021 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097478 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 11 23:57:17.107021 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097484 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 11 23:57:17.107021 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097489 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 11 23:57:17.107021 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097493 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 11 23:57:17.107021 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097497 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 11 23:57:17.107021 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097502 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 11 23:57:17.107021 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097506 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 11 23:57:17.107021 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097510 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 11 23:57:17.107021 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097515 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 11 23:57:17.107021 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097519 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 11 23:57:17.107021 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097524 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 11 23:57:17.107021 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097528 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 11 23:57:17.107021 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097532 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 11 23:57:17.107021 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097536 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 11 23:57:17.107021 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097540 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 11 23:57:17.107021 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097545 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 11 23:57:17.107021 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097549 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 11 23:57:17.107021 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097553 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 11 23:57:17.107021 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097557 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 11 23:57:17.107021 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097560 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 11 23:57:17.107583 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097564 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 11 23:57:17.107583 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:17.097569 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 11 23:57:17.107583 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.097577 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 11 23:57:17.107583 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.097709 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 11 23:57:17.107583 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.100184 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 11 23:57:17.107583 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.101454 2564 server.go:1019] "Starting client certificate rotation" Jul 11 23:57:17.107583 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.101552 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 11 23:57:17.107583 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.102247 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 11 23:57:17.107583 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.105004 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 11 23:57:17.109859 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.109843 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 11 23:57:17.117702 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.117684 2564 log.go:25] "Validated CRI v1 runtime API" Jul 11 23:57:17.119655 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.119637 2564 log.go:25] "Validated CRI v1 image API" Jul 11 23:57:17.120962 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.120948 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 11 23:57:17.123057 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.123039 2564 fs.go:135] Filesystem UUIDs: map[6d8ea6a4-1777-4f4d-99f2-2b1d57dc340f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f2af9324-f263-45e2-b58a-95b045aa975f:/dev/nvme0n1p4] Jul 11 23:57:17.123136 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.123057 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 11 23:57:17.127705 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.127601 2564 manager.go:216] Machine: {Timestamp:2026-07-11 23:57:17.126524772 +0000 UTC m=+0.302321406 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103436 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b559da626cd725d8d325cdf69f64f SystemUUID:ec2b559d-a626-cd72-5d8d-325cdf69f64f BootID:83c9c922-4319-4a55-a4b7-465d65c3b73c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fe:fb:ce:e3:b9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fe:fb:ce:e3:b9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:ec:5d:18:52:30 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 11 23:57:17.127705 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.127703 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 11 23:57:17.127809 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.127773 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 11 23:57:17.130459 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.130432 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 11 23:57:17.130591 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.130461 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-227.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 11 23:57:17.131189 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.131178 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 11 23:57:17.131221 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.131192 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 11 23:57:17.131221 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.131203 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 11 23:57:17.131857 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.131840 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 11 23:57:17.132017 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.132001 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 11 23:57:17.133120 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.133096 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 11 23:57:17.135412 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.135401 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 11 23:57:17.135663 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.135652 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 11 23:57:17.135700 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.135683 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 11 23:57:17.135700 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.135694 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 11 23:57:17.135754 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.135704 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 11 23:57:17.135754 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.135713 2564 kubelet.go:398] "Adding apiserver pod source" Jul 11 23:57:17.135754 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.135724 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 11 23:57:17.136022 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.136011 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 11 23:57:17.136061 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.136029 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 11 23:57:17.137889 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.137872 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 11 23:57:17.139581 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.139568 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 11 23:57:17.139621 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.139598 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 11 23:57:17.139741 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.139732 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 11 23:57:17.139773 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.139746 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 11 23:57:17.139773 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.139752 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 11 23:57:17.139773 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.139758 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 11 23:57:17.139773 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.139765 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 11 23:57:17.139773 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.139770 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 11 23:57:17.140181 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.140172 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 11 23:57:17.140181 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.140181 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 11 23:57:17.140249 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.140187 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 11 23:57:17.140249 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.140192 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 11 23:57:17.140249 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.140206 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 11 23:57:17.140249 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.140214 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 11 23:57:17.140249 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.140232 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 11 23:57:17.140249 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.140237 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 11 23:57:17.143789 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.143775 2564 server.go:1268] "Started kubelet" Jul 11 23:57:17.143877 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.143850 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 11 23:57:17.144144 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.144008 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 11 23:57:17.144144 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.144076 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 11 23:57:17.144605 ip-10-0-132-227 systemd[1]: Started Kubernetes Kubelet. Jul 11 23:57:17.145470 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.145332 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 11 23:57:17.145982 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.145962 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-227.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 11 23:57:17.146574 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:17.146547 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 11 23:57:17.146638 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:17.146564 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-227.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 11 23:57:17.146750 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.146740 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 11 23:57:17.151814 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.151793 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 11 23:57:17.151814 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.151802 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 11 23:57:17.151960 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:17.151904 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-227.ec2.internal\" not found" Jul 11 23:57:17.152268 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:17.152247 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 11 23:57:17.152425 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.152408 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 11 23:57:17.152489 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.152428 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 11 23:57:17.152489 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.152406 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 11 23:57:17.152585 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.152554 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 11 23:57:17.152585 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.152563 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 11 23:57:17.152585 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.152578 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wzrth" Jul 11 23:57:17.152994 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.152978 2564 factory.go:55] Registering systemd factory Jul 11 23:57:17.152994 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.152992 2564 factory.go:223] Registration of the systemd container factory successfully Jul 11 23:57:17.153219 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.153205 2564 factory.go:153] Registering CRI-O factory Jul 11 23:57:17.153261 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.153221 2564 factory.go:223] Registration of the crio container factory successfully Jul 11 23:57:17.153313 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.153270 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 11 23:57:17.153313 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.153287 2564 factory.go:103] Registering Raw factory Jul 11 23:57:17.153313 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.153298 2564 manager.go:1196] Started watching for new ooms in manager Jul 11 23:57:17.153612 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.153602 2564 manager.go:349] Starting recovery of all containers Jul 11 23:57:17.154725 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:17.152745 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-227.ec2.internal.18c16198fe3cb548 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-227.ec2.internal,UID:ip-10-0-132-227.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-227.ec2.internal,},FirstTimestamp:2026-07-11 23:57:17.143741768 +0000 UTC m=+0.319538398,LastTimestamp:2026-07-11 23:57:17.143741768 +0000 UTC m=+0.319538398,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-227.ec2.internal,}" Jul 11 23:57:17.160681 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.160524 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wzrth" Jul 11 23:57:17.162631 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:17.162604 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-227.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 11 23:57:17.162744 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:17.162722 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 11 23:57:17.163858 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.163842 2564 manager.go:354] Recovery completed Jul 11 23:57:17.168081 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.168068 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 11 23:57:17.169936 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.169918 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasSufficientMemory" Jul 11 23:57:17.170001 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.169950 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasNoDiskPressure" Jul 11 23:57:17.170001 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.169961 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasSufficientPID" Jul 11 23:57:17.172113 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.172085 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 11 23:57:17.172113 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.172113 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 11 23:57:17.172215 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.172120 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 11 23:57:17.172215 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.172131 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 11 23:57:17.173044 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.173034 2564 policy_none.go:49] "None policy: Start" Jul 11 23:57:17.173079 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.173048 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 11 23:57:17.173079 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.173059 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 11 23:57:17.174097 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.174086 2564 policy_none.go:47] "Start" Jul 11 23:57:17.177391 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.177375 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasSufficientMemory" Jul 11 23:57:17.177466 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.177402 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasNoDiskPressure" Jul 11 23:57:17.177466 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.177414 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasSufficientPID" Jul 11 23:57:17.209757 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.209737 2564 manager.go:337] "Starting Device Plugin manager" Jul 11 23:57:17.209838 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:17.209784 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 11 23:57:17.209838 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.209798 2564 server.go:87] "Starting device plugin registration server" Jul 11 23:57:17.210070 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.210051 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 11 23:57:17.210177 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.210070 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 11 23:57:17.210177 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.210162 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 11 23:57:17.210281 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.210256 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 11 23:57:17.210281 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.210266 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 11 23:57:17.210803 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:17.210784 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 11 23:57:17.210876 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:17.210840 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-227.ec2.internal\" not found" Jul 11 23:57:17.310603 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.310539 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 11 23:57:17.311575 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.311533 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasSufficientMemory" Jul 11 23:57:17.311575 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.311569 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasNoDiskPressure" Jul 11 23:57:17.311692 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.311584 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasSufficientPID" Jul 11 23:57:17.311692 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.311620 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-227.ec2.internal" Jul 11 23:57:17.319213 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.319197 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-227.ec2.internal" Jul 11 23:57:17.319278 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:17.319219 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-227.ec2.internal\": node \"ip-10-0-132-227.ec2.internal\" not found" Jul 11 23:57:17.328410 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.328386 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 11 23:57:17.329496 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.329478 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 11 23:57:17.329566 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.329514 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 11 23:57:17.329566 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.329536 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 11 23:57:17.329642 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:17.329568 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 11 23:57:17.330435 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:17.330414 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-227.ec2.internal\" not found" Jul 11 23:57:17.332381 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.332365 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 11 23:57:17.430460 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.430425 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-227.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal"] Jul 11 23:57:17.430555 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.430508 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 11 23:57:17.430555 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:17.430513 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-227.ec2.internal\" not found" Jul 11 23:57:17.432282 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.432266 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasSufficientMemory" Jul 11 23:57:17.432341 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.432294 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasNoDiskPressure" Jul 11 23:57:17.432341 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.432304 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasSufficientPID" Jul 11 23:57:17.433350 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.433338 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 11 23:57:17.433438 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.433425 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-227.ec2.internal" Jul 11 23:57:17.433482 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.433453 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 11 23:57:17.434070 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.434055 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasSufficientMemory" Jul 11 23:57:17.434150 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.434085 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasNoDiskPressure" Jul 11 23:57:17.434150 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.434096 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasSufficientPID" Jul 11 23:57:17.434150 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.434055 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasSufficientMemory" Jul 11 23:57:17.434235 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.434164 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasNoDiskPressure" Jul 11 23:57:17.434235 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.434177 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasSufficientPID" Jul 11 23:57:17.435163 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.435149 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal" Jul 11 23:57:17.435234 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.435173 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 11 23:57:17.435974 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.435958 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasSufficientMemory" Jul 11 23:57:17.436028 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.435990 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasNoDiskPressure" Jul 11 23:57:17.436028 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.436000 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasSufficientPID" Jul 11 23:57:17.453637 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.453620 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87ba212901094f4334b3080963b67e70-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal\" (UID: \"87ba212901094f4334b3080963b67e70\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal" Jul 11 23:57:17.453726 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.453643 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/128e18488d42fbf8ffd3f878224f2cb5-config\") pod \"kube-apiserver-proxy-ip-10-0-132-227.ec2.internal\" (UID: \"128e18488d42fbf8ffd3f878224f2cb5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-227.ec2.internal" Jul 11 23:57:17.453726 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.453660 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/87ba212901094f4334b3080963b67e70-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal\" (UID: \"87ba212901094f4334b3080963b67e70\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal" Jul 11 23:57:17.453795 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:17.453729 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-227.ec2.internal\" not found" node="ip-10-0-132-227.ec2.internal" Jul 11 23:57:17.457037 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:17.457018 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-227.ec2.internal\" not found" node="ip-10-0-132-227.ec2.internal" Jul 11 23:57:17.530577 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:17.530556 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-227.ec2.internal\" not found" Jul 11 23:57:17.554369 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.554355 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/128e18488d42fbf8ffd3f878224f2cb5-config\") pod \"kube-apiserver-proxy-ip-10-0-132-227.ec2.internal\" (UID: \"128e18488d42fbf8ffd3f878224f2cb5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-227.ec2.internal" Jul 11 23:57:17.554433 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.554378 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/87ba212901094f4334b3080963b67e70-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal\" (UID: \"87ba212901094f4334b3080963b67e70\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal" Jul 11 23:57:17.554433 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.554395 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87ba212901094f4334b3080963b67e70-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal\" (UID: \"87ba212901094f4334b3080963b67e70\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal" Jul 11 23:57:17.554499 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.554439 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87ba212901094f4334b3080963b67e70-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal\" (UID: \"87ba212901094f4334b3080963b67e70\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal" Jul 11 23:57:17.554499 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.554464 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/128e18488d42fbf8ffd3f878224f2cb5-config\") pod \"kube-apiserver-proxy-ip-10-0-132-227.ec2.internal\" (UID: \"128e18488d42fbf8ffd3f878224f2cb5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-227.ec2.internal" Jul 11 23:57:17.554499 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.554472 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/87ba212901094f4334b3080963b67e70-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal\" (UID: \"87ba212901094f4334b3080963b67e70\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal" Jul 11 23:57:17.631639 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:17.631593 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-227.ec2.internal\" not found" Jul 11 23:57:17.732188 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:17.732165 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-227.ec2.internal\" not found" Jul 11 23:57:17.755556 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.755539 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-227.ec2.internal" Jul 11 23:57:17.760032 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:17.760020 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal" Jul 11 23:57:17.832551 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:17.832519 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-227.ec2.internal\" not found" Jul 11 23:57:17.932984 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:17.932966 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-227.ec2.internal\" not found" Jul 11 23:57:18.033533 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:18.033513 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-227.ec2.internal\" not found" Jul 11 23:57:18.100975 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:18.100951 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 11 23:57:18.101567 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:18.101076 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 11 23:57:18.117771 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:18.117755 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 11 23:57:18.133769 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:18.133745 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-227.ec2.internal\" not found" Jul 11 23:57:18.165293 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:18.165265 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-10 23:52:17 +0000 UTC" deadline="2027-12-05 20:53:54.822163732 +0000 UTC" Jul 11 23:57:18.165293 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:18.165291 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12284h56m36.656876898s" Jul 11 23:57:18.225161 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:18.225123 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87ba212901094f4334b3080963b67e70.slice/crio-0fda7847e21745b2fd9c9b4089d812ae98af2c0611e0fec84944affa294ee140 WatchSource:0}: Error finding container 0fda7847e21745b2fd9c9b4089d812ae98af2c0611e0fec84944affa294ee140: Status 404 returned error can't find the container with id 0fda7847e21745b2fd9c9b4089d812ae98af2c0611e0fec84944affa294ee140 Jul 11 23:57:18.225385 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:18.225371 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod128e18488d42fbf8ffd3f878224f2cb5.slice/crio-317f18c385eecddd5e3e9e23f6e0619f88ea3ecaa0261e919ace735476eb05d9 WatchSource:0}: Error finding container 317f18c385eecddd5e3e9e23f6e0619f88ea3ecaa0261e919ace735476eb05d9: Status 404 returned error can't find the container with id 317f18c385eecddd5e3e9e23f6e0619f88ea3ecaa0261e919ace735476eb05d9 Jul 11 23:57:18.230081 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:18.230065 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 11 23:57:18.234742 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:18.234722 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-227.ec2.internal\" not found" Jul 11 23:57:18.279682 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:18.279662 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 11 23:57:18.332115 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:18.332061 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal" event={"ID":"87ba212901094f4334b3080963b67e70","Type":"ContainerStarted","Data":"0fda7847e21745b2fd9c9b4089d812ae98af2c0611e0fec84944affa294ee140"} Jul 11 23:57:18.332904 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:18.332885 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-227.ec2.internal" event={"ID":"128e18488d42fbf8ffd3f878224f2cb5","Type":"ContainerStarted","Data":"317f18c385eecddd5e3e9e23f6e0619f88ea3ecaa0261e919ace735476eb05d9"} Jul 11 23:57:18.335054 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:18.335030 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-227.ec2.internal\" not found" Jul 11 23:57:18.435579 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:18.435556 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-227.ec2.internal\" not found" Jul 11 23:57:18.536049 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:18.536001 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-227.ec2.internal\" not found" Jul 11 23:57:18.573687 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:18.573667 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 11 23:57:18.652681 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:18.652658 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-227.ec2.internal" Jul 11 23:57:18.662083 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:18.662061 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 11 23:57:18.662949 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:18.662929 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal" Jul 11 23:57:18.672174 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:18.672074 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 11 23:57:19.136770 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.136741 2564 apiserver.go:52] "Watching apiserver" Jul 11 23:57:19.145587 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.145563 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 11 23:57:19.146000 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.145974 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-whhnk","openshift-network-diagnostics/network-check-target-r8fwq","openshift-network-operator/iptables-alerter-v5nd7","openshift-ovn-kubernetes/ovnkube-node-xcdr8","kube-system/global-pull-secret-syncer-2dpdn","kube-system/konnectivity-agent-q72jw","kube-system/kube-apiserver-proxy-ip-10-0-132-227.ec2.internal","openshift-image-registry/node-ca-jw46q","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal","openshift-multus/multus-additional-cni-plugins-phxwk","openshift-multus/multus-chlwj","openshift-multus/network-metrics-daemon-cjtrj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz","openshift-cluster-node-tuning-operator/tuned-h6lgp"] Jul 11 23:57:19.147314 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.147294 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-phxwk" Jul 11 23:57:19.148734 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.148664 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz" Jul 11 23:57:19.150232 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.150207 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 11 23:57:19.150537 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.150520 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mv9tn\"" Jul 11 23:57:19.150700 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.150676 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 11 23:57:19.150775 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.150762 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 11 23:57:19.150812 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.150775 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 11 23:57:19.151083 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.151065 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 11 23:57:19.151246 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.151137 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 11 23:57:19.151246 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.151239 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v5nd7" Jul 11 23:57:19.151347 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.151252 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 11 23:57:19.151415 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.151379 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bcljm\"" Jul 11 23:57:19.151779 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.151761 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.152921 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.152899 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 11 23:57:19.153039 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.153026 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 11 23:57:19.153194 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.153176 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:19.153261 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:19.153241 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dpdn" podUID="a15f85da-2145-459f-8445-82ec38f243b7" Jul 11 23:57:19.153711 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.153537 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wqlrj\"" Jul 11 23:57:19.154522 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.154503 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 11 23:57:19.154614 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.154575 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 11 23:57:19.154866 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.154849 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q72jw" Jul 11 23:57:19.155343 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.155319 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 11 23:57:19.156037 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.155879 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 11 23:57:19.156037 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.155878 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 11 23:57:19.156037 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.155883 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lz5t4\"" Jul 11 23:57:19.156037 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.155934 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 11 23:57:19.156037 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.155945 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 11 23:57:19.156037 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.155978 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 11 23:57:19.156390 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.156171 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 11 23:57:19.156459 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.156441 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.157299 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.157280 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 11 23:57:19.157299 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.157289 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wm9tk\"" Jul 11 23:57:19.157443 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.157289 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 11 23:57:19.158208 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.158174 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jw46q" Jul 11 23:57:19.158867 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.158697 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 11 23:57:19.158867 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.158697 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 11 23:57:19.158867 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.158712 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q7gl5\"" Jul 11 23:57:19.160009 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.159992 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:19.160125 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:19.160090 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8fwq" podUID="0295efe1-26fd-416f-a532-86a675acc31f" Jul 11 23:57:19.160268 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.160249 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 11 23:57:19.160353 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.160303 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 11 23:57:19.160762 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.160747 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-crkvg\"" Jul 11 23:57:19.160762 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.160758 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 11 23:57:19.161761 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.161742 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-whhnk" Jul 11 23:57:19.163512 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.163495 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.163512 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.163506 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjbv8\" (UniqueName: \"kubernetes.io/projected/4d95add4-4953-4489-aa07-eeece59a973b-kube-api-access-rjbv8\") pod \"iptables-alerter-v5nd7\" (UID: \"4d95add4-4953-4489-aa07-eeece59a973b\") " pod="openshift-network-operator/iptables-alerter-v5nd7" Jul 11 23:57:19.163652 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.163528 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-host-run-ovn-kubernetes\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.163652 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.163545 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-host-cni-netd\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.163652 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.163570 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a15f85da-2145-459f-8445-82ec38f243b7-dbus\") pod \"global-pull-secret-syncer-2dpdn\" (UID: \"a15f85da-2145-459f-8445-82ec38f243b7\") " pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:19.163652 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.163590 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-phxwk\" (UID: \"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525\") " pod="openshift-multus/multus-additional-cni-plugins-phxwk" Jul 11 23:57:19.163652 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.163606 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qgdd\" (UniqueName: \"kubernetes.io/projected/7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525-kube-api-access-7qgdd\") pod \"multus-additional-cni-plugins-phxwk\" (UID: \"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525\") " pod="openshift-multus/multus-additional-cni-plugins-phxwk" Jul 11 23:57:19.163652 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.163620 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-run-ovn\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.163652 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.163634 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8bdecd8b-9853-4a8f-8441-68bad8a709c2-ovn-node-metrics-cert\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.163652 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.163649 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525-system-cni-dir\") pod \"multus-additional-cni-plugins-phxwk\" (UID: \"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525\") " pod="openshift-multus/multus-additional-cni-plugins-phxwk" Jul 11 23:57:19.164075 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.163666 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525-cni-binary-copy\") pod \"multus-additional-cni-plugins-phxwk\" (UID: \"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525\") " pod="openshift-multus/multus-additional-cni-plugins-phxwk" Jul 11 23:57:19.164075 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.163680 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525-tuning-conf-dir\") pod \"multus-additional-cni-plugins-phxwk\" (UID: \"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525\") " pod="openshift-multus/multus-additional-cni-plugins-phxwk" Jul 11 23:57:19.164075 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.163695 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-run-openvswitch\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.164075 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.163710 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d95add4-4953-4489-aa07-eeece59a973b-host-slash\") pod \"iptables-alerter-v5nd7\" (UID: \"4d95add4-4953-4489-aa07-eeece59a973b\") " pod="openshift-network-operator/iptables-alerter-v5nd7" Jul 11 23:57:19.164075 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.163726 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/18da12f3-f232-4080-a5d0-1d966e8c02ce-registration-dir\") pod \"aws-ebs-csi-driver-node-xfzhz\" (UID: \"18da12f3-f232-4080-a5d0-1d966e8c02ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz" Jul 11 23:57:19.164075 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.163750 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/18da12f3-f232-4080-a5d0-1d966e8c02ce-etc-selinux\") pod \"aws-ebs-csi-driver-node-xfzhz\" (UID: \"18da12f3-f232-4080-a5d0-1d966e8c02ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz" Jul 11 23:57:19.164075 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.163825 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8bdecd8b-9853-4a8f-8441-68bad8a709c2-ovnkube-config\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.164075 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.163868 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a15f85da-2145-459f-8445-82ec38f243b7-kubelet-config\") pod \"global-pull-secret-syncer-2dpdn\" (UID: \"a15f85da-2145-459f-8445-82ec38f243b7\") " pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:19.164075 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.163886 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8bdecd8b-9853-4a8f-8441-68bad8a709c2-ovnkube-script-lib\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.164075 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.163907 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-host-kubelet\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.164075 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.163927 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 11 23:57:19.164075 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.163932 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/18da12f3-f232-4080-a5d0-1d966e8c02ce-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xfzhz\" (UID: \"18da12f3-f232-4080-a5d0-1d966e8c02ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz" Jul 11 23:57:19.164075 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.163958 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/18da12f3-f232-4080-a5d0-1d966e8c02ce-sys-fs\") pod \"aws-ebs-csi-driver-node-xfzhz\" (UID: \"18da12f3-f232-4080-a5d0-1d966e8c02ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz" Jul 11 23:57:19.164075 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.163981 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzdd4\" (UniqueName: \"kubernetes.io/projected/18da12f3-f232-4080-a5d0-1d966e8c02ce-kube-api-access-rzdd4\") pod \"aws-ebs-csi-driver-node-xfzhz\" (UID: \"18da12f3-f232-4080-a5d0-1d966e8c02ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz" Jul 11 23:57:19.164075 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.164001 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-host-run-netns\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.164075 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.164014 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-etc-openvswitch\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.164731 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.164044 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-host-cni-bin\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.164731 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.164072 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.164731 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.164123 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/18da12f3-f232-4080-a5d0-1d966e8c02ce-device-dir\") pod \"aws-ebs-csi-driver-node-xfzhz\" (UID: \"18da12f3-f232-4080-a5d0-1d966e8c02ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz" Jul 11 23:57:19.164731 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.164148 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-run-systemd\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.164731 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.164169 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-node-log\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.164731 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.164189 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-log-socket\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.164731 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.164198 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 11 23:57:19.164731 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.164211 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8bdecd8b-9853-4a8f-8441-68bad8a709c2-env-overrides\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.164731 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.164190 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4mkwd\"" Jul 11 23:57:19.164731 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.164244 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a15f85da-2145-459f-8445-82ec38f243b7-original-pull-secret\") pod \"global-pull-secret-syncer-2dpdn\" (UID: \"a15f85da-2145-459f-8445-82ec38f243b7\") " pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:19.164731 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.164281 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/18da12f3-f232-4080-a5d0-1d966e8c02ce-socket-dir\") pod \"aws-ebs-csi-driver-node-xfzhz\" (UID: \"18da12f3-f232-4080-a5d0-1d966e8c02ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz" Jul 11 23:57:19.164731 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.164308 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-systemd-units\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.164731 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.164327 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-var-lib-openvswitch\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.164731 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.164348 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xrgv\" (UniqueName: \"kubernetes.io/projected/8bdecd8b-9853-4a8f-8441-68bad8a709c2-kube-api-access-5xrgv\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.164731 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.164392 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/46db6233-0f23-4f52-9648-f6b265d0df9d-agent-certs\") pod \"konnectivity-agent-q72jw\" (UID: \"46db6233-0f23-4f52-9648-f6b265d0df9d\") " pod="kube-system/konnectivity-agent-q72jw" Jul 11 23:57:19.164731 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.164410 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525-cnibin\") pod \"multus-additional-cni-plugins-phxwk\" (UID: \"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525\") " pod="openshift-multus/multus-additional-cni-plugins-phxwk" Jul 11 23:57:19.164731 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.164450 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-host-slash\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.165359 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.164478 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/46db6233-0f23-4f52-9648-f6b265d0df9d-konnectivity-ca\") pod \"konnectivity-agent-q72jw\" (UID: \"46db6233-0f23-4f52-9648-f6b265d0df9d\") " pod="kube-system/konnectivity-agent-q72jw" Jul 11 23:57:19.165359 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.164497 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525-os-release\") pod \"multus-additional-cni-plugins-phxwk\" (UID: \"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525\") " pod="openshift-multus/multus-additional-cni-plugins-phxwk" Jul 11 23:57:19.165359 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.164532 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-phxwk\" (UID: \"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525\") " pod="openshift-multus/multus-additional-cni-plugins-phxwk" Jul 11 23:57:19.165359 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.164553 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4d95add4-4953-4489-aa07-eeece59a973b-iptables-alerter-script\") pod \"iptables-alerter-v5nd7\" (UID: \"4d95add4-4953-4489-aa07-eeece59a973b\") " pod="openshift-network-operator/iptables-alerter-v5nd7" Jul 11 23:57:19.165543 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.165461 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 11 23:57:19.165543 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.165478 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:19.165543 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:19.165522 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjtrj" podUID="7759c22b-76ac-44de-a812-a82cf40941eb" Jul 11 23:57:19.165772 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.165756 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dv9nd\"" Jul 11 23:57:19.168858 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.168842 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 11 23:57:19.191953 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.191932 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hhmz9" Jul 11 23:57:19.197325 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.197310 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hhmz9" Jul 11 23:57:19.253470 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.253452 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 11 23:57:19.265661 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.265633 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc60340a-59c1-4e60-b020-bf384ce4d9b6-tmp-dir\") pod \"node-resolver-whhnk\" (UID: \"fc60340a-59c1-4e60-b020-bf384ce4d9b6\") " pod="openshift-dns/node-resolver-whhnk" Jul 11 23:57:19.265749 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.265670 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-etc-kubernetes\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.265749 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.265698 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-etc-sysctl-conf\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.265749 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.265723 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-lib-modules\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.265749 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.265744 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-host\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.265915 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.265767 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a726134c-d932-409e-aaea-ae8a4cd4f2ee-tmp\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.265915 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.265795 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/18da12f3-f232-4080-a5d0-1d966e8c02ce-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xfzhz\" (UID: \"18da12f3-f232-4080-a5d0-1d966e8c02ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz" Jul 11 23:57:19.265915 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.265825 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/18da12f3-f232-4080-a5d0-1d966e8c02ce-sys-fs\") pod \"aws-ebs-csi-driver-node-xfzhz\" (UID: \"18da12f3-f232-4080-a5d0-1d966e8c02ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz" Jul 11 23:57:19.265915 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.265848 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-host-run-netns\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.265915 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.265853 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/18da12f3-f232-4080-a5d0-1d966e8c02ce-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xfzhz\" (UID: \"18da12f3-f232-4080-a5d0-1d966e8c02ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz" Jul 11 23:57:19.265915 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.265870 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-etc-openvswitch\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.265915 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.265893 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-host-cni-bin\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.265915 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.265907 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/18da12f3-f232-4080-a5d0-1d966e8c02ce-sys-fs\") pod \"aws-ebs-csi-driver-node-xfzhz\" (UID: \"18da12f3-f232-4080-a5d0-1d966e8c02ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz" Jul 11 23:57:19.266230 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.265918 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkv42\" (UniqueName: \"kubernetes.io/projected/a726134c-d932-409e-aaea-ae8a4cd4f2ee-kube-api-access-dkv42\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.266230 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.265930 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-host-run-netns\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.266230 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.265933 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-etc-openvswitch\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.266230 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.265939 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-host-cni-bin\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.266230 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.265942 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx9cb\" (UniqueName: \"kubernetes.io/projected/0295efe1-26fd-416f-a532-86a675acc31f-kube-api-access-sx9cb\") pod \"network-check-target-r8fwq\" (UID: \"0295efe1-26fd-416f-a532-86a675acc31f\") " pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:19.266230 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.265999 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/18da12f3-f232-4080-a5d0-1d966e8c02ce-device-dir\") pod \"aws-ebs-csi-driver-node-xfzhz\" (UID: \"18da12f3-f232-4080-a5d0-1d966e8c02ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz" Jul 11 23:57:19.266230 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266023 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-run-systemd\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.266230 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266046 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-node-log\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.266230 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266068 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8bdecd8b-9853-4a8f-8441-68bad8a709c2-env-overrides\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.266230 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266079 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-run-systemd\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.266230 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266088 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-node-log\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.266230 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266092 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a15f85da-2145-459f-8445-82ec38f243b7-original-pull-secret\") pod \"global-pull-secret-syncer-2dpdn\" (UID: \"a15f85da-2145-459f-8445-82ec38f243b7\") " pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:19.266230 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266143 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fc60340a-59c1-4e60-b020-bf384ce4d9b6-hosts-file\") pod \"node-resolver-whhnk\" (UID: \"fc60340a-59c1-4e60-b020-bf384ce4d9b6\") " pod="openshift-dns/node-resolver-whhnk" Jul 11 23:57:19.266230 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266158 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8441f59-adc8-4e06-939d-7ed374002b1d-cni-binary-copy\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.266230 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266175 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-etc-sysctl-d\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.266230 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:19.266189 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 11 23:57:19.266230 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266080 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/18da12f3-f232-4080-a5d0-1d966e8c02ce-device-dir\") pod \"aws-ebs-csi-driver-node-xfzhz\" (UID: \"18da12f3-f232-4080-a5d0-1d966e8c02ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz" Jul 11 23:57:19.266230 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266204 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/18da12f3-f232-4080-a5d0-1d966e8c02ce-socket-dir\") pod \"aws-ebs-csi-driver-node-xfzhz\" (UID: \"18da12f3-f232-4080-a5d0-1d966e8c02ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz" Jul 11 23:57:19.267079 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:19.266253 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a15f85da-2145-459f-8445-82ec38f243b7-original-pull-secret podName:a15f85da-2145-459f-8445-82ec38f243b7 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:19.766231819 +0000 UTC m=+2.942028451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a15f85da-2145-459f-8445-82ec38f243b7-original-pull-secret") pod "global-pull-secret-syncer-2dpdn" (UID: "a15f85da-2145-459f-8445-82ec38f243b7") : object "kube-system"/"original-pull-secret" not registered Jul 11 23:57:19.267079 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266272 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-systemd-units\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.267079 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266311 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-systemd-units\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.267079 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266342 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xrgv\" (UniqueName: \"kubernetes.io/projected/8bdecd8b-9853-4a8f-8441-68bad8a709c2-kube-api-access-5xrgv\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.267079 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266359 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/18da12f3-f232-4080-a5d0-1d966e8c02ce-socket-dir\") pod \"aws-ebs-csi-driver-node-xfzhz\" (UID: \"18da12f3-f232-4080-a5d0-1d966e8c02ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz" Jul 11 23:57:19.267079 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266379 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/46db6233-0f23-4f52-9648-f6b265d0df9d-agent-certs\") pod \"konnectivity-agent-q72jw\" (UID: \"46db6233-0f23-4f52-9648-f6b265d0df9d\") " pod="kube-system/konnectivity-agent-q72jw" Jul 11 23:57:19.267079 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266509 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-host-slash\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.267079 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266547 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/46db6233-0f23-4f52-9648-f6b265d0df9d-konnectivity-ca\") pod \"konnectivity-agent-q72jw\" (UID: \"46db6233-0f23-4f52-9648-f6b265d0df9d\") " pod="kube-system/konnectivity-agent-q72jw" Jul 11 23:57:19.267079 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266548 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8bdecd8b-9853-4a8f-8441-68bad8a709c2-env-overrides\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.267079 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266579 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-host-slash\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.267079 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266619 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6ae6d9b4-ded1-4cc5-8110-668501906a6d-serviceca\") pod \"node-ca-jw46q\" (UID: \"6ae6d9b4-ded1-4cc5-8110-668501906a6d\") " pod="openshift-image-registry/node-ca-jw46q" Jul 11 23:57:19.267079 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266637 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a726134c-d932-409e-aaea-ae8a4cd4f2ee-etc-tuned\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.267079 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266714 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4d95add4-4953-4489-aa07-eeece59a973b-iptables-alerter-script\") pod \"iptables-alerter-v5nd7\" (UID: \"4d95add4-4953-4489-aa07-eeece59a973b\") " pod="openshift-network-operator/iptables-alerter-v5nd7" Jul 11 23:57:19.267079 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266742 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-host-cni-netd\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.267079 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266760 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 11 23:57:19.267079 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266868 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-host-cni-netd\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.267079 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266870 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-phxwk\" (UID: \"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525\") " pod="openshift-multus/multus-additional-cni-plugins-phxwk" Jul 11 23:57:19.267895 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266911 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qgdd\" (UniqueName: \"kubernetes.io/projected/7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525-kube-api-access-7qgdd\") pod \"multus-additional-cni-plugins-phxwk\" (UID: \"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525\") " pod="openshift-multus/multus-additional-cni-plugins-phxwk" Jul 11 23:57:19.267895 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266930 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-host-run-multus-certs\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.267895 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266948 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-sys\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.267895 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266972 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-os-release\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.267895 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.266995 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-var-lib-kubelet\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.267895 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267019 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d95add4-4953-4489-aa07-eeece59a973b-host-slash\") pod \"iptables-alerter-v5nd7\" (UID: \"4d95add4-4953-4489-aa07-eeece59a973b\") " pod="openshift-network-operator/iptables-alerter-v5nd7" Jul 11 23:57:19.267895 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267044 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/18da12f3-f232-4080-a5d0-1d966e8c02ce-registration-dir\") pod \"aws-ebs-csi-driver-node-xfzhz\" (UID: \"18da12f3-f232-4080-a5d0-1d966e8c02ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz" Jul 11 23:57:19.267895 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267083 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d95add4-4953-4489-aa07-eeece59a973b-host-slash\") pod \"iptables-alerter-v5nd7\" (UID: \"4d95add4-4953-4489-aa07-eeece59a973b\") " pod="openshift-network-operator/iptables-alerter-v5nd7" Jul 11 23:57:19.267895 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267143 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8bdecd8b-9853-4a8f-8441-68bad8a709c2-ovnkube-config\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.267895 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267147 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/46db6233-0f23-4f52-9648-f6b265d0df9d-konnectivity-ca\") pod \"konnectivity-agent-q72jw\" (UID: \"46db6233-0f23-4f52-9648-f6b265d0df9d\") " pod="kube-system/konnectivity-agent-q72jw" Jul 11 23:57:19.267895 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267171 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/18da12f3-f232-4080-a5d0-1d966e8c02ce-registration-dir\") pod \"aws-ebs-csi-driver-node-xfzhz\" (UID: \"18da12f3-f232-4080-a5d0-1d966e8c02ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz" Jul 11 23:57:19.267895 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267203 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ae6d9b4-ded1-4cc5-8110-668501906a6d-host\") pod \"node-ca-jw46q\" (UID: \"6ae6d9b4-ded1-4cc5-8110-668501906a6d\") " pod="openshift-image-registry/node-ca-jw46q" Jul 11 23:57:19.267895 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267297 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f82p\" (UniqueName: \"kubernetes.io/projected/a8441f59-adc8-4e06-939d-7ed374002b1d-kube-api-access-9f82p\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.267895 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267333 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8bdecd8b-9853-4a8f-8441-68bad8a709c2-ovnkube-script-lib\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.267895 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267357 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5984\" (UniqueName: \"kubernetes.io/projected/6ae6d9b4-ded1-4cc5-8110-668501906a6d-kube-api-access-h5984\") pod \"node-ca-jw46q\" (UID: \"6ae6d9b4-ded1-4cc5-8110-668501906a6d\") " pod="openshift-image-registry/node-ca-jw46q" Jul 11 23:57:19.267895 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267380 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-run\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.267895 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267405 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-host-kubelet\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.268726 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267438 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzdd4\" (UniqueName: \"kubernetes.io/projected/18da12f3-f232-4080-a5d0-1d966e8c02ce-kube-api-access-rzdd4\") pod \"aws-ebs-csi-driver-node-xfzhz\" (UID: \"18da12f3-f232-4080-a5d0-1d966e8c02ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz" Jul 11 23:57:19.268726 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267437 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-phxwk\" (UID: \"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525\") " pod="openshift-multus/multus-additional-cni-plugins-phxwk" Jul 11 23:57:19.268726 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267483 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvpw4\" (UniqueName: \"kubernetes.io/projected/fc60340a-59c1-4e60-b020-bf384ce4d9b6-kube-api-access-nvpw4\") pod \"node-resolver-whhnk\" (UID: \"fc60340a-59c1-4e60-b020-bf384ce4d9b6\") " pod="openshift-dns/node-resolver-whhnk" Jul 11 23:57:19.268726 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267509 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-host-run-k8s-cni-cncf-io\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.268726 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267524 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4d95add4-4953-4489-aa07-eeece59a973b-iptables-alerter-script\") pod \"iptables-alerter-v5nd7\" (UID: \"4d95add4-4953-4489-aa07-eeece59a973b\") " pod="openshift-network-operator/iptables-alerter-v5nd7" Jul 11 23:57:19.268726 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267533 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-multus-conf-dir\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.268726 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267558 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a8441f59-adc8-4e06-939d-7ed374002b1d-multus-daemon-config\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.268726 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267531 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-host-kubelet\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.268726 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267581 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-etc-kubernetes\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.268726 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267610 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.268726 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267640 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8bdecd8b-9853-4a8f-8441-68bad8a709c2-ovnkube-config\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.268726 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267637 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-log-socket\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.268726 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267691 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.268726 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267692 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dhgp\" (UniqueName: \"kubernetes.io/projected/7759c22b-76ac-44de-a812-a82cf40941eb-kube-api-access-8dhgp\") pod \"network-metrics-daemon-cjtrj\" (UID: \"7759c22b-76ac-44de-a812-a82cf40941eb\") " pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:19.268726 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267725 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-multus-socket-dir-parent\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.268726 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267729 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-log-socket\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.269460 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267748 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-host-var-lib-kubelet\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.269460 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267774 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-etc-modprobe-d\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.269460 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267795 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-etc-systemd\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.269460 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267823 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-var-lib-openvswitch\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.269460 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267848 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525-cnibin\") pod \"multus-additional-cni-plugins-phxwk\" (UID: \"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525\") " pod="openshift-multus/multus-additional-cni-plugins-phxwk" Jul 11 23:57:19.269460 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267869 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-cnibin\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.269460 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267892 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525-os-release\") pod \"multus-additional-cni-plugins-phxwk\" (UID: \"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525\") " pod="openshift-multus/multus-additional-cni-plugins-phxwk" Jul 11 23:57:19.269460 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267913 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-var-lib-openvswitch\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.269460 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267917 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-phxwk\" (UID: \"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525\") " pod="openshift-multus/multus-additional-cni-plugins-phxwk" Jul 11 23:57:19.269460 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267966 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-system-cni-dir\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.269460 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267982 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525-os-release\") pod \"multus-additional-cni-plugins-phxwk\" (UID: \"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525\") " pod="openshift-multus/multus-additional-cni-plugins-phxwk" Jul 11 23:57:19.269460 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267990 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-host-var-lib-cni-bin\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.269460 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.267925 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525-cnibin\") pod \"multus-additional-cni-plugins-phxwk\" (UID: \"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525\") " pod="openshift-multus/multus-additional-cni-plugins-phxwk" Jul 11 23:57:19.269460 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.268027 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-hostroot\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.269460 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.268057 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjbv8\" (UniqueName: \"kubernetes.io/projected/4d95add4-4953-4489-aa07-eeece59a973b-kube-api-access-rjbv8\") pod \"iptables-alerter-v5nd7\" (UID: \"4d95add4-4953-4489-aa07-eeece59a973b\") " pod="openshift-network-operator/iptables-alerter-v5nd7" Jul 11 23:57:19.269460 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.268082 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-host-run-ovn-kubernetes\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.269460 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.268122 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a15f85da-2145-459f-8445-82ec38f243b7-dbus\") pod \"global-pull-secret-syncer-2dpdn\" (UID: \"a15f85da-2145-459f-8445-82ec38f243b7\") " pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:19.270174 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.268148 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-host-run-netns\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.270174 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.268156 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-host-run-ovn-kubernetes\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.270174 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.268172 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-host-var-lib-cni-multus\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.270174 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.268197 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-run-ovn\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.270174 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.268220 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8bdecd8b-9853-4a8f-8441-68bad8a709c2-ovn-node-metrics-cert\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.270174 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.268246 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525-system-cni-dir\") pod \"multus-additional-cni-plugins-phxwk\" (UID: \"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525\") " pod="openshift-multus/multus-additional-cni-plugins-phxwk" Jul 11 23:57:19.270174 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.268257 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a15f85da-2145-459f-8445-82ec38f243b7-dbus\") pod \"global-pull-secret-syncer-2dpdn\" (UID: \"a15f85da-2145-459f-8445-82ec38f243b7\") " pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:19.270174 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.268272 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525-cni-binary-copy\") pod \"multus-additional-cni-plugins-phxwk\" (UID: \"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525\") " pod="openshift-multus/multus-additional-cni-plugins-phxwk" Jul 11 23:57:19.270174 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.268295 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525-tuning-conf-dir\") pod \"multus-additional-cni-plugins-phxwk\" (UID: \"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525\") " pod="openshift-multus/multus-additional-cni-plugins-phxwk" Jul 11 23:57:19.270174 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.268301 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-run-ovn\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.270174 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.268340 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525-system-cni-dir\") pod \"multus-additional-cni-plugins-phxwk\" (UID: \"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525\") " pod="openshift-multus/multus-additional-cni-plugins-phxwk" Jul 11 23:57:19.270174 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.268374 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7759c22b-76ac-44de-a812-a82cf40941eb-metrics-certs\") pod \"network-metrics-daemon-cjtrj\" (UID: \"7759c22b-76ac-44de-a812-a82cf40941eb\") " pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:19.270174 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.268397 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-multus-cni-dir\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.270174 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.268410 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8bdecd8b-9853-4a8f-8441-68bad8a709c2-ovnkube-script-lib\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.270174 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.268420 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-etc-sysconfig\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.270174 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.268434 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525-tuning-conf-dir\") pod \"multus-additional-cni-plugins-phxwk\" (UID: \"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525\") " pod="openshift-multus/multus-additional-cni-plugins-phxwk" Jul 11 23:57:19.270174 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.268448 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-run-openvswitch\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.270762 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.268479 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/18da12f3-f232-4080-a5d0-1d966e8c02ce-etc-selinux\") pod \"aws-ebs-csi-driver-node-xfzhz\" (UID: \"18da12f3-f232-4080-a5d0-1d966e8c02ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz" Jul 11 23:57:19.270762 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.268514 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8bdecd8b-9853-4a8f-8441-68bad8a709c2-run-openvswitch\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.270762 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.268539 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a15f85da-2145-459f-8445-82ec38f243b7-kubelet-config\") pod \"global-pull-secret-syncer-2dpdn\" (UID: \"a15f85da-2145-459f-8445-82ec38f243b7\") " pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:19.270762 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.268613 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/18da12f3-f232-4080-a5d0-1d966e8c02ce-etc-selinux\") pod \"aws-ebs-csi-driver-node-xfzhz\" (UID: \"18da12f3-f232-4080-a5d0-1d966e8c02ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz" Jul 11 23:57:19.270762 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.268623 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a15f85da-2145-459f-8445-82ec38f243b7-kubelet-config\") pod \"global-pull-secret-syncer-2dpdn\" (UID: \"a15f85da-2145-459f-8445-82ec38f243b7\") " pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:19.270762 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.268749 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525-cni-binary-copy\") pod \"multus-additional-cni-plugins-phxwk\" (UID: \"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525\") " pod="openshift-multus/multus-additional-cni-plugins-phxwk" Jul 11 23:57:19.270762 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.268844 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-phxwk\" (UID: \"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525\") " pod="openshift-multus/multus-additional-cni-plugins-phxwk" Jul 11 23:57:19.270762 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.270460 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/46db6233-0f23-4f52-9648-f6b265d0df9d-agent-certs\") pod \"konnectivity-agent-q72jw\" (UID: \"46db6233-0f23-4f52-9648-f6b265d0df9d\") " pod="kube-system/konnectivity-agent-q72jw" Jul 11 23:57:19.270762 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.270642 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8bdecd8b-9853-4a8f-8441-68bad8a709c2-ovn-node-metrics-cert\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.278520 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.278468 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjbv8\" (UniqueName: \"kubernetes.io/projected/4d95add4-4953-4489-aa07-eeece59a973b-kube-api-access-rjbv8\") pod \"iptables-alerter-v5nd7\" (UID: \"4d95add4-4953-4489-aa07-eeece59a973b\") " pod="openshift-network-operator/iptables-alerter-v5nd7" Jul 11 23:57:19.278982 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.278956 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzdd4\" (UniqueName: \"kubernetes.io/projected/18da12f3-f232-4080-a5d0-1d966e8c02ce-kube-api-access-rzdd4\") pod \"aws-ebs-csi-driver-node-xfzhz\" (UID: \"18da12f3-f232-4080-a5d0-1d966e8c02ce\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz" Jul 11 23:57:19.279064 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.279014 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xrgv\" (UniqueName: \"kubernetes.io/projected/8bdecd8b-9853-4a8f-8441-68bad8a709c2-kube-api-access-5xrgv\") pod \"ovnkube-node-xcdr8\" (UID: \"8bdecd8b-9853-4a8f-8441-68bad8a709c2\") " pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.279200 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.279184 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qgdd\" (UniqueName: \"kubernetes.io/projected/7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525-kube-api-access-7qgdd\") pod \"multus-additional-cni-plugins-phxwk\" (UID: \"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525\") " pod="openshift-multus/multus-additional-cni-plugins-phxwk" Jul 11 23:57:19.369837 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.369805 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-system-cni-dir\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.370015 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.369851 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-host-var-lib-cni-bin\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.370015 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.369876 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-hostroot\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.370015 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.369895 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-system-cni-dir\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.370015 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.369900 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-host-run-netns\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.370015 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.369934 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-host-run-netns\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.370015 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.369952 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-host-var-lib-cni-multus\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.370015 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.369961 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-host-var-lib-cni-bin\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.370015 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.369980 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7759c22b-76ac-44de-a812-a82cf40941eb-metrics-certs\") pod \"network-metrics-daemon-cjtrj\" (UID: \"7759c22b-76ac-44de-a812-a82cf40941eb\") " pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:19.370015 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.369985 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-hostroot\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.370015 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370008 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-host-var-lib-cni-multus\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.370015 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370001 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-multus-cni-dir\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.370787 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370035 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-etc-sysconfig\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.370787 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370059 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc60340a-59c1-4e60-b020-bf384ce4d9b6-tmp-dir\") pod \"node-resolver-whhnk\" (UID: \"fc60340a-59c1-4e60-b020-bf384ce4d9b6\") " pod="openshift-dns/node-resolver-whhnk" Jul 11 23:57:19.370787 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:19.370074 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 23:57:19.370787 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370081 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-etc-kubernetes\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.370787 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370117 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-etc-sysctl-conf\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.370787 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:19.370130 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7759c22b-76ac-44de-a812-a82cf40941eb-metrics-certs podName:7759c22b-76ac-44de-a812-a82cf40941eb nodeName:}" failed. No retries permitted until 2026-07-11 23:57:19.870098127 +0000 UTC m=+3.045894742 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7759c22b-76ac-44de-a812-a82cf40941eb-metrics-certs") pod "network-metrics-daemon-cjtrj" (UID: "7759c22b-76ac-44de-a812-a82cf40941eb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 23:57:19.370787 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370148 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-lib-modules\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.370787 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370163 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-host\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.370787 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370170 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-etc-sysconfig\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.370787 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370177 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a726134c-d932-409e-aaea-ae8a4cd4f2ee-tmp\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.370787 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370208 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-multus-cni-dir\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.370787 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370225 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-etc-sysctl-conf\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.370787 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370270 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-host\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.370787 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370223 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkv42\" (UniqueName: \"kubernetes.io/projected/a726134c-d932-409e-aaea-ae8a4cd4f2ee-kube-api-access-dkv42\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.370787 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370323 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-lib-modules\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.370787 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370281 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-etc-kubernetes\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.370787 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370336 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx9cb\" (UniqueName: \"kubernetes.io/projected/0295efe1-26fd-416f-a532-86a675acc31f-kube-api-access-sx9cb\") pod \"network-check-target-r8fwq\" (UID: \"0295efe1-26fd-416f-a532-86a675acc31f\") " pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:19.371543 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370385 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fc60340a-59c1-4e60-b020-bf384ce4d9b6-hosts-file\") pod \"node-resolver-whhnk\" (UID: \"fc60340a-59c1-4e60-b020-bf384ce4d9b6\") " pod="openshift-dns/node-resolver-whhnk" Jul 11 23:57:19.371543 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370410 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8441f59-adc8-4e06-939d-7ed374002b1d-cni-binary-copy\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.371543 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370432 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-etc-sysctl-d\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.371543 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370451 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fc60340a-59c1-4e60-b020-bf384ce4d9b6-hosts-file\") pod \"node-resolver-whhnk\" (UID: \"fc60340a-59c1-4e60-b020-bf384ce4d9b6\") " pod="openshift-dns/node-resolver-whhnk" Jul 11 23:57:19.371543 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370462 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6ae6d9b4-ded1-4cc5-8110-668501906a6d-serviceca\") pod \"node-ca-jw46q\" (UID: \"6ae6d9b4-ded1-4cc5-8110-668501906a6d\") " pod="openshift-image-registry/node-ca-jw46q" Jul 11 23:57:19.371543 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370485 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a726134c-d932-409e-aaea-ae8a4cd4f2ee-etc-tuned\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.371543 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370511 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-host-run-multus-certs\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.371543 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370534 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-sys\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.371543 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370540 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-etc-sysctl-d\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.371543 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370542 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc60340a-59c1-4e60-b020-bf384ce4d9b6-tmp-dir\") pod \"node-resolver-whhnk\" (UID: \"fc60340a-59c1-4e60-b020-bf384ce4d9b6\") " pod="openshift-dns/node-resolver-whhnk" Jul 11 23:57:19.371543 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370557 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-os-release\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.371543 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370576 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-host-run-multus-certs\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.371543 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370595 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-sys\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.371543 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370618 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-os-release\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.371543 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370594 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-var-lib-kubelet\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.371543 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370642 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-var-lib-kubelet\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.371543 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370659 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ae6d9b4-ded1-4cc5-8110-668501906a6d-host\") pod \"node-ca-jw46q\" (UID: \"6ae6d9b4-ded1-4cc5-8110-668501906a6d\") " pod="openshift-image-registry/node-ca-jw46q" Jul 11 23:57:19.371543 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370683 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f82p\" (UniqueName: \"kubernetes.io/projected/a8441f59-adc8-4e06-939d-7ed374002b1d-kube-api-access-9f82p\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.372068 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370707 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5984\" (UniqueName: \"kubernetes.io/projected/6ae6d9b4-ded1-4cc5-8110-668501906a6d-kube-api-access-h5984\") pod \"node-ca-jw46q\" (UID: \"6ae6d9b4-ded1-4cc5-8110-668501906a6d\") " pod="openshift-image-registry/node-ca-jw46q" Jul 11 23:57:19.372068 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370729 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-run\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.372068 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370754 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvpw4\" (UniqueName: \"kubernetes.io/projected/fc60340a-59c1-4e60-b020-bf384ce4d9b6-kube-api-access-nvpw4\") pod \"node-resolver-whhnk\" (UID: \"fc60340a-59c1-4e60-b020-bf384ce4d9b6\") " pod="openshift-dns/node-resolver-whhnk" Jul 11 23:57:19.372068 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370806 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-run\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.372068 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370729 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ae6d9b4-ded1-4cc5-8110-668501906a6d-host\") pod \"node-ca-jw46q\" (UID: \"6ae6d9b4-ded1-4cc5-8110-668501906a6d\") " pod="openshift-image-registry/node-ca-jw46q" Jul 11 23:57:19.372068 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370840 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-host-run-k8s-cni-cncf-io\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.372068 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370871 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-host-run-k8s-cni-cncf-io\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.372068 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370899 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-multus-conf-dir\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.372068 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370929 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a8441f59-adc8-4e06-939d-7ed374002b1d-multus-daemon-config\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.372068 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370952 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-etc-kubernetes\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.372068 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370979 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dhgp\" (UniqueName: \"kubernetes.io/projected/7759c22b-76ac-44de-a812-a82cf40941eb-kube-api-access-8dhgp\") pod \"network-metrics-daemon-cjtrj\" (UID: \"7759c22b-76ac-44de-a812-a82cf40941eb\") " pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:19.372068 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.370983 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-multus-conf-dir\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.372068 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.371016 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-multus-socket-dir-parent\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.372068 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.371025 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6ae6d9b4-ded1-4cc5-8110-668501906a6d-serviceca\") pod \"node-ca-jw46q\" (UID: \"6ae6d9b4-ded1-4cc5-8110-668501906a6d\") " pod="openshift-image-registry/node-ca-jw46q" Jul 11 23:57:19.372068 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.371041 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-host-var-lib-kubelet\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.372068 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.371027 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a8441f59-adc8-4e06-939d-7ed374002b1d-cni-binary-copy\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.372068 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.371065 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-etc-modprobe-d\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.372068 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.371076 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-etc-kubernetes\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.372607 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.371092 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-etc-systemd\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.372607 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.371128 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-multus-socket-dir-parent\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.372607 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.371139 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-cnibin\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.372607 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.371146 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-host-var-lib-kubelet\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.372607 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.371243 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-etc-systemd\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.372607 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.371243 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a726134c-d932-409e-aaea-ae8a4cd4f2ee-etc-modprobe-d\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.372607 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.371282 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a8441f59-adc8-4e06-939d-7ed374002b1d-cnibin\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.372607 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.371440 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a8441f59-adc8-4e06-939d-7ed374002b1d-multus-daemon-config\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.373156 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.373136 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a726134c-d932-409e-aaea-ae8a4cd4f2ee-tmp\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.373213 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.373166 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a726134c-d932-409e-aaea-ae8a4cd4f2ee-etc-tuned\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.380760 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:19.380445 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 11 23:57:19.380760 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:19.380467 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 11 23:57:19.380760 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:19.380480 2564 projected.go:196] Error preparing data for projected volume kube-api-access-sx9cb for pod openshift-network-diagnostics/network-check-target-r8fwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 23:57:19.380760 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:19.380548 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0295efe1-26fd-416f-a532-86a675acc31f-kube-api-access-sx9cb podName:0295efe1-26fd-416f-a532-86a675acc31f nodeName:}" failed. No retries permitted until 2026-07-11 23:57:19.880529191 +0000 UTC m=+3.056325824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sx9cb" (UniqueName: "kubernetes.io/projected/0295efe1-26fd-416f-a532-86a675acc31f-kube-api-access-sx9cb") pod "network-check-target-r8fwq" (UID: "0295efe1-26fd-416f-a532-86a675acc31f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 23:57:19.382558 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.382538 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5984\" (UniqueName: \"kubernetes.io/projected/6ae6d9b4-ded1-4cc5-8110-668501906a6d-kube-api-access-h5984\") pod \"node-ca-jw46q\" (UID: \"6ae6d9b4-ded1-4cc5-8110-668501906a6d\") " pod="openshift-image-registry/node-ca-jw46q" Jul 11 23:57:19.382642 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.382538 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f82p\" (UniqueName: \"kubernetes.io/projected/a8441f59-adc8-4e06-939d-7ed374002b1d-kube-api-access-9f82p\") pod \"multus-chlwj\" (UID: \"a8441f59-adc8-4e06-939d-7ed374002b1d\") " pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.382687 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.382637 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dhgp\" (UniqueName: \"kubernetes.io/projected/7759c22b-76ac-44de-a812-a82cf40941eb-kube-api-access-8dhgp\") pod \"network-metrics-daemon-cjtrj\" (UID: \"7759c22b-76ac-44de-a812-a82cf40941eb\") " pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:19.382899 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.382876 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvpw4\" (UniqueName: \"kubernetes.io/projected/fc60340a-59c1-4e60-b020-bf384ce4d9b6-kube-api-access-nvpw4\") pod \"node-resolver-whhnk\" (UID: \"fc60340a-59c1-4e60-b020-bf384ce4d9b6\") " pod="openshift-dns/node-resolver-whhnk" Jul 11 23:57:19.382963 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.382879 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkv42\" (UniqueName: \"kubernetes.io/projected/a726134c-d932-409e-aaea-ae8a4cd4f2ee-kube-api-access-dkv42\") pod \"tuned-h6lgp\" (UID: \"a726134c-d932-409e-aaea-ae8a4cd4f2ee\") " pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.411153 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.411067 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 11 23:57:19.463148 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.463120 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-phxwk" Jul 11 23:57:19.470630 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.470608 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q72jw" Jul 11 23:57:19.478169 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.478149 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz" Jul 11 23:57:19.484746 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.484727 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v5nd7" Jul 11 23:57:19.491319 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.491301 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:19.497753 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.497737 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" Jul 11 23:57:19.503168 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.503153 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jw46q" Jul 11 23:57:19.509659 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.509643 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-whhnk" Jul 11 23:57:19.514097 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.514085 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-chlwj" Jul 11 23:57:19.773535 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.773504 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a15f85da-2145-459f-8445-82ec38f243b7-original-pull-secret\") pod \"global-pull-secret-syncer-2dpdn\" (UID: \"a15f85da-2145-459f-8445-82ec38f243b7\") " pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:19.773688 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:19.773665 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 11 23:57:19.773733 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:19.773726 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a15f85da-2145-459f-8445-82ec38f243b7-original-pull-secret podName:a15f85da-2145-459f-8445-82ec38f243b7 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:20.773711258 +0000 UTC m=+3.949507878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a15f85da-2145-459f-8445-82ec38f243b7-original-pull-secret") pod "global-pull-secret-syncer-2dpdn" (UID: "a15f85da-2145-459f-8445-82ec38f243b7") : object "kube-system"/"original-pull-secret" not registered Jul 11 23:57:19.874370 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.874334 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7759c22b-76ac-44de-a812-a82cf40941eb-metrics-certs\") pod \"network-metrics-daemon-cjtrj\" (UID: \"7759c22b-76ac-44de-a812-a82cf40941eb\") " pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:19.874527 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:19.874496 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 23:57:19.874569 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:19.874561 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7759c22b-76ac-44de-a812-a82cf40941eb-metrics-certs podName:7759c22b-76ac-44de-a812-a82cf40941eb nodeName:}" failed. No retries permitted until 2026-07-11 23:57:20.874545818 +0000 UTC m=+4.050342436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7759c22b-76ac-44de-a812-a82cf40941eb-metrics-certs") pod "network-metrics-daemon-cjtrj" (UID: "7759c22b-76ac-44de-a812-a82cf40941eb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 23:57:19.975429 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:19.975398 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx9cb\" (UniqueName: \"kubernetes.io/projected/0295efe1-26fd-416f-a532-86a675acc31f-kube-api-access-sx9cb\") pod \"network-check-target-r8fwq\" (UID: \"0295efe1-26fd-416f-a532-86a675acc31f\") " pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:19.975596 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:19.975576 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 11 23:57:19.975661 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:19.975604 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 11 23:57:19.975661 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:19.975618 2564 projected.go:196] Error preparing data for projected volume kube-api-access-sx9cb for pod openshift-network-diagnostics/network-check-target-r8fwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 23:57:19.975738 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:19.975671 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0295efe1-26fd-416f-a532-86a675acc31f-kube-api-access-sx9cb podName:0295efe1-26fd-416f-a532-86a675acc31f nodeName:}" failed. No retries permitted until 2026-07-11 23:57:20.975656607 +0000 UTC m=+4.151453222 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sx9cb" (UniqueName: "kubernetes.io/projected/0295efe1-26fd-416f-a532-86a675acc31f-kube-api-access-sx9cb") pod "network-check-target-r8fwq" (UID: "0295efe1-26fd-416f-a532-86a675acc31f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 23:57:20.049381 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:20.049225 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda726134c_d932_409e_aaea_ae8a4cd4f2ee.slice/crio-4f131a35b61b75f5e7a56b9f74b44fdf0986fb98c71953d0af7215f6c689b846 WatchSource:0}: Error finding container 4f131a35b61b75f5e7a56b9f74b44fdf0986fb98c71953d0af7215f6c689b846: Status 404 returned error can't find the container with id 4f131a35b61b75f5e7a56b9f74b44fdf0986fb98c71953d0af7215f6c689b846 Jul 11 23:57:20.052415 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:20.052396 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fe0a2f0_0bed_40b5_bbb1_f4acaa7aa525.slice/crio-4b44053628d09861b456b0c338b58b4ea1f2d2022c427864c0fe46626ab16a3a WatchSource:0}: Error finding container 4b44053628d09861b456b0c338b58b4ea1f2d2022c427864c0fe46626ab16a3a: Status 404 returned error can't find the container with id 4b44053628d09861b456b0c338b58b4ea1f2d2022c427864c0fe46626ab16a3a Jul 11 23:57:20.053605 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:20.053588 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18da12f3_f232_4080_a5d0_1d966e8c02ce.slice/crio-e04b70f6be029605eb61a3b9e80fbe60482ec47dd6120265fc92591683485be7 WatchSource:0}: Error finding container e04b70f6be029605eb61a3b9e80fbe60482ec47dd6120265fc92591683485be7: Status 404 returned error can't find the container with id e04b70f6be029605eb61a3b9e80fbe60482ec47dd6120265fc92591683485be7 Jul 11 23:57:20.054337 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:20.054315 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc60340a_59c1_4e60_b020_bf384ce4d9b6.slice/crio-6812ee0d3f5c3bb19fbe633f7eea565f582d482e15b3809110b66a9e37e15b83 WatchSource:0}: Error finding container 6812ee0d3f5c3bb19fbe633f7eea565f582d482e15b3809110b66a9e37e15b83: Status 404 returned error can't find the container with id 6812ee0d3f5c3bb19fbe633f7eea565f582d482e15b3809110b66a9e37e15b83 Jul 11 23:57:20.055871 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:20.055844 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46db6233_0f23_4f52_9648_f6b265d0df9d.slice/crio-05e73133d6fb5c69f26914dbb4a4db73d3683c82a83fa6c7aa4a95b06e83ec70 WatchSource:0}: Error finding container 05e73133d6fb5c69f26914dbb4a4db73d3683c82a83fa6c7aa4a95b06e83ec70: Status 404 returned error can't find the container with id 05e73133d6fb5c69f26914dbb4a4db73d3683c82a83fa6c7aa4a95b06e83ec70 Jul 11 23:57:20.056493 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:20.056450 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bdecd8b_9853_4a8f_8441_68bad8a709c2.slice/crio-3ef5f49ee9ed60f843e611226ac2e7de3232a54d5ad1e24997f31538f4a0ce79 WatchSource:0}: Error finding container 3ef5f49ee9ed60f843e611226ac2e7de3232a54d5ad1e24997f31538f4a0ce79: Status 404 returned error can't find the container with id 3ef5f49ee9ed60f843e611226ac2e7de3232a54d5ad1e24997f31538f4a0ce79 Jul 11 23:57:20.059584 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:20.059551 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ae6d9b4_ded1_4cc5_8110_668501906a6d.slice/crio-3f1eebd422fc5588e8c92e07468d95e55560620088694454a21451f40b37f007 WatchSource:0}: Error finding container 3f1eebd422fc5588e8c92e07468d95e55560620088694454a21451f40b37f007: Status 404 returned error can't find the container with id 3f1eebd422fc5588e8c92e07468d95e55560620088694454a21451f40b37f007 Jul 11 23:57:20.061255 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:20.060518 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8441f59_adc8_4e06_939d_7ed374002b1d.slice/crio-077c1be1798ebd0b01cd9e8f164b5a5a131c1868053f780577bcd2962c5d1a19 WatchSource:0}: Error finding container 077c1be1798ebd0b01cd9e8f164b5a5a131c1868053f780577bcd2962c5d1a19: Status 404 returned error can't find the container with id 077c1be1798ebd0b01cd9e8f164b5a5a131c1868053f780577bcd2962c5d1a19 Jul 11 23:57:20.062213 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:57:20.062189 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d95add4_4953_4489_aa07_eeece59a973b.slice/crio-e4cde2f4966749d9b2df45e36f543252dc7aac673e20075a4df2935dd2dbccf1 WatchSource:0}: Error finding container e4cde2f4966749d9b2df45e36f543252dc7aac673e20075a4df2935dd2dbccf1: Status 404 returned error can't find the container with id e4cde2f4966749d9b2df45e36f543252dc7aac673e20075a4df2935dd2dbccf1 Jul 11 23:57:20.199939 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:20.199909 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-10 23:52:19 +0000 UTC" deadline="2028-02-04 03:24:46.72320205 +0000 UTC" Jul 11 23:57:20.199939 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:20.199938 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13731h27m26.523268522s" Jul 11 23:57:20.329813 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:20.329737 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:20.329902 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:20.329850 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjtrj" podUID="7759c22b-76ac-44de-a812-a82cf40941eb" Jul 11 23:57:20.338957 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:20.338926 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" event={"ID":"8bdecd8b-9853-4a8f-8441-68bad8a709c2","Type":"ContainerStarted","Data":"3ef5f49ee9ed60f843e611226ac2e7de3232a54d5ad1e24997f31538f4a0ce79"} Jul 11 23:57:20.339919 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:20.339895 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz" event={"ID":"18da12f3-f232-4080-a5d0-1d966e8c02ce","Type":"ContainerStarted","Data":"e04b70f6be029605eb61a3b9e80fbe60482ec47dd6120265fc92591683485be7"} Jul 11 23:57:20.340804 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:20.340775 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phxwk" event={"ID":"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525","Type":"ContainerStarted","Data":"4b44053628d09861b456b0c338b58b4ea1f2d2022c427864c0fe46626ab16a3a"} Jul 11 23:57:20.342626 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:20.342606 2564 generic.go:356] "Generic (PLEG): container finished" podID="87ba212901094f4334b3080963b67e70" containerID="b50516134cddca2412cace2c4a27a9ac0d438ce02a5ea2b4926431e16fa7a11f" exitCode=0 Jul 11 23:57:20.342716 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:20.342662 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal" event={"ID":"87ba212901094f4334b3080963b67e70","Type":"ContainerDied","Data":"b50516134cddca2412cace2c4a27a9ac0d438ce02a5ea2b4926431e16fa7a11f"} Jul 11 23:57:20.343829 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:20.343802 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-chlwj" event={"ID":"a8441f59-adc8-4e06-939d-7ed374002b1d","Type":"ContainerStarted","Data":"077c1be1798ebd0b01cd9e8f164b5a5a131c1868053f780577bcd2962c5d1a19"} Jul 11 23:57:20.344844 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:20.344824 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" event={"ID":"a726134c-d932-409e-aaea-ae8a4cd4f2ee","Type":"ContainerStarted","Data":"4f131a35b61b75f5e7a56b9f74b44fdf0986fb98c71953d0af7215f6c689b846"} Jul 11 23:57:20.346181 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:20.346161 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-227.ec2.internal" event={"ID":"128e18488d42fbf8ffd3f878224f2cb5","Type":"ContainerStarted","Data":"99aff4782ed583748e649df5d3f292d5921318fdedaf71c52404a2a286feee16"} Jul 11 23:57:20.347244 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:20.347136 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v5nd7" event={"ID":"4d95add4-4953-4489-aa07-eeece59a973b","Type":"ContainerStarted","Data":"e4cde2f4966749d9b2df45e36f543252dc7aac673e20075a4df2935dd2dbccf1"} Jul 11 23:57:20.348143 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:20.348124 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jw46q" event={"ID":"6ae6d9b4-ded1-4cc5-8110-668501906a6d","Type":"ContainerStarted","Data":"3f1eebd422fc5588e8c92e07468d95e55560620088694454a21451f40b37f007"} Jul 11 23:57:20.349096 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:20.349067 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q72jw" event={"ID":"46db6233-0f23-4f52-9648-f6b265d0df9d","Type":"ContainerStarted","Data":"05e73133d6fb5c69f26914dbb4a4db73d3683c82a83fa6c7aa4a95b06e83ec70"} Jul 11 23:57:20.350021 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:20.350005 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-whhnk" event={"ID":"fc60340a-59c1-4e60-b020-bf384ce4d9b6","Type":"ContainerStarted","Data":"6812ee0d3f5c3bb19fbe633f7eea565f582d482e15b3809110b66a9e37e15b83"} Jul 11 23:57:20.367701 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:20.367653 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-227.ec2.internal" podStartSLOduration=2.367637751 podStartE2EDuration="2.367637751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:57:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:20.366980529 +0000 UTC m=+3.542777167" watchObservedRunningTime="2026-07-11 23:57:20.367637751 +0000 UTC m=+3.543434389" Jul 11 23:57:20.784526 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:20.784493 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a15f85da-2145-459f-8445-82ec38f243b7-original-pull-secret\") pod \"global-pull-secret-syncer-2dpdn\" (UID: \"a15f85da-2145-459f-8445-82ec38f243b7\") " pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:20.784710 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:20.784681 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 11 23:57:20.784770 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:20.784736 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a15f85da-2145-459f-8445-82ec38f243b7-original-pull-secret podName:a15f85da-2145-459f-8445-82ec38f243b7 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:22.784719003 +0000 UTC m=+5.960515624 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a15f85da-2145-459f-8445-82ec38f243b7-original-pull-secret") pod "global-pull-secret-syncer-2dpdn" (UID: "a15f85da-2145-459f-8445-82ec38f243b7") : object "kube-system"/"original-pull-secret" not registered Jul 11 23:57:20.885765 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:20.885731 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7759c22b-76ac-44de-a812-a82cf40941eb-metrics-certs\") pod \"network-metrics-daemon-cjtrj\" (UID: \"7759c22b-76ac-44de-a812-a82cf40941eb\") " pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:20.885944 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:20.885922 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 23:57:20.886011 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:20.885980 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7759c22b-76ac-44de-a812-a82cf40941eb-metrics-certs podName:7759c22b-76ac-44de-a812-a82cf40941eb nodeName:}" failed. No retries permitted until 2026-07-11 23:57:22.885962013 +0000 UTC m=+6.061758628 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7759c22b-76ac-44de-a812-a82cf40941eb-metrics-certs") pod "network-metrics-daemon-cjtrj" (UID: "7759c22b-76ac-44de-a812-a82cf40941eb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 23:57:20.987040 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:20.987009 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx9cb\" (UniqueName: \"kubernetes.io/projected/0295efe1-26fd-416f-a532-86a675acc31f-kube-api-access-sx9cb\") pod \"network-check-target-r8fwq\" (UID: \"0295efe1-26fd-416f-a532-86a675acc31f\") " pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:20.987340 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:20.987249 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 11 23:57:20.987340 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:20.987273 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 11 23:57:20.987340 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:20.987286 2564 projected.go:196] Error preparing data for projected volume kube-api-access-sx9cb for pod openshift-network-diagnostics/network-check-target-r8fwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 23:57:20.987340 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:20.987342 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0295efe1-26fd-416f-a532-86a675acc31f-kube-api-access-sx9cb podName:0295efe1-26fd-416f-a532-86a675acc31f nodeName:}" failed. No retries permitted until 2026-07-11 23:57:22.987322926 +0000 UTC m=+6.163119549 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sx9cb" (UniqueName: "kubernetes.io/projected/0295efe1-26fd-416f-a532-86a675acc31f-kube-api-access-sx9cb") pod "network-check-target-r8fwq" (UID: "0295efe1-26fd-416f-a532-86a675acc31f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 23:57:21.201142 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:21.201067 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-10 23:52:19 +0000 UTC" deadline="2028-01-02 01:49:23.036456244 +0000 UTC" Jul 11 23:57:21.201142 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:21.201140 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12937h52m1.835319996s" Jul 11 23:57:21.332089 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:21.332062 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:21.332257 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:21.332199 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8fwq" podUID="0295efe1-26fd-416f-a532-86a675acc31f" Jul 11 23:57:21.332599 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:21.332578 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:21.332747 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:21.332681 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dpdn" podUID="a15f85da-2145-459f-8445-82ec38f243b7" Jul 11 23:57:21.363389 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:21.362991 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal" event={"ID":"87ba212901094f4334b3080963b67e70","Type":"ContainerStarted","Data":"e7f4ce9797a9be7ca7cc72fb0281a6b7b960183fc46e5062635eaef7596a260b"} Jul 11 23:57:21.377609 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:21.376639 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal" podStartSLOduration=3.376621001 podStartE2EDuration="3.376621001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:57:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:21.376484837 +0000 UTC m=+4.552281475" watchObservedRunningTime="2026-07-11 23:57:21.376621001 +0000 UTC m=+4.552417639" Jul 11 23:57:22.330379 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:22.330338 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:22.330817 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:22.330471 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjtrj" podUID="7759c22b-76ac-44de-a812-a82cf40941eb" Jul 11 23:57:22.802886 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:22.802850 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a15f85da-2145-459f-8445-82ec38f243b7-original-pull-secret\") pod \"global-pull-secret-syncer-2dpdn\" (UID: \"a15f85da-2145-459f-8445-82ec38f243b7\") " pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:22.803066 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:22.803004 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 11 23:57:22.803066 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:22.803059 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a15f85da-2145-459f-8445-82ec38f243b7-original-pull-secret podName:a15f85da-2145-459f-8445-82ec38f243b7 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:26.803041371 +0000 UTC m=+9.978837994 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a15f85da-2145-459f-8445-82ec38f243b7-original-pull-secret") pod "global-pull-secret-syncer-2dpdn" (UID: "a15f85da-2145-459f-8445-82ec38f243b7") : object "kube-system"/"original-pull-secret" not registered Jul 11 23:57:22.903382 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:22.903350 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7759c22b-76ac-44de-a812-a82cf40941eb-metrics-certs\") pod \"network-metrics-daemon-cjtrj\" (UID: \"7759c22b-76ac-44de-a812-a82cf40941eb\") " pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:22.903544 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:22.903507 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 23:57:22.903611 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:22.903564 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7759c22b-76ac-44de-a812-a82cf40941eb-metrics-certs podName:7759c22b-76ac-44de-a812-a82cf40941eb nodeName:}" failed. No retries permitted until 2026-07-11 23:57:26.903543841 +0000 UTC m=+10.079340459 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7759c22b-76ac-44de-a812-a82cf40941eb-metrics-certs") pod "network-metrics-daemon-cjtrj" (UID: "7759c22b-76ac-44de-a812-a82cf40941eb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 23:57:23.003893 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:23.003857 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx9cb\" (UniqueName: \"kubernetes.io/projected/0295efe1-26fd-416f-a532-86a675acc31f-kube-api-access-sx9cb\") pod \"network-check-target-r8fwq\" (UID: \"0295efe1-26fd-416f-a532-86a675acc31f\") " pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:23.004063 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:23.004025 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 11 23:57:23.004063 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:23.004047 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 11 23:57:23.004063 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:23.004058 2564 projected.go:196] Error preparing data for projected volume kube-api-access-sx9cb for pod openshift-network-diagnostics/network-check-target-r8fwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 23:57:23.004272 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:23.004133 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0295efe1-26fd-416f-a532-86a675acc31f-kube-api-access-sx9cb podName:0295efe1-26fd-416f-a532-86a675acc31f nodeName:}" failed. No retries permitted until 2026-07-11 23:57:27.004097882 +0000 UTC m=+10.179894512 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sx9cb" (UniqueName: "kubernetes.io/projected/0295efe1-26fd-416f-a532-86a675acc31f-kube-api-access-sx9cb") pod "network-check-target-r8fwq" (UID: "0295efe1-26fd-416f-a532-86a675acc31f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 23:57:23.329962 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:23.329919 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:23.329962 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:23.329947 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:23.330224 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:23.330046 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dpdn" podUID="a15f85da-2145-459f-8445-82ec38f243b7" Jul 11 23:57:23.330284 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:23.330214 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8fwq" podUID="0295efe1-26fd-416f-a532-86a675acc31f" Jul 11 23:57:24.330489 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:24.329989 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:24.330489 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:24.330145 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjtrj" podUID="7759c22b-76ac-44de-a812-a82cf40941eb" Jul 11 23:57:25.330200 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:25.330158 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:25.330200 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:25.330192 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:25.330389 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:25.330289 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8fwq" podUID="0295efe1-26fd-416f-a532-86a675acc31f" Jul 11 23:57:25.330389 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:25.330377 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dpdn" podUID="a15f85da-2145-459f-8445-82ec38f243b7" Jul 11 23:57:26.330115 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:26.330068 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:26.330542 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:26.330256 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjtrj" podUID="7759c22b-76ac-44de-a812-a82cf40941eb" Jul 11 23:57:26.836436 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:26.836396 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a15f85da-2145-459f-8445-82ec38f243b7-original-pull-secret\") pod \"global-pull-secret-syncer-2dpdn\" (UID: \"a15f85da-2145-459f-8445-82ec38f243b7\") " pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:26.836680 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:26.836628 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 11 23:57:26.836752 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:26.836703 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a15f85da-2145-459f-8445-82ec38f243b7-original-pull-secret podName:a15f85da-2145-459f-8445-82ec38f243b7 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:34.836685101 +0000 UTC m=+18.012481716 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a15f85da-2145-459f-8445-82ec38f243b7-original-pull-secret") pod "global-pull-secret-syncer-2dpdn" (UID: "a15f85da-2145-459f-8445-82ec38f243b7") : object "kube-system"/"original-pull-secret" not registered Jul 11 23:57:26.937448 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:26.936869 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7759c22b-76ac-44de-a812-a82cf40941eb-metrics-certs\") pod \"network-metrics-daemon-cjtrj\" (UID: \"7759c22b-76ac-44de-a812-a82cf40941eb\") " pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:26.937448 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:26.937041 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 23:57:26.937448 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:26.937118 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7759c22b-76ac-44de-a812-a82cf40941eb-metrics-certs podName:7759c22b-76ac-44de-a812-a82cf40941eb nodeName:}" failed. No retries permitted until 2026-07-11 23:57:34.937085678 +0000 UTC m=+18.112882295 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7759c22b-76ac-44de-a812-a82cf40941eb-metrics-certs") pod "network-metrics-daemon-cjtrj" (UID: "7759c22b-76ac-44de-a812-a82cf40941eb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 23:57:27.037543 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:27.037507 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx9cb\" (UniqueName: \"kubernetes.io/projected/0295efe1-26fd-416f-a532-86a675acc31f-kube-api-access-sx9cb\") pod \"network-check-target-r8fwq\" (UID: \"0295efe1-26fd-416f-a532-86a675acc31f\") " pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:27.037712 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:27.037690 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 11 23:57:27.037768 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:27.037721 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 11 23:57:27.037768 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:27.037736 2564 projected.go:196] Error preparing data for projected volume kube-api-access-sx9cb for pod openshift-network-diagnostics/network-check-target-r8fwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 23:57:27.037876 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:27.037800 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0295efe1-26fd-416f-a532-86a675acc31f-kube-api-access-sx9cb podName:0295efe1-26fd-416f-a532-86a675acc31f nodeName:}" failed. No retries permitted until 2026-07-11 23:57:35.037780852 +0000 UTC m=+18.213577490 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sx9cb" (UniqueName: "kubernetes.io/projected/0295efe1-26fd-416f-a532-86a675acc31f-kube-api-access-sx9cb") pod "network-check-target-r8fwq" (UID: "0295efe1-26fd-416f-a532-86a675acc31f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 23:57:27.332004 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:27.331562 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:27.332004 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:27.331676 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dpdn" podUID="a15f85da-2145-459f-8445-82ec38f243b7" Jul 11 23:57:27.332004 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:27.331852 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:27.332004 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:27.331961 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8fwq" podUID="0295efe1-26fd-416f-a532-86a675acc31f" Jul 11 23:57:28.330620 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:28.330132 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:28.330620 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:28.330276 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjtrj" podUID="7759c22b-76ac-44de-a812-a82cf40941eb" Jul 11 23:57:29.330282 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:29.330132 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:29.330282 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:29.330174 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:29.330282 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:29.330259 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dpdn" podUID="a15f85da-2145-459f-8445-82ec38f243b7" Jul 11 23:57:29.330801 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:29.330383 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8fwq" podUID="0295efe1-26fd-416f-a532-86a675acc31f" Jul 11 23:57:30.330771 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:30.330738 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:30.331159 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:30.330855 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjtrj" podUID="7759c22b-76ac-44de-a812-a82cf40941eb" Jul 11 23:57:31.329781 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:31.329742 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:31.329781 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:31.329784 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:31.330011 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:31.329870 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dpdn" podUID="a15f85da-2145-459f-8445-82ec38f243b7" Jul 11 23:57:31.330067 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:31.330030 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8fwq" podUID="0295efe1-26fd-416f-a532-86a675acc31f" Jul 11 23:57:32.330318 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:32.330281 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:32.330723 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:32.330406 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjtrj" podUID="7759c22b-76ac-44de-a812-a82cf40941eb" Jul 11 23:57:33.329998 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:33.329962 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:33.330175 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:33.330085 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8fwq" podUID="0295efe1-26fd-416f-a532-86a675acc31f" Jul 11 23:57:33.330175 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:33.330133 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:33.330264 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:33.330226 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dpdn" podUID="a15f85da-2145-459f-8445-82ec38f243b7" Jul 11 23:57:34.329922 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:34.329889 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:34.330397 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:34.330004 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjtrj" podUID="7759c22b-76ac-44de-a812-a82cf40941eb" Jul 11 23:57:34.895494 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:34.895461 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a15f85da-2145-459f-8445-82ec38f243b7-original-pull-secret\") pod \"global-pull-secret-syncer-2dpdn\" (UID: \"a15f85da-2145-459f-8445-82ec38f243b7\") " pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:34.895671 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:34.895651 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 11 23:57:34.895729 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:34.895716 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a15f85da-2145-459f-8445-82ec38f243b7-original-pull-secret podName:a15f85da-2145-459f-8445-82ec38f243b7 nodeName:}" failed. No retries permitted until 2026-07-11 23:57:50.895701168 +0000 UTC m=+34.071497787 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a15f85da-2145-459f-8445-82ec38f243b7-original-pull-secret") pod "global-pull-secret-syncer-2dpdn" (UID: "a15f85da-2145-459f-8445-82ec38f243b7") : object "kube-system"/"original-pull-secret" not registered Jul 11 23:57:34.996876 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:34.996839 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7759c22b-76ac-44de-a812-a82cf40941eb-metrics-certs\") pod \"network-metrics-daemon-cjtrj\" (UID: \"7759c22b-76ac-44de-a812-a82cf40941eb\") " pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:34.997026 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:34.996998 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 23:57:34.997096 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:34.997078 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7759c22b-76ac-44de-a812-a82cf40941eb-metrics-certs podName:7759c22b-76ac-44de-a812-a82cf40941eb nodeName:}" failed. No retries permitted until 2026-07-11 23:57:50.997056077 +0000 UTC m=+34.172852714 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7759c22b-76ac-44de-a812-a82cf40941eb-metrics-certs") pod "network-metrics-daemon-cjtrj" (UID: "7759c22b-76ac-44de-a812-a82cf40941eb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 23:57:35.097998 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:35.097960 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx9cb\" (UniqueName: \"kubernetes.io/projected/0295efe1-26fd-416f-a532-86a675acc31f-kube-api-access-sx9cb\") pod \"network-check-target-r8fwq\" (UID: \"0295efe1-26fd-416f-a532-86a675acc31f\") " pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:35.098202 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:35.098170 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 11 23:57:35.098202 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:35.098200 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 11 23:57:35.098377 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:35.098211 2564 projected.go:196] Error preparing data for projected volume kube-api-access-sx9cb for pod openshift-network-diagnostics/network-check-target-r8fwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 23:57:35.098377 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:35.098272 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0295efe1-26fd-416f-a532-86a675acc31f-kube-api-access-sx9cb podName:0295efe1-26fd-416f-a532-86a675acc31f nodeName:}" failed. No retries permitted until 2026-07-11 23:57:51.098250809 +0000 UTC m=+34.274047424 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sx9cb" (UniqueName: "kubernetes.io/projected/0295efe1-26fd-416f-a532-86a675acc31f-kube-api-access-sx9cb") pod "network-check-target-r8fwq" (UID: "0295efe1-26fd-416f-a532-86a675acc31f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 23:57:35.330660 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:35.330627 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:35.330660 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:35.330659 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:35.331224 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:35.330725 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dpdn" podUID="a15f85da-2145-459f-8445-82ec38f243b7" Jul 11 23:57:35.331224 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:35.330796 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8fwq" podUID="0295efe1-26fd-416f-a532-86a675acc31f" Jul 11 23:57:36.329849 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:36.329813 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:36.330028 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:36.329930 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjtrj" podUID="7759c22b-76ac-44de-a812-a82cf40941eb" Jul 11 23:57:37.330806 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:37.330758 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:37.331359 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:37.330861 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:37.331359 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:37.330894 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dpdn" podUID="a15f85da-2145-459f-8445-82ec38f243b7" Jul 11 23:57:37.331359 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:37.330937 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8fwq" podUID="0295efe1-26fd-416f-a532-86a675acc31f" Jul 11 23:57:38.330565 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:38.330532 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:38.330738 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:38.330652 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjtrj" podUID="7759c22b-76ac-44de-a812-a82cf40941eb" Jul 11 23:57:39.330425 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:39.330256 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:39.330956 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:39.330320 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:39.330956 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:39.330511 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dpdn" podUID="a15f85da-2145-459f-8445-82ec38f243b7" Jul 11 23:57:39.330956 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:39.330568 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8fwq" podUID="0295efe1-26fd-416f-a532-86a675acc31f" Jul 11 23:57:39.402999 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:39.402972 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jw46q" event={"ID":"6ae6d9b4-ded1-4cc5-8110-668501906a6d","Type":"ContainerStarted","Data":"7350be3086340e88f58e53801fc1f62c1e28eccc7958ab5adfef26c182c5823b"} Jul 11 23:57:39.404219 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:39.404200 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q72jw" event={"ID":"46db6233-0f23-4f52-9648-f6b265d0df9d","Type":"ContainerStarted","Data":"9e1d6c90b61946d5bc3280ea356bb8f475ed5b418fcad5c240770ac9a85d96bb"} Jul 11 23:57:39.405605 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:39.405584 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-whhnk" event={"ID":"fc60340a-59c1-4e60-b020-bf384ce4d9b6","Type":"ContainerStarted","Data":"4bfeadccd4e17cd8583a8308413e0ba189ccec04ad65d7e54892f209f862c808"} Jul 11 23:57:39.407556 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:39.407541 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcdr8_8bdecd8b-9853-4a8f-8441-68bad8a709c2/ovn-acl-logging/0.log" Jul 11 23:57:39.407874 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:39.407851 2564 generic.go:356] "Generic (PLEG): container finished" podID="8bdecd8b-9853-4a8f-8441-68bad8a709c2" containerID="7c87019dd8f7b9964569a7decf4637a15ea90c9ab9533aa1c63f75df8bbdf125" exitCode=1 Jul 11 23:57:39.407929 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:39.407910 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" event={"ID":"8bdecd8b-9853-4a8f-8441-68bad8a709c2","Type":"ContainerStarted","Data":"12393ee6782cb9b6c379826a525802f7291e3a3560605318a368e15f7e39adf3"} Jul 11 23:57:39.407973 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:39.407960 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" event={"ID":"8bdecd8b-9853-4a8f-8441-68bad8a709c2","Type":"ContainerStarted","Data":"45552697018ec62ed7df95b7f86de6a7ed8cbae858780307b9c8a2a85dc030d9"} Jul 11 23:57:39.408013 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:39.408000 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" event={"ID":"8bdecd8b-9853-4a8f-8441-68bad8a709c2","Type":"ContainerDied","Data":"7c87019dd8f7b9964569a7decf4637a15ea90c9ab9533aa1c63f75df8bbdf125"} Jul 11 23:57:39.408057 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:39.408046 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" event={"ID":"8bdecd8b-9853-4a8f-8441-68bad8a709c2","Type":"ContainerStarted","Data":"f38d15311df1a2a75a70fe3b0b0e7f3390010f93f218380ba5f761af882166d7"} Jul 11 23:57:39.409243 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:39.409225 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz" event={"ID":"18da12f3-f232-4080-a5d0-1d966e8c02ce","Type":"ContainerStarted","Data":"a7aaf9edc56dbfdb9740133745374a20ad852115aeb043794949bc12156a0583"} Jul 11 23:57:39.410461 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:39.410443 2564 generic.go:356] "Generic (PLEG): container finished" podID="7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525" containerID="697d17f8ac4170f13ae91db062048c283e61323b468f42280a33f2eedcdf1e91" exitCode=0 Jul 11 23:57:39.410550 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:39.410502 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phxwk" event={"ID":"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525","Type":"ContainerDied","Data":"697d17f8ac4170f13ae91db062048c283e61323b468f42280a33f2eedcdf1e91"} Jul 11 23:57:39.411999 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:39.411917 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-chlwj" event={"ID":"a8441f59-adc8-4e06-939d-7ed374002b1d","Type":"ContainerStarted","Data":"3c962832c000dbe7b5e67335b5ecc3ce7ebd825a9e156f45b120a19af6b829e0"} Jul 11 23:57:39.413404 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:39.413386 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" event={"ID":"a726134c-d932-409e-aaea-ae8a4cd4f2ee","Type":"ContainerStarted","Data":"bc1cbccc81abb766a21a98a1c6741c796d337cb601d132f390799aa48ba9aa75"} Jul 11 23:57:39.427970 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:39.427900 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jw46q" podStartSLOduration=3.604652349 podStartE2EDuration="22.427881363s" totalImagesPullingTime="18.823229014s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:57:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:39.427754618 +0000 UTC m=+22.603551255" watchObservedRunningTime="2026-07-11 23:57:39.427881363 +0000 UTC m=+22.603678001" Jul 11 23:57:39.471053 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:39.470798 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-whhnk" podStartSLOduration=3.625956655 podStartE2EDuration="22.470782604s" totalImagesPullingTime="18.844825949s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:57:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:39.470741176 +0000 UTC m=+22.646537813" watchObservedRunningTime="2026-07-11 23:57:39.470782604 +0000 UTC m=+22.646579242" Jul 11 23:57:39.548524 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:39.548462 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-h6lgp" podStartSLOduration=3.695921983 podStartE2EDuration="22.548440733s" totalImagesPullingTime="18.85251875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:57:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:39.548238902 +0000 UTC m=+22.724035539" watchObservedRunningTime="2026-07-11 23:57:39.548440733 +0000 UTC m=+22.724237373" Jul 11 23:57:39.549008 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:39.548978 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-q72jw" podStartSLOduration=12.101340647 podStartE2EDuration="22.548969993s" totalImagesPullingTime="10.447629346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:57:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:39.531911367 +0000 UTC m=+22.707708000" watchObservedRunningTime="2026-07-11 23:57:39.548969993 +0000 UTC m=+22.724766632" Jul 11 23:57:39.567039 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:39.566982 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-chlwj" podStartSLOduration=3.656649095 podStartE2EDuration="22.566961941s" totalImagesPullingTime="18.910312846s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:57:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:39.566317075 +0000 UTC m=+22.742113722" watchObservedRunningTime="2026-07-11 23:57:39.566961941 +0000 UTC m=+22.742758582" Jul 11 23:57:40.312209 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:40.312179 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 11 23:57:40.330467 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:40.330447 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:40.330812 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:40.330557 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjtrj" podUID="7759c22b-76ac-44de-a812-a82cf40941eb" Jul 11 23:57:40.417290 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:40.417255 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v5nd7" event={"ID":"4d95add4-4953-4489-aa07-eeece59a973b","Type":"ContainerStarted","Data":"2fcbc07eb381b63890b969ddf67a932d934ab6dd3eadf52c078477748077bdd4"} Jul 11 23:57:40.420614 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:40.420592 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcdr8_8bdecd8b-9853-4a8f-8441-68bad8a709c2/ovn-acl-logging/0.log" Jul 11 23:57:40.421034 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:40.420995 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" event={"ID":"8bdecd8b-9853-4a8f-8441-68bad8a709c2","Type":"ContainerStarted","Data":"57dc09654ad6d3a777adcdff9c136c7872f19e78471055d7e4506565f9c801be"} Jul 11 23:57:40.421157 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:40.421065 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" event={"ID":"8bdecd8b-9853-4a8f-8441-68bad8a709c2","Type":"ContainerStarted","Data":"81eea3dae6098cbbddb243f32e75d2b8fc402cdc29d42b2ef48bce249e304efc"} Jul 11 23:57:40.422847 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:40.422822 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz" event={"ID":"18da12f3-f232-4080-a5d0-1d966e8c02ce","Type":"ContainerStarted","Data":"08f28d60699bc6b55b877d9ddde3763b6d585796d3c48b0458abad7b616e7776"} Jul 11 23:57:40.431161 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:40.431125 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-v5nd7" podStartSLOduration=4.593545332 podStartE2EDuration="23.431092625s" totalImagesPullingTime="18.837547293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:57:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:40.430835482 +0000 UTC m=+23.606632120" watchObservedRunningTime="2026-07-11 23:57:40.431092625 +0000 UTC m=+23.606889262" Jul 11 23:57:40.633296 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:40.633069 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-whhnk_fc60340a-59c1-4e60-b020-bf384ce4d9b6/dns-node-resolver/0.log" Jul 11 23:57:41.224627 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:41.224514 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-11T23:57:40.312201109Z","UUID":"cef837d8-4d09-4d95-9b81-bf9404627891","Handler":null,"Name":"","Endpoint":""} Jul 11 23:57:41.226518 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:41.226284 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 11 23:57:41.226518 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:41.226327 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 11 23:57:41.330506 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:41.330476 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:41.330918 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:41.330588 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dpdn" podUID="a15f85da-2145-459f-8445-82ec38f243b7" Jul 11 23:57:41.330918 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:41.330677 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:41.330918 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:41.330777 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8fwq" podUID="0295efe1-26fd-416f-a532-86a675acc31f" Jul 11 23:57:41.613042 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:41.613016 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jw46q_6ae6d9b4-ded1-4cc5-8110-668501906a6d/node-ca/0.log" Jul 11 23:57:42.330595 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:42.330568 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:42.331208 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:42.330684 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjtrj" podUID="7759c22b-76ac-44de-a812-a82cf40941eb" Jul 11 23:57:42.432057 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:42.432031 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcdr8_8bdecd8b-9853-4a8f-8441-68bad8a709c2/ovn-acl-logging/0.log" Jul 11 23:57:42.432509 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:42.432477 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" event={"ID":"8bdecd8b-9853-4a8f-8441-68bad8a709c2","Type":"ContainerStarted","Data":"9d2d072510d8d411c56d2997b26dbc4f456c2b27e4bbcb8fe4146bd6cc8b587e"} Jul 11 23:57:42.434620 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:42.434597 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz" event={"ID":"18da12f3-f232-4080-a5d0-1d966e8c02ce","Type":"ContainerStarted","Data":"7d0a925ecf8d789d621fed765bea85da3b552d1368e2841ae3a0d5bc584592dd"} Jul 11 23:57:42.451304 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:42.451268 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xfzhz" podStartSLOduration=4.469861586 podStartE2EDuration="25.451253789s" totalImagesPullingTime="20.981392203s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:57:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:42.450873414 +0000 UTC m=+25.626670051" watchObservedRunningTime="2026-07-11 23:57:42.451253789 +0000 UTC m=+25.627050425" Jul 11 23:57:43.139352 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:43.139319 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-q72jw" Jul 11 23:57:43.330536 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:43.330504 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:43.330706 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:43.330634 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dpdn" podUID="a15f85da-2145-459f-8445-82ec38f243b7" Jul 11 23:57:43.330706 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:43.330685 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:43.331206 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:43.330777 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8fwq" podUID="0295efe1-26fd-416f-a532-86a675acc31f" Jul 11 23:57:44.027654 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:44.027443 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-q72jw" Jul 11 23:57:44.028901 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:44.028798 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-q72jw" Jul 11 23:57:44.330190 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:44.330165 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:44.330331 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:44.330268 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjtrj" podUID="7759c22b-76ac-44de-a812-a82cf40941eb" Jul 11 23:57:44.441040 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:44.441006 2564 generic.go:356] "Generic (PLEG): container finished" podID="7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525" containerID="f930fffcf7bca0615028005ef29e0068d3cb6e26f68aa1931b503312a32f8c8a" exitCode=0 Jul 11 23:57:44.441409 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:44.441094 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phxwk" event={"ID":"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525","Type":"ContainerDied","Data":"f930fffcf7bca0615028005ef29e0068d3cb6e26f68aa1931b503312a32f8c8a"} Jul 11 23:57:44.444374 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:44.444358 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcdr8_8bdecd8b-9853-4a8f-8441-68bad8a709c2/ovn-acl-logging/0.log" Jul 11 23:57:44.444653 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:44.444635 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" event={"ID":"8bdecd8b-9853-4a8f-8441-68bad8a709c2","Type":"ContainerStarted","Data":"bb13ceaec79706fb00ea0927663acd55fd78857e498a4cfbe6ba2cc44d63fdf7"} Jul 11 23:57:44.445153 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:44.445136 2564 scope.go:117] "RemoveContainer" containerID="7c87019dd8f7b9964569a7decf4637a15ea90c9ab9533aa1c63f75df8bbdf125" Jul 11 23:57:44.445313 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:44.445301 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-q72jw" Jul 11 23:57:45.330676 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:45.330650 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:45.330676 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:45.330671 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:45.330884 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:45.330752 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8fwq" podUID="0295efe1-26fd-416f-a532-86a675acc31f" Jul 11 23:57:45.330943 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:45.330886 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dpdn" podUID="a15f85da-2145-459f-8445-82ec38f243b7" Jul 11 23:57:45.449500 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:45.449480 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcdr8_8bdecd8b-9853-4a8f-8441-68bad8a709c2/ovn-acl-logging/0.log" Jul 11 23:57:45.449808 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:45.449773 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" event={"ID":"8bdecd8b-9853-4a8f-8441-68bad8a709c2","Type":"ContainerStarted","Data":"bb615a639e4578f7276ec67ade4c51618f48c856f66f6af387189deb7b4904f6"} Jul 11 23:57:45.449884 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:45.449869 2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 11 23:57:45.450149 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:45.450131 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:45.450232 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:45.450199 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:45.464812 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:45.464792 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:45.464917 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:45.464877 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:45.479755 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:45.479714 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" podStartSLOduration=9.55166223 podStartE2EDuration="28.479699844s" totalImagesPullingTime="18.928037614s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:57:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:45.477147571 +0000 UTC m=+28.652944209" watchObservedRunningTime="2026-07-11 23:57:45.479699844 +0000 UTC m=+28.655496480" Jul 11 23:57:45.536092 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:45.536069 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:57:46.330618 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:46.330591 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:46.330853 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:46.330682 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjtrj" podUID="7759c22b-76ac-44de-a812-a82cf40941eb" Jul 11 23:57:46.453354 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:46.453329 2564 generic.go:356] "Generic (PLEG): container finished" podID="7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525" containerID="8cd6a388f930a38c5d0625ff276b195f562a2b7268c8befaaf6fdbab2003734a" exitCode=0 Jul 11 23:57:46.453673 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:46.453424 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phxwk" event={"ID":"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525","Type":"ContainerDied","Data":"8cd6a388f930a38c5d0625ff276b195f562a2b7268c8befaaf6fdbab2003734a"} Jul 11 23:57:47.331174 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:47.330993 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:47.331353 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:47.331232 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8fwq" podUID="0295efe1-26fd-416f-a532-86a675acc31f" Jul 11 23:57:47.331353 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:47.331062 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:47.331353 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:47.331344 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dpdn" podUID="a15f85da-2145-459f-8445-82ec38f243b7" Jul 11 23:57:48.329752 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:48.329726 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:48.330089 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:48.329817 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjtrj" podUID="7759c22b-76ac-44de-a812-a82cf40941eb" Jul 11 23:57:48.459387 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:48.459361 2564 generic.go:356] "Generic (PLEG): container finished" podID="7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525" containerID="3acbd4c7de458b4168f09830a649c9c5d9e12f5f4660fe74dfdc4cdc852605a0" exitCode=0 Jul 11 23:57:48.459497 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:48.459429 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phxwk" event={"ID":"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525","Type":"ContainerDied","Data":"3acbd4c7de458b4168f09830a649c9c5d9e12f5f4660fe74dfdc4cdc852605a0"} Jul 11 23:57:49.330551 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:49.330515 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:49.330970 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:49.330526 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:49.330970 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:49.330642 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dpdn" podUID="a15f85da-2145-459f-8445-82ec38f243b7" Jul 11 23:57:49.330970 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:49.330746 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8fwq" podUID="0295efe1-26fd-416f-a532-86a675acc31f" Jul 11 23:57:50.330559 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:50.330526 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:50.331008 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:50.330657 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjtrj" podUID="7759c22b-76ac-44de-a812-a82cf40941eb" Jul 11 23:57:50.918418 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:50.918380 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a15f85da-2145-459f-8445-82ec38f243b7-original-pull-secret\") pod \"global-pull-secret-syncer-2dpdn\" (UID: \"a15f85da-2145-459f-8445-82ec38f243b7\") " pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:50.918615 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:50.918505 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 11 23:57:50.918615 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:50.918575 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a15f85da-2145-459f-8445-82ec38f243b7-original-pull-secret podName:a15f85da-2145-459f-8445-82ec38f243b7 nodeName:}" failed. No retries permitted until 2026-07-11 23:58:22.918559252 +0000 UTC m=+66.094355869 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a15f85da-2145-459f-8445-82ec38f243b7-original-pull-secret") pod "global-pull-secret-syncer-2dpdn" (UID: "a15f85da-2145-459f-8445-82ec38f243b7") : object "kube-system"/"original-pull-secret" not registered Jul 11 23:57:51.019141 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:51.019093 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7759c22b-76ac-44de-a812-a82cf40941eb-metrics-certs\") pod \"network-metrics-daemon-cjtrj\" (UID: \"7759c22b-76ac-44de-a812-a82cf40941eb\") " pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:51.019282 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:51.019203 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 23:57:51.019282 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:51.019263 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7759c22b-76ac-44de-a812-a82cf40941eb-metrics-certs podName:7759c22b-76ac-44de-a812-a82cf40941eb nodeName:}" failed. No retries permitted until 2026-07-11 23:58:23.019247664 +0000 UTC m=+66.195044279 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7759c22b-76ac-44de-a812-a82cf40941eb-metrics-certs") pod "network-metrics-daemon-cjtrj" (UID: "7759c22b-76ac-44de-a812-a82cf40941eb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 11 23:57:51.120006 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:51.119973 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx9cb\" (UniqueName: \"kubernetes.io/projected/0295efe1-26fd-416f-a532-86a675acc31f-kube-api-access-sx9cb\") pod \"network-check-target-r8fwq\" (UID: \"0295efe1-26fd-416f-a532-86a675acc31f\") " pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:51.120176 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:51.120148 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 11 23:57:51.120176 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:51.120168 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 11 23:57:51.120278 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:51.120181 2564 projected.go:196] Error preparing data for projected volume kube-api-access-sx9cb for pod openshift-network-diagnostics/network-check-target-r8fwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 23:57:51.120278 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:51.120238 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0295efe1-26fd-416f-a532-86a675acc31f-kube-api-access-sx9cb podName:0295efe1-26fd-416f-a532-86a675acc31f nodeName:}" failed. No retries permitted until 2026-07-11 23:58:23.1202242 +0000 UTC m=+66.296020815 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sx9cb" (UniqueName: "kubernetes.io/projected/0295efe1-26fd-416f-a532-86a675acc31f-kube-api-access-sx9cb") pod "network-check-target-r8fwq" (UID: "0295efe1-26fd-416f-a532-86a675acc31f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 11 23:57:51.330295 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:51.330261 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:51.330469 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:51.330390 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dpdn" podUID="a15f85da-2145-459f-8445-82ec38f243b7" Jul 11 23:57:51.330469 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:51.330448 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:51.330591 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:51.330544 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8fwq" podUID="0295efe1-26fd-416f-a532-86a675acc31f" Jul 11 23:57:52.330039 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:52.330008 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:52.330250 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:52.330163 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjtrj" podUID="7759c22b-76ac-44de-a812-a82cf40941eb" Jul 11 23:57:52.471968 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:52.471941 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phxwk" event={"ID":"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525","Type":"ContainerStarted","Data":"6ca0fe4bb403f8554b46b92c1efdaf71a187e863c2e6995e90ae4cd8f3eb9f70"} Jul 11 23:57:53.330419 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:53.330392 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:53.330570 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:53.330484 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dpdn" podUID="a15f85da-2145-459f-8445-82ec38f243b7" Jul 11 23:57:53.330570 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:53.330554 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:53.330653 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:53.330630 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8fwq" podUID="0295efe1-26fd-416f-a532-86a675acc31f" Jul 11 23:57:53.475913 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:53.475888 2564 generic.go:356] "Generic (PLEG): container finished" podID="7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525" containerID="6ca0fe4bb403f8554b46b92c1efdaf71a187e863c2e6995e90ae4cd8f3eb9f70" exitCode=0 Jul 11 23:57:53.476247 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:53.475927 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phxwk" event={"ID":"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525","Type":"ContainerDied","Data":"6ca0fe4bb403f8554b46b92c1efdaf71a187e863c2e6995e90ae4cd8f3eb9f70"} Jul 11 23:57:54.330338 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:54.330312 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:54.330480 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:54.330403 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjtrj" podUID="7759c22b-76ac-44de-a812-a82cf40941eb" Jul 11 23:57:54.481792 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:54.481766 2564 generic.go:356] "Generic (PLEG): container finished" podID="7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525" containerID="38191971b2d0483139e3b1a542ed0205b6d4f1c2c827351142cf78faa055676e" exitCode=0 Jul 11 23:57:54.482141 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:54.481829 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phxwk" event={"ID":"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525","Type":"ContainerDied","Data":"38191971b2d0483139e3b1a542ed0205b6d4f1c2c827351142cf78faa055676e"} Jul 11 23:57:55.330073 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:55.330043 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:55.330235 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:55.330083 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:55.330235 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:55.330174 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8fwq" podUID="0295efe1-26fd-416f-a532-86a675acc31f" Jul 11 23:57:55.330308 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:55.330266 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dpdn" podUID="a15f85da-2145-459f-8445-82ec38f243b7" Jul 11 23:57:55.487254 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:55.487221 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-phxwk" event={"ID":"7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525","Type":"ContainerStarted","Data":"0beb9500cb45f60c9ede2036bfb5885551558f4df8916d6bfa5f92ce1af51eb0"} Jul 11 23:57:55.508902 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:55.508863 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-phxwk" podStartSLOduration=9.246113904 podStartE2EDuration="38.508850235s" totalImagesPullingTime="29.262736331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:57:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:57:55.508680082 +0000 UTC m=+38.684476719" watchObservedRunningTime="2026-07-11 23:57:55.508850235 +0000 UTC m=+38.684646872" Jul 11 23:57:56.330392 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:56.330365 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:56.330545 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:56.330468 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjtrj" podUID="7759c22b-76ac-44de-a812-a82cf40941eb" Jul 11 23:57:57.330679 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:57.330650 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:57.331235 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:57.330735 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dpdn" podUID="a15f85da-2145-459f-8445-82ec38f243b7" Jul 11 23:57:57.331235 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:57.330833 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:57.331235 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:57.330978 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8fwq" podUID="0295efe1-26fd-416f-a532-86a675acc31f" Jul 11 23:57:58.330166 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:58.330136 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:57:58.330332 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:58.330247 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjtrj" podUID="7759c22b-76ac-44de-a812-a82cf40941eb" Jul 11 23:57:59.330515 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:59.330486 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:57:59.330515 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:57:59.330501 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:57:59.330961 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:59.330578 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dpdn" podUID="a15f85da-2145-459f-8445-82ec38f243b7" Jul 11 23:57:59.330961 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:57:59.330718 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8fwq" podUID="0295efe1-26fd-416f-a532-86a675acc31f" Jul 11 23:58:00.330190 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:00.330166 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:58:00.330342 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:58:00.330254 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjtrj" podUID="7759c22b-76ac-44de-a812-a82cf40941eb" Jul 11 23:58:01.330180 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:01.330149 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:58:01.330180 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:01.330173 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:58:01.330607 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:58:01.330250 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dpdn" podUID="a15f85da-2145-459f-8445-82ec38f243b7" Jul 11 23:58:01.330607 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:58:01.330354 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8fwq" podUID="0295efe1-26fd-416f-a532-86a675acc31f" Jul 11 23:58:02.109056 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:02.108809 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2dpdn"] Jul 11 23:58:02.109383 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:02.109165 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:58:02.109383 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:58:02.109275 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dpdn" podUID="a15f85da-2145-459f-8445-82ec38f243b7" Jul 11 23:58:02.111513 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:02.111486 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r8fwq"] Jul 11 23:58:02.111628 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:02.111577 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:58:02.111687 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:58:02.111657 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8fwq" podUID="0295efe1-26fd-416f-a532-86a675acc31f" Jul 11 23:58:02.112153 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:02.112129 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cjtrj"] Jul 11 23:58:02.112254 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:02.112212 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:58:02.112321 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:58:02.112300 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjtrj" podUID="7759c22b-76ac-44de-a812-a82cf40941eb" Jul 11 23:58:03.330300 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:03.330271 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:58:03.330739 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:58:03.330377 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjtrj" podUID="7759c22b-76ac-44de-a812-a82cf40941eb" Jul 11 23:58:03.330739 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:03.330432 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:58:03.330739 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:58:03.330506 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8fwq" podUID="0295efe1-26fd-416f-a532-86a675acc31f" Jul 11 23:58:04.330060 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:04.330029 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:58:04.330246 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:58:04.330165 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dpdn" podUID="a15f85da-2145-459f-8445-82ec38f243b7" Jul 11 23:58:05.330777 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:05.330749 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:58:05.331228 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:05.330747 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:58:05.331228 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:58:05.330877 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cjtrj" podUID="7759c22b-76ac-44de-a812-a82cf40941eb" Jul 11 23:58:05.331228 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:58:05.330934 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r8fwq" podUID="0295efe1-26fd-416f-a532-86a675acc31f" Jul 11 23:58:06.330029 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.329999 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:58:06.330196 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:58:06.330097 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2dpdn" podUID="a15f85da-2145-459f-8445-82ec38f243b7" Jul 11 23:58:06.637399 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.637338 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeReady" Jul 11 23:58:06.637721 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.637450 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 11 23:58:06.679540 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.679509 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-s4jhn"] Jul 11 23:58:06.702873 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.702851 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-f8z6q"] Jul 11 23:58:06.702994 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.702971 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s4jhn" Jul 11 23:58:06.705386 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.705359 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 11 23:58:06.705386 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.705368 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 11 23:58:06.705571 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.705465 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 11 23:58:06.705653 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.705639 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f56l4\"" Jul 11 23:58:06.705703 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.705655 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 11 23:58:06.720994 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.720976 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s4jhn"] Jul 11 23:58:06.721074 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.721008 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f8z6q"] Jul 11 23:58:06.721074 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.721069 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f8z6q" Jul 11 23:58:06.723330 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.723313 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 11 23:58:06.723474 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.723457 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 11 23:58:06.723591 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.723581 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 11 23:58:06.723657 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.723641 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xw7sj\"" Jul 11 23:58:06.782323 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.782299 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tmx6h"] Jul 11 23:58:06.799029 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.799009 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tmx6h"] Jul 11 23:58:06.799131 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.799095 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tmx6h" Jul 11 23:58:06.801401 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.801383 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 11 23:58:06.801401 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.801400 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 11 23:58:06.801543 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.801476 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pcsfw\"" Jul 11 23:58:06.835263 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.835238 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38b3a226-3fad-4685-9361-ab9ea0688ac2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s4jhn\" (UID: \"38b3a226-3fad-4685-9361-ab9ea0688ac2\") " pod="openshift-insights/insights-runtime-extractor-s4jhn" Jul 11 23:58:06.835362 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.835268 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6q6x\" (UniqueName: \"kubernetes.io/projected/38b3a226-3fad-4685-9361-ab9ea0688ac2-kube-api-access-t6q6x\") pod \"insights-runtime-extractor-s4jhn\" (UID: \"38b3a226-3fad-4685-9361-ab9ea0688ac2\") " pod="openshift-insights/insights-runtime-extractor-s4jhn" Jul 11 23:58:06.835362 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.835310 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/38b3a226-3fad-4685-9361-ab9ea0688ac2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s4jhn\" (UID: \"38b3a226-3fad-4685-9361-ab9ea0688ac2\") " pod="openshift-insights/insights-runtime-extractor-s4jhn" Jul 11 23:58:06.835438 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.835376 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bbc60d51-642d-40a2-bb34-b6617178b718-cert\") pod \"ingress-canary-f8z6q\" (UID: \"bbc60d51-642d-40a2-bb34-b6617178b718\") " pod="openshift-ingress-canary/ingress-canary-f8z6q" Jul 11 23:58:06.835438 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.835405 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gznng\" (UniqueName: \"kubernetes.io/projected/bbc60d51-642d-40a2-bb34-b6617178b718-kube-api-access-gznng\") pod \"ingress-canary-f8z6q\" (UID: \"bbc60d51-642d-40a2-bb34-b6617178b718\") " pod="openshift-ingress-canary/ingress-canary-f8z6q" Jul 11 23:58:06.835438 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.835432 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/38b3a226-3fad-4685-9361-ab9ea0688ac2-crio-socket\") pod \"insights-runtime-extractor-s4jhn\" (UID: \"38b3a226-3fad-4685-9361-ab9ea0688ac2\") " pod="openshift-insights/insights-runtime-extractor-s4jhn" Jul 11 23:58:06.835555 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.835463 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/38b3a226-3fad-4685-9361-ab9ea0688ac2-data-volume\") pod \"insights-runtime-extractor-s4jhn\" (UID: \"38b3a226-3fad-4685-9361-ab9ea0688ac2\") " pod="openshift-insights/insights-runtime-extractor-s4jhn" Jul 11 23:58:06.936586 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.936567 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c572ec5d-e507-4720-bc4c-13308d59b739-tmp-dir\") pod \"dns-default-tmx6h\" (UID: \"c572ec5d-e507-4720-bc4c-13308d59b739\") " pod="openshift-dns/dns-default-tmx6h" Jul 11 23:58:06.936656 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.936607 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bbc60d51-642d-40a2-bb34-b6617178b718-cert\") pod \"ingress-canary-f8z6q\" (UID: \"bbc60d51-642d-40a2-bb34-b6617178b718\") " pod="openshift-ingress-canary/ingress-canary-f8z6q" Jul 11 23:58:06.936656 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.936623 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gznng\" (UniqueName: \"kubernetes.io/projected/bbc60d51-642d-40a2-bb34-b6617178b718-kube-api-access-gznng\") pod \"ingress-canary-f8z6q\" (UID: \"bbc60d51-642d-40a2-bb34-b6617178b718\") " pod="openshift-ingress-canary/ingress-canary-f8z6q" Jul 11 23:58:06.936656 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.936647 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/38b3a226-3fad-4685-9361-ab9ea0688ac2-crio-socket\") pod \"insights-runtime-extractor-s4jhn\" (UID: \"38b3a226-3fad-4685-9361-ab9ea0688ac2\") " pod="openshift-insights/insights-runtime-extractor-s4jhn" Jul 11 23:58:06.936778 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.936679 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/38b3a226-3fad-4685-9361-ab9ea0688ac2-data-volume\") pod \"insights-runtime-extractor-s4jhn\" (UID: \"38b3a226-3fad-4685-9361-ab9ea0688ac2\") " pod="openshift-insights/insights-runtime-extractor-s4jhn" Jul 11 23:58:06.936778 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.936695 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5k8t\" (UniqueName: \"kubernetes.io/projected/c572ec5d-e507-4720-bc4c-13308d59b739-kube-api-access-j5k8t\") pod \"dns-default-tmx6h\" (UID: \"c572ec5d-e507-4720-bc4c-13308d59b739\") " pod="openshift-dns/dns-default-tmx6h" Jul 11 23:58:06.936778 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.936711 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38b3a226-3fad-4685-9361-ab9ea0688ac2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s4jhn\" (UID: \"38b3a226-3fad-4685-9361-ab9ea0688ac2\") " pod="openshift-insights/insights-runtime-extractor-s4jhn" Jul 11 23:58:06.936924 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.936798 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6q6x\" (UniqueName: \"kubernetes.io/projected/38b3a226-3fad-4685-9361-ab9ea0688ac2-kube-api-access-t6q6x\") pod \"insights-runtime-extractor-s4jhn\" (UID: \"38b3a226-3fad-4685-9361-ab9ea0688ac2\") " pod="openshift-insights/insights-runtime-extractor-s4jhn" Jul 11 23:58:06.936924 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.936848 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c572ec5d-e507-4720-bc4c-13308d59b739-metrics-tls\") pod \"dns-default-tmx6h\" (UID: \"c572ec5d-e507-4720-bc4c-13308d59b739\") " pod="openshift-dns/dns-default-tmx6h" Jul 11 23:58:06.936924 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.936882 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c572ec5d-e507-4720-bc4c-13308d59b739-config-volume\") pod \"dns-default-tmx6h\" (UID: \"c572ec5d-e507-4720-bc4c-13308d59b739\") " pod="openshift-dns/dns-default-tmx6h" Jul 11 23:58:06.937057 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.936927 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/38b3a226-3fad-4685-9361-ab9ea0688ac2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s4jhn\" (UID: \"38b3a226-3fad-4685-9361-ab9ea0688ac2\") " pod="openshift-insights/insights-runtime-extractor-s4jhn" Jul 11 23:58:06.937057 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.936961 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/38b3a226-3fad-4685-9361-ab9ea0688ac2-data-volume\") pod \"insights-runtime-extractor-s4jhn\" (UID: \"38b3a226-3fad-4685-9361-ab9ea0688ac2\") " pod="openshift-insights/insights-runtime-extractor-s4jhn" Jul 11 23:58:06.937057 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.936969 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/38b3a226-3fad-4685-9361-ab9ea0688ac2-crio-socket\") pod \"insights-runtime-extractor-s4jhn\" (UID: \"38b3a226-3fad-4685-9361-ab9ea0688ac2\") " pod="openshift-insights/insights-runtime-extractor-s4jhn" Jul 11 23:58:06.937418 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.937399 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/38b3a226-3fad-4685-9361-ab9ea0688ac2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s4jhn\" (UID: \"38b3a226-3fad-4685-9361-ab9ea0688ac2\") " pod="openshift-insights/insights-runtime-extractor-s4jhn" Jul 11 23:58:06.940547 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.940523 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bbc60d51-642d-40a2-bb34-b6617178b718-cert\") pod \"ingress-canary-f8z6q\" (UID: \"bbc60d51-642d-40a2-bb34-b6617178b718\") " pod="openshift-ingress-canary/ingress-canary-f8z6q" Jul 11 23:58:06.940547 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.940542 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/38b3a226-3fad-4685-9361-ab9ea0688ac2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s4jhn\" (UID: \"38b3a226-3fad-4685-9361-ab9ea0688ac2\") " pod="openshift-insights/insights-runtime-extractor-s4jhn" Jul 11 23:58:06.944282 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.944262 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6q6x\" (UniqueName: \"kubernetes.io/projected/38b3a226-3fad-4685-9361-ab9ea0688ac2-kube-api-access-t6q6x\") pod \"insights-runtime-extractor-s4jhn\" (UID: \"38b3a226-3fad-4685-9361-ab9ea0688ac2\") " pod="openshift-insights/insights-runtime-extractor-s4jhn" Jul 11 23:58:06.944616 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:06.944589 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gznng\" (UniqueName: \"kubernetes.io/projected/bbc60d51-642d-40a2-bb34-b6617178b718-kube-api-access-gznng\") pod \"ingress-canary-f8z6q\" (UID: \"bbc60d51-642d-40a2-bb34-b6617178b718\") " pod="openshift-ingress-canary/ingress-canary-f8z6q" Jul 11 23:58:07.011802 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:07.011781 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s4jhn" Jul 11 23:58:07.028902 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:07.028885 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f8z6q" Jul 11 23:58:07.038209 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:07.038189 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c572ec5d-e507-4720-bc4c-13308d59b739-metrics-tls\") pod \"dns-default-tmx6h\" (UID: \"c572ec5d-e507-4720-bc4c-13308d59b739\") " pod="openshift-dns/dns-default-tmx6h" Jul 11 23:58:07.038279 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:07.038223 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c572ec5d-e507-4720-bc4c-13308d59b739-config-volume\") pod \"dns-default-tmx6h\" (UID: \"c572ec5d-e507-4720-bc4c-13308d59b739\") " pod="openshift-dns/dns-default-tmx6h" Jul 11 23:58:07.038279 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:07.038258 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c572ec5d-e507-4720-bc4c-13308d59b739-tmp-dir\") pod \"dns-default-tmx6h\" (UID: \"c572ec5d-e507-4720-bc4c-13308d59b739\") " pod="openshift-dns/dns-default-tmx6h" Jul 11 23:58:07.038380 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:07.038334 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5k8t\" (UniqueName: \"kubernetes.io/projected/c572ec5d-e507-4720-bc4c-13308d59b739-kube-api-access-j5k8t\") pod \"dns-default-tmx6h\" (UID: \"c572ec5d-e507-4720-bc4c-13308d59b739\") " pod="openshift-dns/dns-default-tmx6h" Jul 11 23:58:07.038678 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:07.038651 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c572ec5d-e507-4720-bc4c-13308d59b739-tmp-dir\") pod \"dns-default-tmx6h\" (UID: \"c572ec5d-e507-4720-bc4c-13308d59b739\") " pod="openshift-dns/dns-default-tmx6h" Jul 11 23:58:07.038875 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:07.038858 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c572ec5d-e507-4720-bc4c-13308d59b739-config-volume\") pod \"dns-default-tmx6h\" (UID: \"c572ec5d-e507-4720-bc4c-13308d59b739\") " pod="openshift-dns/dns-default-tmx6h" Jul 11 23:58:07.040473 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:07.040455 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c572ec5d-e507-4720-bc4c-13308d59b739-metrics-tls\") pod \"dns-default-tmx6h\" (UID: \"c572ec5d-e507-4720-bc4c-13308d59b739\") " pod="openshift-dns/dns-default-tmx6h" Jul 11 23:58:07.046006 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:07.045981 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5k8t\" (UniqueName: \"kubernetes.io/projected/c572ec5d-e507-4720-bc4c-13308d59b739-kube-api-access-j5k8t\") pod \"dns-default-tmx6h\" (UID: \"c572ec5d-e507-4720-bc4c-13308d59b739\") " pod="openshift-dns/dns-default-tmx6h" Jul 11 23:58:07.107140 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:07.107091 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tmx6h" Jul 11 23:58:07.202799 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:07.202569 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f8z6q"] Jul 11 23:58:07.207206 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:58:07.207010 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbc60d51_642d_40a2_bb34_b6617178b718.slice/crio-8bf2acd74f831d083250dc4c132a53d0d7bf7d9525cdd94202a8c85a971192a1 WatchSource:0}: Error finding container 8bf2acd74f831d083250dc4c132a53d0d7bf7d9525cdd94202a8c85a971192a1: Status 404 returned error can't find the container with id 8bf2acd74f831d083250dc4c132a53d0d7bf7d9525cdd94202a8c85a971192a1 Jul 11 23:58:07.207557 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:07.207438 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s4jhn"] Jul 11 23:58:07.210974 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:58:07.210952 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38b3a226_3fad_4685_9361_ab9ea0688ac2.slice/crio-07e837a471fb7be829afebeab981a3380c34945fda183ca208d16b910ab508d9 WatchSource:0}: Error finding container 07e837a471fb7be829afebeab981a3380c34945fda183ca208d16b910ab508d9: Status 404 returned error can't find the container with id 07e837a471fb7be829afebeab981a3380c34945fda183ca208d16b910ab508d9 Jul 11 23:58:07.255388 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:07.255364 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tmx6h"] Jul 11 23:58:07.258739 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:58:07.258717 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc572ec5d_e507_4720_bc4c_13308d59b739.slice/crio-f3fce767ade26b69d91800923ff160f3bb231d05634d4fc7b9e8f0dfbe7991d5 WatchSource:0}: Error finding container f3fce767ade26b69d91800923ff160f3bb231d05634d4fc7b9e8f0dfbe7991d5: Status 404 returned error can't find the container with id f3fce767ade26b69d91800923ff160f3bb231d05634d4fc7b9e8f0dfbe7991d5 Jul 11 23:58:07.332824 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:07.332806 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:58:07.332942 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:07.332926 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:58:07.335512 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:07.335490 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sbvsd\"" Jul 11 23:58:07.335512 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:07.335497 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 11 23:58:07.335650 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:07.335632 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 11 23:58:07.335748 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:07.335731 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 11 23:58:07.336166 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:07.336153 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7t5sz\"" Jul 11 23:58:07.511947 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:07.511859 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tmx6h" event={"ID":"c572ec5d-e507-4720-bc4c-13308d59b739","Type":"ContainerStarted","Data":"f3fce767ade26b69d91800923ff160f3bb231d05634d4fc7b9e8f0dfbe7991d5"} Jul 11 23:58:07.512866 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:07.512837 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f8z6q" event={"ID":"bbc60d51-642d-40a2-bb34-b6617178b718","Type":"ContainerStarted","Data":"8bf2acd74f831d083250dc4c132a53d0d7bf7d9525cdd94202a8c85a971192a1"} Jul 11 23:58:07.513822 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:07.513800 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s4jhn" event={"ID":"38b3a226-3fad-4685-9361-ab9ea0688ac2","Type":"ContainerStarted","Data":"07e837a471fb7be829afebeab981a3380c34945fda183ca208d16b910ab508d9"} Jul 11 23:58:08.330519 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:08.330141 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:58:08.332834 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:08.332598 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 11 23:58:12.295718 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:12.295687 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rmgt9"] Jul 11 23:58:12.297807 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:12.297786 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rmgt9" Jul 11 23:58:12.300145 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:12.300126 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 11 23:58:12.300259 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:12.300129 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xbtnh\"" Jul 11 23:58:12.308179 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:12.308154 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rmgt9"] Jul 11 23:58:12.379144 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:12.379118 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/861636f5-b3e5-499d-802e-2d956e9c6f46-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-rmgt9\" (UID: \"861636f5-b3e5-499d-802e-2d956e9c6f46\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rmgt9" Jul 11 23:58:12.479797 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:12.479764 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/861636f5-b3e5-499d-802e-2d956e9c6f46-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-rmgt9\" (UID: \"861636f5-b3e5-499d-802e-2d956e9c6f46\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rmgt9" Jul 11 23:58:12.483900 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:12.483860 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/861636f5-b3e5-499d-802e-2d956e9c6f46-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-rmgt9\" (UID: \"861636f5-b3e5-499d-802e-2d956e9c6f46\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rmgt9" Jul 11 23:58:12.612848 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:12.612826 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rmgt9" Jul 11 23:58:12.779680 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:12.779420 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rmgt9"] Jul 11 23:58:12.784463 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:58:12.784420 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod861636f5_b3e5_499d_802e_2d956e9c6f46.slice/crio-5aa80d0dd249a43aced172bb69d4cbc042b821a419d8698d5ba999db2c05001b WatchSource:0}: Error finding container 5aa80d0dd249a43aced172bb69d4cbc042b821a419d8698d5ba999db2c05001b: Status 404 returned error can't find the container with id 5aa80d0dd249a43aced172bb69d4cbc042b821a419d8698d5ba999db2c05001b Jul 11 23:58:13.534254 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.534168 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tmx6h" event={"ID":"c572ec5d-e507-4720-bc4c-13308d59b739","Type":"ContainerStarted","Data":"ede60d16cbb19f73c60c1383eab032f8298f1145968b4d9876e39c9ab754f009"} Jul 11 23:58:13.534254 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.534236 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tmx6h" event={"ID":"c572ec5d-e507-4720-bc4c-13308d59b739","Type":"ContainerStarted","Data":"7c8fe7272e2925225d7914bfbb4cff4ddcb53dd67af7a22a6637d08a957ee0b3"} Jul 11 23:58:13.534880 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.534290 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tmx6h" Jul 11 23:58:13.535975 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.535951 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f8z6q" event={"ID":"bbc60d51-642d-40a2-bb34-b6617178b718","Type":"ContainerStarted","Data":"70616b0bea78023ab0b0d907775a2bcf3565e7c2ab75cc5133e426676566651e"} Jul 11 23:58:13.537328 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.537301 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rmgt9" event={"ID":"861636f5-b3e5-499d-802e-2d956e9c6f46","Type":"ContainerStarted","Data":"5aa80d0dd249a43aced172bb69d4cbc042b821a419d8698d5ba999db2c05001b"} Jul 11 23:58:13.539082 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.539053 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s4jhn" event={"ID":"38b3a226-3fad-4685-9361-ab9ea0688ac2","Type":"ContainerStarted","Data":"9afa94dbd1846e0e45cea242c4d6aa196b86c5f373ed1e63f70481b586783bc7"} Jul 11 23:58:13.539235 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.539124 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s4jhn" event={"ID":"38b3a226-3fad-4685-9361-ab9ea0688ac2","Type":"ContainerStarted","Data":"6e69e8aa3c217d843854b68f9e224f49ceaba4bdf4ee08b23eacea850c7141b7"} Jul 11 23:58:13.550201 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.550157 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tmx6h" podStartSLOduration=2.256855954 podStartE2EDuration="7.550140212s" totalImagesPullingTime="5.293284258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:58:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:13.549030744 +0000 UTC m=+56.724827381" watchObservedRunningTime="2026-07-11 23:58:13.550140212 +0000 UTC m=+56.725936846" Jul 11 23:58:13.562576 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.562501 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-f8z6q" podStartSLOduration=2.198806422 podStartE2EDuration="7.562482751s" totalImagesPullingTime="5.363676329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:58:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:13.562249808 +0000 UTC m=+56.738046445" watchObservedRunningTime="2026-07-11 23:58:13.562482751 +0000 UTC m=+56.738279368" Jul 11 23:58:13.792159 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.791946 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74bc586ff-mgg5q"] Jul 11 23:58:13.793834 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.793805 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:58:13.796404 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.796383 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tjm2k\"" Jul 11 23:58:13.796735 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.796652 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 11 23:58:13.796867 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.796829 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 11 23:58:13.796936 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.796889 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 11 23:58:13.796936 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.796907 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 11 23:58:13.796936 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.796916 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 11 23:58:13.797466 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.797341 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 11 23:58:13.797585 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.797569 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 11 23:58:13.802473 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.802455 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 11 23:58:13.809918 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.809893 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74bc586ff-mgg5q"] Jul 11 23:58:13.890344 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.890289 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3021087f-e6ae-4e92-b22e-c531602a1341-console-oauth-config\") pod \"console-74bc586ff-mgg5q\" (UID: \"3021087f-e6ae-4e92-b22e-c531602a1341\") " pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:58:13.890344 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.890332 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3021087f-e6ae-4e92-b22e-c531602a1341-console-serving-cert\") pod \"console-74bc586ff-mgg5q\" (UID: \"3021087f-e6ae-4e92-b22e-c531602a1341\") " pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:58:13.890513 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.890360 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3021087f-e6ae-4e92-b22e-c531602a1341-console-config\") pod \"console-74bc586ff-mgg5q\" (UID: \"3021087f-e6ae-4e92-b22e-c531602a1341\") " pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:58:13.890513 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.890382 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3021087f-e6ae-4e92-b22e-c531602a1341-service-ca\") pod \"console-74bc586ff-mgg5q\" (UID: \"3021087f-e6ae-4e92-b22e-c531602a1341\") " pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:58:13.890513 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.890448 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3021087f-e6ae-4e92-b22e-c531602a1341-oauth-serving-cert\") pod \"console-74bc586ff-mgg5q\" (UID: \"3021087f-e6ae-4e92-b22e-c531602a1341\") " pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:58:13.890513 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.890480 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3021087f-e6ae-4e92-b22e-c531602a1341-trusted-ca-bundle\") pod \"console-74bc586ff-mgg5q\" (UID: \"3021087f-e6ae-4e92-b22e-c531602a1341\") " pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:58:13.890513 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.890506 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cms9t\" (UniqueName: \"kubernetes.io/projected/3021087f-e6ae-4e92-b22e-c531602a1341-kube-api-access-cms9t\") pod \"console-74bc586ff-mgg5q\" (UID: \"3021087f-e6ae-4e92-b22e-c531602a1341\") " pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:58:13.991383 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.991351 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3021087f-e6ae-4e92-b22e-c531602a1341-console-config\") pod \"console-74bc586ff-mgg5q\" (UID: \"3021087f-e6ae-4e92-b22e-c531602a1341\") " pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:58:13.991522 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.991389 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3021087f-e6ae-4e92-b22e-c531602a1341-service-ca\") pod \"console-74bc586ff-mgg5q\" (UID: \"3021087f-e6ae-4e92-b22e-c531602a1341\") " pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:58:13.991522 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.991427 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3021087f-e6ae-4e92-b22e-c531602a1341-oauth-serving-cert\") pod \"console-74bc586ff-mgg5q\" (UID: \"3021087f-e6ae-4e92-b22e-c531602a1341\") " pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:58:13.991522 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.991477 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3021087f-e6ae-4e92-b22e-c531602a1341-trusted-ca-bundle\") pod \"console-74bc586ff-mgg5q\" (UID: \"3021087f-e6ae-4e92-b22e-c531602a1341\") " pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:58:13.991522 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.991503 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cms9t\" (UniqueName: \"kubernetes.io/projected/3021087f-e6ae-4e92-b22e-c531602a1341-kube-api-access-cms9t\") pod \"console-74bc586ff-mgg5q\" (UID: \"3021087f-e6ae-4e92-b22e-c531602a1341\") " pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:58:13.991715 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.991598 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3021087f-e6ae-4e92-b22e-c531602a1341-console-oauth-config\") pod \"console-74bc586ff-mgg5q\" (UID: \"3021087f-e6ae-4e92-b22e-c531602a1341\") " pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:58:13.991715 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.991626 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3021087f-e6ae-4e92-b22e-c531602a1341-console-serving-cert\") pod \"console-74bc586ff-mgg5q\" (UID: \"3021087f-e6ae-4e92-b22e-c531602a1341\") " pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:58:13.992213 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.992189 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3021087f-e6ae-4e92-b22e-c531602a1341-console-config\") pod \"console-74bc586ff-mgg5q\" (UID: \"3021087f-e6ae-4e92-b22e-c531602a1341\") " pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:58:13.992213 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.992204 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3021087f-e6ae-4e92-b22e-c531602a1341-service-ca\") pod \"console-74bc586ff-mgg5q\" (UID: \"3021087f-e6ae-4e92-b22e-c531602a1341\") " pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:58:13.992213 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.992211 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3021087f-e6ae-4e92-b22e-c531602a1341-oauth-serving-cert\") pod \"console-74bc586ff-mgg5q\" (UID: \"3021087f-e6ae-4e92-b22e-c531602a1341\") " pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:58:13.992546 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.992526 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3021087f-e6ae-4e92-b22e-c531602a1341-trusted-ca-bundle\") pod \"console-74bc586ff-mgg5q\" (UID: \"3021087f-e6ae-4e92-b22e-c531602a1341\") " pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:58:13.996464 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.996249 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3021087f-e6ae-4e92-b22e-c531602a1341-console-oauth-config\") pod \"console-74bc586ff-mgg5q\" (UID: \"3021087f-e6ae-4e92-b22e-c531602a1341\") " pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:58:13.996464 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.996289 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3021087f-e6ae-4e92-b22e-c531602a1341-console-serving-cert\") pod \"console-74bc586ff-mgg5q\" (UID: \"3021087f-e6ae-4e92-b22e-c531602a1341\") " pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:58:13.999384 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:13.999361 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cms9t\" (UniqueName: \"kubernetes.io/projected/3021087f-e6ae-4e92-b22e-c531602a1341-kube-api-access-cms9t\") pod \"console-74bc586ff-mgg5q\" (UID: \"3021087f-e6ae-4e92-b22e-c531602a1341\") " pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:58:14.105079 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:14.105011 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:58:14.241416 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:14.241385 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74bc586ff-mgg5q"] Jul 11 23:58:14.244357 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:58:14.244327 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3021087f_e6ae_4e92_b22e_c531602a1341.slice/crio-b723b359e7c6d1bc93f3ff9799db79ca4d60d35f98771d39e108d4a2f0b4e7f8 WatchSource:0}: Error finding container b723b359e7c6d1bc93f3ff9799db79ca4d60d35f98771d39e108d4a2f0b4e7f8: Status 404 returned error can't find the container with id b723b359e7c6d1bc93f3ff9799db79ca4d60d35f98771d39e108d4a2f0b4e7f8 Jul 11 23:58:14.544751 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:14.544713 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rmgt9" event={"ID":"861636f5-b3e5-499d-802e-2d956e9c6f46","Type":"ContainerStarted","Data":"d7628087d7e4d3a1c5adfe23150a5b644c17392e6983f24fcfde35c9130fb370"} Jul 11 23:58:14.545178 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:14.544921 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rmgt9" Jul 11 23:58:14.546662 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:14.546637 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74bc586ff-mgg5q" event={"ID":"3021087f-e6ae-4e92-b22e-c531602a1341","Type":"ContainerStarted","Data":"b723b359e7c6d1bc93f3ff9799db79ca4d60d35f98771d39e108d4a2f0b4e7f8"} Jul 11 23:58:14.550350 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:14.550327 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rmgt9" Jul 11 23:58:14.559744 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:14.559701 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-rmgt9" podStartSLOduration=1.671332396 podStartE2EDuration="2.559686193s" totalImagesPullingTime="888.353797ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:58:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:14.558530499 +0000 UTC m=+57.734327137" watchObservedRunningTime="2026-07-11 23:58:14.559686193 +0000 UTC m=+57.735482830" Jul 11 23:58:15.346489 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:15.346456 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-dqq4k"] Jul 11 23:58:15.352047 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:15.352026 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-dqq4k" Jul 11 23:58:15.354284 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:15.354247 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 11 23:58:15.354284 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:15.354264 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 11 23:58:15.355548 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:15.355323 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-v7tbs\"" Jul 11 23:58:15.355548 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:15.355366 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 11 23:58:15.356356 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:15.355946 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 11 23:58:15.356356 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:15.356214 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 11 23:58:15.364547 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:15.364526 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-dqq4k"] Jul 11 23:58:15.402837 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:15.402708 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ffe969c-2596-410b-a64a-b5228a50c7d8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-dqq4k\" (UID: \"1ffe969c-2596-410b-a64a-b5228a50c7d8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dqq4k" Jul 11 23:58:15.402837 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:15.402763 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ffe969c-2596-410b-a64a-b5228a50c7d8-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-dqq4k\" (UID: \"1ffe969c-2596-410b-a64a-b5228a50c7d8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dqq4k" Jul 11 23:58:15.403040 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:15.402849 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ffe969c-2596-410b-a64a-b5228a50c7d8-metrics-client-ca\") pod \"prometheus-operator-64785b6675-dqq4k\" (UID: \"1ffe969c-2596-410b-a64a-b5228a50c7d8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dqq4k" Jul 11 23:58:15.403040 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:15.402944 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qcqm\" (UniqueName: \"kubernetes.io/projected/1ffe969c-2596-410b-a64a-b5228a50c7d8-kube-api-access-9qcqm\") pod \"prometheus-operator-64785b6675-dqq4k\" (UID: \"1ffe969c-2596-410b-a64a-b5228a50c7d8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dqq4k" Jul 11 23:58:15.504017 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:15.503792 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ffe969c-2596-410b-a64a-b5228a50c7d8-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-dqq4k\" (UID: \"1ffe969c-2596-410b-a64a-b5228a50c7d8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dqq4k" Jul 11 23:58:15.504017 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:15.503868 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ffe969c-2596-410b-a64a-b5228a50c7d8-metrics-client-ca\") pod \"prometheus-operator-64785b6675-dqq4k\" (UID: \"1ffe969c-2596-410b-a64a-b5228a50c7d8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dqq4k" Jul 11 23:58:15.504017 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:15.503939 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qcqm\" (UniqueName: \"kubernetes.io/projected/1ffe969c-2596-410b-a64a-b5228a50c7d8-kube-api-access-9qcqm\") pod \"prometheus-operator-64785b6675-dqq4k\" (UID: \"1ffe969c-2596-410b-a64a-b5228a50c7d8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dqq4k" Jul 11 23:58:15.504017 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:15.503976 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ffe969c-2596-410b-a64a-b5228a50c7d8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-dqq4k\" (UID: \"1ffe969c-2596-410b-a64a-b5228a50c7d8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dqq4k" Jul 11 23:58:15.504360 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:58:15.504076 2564 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 11 23:58:15.504360 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:58:15.504171 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ffe969c-2596-410b-a64a-b5228a50c7d8-prometheus-operator-tls podName:1ffe969c-2596-410b-a64a-b5228a50c7d8 nodeName:}" failed. No retries permitted until 2026-07-11 23:58:16.004148806 +0000 UTC m=+59.179945434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/1ffe969c-2596-410b-a64a-b5228a50c7d8-prometheus-operator-tls") pod "prometheus-operator-64785b6675-dqq4k" (UID: "1ffe969c-2596-410b-a64a-b5228a50c7d8") : secret "prometheus-operator-tls" not found Jul 11 23:58:15.504783 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:15.504733 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ffe969c-2596-410b-a64a-b5228a50c7d8-metrics-client-ca\") pod \"prometheus-operator-64785b6675-dqq4k\" (UID: \"1ffe969c-2596-410b-a64a-b5228a50c7d8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dqq4k" Jul 11 23:58:15.506777 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:15.506750 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1ffe969c-2596-410b-a64a-b5228a50c7d8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-dqq4k\" (UID: \"1ffe969c-2596-410b-a64a-b5228a50c7d8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dqq4k" Jul 11 23:58:15.512413 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:15.512384 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qcqm\" (UniqueName: \"kubernetes.io/projected/1ffe969c-2596-410b-a64a-b5228a50c7d8-kube-api-access-9qcqm\") pod \"prometheus-operator-64785b6675-dqq4k\" (UID: \"1ffe969c-2596-410b-a64a-b5228a50c7d8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dqq4k" Jul 11 23:58:16.008029 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:16.007990 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ffe969c-2596-410b-a64a-b5228a50c7d8-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-dqq4k\" (UID: \"1ffe969c-2596-410b-a64a-b5228a50c7d8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dqq4k" Jul 11 23:58:16.010445 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:16.010420 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1ffe969c-2596-410b-a64a-b5228a50c7d8-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-dqq4k\" (UID: \"1ffe969c-2596-410b-a64a-b5228a50c7d8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-dqq4k" Jul 11 23:58:16.264355 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:16.264273 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-dqq4k" Jul 11 23:58:17.082086 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:17.082061 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-dqq4k"] Jul 11 23:58:17.085586 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:58:17.085563 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ffe969c_2596_410b_a64a_b5228a50c7d8.slice/crio-2bca4b3af320a8c9cfcd970301d219aadf133f0cc04e30f7d80e5cd615eff70f WatchSource:0}: Error finding container 2bca4b3af320a8c9cfcd970301d219aadf133f0cc04e30f7d80e5cd615eff70f: Status 404 returned error can't find the container with id 2bca4b3af320a8c9cfcd970301d219aadf133f0cc04e30f7d80e5cd615eff70f Jul 11 23:58:17.472715 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:17.472693 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xcdr8" Jul 11 23:58:17.560818 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:17.560779 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74bc586ff-mgg5q" event={"ID":"3021087f-e6ae-4e92-b22e-c531602a1341","Type":"ContainerStarted","Data":"3ecb95d0007f11ac40aa7911146fbd4e2d6e9618f6e932806ed8b4794ca15add"} Jul 11 23:58:17.563091 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:17.563047 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s4jhn" event={"ID":"38b3a226-3fad-4685-9361-ab9ea0688ac2","Type":"ContainerStarted","Data":"d02eae7827546900f372da0caa81c525b44b7e6f955fdc78160182a996738a95"} Jul 11 23:58:17.564478 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:17.564453 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-dqq4k" event={"ID":"1ffe969c-2596-410b-a64a-b5228a50c7d8","Type":"ContainerStarted","Data":"2bca4b3af320a8c9cfcd970301d219aadf133f0cc04e30f7d80e5cd615eff70f"} Jul 11 23:58:17.581819 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:17.581779 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74bc586ff-mgg5q" podStartSLOduration=1.8583309369999998 podStartE2EDuration="4.581766003s" totalImagesPullingTime="2.723435066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:17.581381975 +0000 UTC m=+60.757178623" watchObservedRunningTime="2026-07-11 23:58:17.581766003 +0000 UTC m=+60.757562639" Jul 11 23:58:17.599320 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:17.599280 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-s4jhn" podStartSLOduration=2.009070322 podStartE2EDuration="11.59926503s" totalImagesPullingTime="9.590194708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:58:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:17.599041127 +0000 UTC m=+60.774837777" watchObservedRunningTime="2026-07-11 23:58:17.59926503 +0000 UTC m=+60.775061669" Jul 11 23:58:19.573570 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:19.573524 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-dqq4k" event={"ID":"1ffe969c-2596-410b-a64a-b5228a50c7d8","Type":"ContainerStarted","Data":"f29cab15ddfa6ee2890ea45fb54088b626310fac8305ec8bbb5d5e41200c7f00"} Jul 11 23:58:19.573955 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:19.573582 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-dqq4k" event={"ID":"1ffe969c-2596-410b-a64a-b5228a50c7d8","Type":"ContainerStarted","Data":"7b976b368951002f7ccb869d7f1ccf69248667928e7a326dd20cc5199aa83437"} Jul 11 23:58:19.590476 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:19.590434 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-dqq4k" podStartSLOduration=3.124059893 podStartE2EDuration="4.590418949s" totalImagesPullingTime="1.466359056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:19.589024964 +0000 UTC m=+62.764821605" watchObservedRunningTime="2026-07-11 23:58:19.590418949 +0000 UTC m=+62.766215564" Jul 11 23:58:21.669327 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.669283 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-xsgt9"] Jul 11 23:58:21.671521 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.671503 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-xsgt9" Jul 11 23:58:21.673912 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.673883 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 11 23:58:21.673912 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.673897 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 11 23:58:21.674071 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.673940 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4zx4f\"" Jul 11 23:58:21.691482 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.691460 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-v2lbx"] Jul 11 23:58:21.693378 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.693359 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-xsgt9"] Jul 11 23:58:21.693501 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.693485 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-v2lbx" Jul 11 23:58:21.695901 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.695881 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 11 23:58:21.695991 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.695930 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 11 23:58:21.696441 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.696424 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-g26mk\"" Jul 11 23:58:21.696441 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.696432 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 11 23:58:21.702221 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.702204 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-984m4"] Jul 11 23:58:21.704015 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.704000 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:21.705832 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.705813 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-v2lbx"] Jul 11 23:58:21.706193 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.706168 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 11 23:58:21.706324 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.706304 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qbcvt\"" Jul 11 23:58:21.706397 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.706385 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 11 23:58:21.706458 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.706424 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 11 23:58:21.747980 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.747957 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2cb8a669-b3fa-4c26-a706-5dea8a445f17-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-v2lbx\" (UID: \"2cb8a669-b3fa-4c26-a706-5dea8a445f17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v2lbx" Jul 11 23:58:21.748140 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.747985 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-sys\") pod \"node-exporter-984m4\" (UID: \"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc\") " pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:21.748140 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.748005 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2cb8a669-b3fa-4c26-a706-5dea8a445f17-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-v2lbx\" (UID: \"2cb8a669-b3fa-4c26-a706-5dea8a445f17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v2lbx" Jul 11 23:58:21.748140 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.748020 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-root\") pod \"node-exporter-984m4\" (UID: \"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc\") " pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:21.748140 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.748070 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-node-exporter-accelerators-collector-config\") pod \"node-exporter-984m4\" (UID: \"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc\") " pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:21.748140 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.748120 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-metrics-client-ca\") pod \"node-exporter-984m4\" (UID: \"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc\") " pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:21.748399 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.748189 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f91c62dd-4916-4142-b0df-68e7e49c9bd1-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-xsgt9\" (UID: \"f91c62dd-4916-4142-b0df-68e7e49c9bd1\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-xsgt9" Jul 11 23:58:21.748399 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.748214 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-984m4\" (UID: \"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc\") " pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:21.748399 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.748233 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-node-exporter-wtmp\") pod \"node-exporter-984m4\" (UID: \"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc\") " pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:21.748399 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.748251 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f91c62dd-4916-4142-b0df-68e7e49c9bd1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-xsgt9\" (UID: \"f91c62dd-4916-4142-b0df-68e7e49c9bd1\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-xsgt9" Jul 11 23:58:21.748399 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.748268 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-node-exporter-tls\") pod \"node-exporter-984m4\" (UID: \"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc\") " pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:21.748399 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.748285 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xphhr\" (UniqueName: \"kubernetes.io/projected/2cb8a669-b3fa-4c26-a706-5dea8a445f17-kube-api-access-xphhr\") pod \"kube-state-metrics-785778ff74-v2lbx\" (UID: \"2cb8a669-b3fa-4c26-a706-5dea8a445f17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v2lbx" Jul 11 23:58:21.748399 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.748303 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2cb8a669-b3fa-4c26-a706-5dea8a445f17-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-v2lbx\" (UID: \"2cb8a669-b3fa-4c26-a706-5dea8a445f17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v2lbx" Jul 11 23:58:21.748399 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.748319 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9bfl\" (UniqueName: \"kubernetes.io/projected/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-kube-api-access-z9bfl\") pod \"node-exporter-984m4\" (UID: \"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc\") " pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:21.748399 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.748349 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2cb8a669-b3fa-4c26-a706-5dea8a445f17-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-v2lbx\" (UID: \"2cb8a669-b3fa-4c26-a706-5dea8a445f17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v2lbx" Jul 11 23:58:21.748399 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.748363 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2cb8a669-b3fa-4c26-a706-5dea8a445f17-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-v2lbx\" (UID: \"2cb8a669-b3fa-4c26-a706-5dea8a445f17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v2lbx" Jul 11 23:58:21.748399 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.748395 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84wkv\" (UniqueName: \"kubernetes.io/projected/f91c62dd-4916-4142-b0df-68e7e49c9bd1-kube-api-access-84wkv\") pod \"openshift-state-metrics-84bd68b896-xsgt9\" (UID: \"f91c62dd-4916-4142-b0df-68e7e49c9bd1\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-xsgt9" Jul 11 23:58:21.748722 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.748415 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-node-exporter-textfile\") pod \"node-exporter-984m4\" (UID: \"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc\") " pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:21.748722 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.748430 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f91c62dd-4916-4142-b0df-68e7e49c9bd1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-xsgt9\" (UID: \"f91c62dd-4916-4142-b0df-68e7e49c9bd1\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-xsgt9" Jul 11 23:58:21.848813 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.848789 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84wkv\" (UniqueName: \"kubernetes.io/projected/f91c62dd-4916-4142-b0df-68e7e49c9bd1-kube-api-access-84wkv\") pod \"openshift-state-metrics-84bd68b896-xsgt9\" (UID: \"f91c62dd-4916-4142-b0df-68e7e49c9bd1\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-xsgt9" Jul 11 23:58:21.848917 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.848818 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-node-exporter-textfile\") pod \"node-exporter-984m4\" (UID: \"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc\") " pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:21.848917 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.848836 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f91c62dd-4916-4142-b0df-68e7e49c9bd1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-xsgt9\" (UID: \"f91c62dd-4916-4142-b0df-68e7e49c9bd1\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-xsgt9" Jul 11 23:58:21.848917 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.848855 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2cb8a669-b3fa-4c26-a706-5dea8a445f17-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-v2lbx\" (UID: \"2cb8a669-b3fa-4c26-a706-5dea8a445f17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v2lbx" Jul 11 23:58:21.849079 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.849056 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-sys\") pod \"node-exporter-984m4\" (UID: \"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc\") " pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:21.849159 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.849098 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2cb8a669-b3fa-4c26-a706-5dea8a445f17-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-v2lbx\" (UID: \"2cb8a669-b3fa-4c26-a706-5dea8a445f17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v2lbx" Jul 11 23:58:21.849159 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.849145 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-root\") pod \"node-exporter-984m4\" (UID: \"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc\") " pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:21.849266 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.849154 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-sys\") pod \"node-exporter-984m4\" (UID: \"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc\") " pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:21.849266 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.849197 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-root\") pod \"node-exporter-984m4\" (UID: \"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc\") " pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:21.849266 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.849216 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-node-exporter-textfile\") pod \"node-exporter-984m4\" (UID: \"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc\") " pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:21.849266 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.849228 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-node-exporter-accelerators-collector-config\") pod \"node-exporter-984m4\" (UID: \"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc\") " pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:21.849266 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.849257 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-metrics-client-ca\") pod \"node-exporter-984m4\" (UID: \"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc\") " pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:21.849516 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.849304 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f91c62dd-4916-4142-b0df-68e7e49c9bd1-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-xsgt9\" (UID: \"f91c62dd-4916-4142-b0df-68e7e49c9bd1\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-xsgt9" Jul 11 23:58:21.849516 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.849325 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-984m4\" (UID: \"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc\") " pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:21.849516 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.849353 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-node-exporter-wtmp\") pod \"node-exporter-984m4\" (UID: \"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc\") " pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:21.849516 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.849381 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f91c62dd-4916-4142-b0df-68e7e49c9bd1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-xsgt9\" (UID: \"f91c62dd-4916-4142-b0df-68e7e49c9bd1\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-xsgt9" Jul 11 23:58:21.849516 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.849398 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-node-exporter-tls\") pod \"node-exporter-984m4\" (UID: \"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc\") " pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:21.849516 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.849417 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xphhr\" (UniqueName: \"kubernetes.io/projected/2cb8a669-b3fa-4c26-a706-5dea8a445f17-kube-api-access-xphhr\") pod \"kube-state-metrics-785778ff74-v2lbx\" (UID: \"2cb8a669-b3fa-4c26-a706-5dea8a445f17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v2lbx" Jul 11 23:58:21.849516 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.849439 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2cb8a669-b3fa-4c26-a706-5dea8a445f17-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-v2lbx\" (UID: \"2cb8a669-b3fa-4c26-a706-5dea8a445f17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v2lbx" Jul 11 23:58:21.849516 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.849456 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9bfl\" (UniqueName: \"kubernetes.io/projected/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-kube-api-access-z9bfl\") pod \"node-exporter-984m4\" (UID: \"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc\") " pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:21.849516 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.849489 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2cb8a669-b3fa-4c26-a706-5dea8a445f17-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-v2lbx\" (UID: \"2cb8a669-b3fa-4c26-a706-5dea8a445f17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v2lbx" Jul 11 23:58:21.849972 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.849555 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2cb8a669-b3fa-4c26-a706-5dea8a445f17-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-v2lbx\" (UID: \"2cb8a669-b3fa-4c26-a706-5dea8a445f17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v2lbx" Jul 11 23:58:21.849972 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.849692 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2cb8a669-b3fa-4c26-a706-5dea8a445f17-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-v2lbx\" (UID: \"2cb8a669-b3fa-4c26-a706-5dea8a445f17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v2lbx" Jul 11 23:58:21.849972 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.849719 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-node-exporter-accelerators-collector-config\") pod \"node-exporter-984m4\" (UID: \"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc\") " pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:21.849972 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:58:21.849804 2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 11 23:58:21.849972 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.849815 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2cb8a669-b3fa-4c26-a706-5dea8a445f17-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-v2lbx\" (UID: \"2cb8a669-b3fa-4c26-a706-5dea8a445f17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v2lbx" Jul 11 23:58:21.849972 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.849839 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-metrics-client-ca\") pod \"node-exporter-984m4\" (UID: \"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc\") " pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:21.849972 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:58:21.849859 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-node-exporter-tls podName:5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc nodeName:}" failed. No retries permitted until 2026-07-11 23:58:22.349840808 +0000 UTC m=+65.525637441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-node-exporter-tls") pod "node-exporter-984m4" (UID: "5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc") : secret "node-exporter-tls" not found Jul 11 23:58:21.849972 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:58:21.849904 2564 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 11 23:58:21.849972 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:58:21.849964 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f91c62dd-4916-4142-b0df-68e7e49c9bd1-openshift-state-metrics-tls podName:f91c62dd-4916-4142-b0df-68e7e49c9bd1 nodeName:}" failed. No retries permitted until 2026-07-11 23:58:22.34994753 +0000 UTC m=+65.525744150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f91c62dd-4916-4142-b0df-68e7e49c9bd1-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-xsgt9" (UID: "f91c62dd-4916-4142-b0df-68e7e49c9bd1") : secret "openshift-state-metrics-tls" not found Jul 11 23:58:21.850430 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.850078 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-node-exporter-wtmp\") pod \"node-exporter-984m4\" (UID: \"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc\") " pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:21.850430 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.850374 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f91c62dd-4916-4142-b0df-68e7e49c9bd1-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-xsgt9\" (UID: \"f91c62dd-4916-4142-b0df-68e7e49c9bd1\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-xsgt9" Jul 11 23:58:21.850660 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.850644 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2cb8a669-b3fa-4c26-a706-5dea8a445f17-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-v2lbx\" (UID: \"2cb8a669-b3fa-4c26-a706-5dea8a445f17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v2lbx" Jul 11 23:58:21.851644 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.851623 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f91c62dd-4916-4142-b0df-68e7e49c9bd1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-xsgt9\" (UID: \"f91c62dd-4916-4142-b0df-68e7e49c9bd1\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-xsgt9" Jul 11 23:58:21.852364 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.852341 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-984m4\" (UID: \"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc\") " pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:21.852467 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.852433 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2cb8a669-b3fa-4c26-a706-5dea8a445f17-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-v2lbx\" (UID: \"2cb8a669-b3fa-4c26-a706-5dea8a445f17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v2lbx" Jul 11 23:58:21.852467 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.852446 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2cb8a669-b3fa-4c26-a706-5dea8a445f17-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-v2lbx\" (UID: \"2cb8a669-b3fa-4c26-a706-5dea8a445f17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v2lbx" Jul 11 23:58:21.858298 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.858266 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84wkv\" (UniqueName: \"kubernetes.io/projected/f91c62dd-4916-4142-b0df-68e7e49c9bd1-kube-api-access-84wkv\") pod \"openshift-state-metrics-84bd68b896-xsgt9\" (UID: \"f91c62dd-4916-4142-b0df-68e7e49c9bd1\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-xsgt9" Jul 11 23:58:21.860466 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.860446 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9bfl\" (UniqueName: \"kubernetes.io/projected/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-kube-api-access-z9bfl\") pod \"node-exporter-984m4\" (UID: \"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc\") " pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:21.862530 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:21.862511 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xphhr\" (UniqueName: \"kubernetes.io/projected/2cb8a669-b3fa-4c26-a706-5dea8a445f17-kube-api-access-xphhr\") pod \"kube-state-metrics-785778ff74-v2lbx\" (UID: \"2cb8a669-b3fa-4c26-a706-5dea8a445f17\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-v2lbx" Jul 11 23:58:22.002512 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.002492 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-v2lbx" Jul 11 23:58:22.123459 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.123431 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-v2lbx"] Jul 11 23:58:22.126345 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:58:22.126318 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cb8a669_b3fa_4c26_a706_5dea8a445f17.slice/crio-01594e77ac33499438893aa869b714913c8b3d03601dedd82ebaa99ab61150ce WatchSource:0}: Error finding container 01594e77ac33499438893aa869b714913c8b3d03601dedd82ebaa99ab61150ce: Status 404 returned error can't find the container with id 01594e77ac33499438893aa869b714913c8b3d03601dedd82ebaa99ab61150ce Jul 11 23:58:22.353272 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.353210 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f91c62dd-4916-4142-b0df-68e7e49c9bd1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-xsgt9\" (UID: \"f91c62dd-4916-4142-b0df-68e7e49c9bd1\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-xsgt9" Jul 11 23:58:22.353272 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.353241 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-node-exporter-tls\") pod \"node-exporter-984m4\" (UID: \"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc\") " pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:22.355624 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.355606 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc-node-exporter-tls\") pod \"node-exporter-984m4\" (UID: \"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc\") " pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:22.355786 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.355769 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f91c62dd-4916-4142-b0df-68e7e49c9bd1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-xsgt9\" (UID: \"f91c62dd-4916-4142-b0df-68e7e49c9bd1\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-xsgt9" Jul 11 23:58:22.580304 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.580270 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-xsgt9" Jul 11 23:58:22.584541 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.584510 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-v2lbx" event={"ID":"2cb8a669-b3fa-4c26-a706-5dea8a445f17","Type":"ContainerStarted","Data":"01594e77ac33499438893aa869b714913c8b3d03601dedd82ebaa99ab61150ce"} Jul 11 23:58:22.612948 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.612869 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-984m4" Jul 11 23:58:22.628273 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:58:22.628240 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e5cc3f1_b0cf_4116_9970_87e5a8eb92cc.slice/crio-956c55d430c872bcd74e6c082cdd2865fe5212ff56f1d4de0d36b34d88e742f7 WatchSource:0}: Error finding container 956c55d430c872bcd74e6c082cdd2865fe5212ff56f1d4de0d36b34d88e742f7: Status 404 returned error can't find the container with id 956c55d430c872bcd74e6c082cdd2865fe5212ff56f1d4de0d36b34d88e742f7 Jul 11 23:58:22.732241 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.732157 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-xsgt9"] Jul 11 23:58:22.736216 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:58:22.736189 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf91c62dd_4916_4142_b0df_68e7e49c9bd1.slice/crio-8a9823ae1082a745470127adfacc002e4e31b2a7b474fc681b4b41989c9a199b WatchSource:0}: Error finding container 8a9823ae1082a745470127adfacc002e4e31b2a7b474fc681b4b41989c9a199b: Status 404 returned error can't find the container with id 8a9823ae1082a745470127adfacc002e4e31b2a7b474fc681b4b41989c9a199b Jul 11 23:58:22.753978 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.753955 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 11 23:58:22.756872 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.756852 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.759857 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.759837 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 11 23:58:22.759956 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.759853 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 11 23:58:22.759956 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.759876 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2m2dn\"" Jul 11 23:58:22.759956 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.759905 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 11 23:58:22.760215 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.760196 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 11 23:58:22.760215 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.760207 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 11 23:58:22.760364 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.760227 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 11 23:58:22.760364 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.760268 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 11 23:58:22.760364 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.760274 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 11 23:58:22.760364 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.760227 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 11 23:58:22.774620 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.774600 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 11 23:58:22.858019 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.857988 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.858152 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.858032 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.858152 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.858063 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.858152 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.858096 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.858152 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.858133 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-web-config\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.858152 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.858149 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.858333 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.858170 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gcsg\" (UniqueName: \"kubernetes.io/projected/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-kube-api-access-7gcsg\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.858333 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.858228 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.858333 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.858312 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.858459 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.858347 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.858459 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.858391 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-config-volume\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.858459 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.858431 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.858653 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.858461 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-config-out\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.959195 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.959157 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.959517 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.959199 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.959517 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.959248 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-config-volume\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.959517 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.959283 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.959517 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.959313 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-config-out\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.961239 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.959988 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a15f85da-2145-459f-8445-82ec38f243b7-original-pull-secret\") pod \"global-pull-secret-syncer-2dpdn\" (UID: \"a15f85da-2145-459f-8445-82ec38f243b7\") " pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:58:22.961239 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.960027 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.961239 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.960056 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.961239 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.960082 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.961239 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.960136 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.961239 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.960161 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-web-config\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.961239 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.960186 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.961239 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.960228 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gcsg\" (UniqueName: \"kubernetes.io/projected/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-kube-api-access-7gcsg\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.961239 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.960257 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.961239 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.960908 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.961239 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.961057 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.961829 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.961677 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.962556 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.962538 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 11 23:58:22.962698 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.962540 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-config-out\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.963837 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.963801 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.963837 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.963811 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.964004 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.963896 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-web-config\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.964070 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.964041 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-config-volume\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.964718 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.964696 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.964801 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.964760 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.964801 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.964792 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.965554 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.965537 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.970926 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.970905 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gcsg\" (UniqueName: \"kubernetes.io/projected/8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25-kube-api-access-7gcsg\") pod \"alertmanager-main-0\" (UID: \"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25\") " pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:22.972414 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:22.972390 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a15f85da-2145-459f-8445-82ec38f243b7-original-pull-secret\") pod \"global-pull-secret-syncer-2dpdn\" (UID: \"a15f85da-2145-459f-8445-82ec38f243b7\") " pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:58:23.043570 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:23.043545 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2dpdn" Jul 11 23:58:23.061520 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:23.061463 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7759c22b-76ac-44de-a812-a82cf40941eb-metrics-certs\") pod \"network-metrics-daemon-cjtrj\" (UID: \"7759c22b-76ac-44de-a812-a82cf40941eb\") " pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:58:23.063917 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:23.063897 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 11 23:58:23.074053 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:23.074032 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 11 23:58:23.074266 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:23.074246 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7759c22b-76ac-44de-a812-a82cf40941eb-metrics-certs\") pod \"network-metrics-daemon-cjtrj\" (UID: \"7759c22b-76ac-44de-a812-a82cf40941eb\") " pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:58:23.162557 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:23.162429 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx9cb\" (UniqueName: \"kubernetes.io/projected/0295efe1-26fd-416f-a532-86a675acc31f-kube-api-access-sx9cb\") pod \"network-check-target-r8fwq\" (UID: \"0295efe1-26fd-416f-a532-86a675acc31f\") " pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:58:23.165003 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:23.164974 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 11 23:58:23.175210 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:23.175186 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 11 23:58:23.185986 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:23.185962 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx9cb\" (UniqueName: \"kubernetes.io/projected/0295efe1-26fd-416f-a532-86a675acc31f-kube-api-access-sx9cb\") pod \"network-check-target-r8fwq\" (UID: \"0295efe1-26fd-416f-a532-86a675acc31f\") " pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:58:23.245491 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:23.245461 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sbvsd\"" Jul 11 23:58:23.249519 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:23.249495 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7t5sz\"" Jul 11 23:58:23.253524 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:23.253499 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cjtrj" Jul 11 23:58:23.258473 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:23.258455 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:58:23.549322 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:23.549295 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tmx6h" Jul 11 23:58:23.593396 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:23.593356 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-xsgt9" event={"ID":"f91c62dd-4916-4142-b0df-68e7e49c9bd1","Type":"ContainerStarted","Data":"29bf2d57152e99623b9614d83e22a817acd73b1bbb12c7f5fe1b4f0eb83963cb"} Jul 11 23:58:23.593537 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:23.593463 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-xsgt9" event={"ID":"f91c62dd-4916-4142-b0df-68e7e49c9bd1","Type":"ContainerStarted","Data":"4dc0da85c3744301f9ea902962441bebc58bcbf98f4428aa13d3f4c6e6cdf22a"} Jul 11 23:58:23.593537 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:23.593492 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-xsgt9" event={"ID":"f91c62dd-4916-4142-b0df-68e7e49c9bd1","Type":"ContainerStarted","Data":"8a9823ae1082a745470127adfacc002e4e31b2a7b474fc681b4b41989c9a199b"} Jul 11 23:58:23.595169 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:23.595142 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-984m4" event={"ID":"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc","Type":"ContainerStarted","Data":"956c55d430c872bcd74e6c082cdd2865fe5212ff56f1d4de0d36b34d88e742f7"} Jul 11 23:58:23.833625 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:23.833473 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2dpdn"] Jul 11 23:58:23.838310 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:58:23.838025 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda15f85da_2145_459f_8445_82ec38f243b7.slice/crio-eb083e88509aa98e1dbcc6b93f8b8b6999a90929528ff7d4e8617554a7978452 WatchSource:0}: Error finding container eb083e88509aa98e1dbcc6b93f8b8b6999a90929528ff7d4e8617554a7978452: Status 404 returned error can't find the container with id eb083e88509aa98e1dbcc6b93f8b8b6999a90929528ff7d4e8617554a7978452 Jul 11 23:58:23.901684 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:23.901607 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cjtrj"] Jul 11 23:58:24.051816 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.051736 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r8fwq"] Jul 11 23:58:24.065498 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.065411 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 11 23:58:24.106131 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.106085 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:58:24.106252 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.106160 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:58:24.111347 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.111328 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:58:24.167213 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:58:24.167187 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0295efe1_26fd_416f_a532_86a675acc31f.slice/crio-8ccb83c6412c7c768dfa644889afb34ab0db61ade03084f55d8bccb25b230e27 WatchSource:0}: Error finding container 8ccb83c6412c7c768dfa644889afb34ab0db61ade03084f55d8bccb25b230e27: Status 404 returned error can't find the container with id 8ccb83c6412c7c768dfa644889afb34ab0db61ade03084f55d8bccb25b230e27 Jul 11 23:58:24.168803 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:58:24.168780 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aee3fe4_8fd5_4eb4_b9d5_425aa7eefd25.slice/crio-26ff02ea121df1f02007a8f45d4b61399bfa7477a1f7df214a7c0a85d46ac30e WatchSource:0}: Error finding container 26ff02ea121df1f02007a8f45d4b61399bfa7477a1f7df214a7c0a85d46ac30e: Status 404 returned error can't find the container with id 26ff02ea121df1f02007a8f45d4b61399bfa7477a1f7df214a7c0a85d46ac30e Jul 11 23:58:24.603791 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.603755 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-v2lbx" event={"ID":"2cb8a669-b3fa-4c26-a706-5dea8a445f17","Type":"ContainerStarted","Data":"d2ca803b7c68865668cf7d5d85fff2b40acbdc6385b7933921385c435acd86dd"} Jul 11 23:58:24.603945 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.603825 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-v2lbx" event={"ID":"2cb8a669-b3fa-4c26-a706-5dea8a445f17","Type":"ContainerStarted","Data":"e3c58dcd83d6f96c0eb06fe56d1b736b1e8554994f19792d80abedea4a42bf92"} Jul 11 23:58:24.603945 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.603854 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-v2lbx" event={"ID":"2cb8a669-b3fa-4c26-a706-5dea8a445f17","Type":"ContainerStarted","Data":"9e1f6fc280cc71c4d0f6887968555748f23d0a94b6142f1d3f6d706a7e59d7f5"} Jul 11 23:58:24.607301 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.607274 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-xsgt9" event={"ID":"f91c62dd-4916-4142-b0df-68e7e49c9bd1","Type":"ContainerStarted","Data":"2ad12c0cab8135983f49d65e93e1c5879f9c1cd99ccc7738974a0f3379759be5"} Jul 11 23:58:24.610166 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.610136 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r8fwq" event={"ID":"0295efe1-26fd-416f-a532-86a675acc31f","Type":"ContainerStarted","Data":"8ccb83c6412c7c768dfa644889afb34ab0db61ade03084f55d8bccb25b230e27"} Jul 11 23:58:24.612061 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.611983 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25","Type":"ContainerStarted","Data":"26ff02ea121df1f02007a8f45d4b61399bfa7477a1f7df214a7c0a85d46ac30e"} Jul 11 23:58:24.615116 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.614449 2564 generic.go:356] "Generic (PLEG): container finished" podID="5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc" containerID="a527fa19452c2fd145a4209b1256351817959b4268dffe9f878046faa8552dd6" exitCode=0 Jul 11 23:58:24.615116 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.614598 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-984m4" event={"ID":"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc","Type":"ContainerDied","Data":"a527fa19452c2fd145a4209b1256351817959b4268dffe9f878046faa8552dd6"} Jul 11 23:58:24.616002 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.615935 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cjtrj" event={"ID":"7759c22b-76ac-44de-a812-a82cf40941eb","Type":"ContainerStarted","Data":"7e9e335f27bbfff02dc9a70c7ae5beedff6d73f5a1b9e17e87a716e53a257f1d"} Jul 11 23:58:24.617791 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.617740 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2dpdn" event={"ID":"a15f85da-2145-459f-8445-82ec38f243b7","Type":"ContainerStarted","Data":"eb083e88509aa98e1dbcc6b93f8b8b6999a90929528ff7d4e8617554a7978452"} Jul 11 23:58:24.622835 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.621817 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-v2lbx" podStartSLOduration=2.085254655 podStartE2EDuration="3.621800622s" totalImagesPullingTime="1.536545967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:24.621187071 +0000 UTC m=+67.796983711" watchObservedRunningTime="2026-07-11 23:58:24.621800622 +0000 UTC m=+67.797597260" Jul 11 23:58:24.623975 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.623954 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:58:24.647588 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.647251 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-xsgt9" podStartSLOduration=2.289218857 podStartE2EDuration="3.647233593s" totalImagesPullingTime="1.358014736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:24.645643528 +0000 UTC m=+67.821440178" watchObservedRunningTime="2026-07-11 23:58:24.647233593 +0000 UTC m=+67.823030232" Jul 11 23:58:24.687825 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.686047 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-557df4ff8b-fc8gh"] Jul 11 23:58:24.716096 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.714944 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-557df4ff8b-fc8gh"] Jul 11 23:58:24.716096 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.715121 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" Jul 11 23:58:24.718474 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.717933 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 11 23:58:24.718474 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.718192 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 11 23:58:24.718718 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.718545 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 11 23:58:24.718775 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.718753 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 11 23:58:24.718981 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.718961 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1ggtjr16m9mpf\"" Jul 11 23:58:24.719186 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.719170 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 11 23:58:24.719405 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.719389 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hjf96\"" Jul 11 23:58:24.775686 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.775251 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5afc1c2b-a166-4afb-8aa6-bf80156a012f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-557df4ff8b-fc8gh\" (UID: \"5afc1c2b-a166-4afb-8aa6-bf80156a012f\") " pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" Jul 11 23:58:24.775686 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.775304 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5afc1c2b-a166-4afb-8aa6-bf80156a012f-secret-grpc-tls\") pod \"thanos-querier-557df4ff8b-fc8gh\" (UID: \"5afc1c2b-a166-4afb-8aa6-bf80156a012f\") " pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" Jul 11 23:58:24.775686 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.775353 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5afc1c2b-a166-4afb-8aa6-bf80156a012f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-557df4ff8b-fc8gh\" (UID: \"5afc1c2b-a166-4afb-8aa6-bf80156a012f\") " pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" Jul 11 23:58:24.775686 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.775380 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5afc1c2b-a166-4afb-8aa6-bf80156a012f-secret-thanos-querier-tls\") pod \"thanos-querier-557df4ff8b-fc8gh\" (UID: \"5afc1c2b-a166-4afb-8aa6-bf80156a012f\") " pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" Jul 11 23:58:24.775686 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.775405 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5afc1c2b-a166-4afb-8aa6-bf80156a012f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-557df4ff8b-fc8gh\" (UID: \"5afc1c2b-a166-4afb-8aa6-bf80156a012f\") " pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" Jul 11 23:58:24.775686 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.775440 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5afc1c2b-a166-4afb-8aa6-bf80156a012f-metrics-client-ca\") pod \"thanos-querier-557df4ff8b-fc8gh\" (UID: \"5afc1c2b-a166-4afb-8aa6-bf80156a012f\") " pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" Jul 11 23:58:24.775686 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.775496 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5afc1c2b-a166-4afb-8aa6-bf80156a012f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-557df4ff8b-fc8gh\" (UID: \"5afc1c2b-a166-4afb-8aa6-bf80156a012f\") " pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" Jul 11 23:58:24.775686 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.775536 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sflrf\" (UniqueName: \"kubernetes.io/projected/5afc1c2b-a166-4afb-8aa6-bf80156a012f-kube-api-access-sflrf\") pod \"thanos-querier-557df4ff8b-fc8gh\" (UID: \"5afc1c2b-a166-4afb-8aa6-bf80156a012f\") " pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" Jul 11 23:58:24.877943 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.876719 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5afc1c2b-a166-4afb-8aa6-bf80156a012f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-557df4ff8b-fc8gh\" (UID: \"5afc1c2b-a166-4afb-8aa6-bf80156a012f\") " pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" Jul 11 23:58:24.877943 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.876765 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5afc1c2b-a166-4afb-8aa6-bf80156a012f-secret-thanos-querier-tls\") pod \"thanos-querier-557df4ff8b-fc8gh\" (UID: \"5afc1c2b-a166-4afb-8aa6-bf80156a012f\") " pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" Jul 11 23:58:24.877943 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.876790 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5afc1c2b-a166-4afb-8aa6-bf80156a012f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-557df4ff8b-fc8gh\" (UID: \"5afc1c2b-a166-4afb-8aa6-bf80156a012f\") " pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" Jul 11 23:58:24.877943 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.876828 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5afc1c2b-a166-4afb-8aa6-bf80156a012f-metrics-client-ca\") pod \"thanos-querier-557df4ff8b-fc8gh\" (UID: \"5afc1c2b-a166-4afb-8aa6-bf80156a012f\") " pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" Jul 11 23:58:24.877943 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.876888 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5afc1c2b-a166-4afb-8aa6-bf80156a012f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-557df4ff8b-fc8gh\" (UID: \"5afc1c2b-a166-4afb-8aa6-bf80156a012f\") " pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" Jul 11 23:58:24.877943 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.876930 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sflrf\" (UniqueName: \"kubernetes.io/projected/5afc1c2b-a166-4afb-8aa6-bf80156a012f-kube-api-access-sflrf\") pod \"thanos-querier-557df4ff8b-fc8gh\" (UID: \"5afc1c2b-a166-4afb-8aa6-bf80156a012f\") " pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" Jul 11 23:58:24.877943 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.876963 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5afc1c2b-a166-4afb-8aa6-bf80156a012f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-557df4ff8b-fc8gh\" (UID: \"5afc1c2b-a166-4afb-8aa6-bf80156a012f\") " pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" Jul 11 23:58:24.877943 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.877006 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5afc1c2b-a166-4afb-8aa6-bf80156a012f-secret-grpc-tls\") pod \"thanos-querier-557df4ff8b-fc8gh\" (UID: \"5afc1c2b-a166-4afb-8aa6-bf80156a012f\") " pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" Jul 11 23:58:24.878684 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.878035 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5afc1c2b-a166-4afb-8aa6-bf80156a012f-metrics-client-ca\") pod \"thanos-querier-557df4ff8b-fc8gh\" (UID: \"5afc1c2b-a166-4afb-8aa6-bf80156a012f\") " pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" Jul 11 23:58:24.885490 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.885412 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5afc1c2b-a166-4afb-8aa6-bf80156a012f-secret-grpc-tls\") pod \"thanos-querier-557df4ff8b-fc8gh\" (UID: \"5afc1c2b-a166-4afb-8aa6-bf80156a012f\") " pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" Jul 11 23:58:24.886157 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.886056 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5afc1c2b-a166-4afb-8aa6-bf80156a012f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-557df4ff8b-fc8gh\" (UID: \"5afc1c2b-a166-4afb-8aa6-bf80156a012f\") " pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" Jul 11 23:58:24.886157 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.886146 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5afc1c2b-a166-4afb-8aa6-bf80156a012f-secret-thanos-querier-tls\") pod \"thanos-querier-557df4ff8b-fc8gh\" (UID: \"5afc1c2b-a166-4afb-8aa6-bf80156a012f\") " pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" Jul 11 23:58:24.892418 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.892374 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5afc1c2b-a166-4afb-8aa6-bf80156a012f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-557df4ff8b-fc8gh\" (UID: \"5afc1c2b-a166-4afb-8aa6-bf80156a012f\") " pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" Jul 11 23:58:24.892671 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.892648 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sflrf\" (UniqueName: \"kubernetes.io/projected/5afc1c2b-a166-4afb-8aa6-bf80156a012f-kube-api-access-sflrf\") pod \"thanos-querier-557df4ff8b-fc8gh\" (UID: \"5afc1c2b-a166-4afb-8aa6-bf80156a012f\") " pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" Jul 11 23:58:24.894188 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.894149 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5afc1c2b-a166-4afb-8aa6-bf80156a012f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-557df4ff8b-fc8gh\" (UID: \"5afc1c2b-a166-4afb-8aa6-bf80156a012f\") " pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" Jul 11 23:58:24.901196 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:24.901155 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5afc1c2b-a166-4afb-8aa6-bf80156a012f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-557df4ff8b-fc8gh\" (UID: \"5afc1c2b-a166-4afb-8aa6-bf80156a012f\") " pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" Jul 11 23:58:25.031483 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:25.031400 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" Jul 11 23:58:25.626148 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:25.626085 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-984m4" event={"ID":"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc","Type":"ContainerStarted","Data":"5a68a259eb109f747a270567b3856d5d6d5abdb5e6c876e4f67ffc0f2ec86607"} Jul 11 23:58:25.626321 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:25.626169 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-984m4" event={"ID":"5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc","Type":"ContainerStarted","Data":"76bd4b647315fbd72f724bce8fd1597982be8b77658decad99218381b4e5319e"} Jul 11 23:58:25.645982 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:25.645883 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-984m4" podStartSLOduration=3.5027215739999997 podStartE2EDuration="4.645864056s" totalImagesPullingTime="1.033591442s" totalInitContainerRuntime="109.55104ms" isStatefulPod=true podCreationTimestamp="2026-07-11 23:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:25.643625231 +0000 UTC m=+68.819421870" watchObservedRunningTime="2026-07-11 23:58:25.645864056 +0000 UTC m=+68.821660695" Jul 11 23:58:25.999279 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:25.999180 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-557df4ff8b-fc8gh"] Jul 11 23:58:26.022469 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:58:26.022246 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5afc1c2b_a166_4afb_8aa6_bf80156a012f.slice/crio-8357f785e0aa3d1fd40bf702350e41d56bb3bdf939fd2ff31529669113f32b56 WatchSource:0}: Error finding container 8357f785e0aa3d1fd40bf702350e41d56bb3bdf939fd2ff31529669113f32b56: Status 404 returned error can't find the container with id 8357f785e0aa3d1fd40bf702350e41d56bb3bdf939fd2ff31529669113f32b56 Jul 11 23:58:26.039401 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.039381 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-658cdbb5d4-2kqgl"] Jul 11 23:58:26.043154 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.042002 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" Jul 11 23:58:26.046071 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.045340 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 11 23:58:26.046071 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.045527 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3fnel5qup3ct8\"" Jul 11 23:58:26.046071 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.045561 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 11 23:58:26.046071 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.045697 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-m4l46\"" Jul 11 23:58:26.046071 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.045799 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 11 23:58:26.046071 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.045895 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 11 23:58:26.052488 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.052438 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-658cdbb5d4-2kqgl"] Jul 11 23:58:26.090848 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.090679 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6f531380-b19e-45a3-95a2-11d13132a3b5-secret-metrics-server-tls\") pod \"metrics-server-658cdbb5d4-2kqgl\" (UID: \"6f531380-b19e-45a3-95a2-11d13132a3b5\") " pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" Jul 11 23:58:26.090848 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.090734 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6f531380-b19e-45a3-95a2-11d13132a3b5-secret-metrics-server-client-certs\") pod \"metrics-server-658cdbb5d4-2kqgl\" (UID: \"6f531380-b19e-45a3-95a2-11d13132a3b5\") " pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" Jul 11 23:58:26.091285 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.090774 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f531380-b19e-45a3-95a2-11d13132a3b5-client-ca-bundle\") pod \"metrics-server-658cdbb5d4-2kqgl\" (UID: \"6f531380-b19e-45a3-95a2-11d13132a3b5\") " pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" Jul 11 23:58:26.091285 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.091154 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6f531380-b19e-45a3-95a2-11d13132a3b5-metrics-server-audit-profiles\") pod \"metrics-server-658cdbb5d4-2kqgl\" (UID: \"6f531380-b19e-45a3-95a2-11d13132a3b5\") " pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" Jul 11 23:58:26.091285 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.091186 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6f531380-b19e-45a3-95a2-11d13132a3b5-audit-log\") pod \"metrics-server-658cdbb5d4-2kqgl\" (UID: \"6f531380-b19e-45a3-95a2-11d13132a3b5\") " pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" Jul 11 23:58:26.091285 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.091269 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cdpm\" (UniqueName: \"kubernetes.io/projected/6f531380-b19e-45a3-95a2-11d13132a3b5-kube-api-access-2cdpm\") pod \"metrics-server-658cdbb5d4-2kqgl\" (UID: \"6f531380-b19e-45a3-95a2-11d13132a3b5\") " pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" Jul 11 23:58:26.091510 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.091327 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f531380-b19e-45a3-95a2-11d13132a3b5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-658cdbb5d4-2kqgl\" (UID: \"6f531380-b19e-45a3-95a2-11d13132a3b5\") " pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" Jul 11 23:58:26.192354 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.192317 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6f531380-b19e-45a3-95a2-11d13132a3b5-audit-log\") pod \"metrics-server-658cdbb5d4-2kqgl\" (UID: \"6f531380-b19e-45a3-95a2-11d13132a3b5\") " pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" Jul 11 23:58:26.192506 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.192369 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cdpm\" (UniqueName: \"kubernetes.io/projected/6f531380-b19e-45a3-95a2-11d13132a3b5-kube-api-access-2cdpm\") pod \"metrics-server-658cdbb5d4-2kqgl\" (UID: \"6f531380-b19e-45a3-95a2-11d13132a3b5\") " pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" Jul 11 23:58:26.192506 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.192415 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f531380-b19e-45a3-95a2-11d13132a3b5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-658cdbb5d4-2kqgl\" (UID: \"6f531380-b19e-45a3-95a2-11d13132a3b5\") " pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" Jul 11 23:58:26.192506 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.192463 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6f531380-b19e-45a3-95a2-11d13132a3b5-secret-metrics-server-tls\") pod \"metrics-server-658cdbb5d4-2kqgl\" (UID: \"6f531380-b19e-45a3-95a2-11d13132a3b5\") " pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" Jul 11 23:58:26.192506 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.192498 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6f531380-b19e-45a3-95a2-11d13132a3b5-secret-metrics-server-client-certs\") pod \"metrics-server-658cdbb5d4-2kqgl\" (UID: \"6f531380-b19e-45a3-95a2-11d13132a3b5\") " pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" Jul 11 23:58:26.192714 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.192534 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f531380-b19e-45a3-95a2-11d13132a3b5-client-ca-bundle\") pod \"metrics-server-658cdbb5d4-2kqgl\" (UID: \"6f531380-b19e-45a3-95a2-11d13132a3b5\") " pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" Jul 11 23:58:26.192714 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.192569 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6f531380-b19e-45a3-95a2-11d13132a3b5-metrics-server-audit-profiles\") pod \"metrics-server-658cdbb5d4-2kqgl\" (UID: \"6f531380-b19e-45a3-95a2-11d13132a3b5\") " pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" Jul 11 23:58:26.192807 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.192765 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6f531380-b19e-45a3-95a2-11d13132a3b5-audit-log\") pod \"metrics-server-658cdbb5d4-2kqgl\" (UID: \"6f531380-b19e-45a3-95a2-11d13132a3b5\") " pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" Jul 11 23:58:26.193722 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.193562 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6f531380-b19e-45a3-95a2-11d13132a3b5-metrics-server-audit-profiles\") pod \"metrics-server-658cdbb5d4-2kqgl\" (UID: \"6f531380-b19e-45a3-95a2-11d13132a3b5\") " pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" Jul 11 23:58:26.193722 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.193677 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f531380-b19e-45a3-95a2-11d13132a3b5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-658cdbb5d4-2kqgl\" (UID: \"6f531380-b19e-45a3-95a2-11d13132a3b5\") " pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" Jul 11 23:58:26.196318 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.196279 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6f531380-b19e-45a3-95a2-11d13132a3b5-secret-metrics-server-client-certs\") pod \"metrics-server-658cdbb5d4-2kqgl\" (UID: \"6f531380-b19e-45a3-95a2-11d13132a3b5\") " pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" Jul 11 23:58:26.196523 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.196505 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f531380-b19e-45a3-95a2-11d13132a3b5-client-ca-bundle\") pod \"metrics-server-658cdbb5d4-2kqgl\" (UID: \"6f531380-b19e-45a3-95a2-11d13132a3b5\") " pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" Jul 11 23:58:26.196595 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.196528 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6f531380-b19e-45a3-95a2-11d13132a3b5-secret-metrics-server-tls\") pod \"metrics-server-658cdbb5d4-2kqgl\" (UID: \"6f531380-b19e-45a3-95a2-11d13132a3b5\") " pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" Jul 11 23:58:26.202931 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.202908 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cdpm\" (UniqueName: \"kubernetes.io/projected/6f531380-b19e-45a3-95a2-11d13132a3b5-kube-api-access-2cdpm\") pod \"metrics-server-658cdbb5d4-2kqgl\" (UID: \"6f531380-b19e-45a3-95a2-11d13132a3b5\") " pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" Jul 11 23:58:26.359902 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.359274 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" Jul 11 23:58:26.475217 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.475186 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-qp4b9"] Jul 11 23:58:26.478370 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.478287 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qp4b9" Jul 11 23:58:26.481213 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.481043 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 11 23:58:26.481376 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.481358 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-8wvtq\"" Jul 11 23:58:26.491457 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.491394 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-qp4b9"] Jul 11 23:58:26.524066 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.524039 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-658cdbb5d4-2kqgl"] Jul 11 23:58:26.528759 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:58:26.528734 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f531380_b19e_45a3_95a2_11d13132a3b5.slice/crio-8fcab1a4506b1e0ba2a7a1ae56ea83d417fbc32b447522fa1659f562ff972ee3 WatchSource:0}: Error finding container 8fcab1a4506b1e0ba2a7a1ae56ea83d417fbc32b447522fa1659f562ff972ee3: Status 404 returned error can't find the container with id 8fcab1a4506b1e0ba2a7a1ae56ea83d417fbc32b447522fa1659f562ff972ee3 Jul 11 23:58:26.596876 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.596710 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eafcd884-1232-4901-ba5b-69950705d701-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-qp4b9\" (UID: \"eafcd884-1232-4901-ba5b-69950705d701\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qp4b9" Jul 11 23:58:26.596876 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.596794 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbmqt\" (UniqueName: \"kubernetes.io/projected/eafcd884-1232-4901-ba5b-69950705d701-kube-api-access-rbmqt\") pod \"monitoring-plugin-5f68df7f58-qp4b9\" (UID: \"eafcd884-1232-4901-ba5b-69950705d701\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qp4b9" Jul 11 23:58:26.633651 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.633616 2564 generic.go:356] "Generic (PLEG): container finished" podID="8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25" containerID="d9a9e66bff97b7d78914f5c30f97b6a9d68138fd2e50b348171d810442341393" exitCode=0 Jul 11 23:58:26.633789 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.633705 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25","Type":"ContainerDied","Data":"d9a9e66bff97b7d78914f5c30f97b6a9d68138fd2e50b348171d810442341393"} Jul 11 23:58:26.636690 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.636569 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" event={"ID":"5afc1c2b-a166-4afb-8aa6-bf80156a012f","Type":"ContainerStarted","Data":"8357f785e0aa3d1fd40bf702350e41d56bb3bdf939fd2ff31529669113f32b56"} Jul 11 23:58:26.641440 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.640757 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cjtrj" event={"ID":"7759c22b-76ac-44de-a812-a82cf40941eb","Type":"ContainerStarted","Data":"102ff449ed1e67a464b9d37bebb2a388f58c7c2adf78cd7f5074f4f42b6aa5c6"} Jul 11 23:58:26.641440 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.640808 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cjtrj" event={"ID":"7759c22b-76ac-44de-a812-a82cf40941eb","Type":"ContainerStarted","Data":"bdf6c47a701490beb5d74dc695528f4322b775c3c5ee3c4254c08f20d5bd8bb2"} Jul 11 23:58:26.643673 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.643616 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" event={"ID":"6f531380-b19e-45a3-95a2-11d13132a3b5","Type":"ContainerStarted","Data":"8fcab1a4506b1e0ba2a7a1ae56ea83d417fbc32b447522fa1659f562ff972ee3"} Jul 11 23:58:26.673142 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.672224 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cjtrj" podStartSLOduration=67.760960042 podStartE2EDuration="1m9.672203918s" totalImagesPullingTime="1.911243876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:57:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:26.670413142 +0000 UTC m=+69.846209780" watchObservedRunningTime="2026-07-11 23:58:26.672203918 +0000 UTC m=+69.848000556" Jul 11 23:58:26.699235 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.697695 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eafcd884-1232-4901-ba5b-69950705d701-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-qp4b9\" (UID: \"eafcd884-1232-4901-ba5b-69950705d701\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qp4b9" Jul 11 23:58:26.699235 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.697900 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbmqt\" (UniqueName: \"kubernetes.io/projected/eafcd884-1232-4901-ba5b-69950705d701-kube-api-access-rbmqt\") pod \"monitoring-plugin-5f68df7f58-qp4b9\" (UID: \"eafcd884-1232-4901-ba5b-69950705d701\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qp4b9" Jul 11 23:58:26.706491 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.702657 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/eafcd884-1232-4901-ba5b-69950705d701-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-qp4b9\" (UID: \"eafcd884-1232-4901-ba5b-69950705d701\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qp4b9" Jul 11 23:58:26.709767 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.709690 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbmqt\" (UniqueName: \"kubernetes.io/projected/eafcd884-1232-4901-ba5b-69950705d701-kube-api-access-rbmqt\") pod \"monitoring-plugin-5f68df7f58-qp4b9\" (UID: \"eafcd884-1232-4901-ba5b-69950705d701\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qp4b9" Jul 11 23:58:26.798342 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:26.798313 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qp4b9" Jul 11 23:58:27.004982 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.004899 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f79b7c56-qbszx"] Jul 11 23:58:27.007345 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.007276 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f79b7c56-qbszx" Jul 11 23:58:27.018960 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.018908 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f79b7c56-qbszx"] Jul 11 23:58:27.101369 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.101314 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/399f419a-d051-401c-bf50-71d49f26a3ba-console-config\") pod \"console-f79b7c56-qbszx\" (UID: \"399f419a-d051-401c-bf50-71d49f26a3ba\") " pod="openshift-console/console-f79b7c56-qbszx" Jul 11 23:58:27.101528 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.101374 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr6rk\" (UniqueName: \"kubernetes.io/projected/399f419a-d051-401c-bf50-71d49f26a3ba-kube-api-access-fr6rk\") pod \"console-f79b7c56-qbszx\" (UID: \"399f419a-d051-401c-bf50-71d49f26a3ba\") " pod="openshift-console/console-f79b7c56-qbszx" Jul 11 23:58:27.101528 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.101412 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/399f419a-d051-401c-bf50-71d49f26a3ba-oauth-serving-cert\") pod \"console-f79b7c56-qbszx\" (UID: \"399f419a-d051-401c-bf50-71d49f26a3ba\") " pod="openshift-console/console-f79b7c56-qbszx" Jul 11 23:58:27.101528 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.101471 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/399f419a-d051-401c-bf50-71d49f26a3ba-console-serving-cert\") pod \"console-f79b7c56-qbszx\" (UID: \"399f419a-d051-401c-bf50-71d49f26a3ba\") " pod="openshift-console/console-f79b7c56-qbszx" Jul 11 23:58:27.101670 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.101527 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/399f419a-d051-401c-bf50-71d49f26a3ba-trusted-ca-bundle\") pod \"console-f79b7c56-qbszx\" (UID: \"399f419a-d051-401c-bf50-71d49f26a3ba\") " pod="openshift-console/console-f79b7c56-qbszx" Jul 11 23:58:27.101670 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.101597 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/399f419a-d051-401c-bf50-71d49f26a3ba-console-oauth-config\") pod \"console-f79b7c56-qbszx\" (UID: \"399f419a-d051-401c-bf50-71d49f26a3ba\") " pod="openshift-console/console-f79b7c56-qbszx" Jul 11 23:58:27.101670 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.101627 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/399f419a-d051-401c-bf50-71d49f26a3ba-service-ca\") pod \"console-f79b7c56-qbszx\" (UID: \"399f419a-d051-401c-bf50-71d49f26a3ba\") " pod="openshift-console/console-f79b7c56-qbszx" Jul 11 23:58:27.202122 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.202069 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/399f419a-d051-401c-bf50-71d49f26a3ba-service-ca\") pod \"console-f79b7c56-qbszx\" (UID: \"399f419a-d051-401c-bf50-71d49f26a3ba\") " pod="openshift-console/console-f79b7c56-qbszx" Jul 11 23:58:27.202294 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.202145 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/399f419a-d051-401c-bf50-71d49f26a3ba-console-config\") pod \"console-f79b7c56-qbszx\" (UID: \"399f419a-d051-401c-bf50-71d49f26a3ba\") " pod="openshift-console/console-f79b7c56-qbszx" Jul 11 23:58:27.202294 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.202195 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr6rk\" (UniqueName: \"kubernetes.io/projected/399f419a-d051-401c-bf50-71d49f26a3ba-kube-api-access-fr6rk\") pod \"console-f79b7c56-qbszx\" (UID: \"399f419a-d051-401c-bf50-71d49f26a3ba\") " pod="openshift-console/console-f79b7c56-qbszx" Jul 11 23:58:27.202294 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.202236 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/399f419a-d051-401c-bf50-71d49f26a3ba-oauth-serving-cert\") pod \"console-f79b7c56-qbszx\" (UID: \"399f419a-d051-401c-bf50-71d49f26a3ba\") " pod="openshift-console/console-f79b7c56-qbszx" Jul 11 23:58:27.202294 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.202255 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/399f419a-d051-401c-bf50-71d49f26a3ba-console-serving-cert\") pod \"console-f79b7c56-qbszx\" (UID: \"399f419a-d051-401c-bf50-71d49f26a3ba\") " pod="openshift-console/console-f79b7c56-qbszx" Jul 11 23:58:27.202294 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.202291 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/399f419a-d051-401c-bf50-71d49f26a3ba-trusted-ca-bundle\") pod \"console-f79b7c56-qbszx\" (UID: \"399f419a-d051-401c-bf50-71d49f26a3ba\") " pod="openshift-console/console-f79b7c56-qbszx" Jul 11 23:58:27.202544 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.202363 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/399f419a-d051-401c-bf50-71d49f26a3ba-console-oauth-config\") pod \"console-f79b7c56-qbszx\" (UID: \"399f419a-d051-401c-bf50-71d49f26a3ba\") " pod="openshift-console/console-f79b7c56-qbszx" Jul 11 23:58:27.202895 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.202862 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/399f419a-d051-401c-bf50-71d49f26a3ba-service-ca\") pod \"console-f79b7c56-qbszx\" (UID: \"399f419a-d051-401c-bf50-71d49f26a3ba\") " pod="openshift-console/console-f79b7c56-qbszx" Jul 11 23:58:27.203255 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.203231 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/399f419a-d051-401c-bf50-71d49f26a3ba-oauth-serving-cert\") pod \"console-f79b7c56-qbszx\" (UID: \"399f419a-d051-401c-bf50-71d49f26a3ba\") " pod="openshift-console/console-f79b7c56-qbszx" Jul 11 23:58:27.203471 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.203451 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/399f419a-d051-401c-bf50-71d49f26a3ba-console-config\") pod \"console-f79b7c56-qbszx\" (UID: \"399f419a-d051-401c-bf50-71d49f26a3ba\") " pod="openshift-console/console-f79b7c56-qbszx" Jul 11 23:58:27.203892 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.203855 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/399f419a-d051-401c-bf50-71d49f26a3ba-trusted-ca-bundle\") pod \"console-f79b7c56-qbszx\" (UID: \"399f419a-d051-401c-bf50-71d49f26a3ba\") " pod="openshift-console/console-f79b7c56-qbszx" Jul 11 23:58:27.206009 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.205966 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/399f419a-d051-401c-bf50-71d49f26a3ba-console-oauth-config\") pod \"console-f79b7c56-qbszx\" (UID: \"399f419a-d051-401c-bf50-71d49f26a3ba\") " pod="openshift-console/console-f79b7c56-qbszx" Jul 11 23:58:27.206586 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.206563 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/399f419a-d051-401c-bf50-71d49f26a3ba-console-serving-cert\") pod \"console-f79b7c56-qbszx\" (UID: \"399f419a-d051-401c-bf50-71d49f26a3ba\") " pod="openshift-console/console-f79b7c56-qbszx" Jul 11 23:58:27.211212 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.211170 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr6rk\" (UniqueName: \"kubernetes.io/projected/399f419a-d051-401c-bf50-71d49f26a3ba-kube-api-access-fr6rk\") pod \"console-f79b7c56-qbszx\" (UID: \"399f419a-d051-401c-bf50-71d49f26a3ba\") " pod="openshift-console/console-f79b7c56-qbszx" Jul 11 23:58:27.322378 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.322293 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f79b7c56-qbszx" Jul 11 23:58:27.886198 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.886154 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 11 23:58:27.890290 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.890266 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:27.892920 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.892868 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 11 23:58:27.893048 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.892979 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 11 23:58:27.893148 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.893086 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 11 23:58:27.893148 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.893133 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jl6n8\"" Jul 11 23:58:27.893377 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.893353 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 11 23:58:27.894629 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.894448 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 11 23:58:27.894629 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.894468 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 11 23:58:27.894629 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.894506 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 11 23:58:27.894629 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.894512 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 11 23:58:27.894918 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.894793 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fm5pc27a2ttdl\"" Jul 11 23:58:27.894984 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.894969 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 11 23:58:27.895309 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.895181 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 11 23:58:27.895309 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.895212 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 11 23:58:27.895309 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.895217 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 11 23:58:27.895566 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.895540 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 11 23:58:27.897441 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.897234 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 11 23:58:27.903149 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:27.903127 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 11 23:58:28.009432 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.009395 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c17fd92b-7812-4cf6-a66f-f290c4daae0d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.009432 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.009439 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c17fd92b-7812-4cf6-a66f-f290c4daae0d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.009938 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.009467 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c17fd92b-7812-4cf6-a66f-f290c4daae0d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.009938 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.009522 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c17fd92b-7812-4cf6-a66f-f290c4daae0d-config-out\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.009938 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.009599 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c17fd92b-7812-4cf6-a66f-f290c4daae0d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.009938 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.009629 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c17fd92b-7812-4cf6-a66f-f290c4daae0d-config\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.009938 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.009685 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c17fd92b-7812-4cf6-a66f-f290c4daae0d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.009938 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.009714 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c17fd92b-7812-4cf6-a66f-f290c4daae0d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.009938 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.009736 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c17fd92b-7812-4cf6-a66f-f290c4daae0d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.009938 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.009759 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c17fd92b-7812-4cf6-a66f-f290c4daae0d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.009938 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.009781 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c17fd92b-7812-4cf6-a66f-f290c4daae0d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.009938 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.009809 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c17fd92b-7812-4cf6-a66f-f290c4daae0d-web-config\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.009938 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.009855 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c17fd92b-7812-4cf6-a66f-f290c4daae0d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.009938 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.009873 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c17fd92b-7812-4cf6-a66f-f290c4daae0d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.009938 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.009904 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c17fd92b-7812-4cf6-a66f-f290c4daae0d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.009938 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.009922 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppchs\" (UniqueName: \"kubernetes.io/projected/c17fd92b-7812-4cf6-a66f-f290c4daae0d-kube-api-access-ppchs\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.010642 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.009969 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c17fd92b-7812-4cf6-a66f-f290c4daae0d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.010642 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.010003 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c17fd92b-7812-4cf6-a66f-f290c4daae0d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.010642 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.010027 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c17fd92b-7812-4cf6-a66f-f290c4daae0d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.010642 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.010050 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c17fd92b-7812-4cf6-a66f-f290c4daae0d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.110869 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.110833 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c17fd92b-7812-4cf6-a66f-f290c4daae0d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.110869 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.110876 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c17fd92b-7812-4cf6-a66f-f290c4daae0d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.111093 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.110903 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c17fd92b-7812-4cf6-a66f-f290c4daae0d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.111093 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.110935 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c17fd92b-7812-4cf6-a66f-f290c4daae0d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.111093 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.110964 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c17fd92b-7812-4cf6-a66f-f290c4daae0d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.111093 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.110990 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c17fd92b-7812-4cf6-a66f-f290c4daae0d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.111093 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.111017 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c17fd92b-7812-4cf6-a66f-f290c4daae0d-config-out\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.111093 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.111050 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c17fd92b-7812-4cf6-a66f-f290c4daae0d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.111093 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.111075 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c17fd92b-7812-4cf6-a66f-f290c4daae0d-config\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.111479 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.111130 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c17fd92b-7812-4cf6-a66f-f290c4daae0d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.111479 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.111153 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c17fd92b-7812-4cf6-a66f-f290c4daae0d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.111479 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.111181 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c17fd92b-7812-4cf6-a66f-f290c4daae0d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.111479 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.111212 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c17fd92b-7812-4cf6-a66f-f290c4daae0d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.111479 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.111241 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c17fd92b-7812-4cf6-a66f-f290c4daae0d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.111479 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.111273 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c17fd92b-7812-4cf6-a66f-f290c4daae0d-web-config\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.111479 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.111311 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c17fd92b-7812-4cf6-a66f-f290c4daae0d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.111479 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.111335 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c17fd92b-7812-4cf6-a66f-f290c4daae0d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.111479 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.111372 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c17fd92b-7812-4cf6-a66f-f290c4daae0d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.111479 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.111396 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppchs\" (UniqueName: \"kubernetes.io/projected/c17fd92b-7812-4cf6-a66f-f290c4daae0d-kube-api-access-ppchs\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.111479 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.111437 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c17fd92b-7812-4cf6-a66f-f290c4daae0d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.111941 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.111866 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c17fd92b-7812-4cf6-a66f-f290c4daae0d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.113865 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.113551 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c17fd92b-7812-4cf6-a66f-f290c4daae0d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.114431 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.114406 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c17fd92b-7812-4cf6-a66f-f290c4daae0d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.116996 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.116971 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c17fd92b-7812-4cf6-a66f-f290c4daae0d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.117096 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.113558 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c17fd92b-7812-4cf6-a66f-f290c4daae0d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.118418 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.117617 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c17fd92b-7812-4cf6-a66f-f290c4daae0d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.118418 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.118360 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c17fd92b-7812-4cf6-a66f-f290c4daae0d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.119039 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.119018 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c17fd92b-7812-4cf6-a66f-f290c4daae0d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.121355 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.121332 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c17fd92b-7812-4cf6-a66f-f290c4daae0d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.121928 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.121889 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c17fd92b-7812-4cf6-a66f-f290c4daae0d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.122084 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.122064 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c17fd92b-7812-4cf6-a66f-f290c4daae0d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.122643 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.122620 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c17fd92b-7812-4cf6-a66f-f290c4daae0d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.122934 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.122916 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c17fd92b-7812-4cf6-a66f-f290c4daae0d-config-out\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.123028 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.123006 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c17fd92b-7812-4cf6-a66f-f290c4daae0d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.123769 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.123712 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c17fd92b-7812-4cf6-a66f-f290c4daae0d-web-config\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.124264 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.124241 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c17fd92b-7812-4cf6-a66f-f290c4daae0d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.124707 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.124653 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c17fd92b-7812-4cf6-a66f-f290c4daae0d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.127492 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.127462 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c17fd92b-7812-4cf6-a66f-f290c4daae0d-config\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.127755 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.127717 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c17fd92b-7812-4cf6-a66f-f290c4daae0d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.129448 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.129425 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppchs\" (UniqueName: \"kubernetes.io/projected/c17fd92b-7812-4cf6-a66f-f290c4daae0d-kube-api-access-ppchs\") pod \"prometheus-k8s-0\" (UID: \"c17fd92b-7812-4cf6-a66f-f290c4daae0d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:28.204619 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:28.204546 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:30.091158 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:30.091134 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f79b7c56-qbszx"] Jul 11 23:58:30.439881 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:30.439849 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-qp4b9"] Jul 11 23:58:30.694075 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:58:30.694047 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod399f419a_d051_401c_bf50_71d49f26a3ba.slice/crio-6d9c3a6a0f40a0d04a2bf536921912de268227223ec5df59aa53d584377a7902 WatchSource:0}: Error finding container 6d9c3a6a0f40a0d04a2bf536921912de268227223ec5df59aa53d584377a7902: Status 404 returned error can't find the container with id 6d9c3a6a0f40a0d04a2bf536921912de268227223ec5df59aa53d584377a7902 Jul 11 23:58:30.718178 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:58:30.718151 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeafcd884_1232_4901_ba5b_69950705d701.slice/crio-22abf6e8d142f187084f68f91cbcdc13cf31e786090fbf01602339abd7fb344e WatchSource:0}: Error finding container 22abf6e8d142f187084f68f91cbcdc13cf31e786090fbf01602339abd7fb344e: Status 404 returned error can't find the container with id 22abf6e8d142f187084f68f91cbcdc13cf31e786090fbf01602339abd7fb344e Jul 11 23:58:30.881686 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:30.881593 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 11 23:58:31.673601 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:31.673522 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2dpdn" event={"ID":"a15f85da-2145-459f-8445-82ec38f243b7","Type":"ContainerStarted","Data":"d8062c3c489712b31dcc235c9c059171340fb601decd7faff0a213b36450b015"} Jul 11 23:58:31.675163 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:31.675133 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r8fwq" event={"ID":"0295efe1-26fd-416f-a532-86a675acc31f","Type":"ContainerStarted","Data":"3f060097a4e098ab98464f8b8d842e88cb2b7b5c6f4c985db89ec6cf32a0e4c7"} Jul 11 23:58:31.675309 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:31.675191 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:58:31.677532 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:31.677502 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" event={"ID":"5afc1c2b-a166-4afb-8aa6-bf80156a012f","Type":"ContainerStarted","Data":"23d03631b62a0d04e3027aed8b5e4c52991b60121f253907110c528904af62f1"} Jul 11 23:58:31.677638 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:31.677552 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" event={"ID":"5afc1c2b-a166-4afb-8aa6-bf80156a012f","Type":"ContainerStarted","Data":"c29c2d822edcc4956c51429dbca35dd9b9fdf31f94d95dc9f09fa287d16ba218"} Jul 11 23:58:31.677638 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:31.677590 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" event={"ID":"5afc1c2b-a166-4afb-8aa6-bf80156a012f","Type":"ContainerStarted","Data":"0757656f15852d5a2312d1255a5a4c5e3ad795c33cb506cdecdcc4710b46f1ad"} Jul 11 23:58:31.679068 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:31.679039 2564 generic.go:356] "Generic (PLEG): container finished" podID="c17fd92b-7812-4cf6-a66f-f290c4daae0d" containerID="6b3c97f0da89f5dd9b90e6795e66468de81bb03b8be7ddc0afce154879830544" exitCode=0 Jul 11 23:58:31.679201 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:31.679132 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c17fd92b-7812-4cf6-a66f-f290c4daae0d","Type":"ContainerDied","Data":"6b3c97f0da89f5dd9b90e6795e66468de81bb03b8be7ddc0afce154879830544"} Jul 11 23:58:31.679262 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:31.679198 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c17fd92b-7812-4cf6-a66f-f290c4daae0d","Type":"ContainerStarted","Data":"186eeac091aa5decf08d68b8c78432d5ca1532d59a1cd96f45ad3b95dfbfe9af"} Jul 11 23:58:31.680847 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:31.680800 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" event={"ID":"6f531380-b19e-45a3-95a2-11d13132a3b5","Type":"ContainerStarted","Data":"980dc4f1311553de160b95313ae2cffcb7efd3dfa9fd1570efd881bb2627e757"} Jul 11 23:58:31.682497 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:31.682476 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f79b7c56-qbszx" event={"ID":"399f419a-d051-401c-bf50-71d49f26a3ba","Type":"ContainerStarted","Data":"1a1350a4e0710a6a85f789c0fef98036893cd6b25208384248cb786cff25d2d0"} Jul 11 23:58:31.682580 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:31.682520 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f79b7c56-qbszx" event={"ID":"399f419a-d051-401c-bf50-71d49f26a3ba","Type":"ContainerStarted","Data":"6d9c3a6a0f40a0d04a2bf536921912de268227223ec5df59aa53d584377a7902"} Jul 11 23:58:31.683719 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:31.683698 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qp4b9" event={"ID":"eafcd884-1232-4901-ba5b-69950705d701","Type":"ContainerStarted","Data":"22abf6e8d142f187084f68f91cbcdc13cf31e786090fbf01602339abd7fb344e"} Jul 11 23:58:31.687890 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:31.687786 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25","Type":"ContainerStarted","Data":"e958b86487598bf28bf9bb930da668b0a594b950f59f7363886983582add4ee8"} Jul 11 23:58:31.687890 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:31.687853 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25","Type":"ContainerStarted","Data":"1d2ce68ccdd9c98140ffa0ca678941f1d3b35b9111b59bf526e68ba434e56635"} Jul 11 23:58:31.688084 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:31.687894 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25","Type":"ContainerStarted","Data":"f461ba12cad3b498df4428fb9cb162e766654fa01e5c78d72b264107d84cbc62"} Jul 11 23:58:31.688084 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:31.687934 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25","Type":"ContainerStarted","Data":"be60b9e53f0c193f1bd59351226f21b2f5351d3e4becf8bbd7daec155c90924e"} Jul 11 23:58:31.688084 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:31.687970 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25","Type":"ContainerStarted","Data":"e6f98429c80fe202444522addadf4f82453f07ec5cedc6cec6a9347835eb5db6"} Jul 11 23:58:31.690534 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:31.690492 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2dpdn" podStartSLOduration=67.812498126 podStartE2EDuration="1m14.690481126s" totalImagesPullingTime="6.877983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-11 23:57:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:31.688707929 +0000 UTC m=+74.864504568" watchObservedRunningTime="2026-07-11 23:58:31.690481126 +0000 UTC m=+74.866277756" Jul 11 23:58:31.704575 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:31.704527 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" podStartSLOduration=1.480480471 podStartE2EDuration="5.704508785s" totalImagesPullingTime="4.224028314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:58:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:31.703605733 +0000 UTC m=+74.879402371" watchObservedRunningTime="2026-07-11 23:58:31.704508785 +0000 UTC m=+74.880305424" Jul 11 23:58:31.744244 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:31.744197 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-r8fwq" podStartSLOduration=68.163916984 podStartE2EDuration="1m14.744180208s" totalImagesPullingTime="6.580263224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:57:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:31.743228682 +0000 UTC m=+74.919025324" watchObservedRunningTime="2026-07-11 23:58:31.744180208 +0000 UTC m=+74.919976845" Jul 11 23:58:31.759723 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:31.759670 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f79b7c56-qbszx" podStartSLOduration=5.759635561 podStartE2EDuration="5.759635561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:58:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:31.759081961 +0000 UTC m=+74.934878604" watchObservedRunningTime="2026-07-11 23:58:31.759635561 +0000 UTC m=+74.935432198" Jul 11 23:58:32.697044 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:32.697001 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" event={"ID":"5afc1c2b-a166-4afb-8aa6-bf80156a012f","Type":"ContainerStarted","Data":"7ab086c1d8a5d01b5699d70b904d7cb4c8e3b16bb0293cd5e1a6cf94676e594d"} Jul 11 23:58:32.697493 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:32.697287 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" Jul 11 23:58:32.697493 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:32.697341 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" event={"ID":"5afc1c2b-a166-4afb-8aa6-bf80156a012f","Type":"ContainerStarted","Data":"348d7f4dee266935935d2306e40c1e6c27b838b5f147ac6d182c84c7771186b9"} Jul 11 23:58:32.697493 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:32.697387 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" event={"ID":"5afc1c2b-a166-4afb-8aa6-bf80156a012f","Type":"ContainerStarted","Data":"512a312fe74267c0c2eaba6b708193d27bea4a237d5bd9b645b82aa721d0244e"} Jul 11 23:58:32.698816 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:32.698788 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qp4b9" event={"ID":"eafcd884-1232-4901-ba5b-69950705d701","Type":"ContainerStarted","Data":"f73280c245ce7d6c78ab4c90b889ce5a7064f8dc1dd7f0f503d05ad64f940cba"} Jul 11 23:58:32.698966 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:32.698942 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qp4b9" Jul 11 23:58:32.705527 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:32.705505 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qp4b9" Jul 11 23:58:32.705826 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:32.705752 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25","Type":"ContainerStarted","Data":"b93a3c26732ad88904ccf6e07ebe69e1a4eaece2070f3c6af8e314d8c882a8ee"} Jul 11 23:58:32.719263 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:32.718899 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" podStartSLOduration=2.944445133 podStartE2EDuration="8.718882815s" totalImagesPullingTime="5.774437682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:58:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:32.717448221 +0000 UTC m=+75.893244860" watchObservedRunningTime="2026-07-11 23:58:32.718882815 +0000 UTC m=+75.894679453" Jul 11 23:58:32.740917 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:32.740870 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.001412907 podStartE2EDuration="10.740856663s" totalImagesPullingTime="6.712277432s" totalInitContainerRuntime="27.166324ms" isStatefulPod=false podCreationTimestamp="2026-07-11 23:58:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:32.738985468 +0000 UTC m=+75.914782122" watchObservedRunningTime="2026-07-11 23:58:32.740856663 +0000 UTC m=+75.916653300" Jul 11 23:58:32.756500 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:32.756449 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qp4b9" podStartSLOduration=5.323879161 podStartE2EDuration="6.756433455s" totalImagesPullingTime="1.432554294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:58:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:32.755608378 +0000 UTC m=+75.931405016" watchObservedRunningTime="2026-07-11 23:58:32.756433455 +0000 UTC m=+75.932230095" Jul 11 23:58:35.725745 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:35.725711 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c17fd92b-7812-4cf6-a66f-f290c4daae0d","Type":"ContainerStarted","Data":"dede600c23abc93ec689765010c08068be9988fde5f1ebe37c7e08f6c153a84e"} Jul 11 23:58:35.726164 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:35.725771 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c17fd92b-7812-4cf6-a66f-f290c4daae0d","Type":"ContainerStarted","Data":"2a5d75b068dd044895c7cad53d48cbb2c20f20bdefeb3bfd0d9e0b1a01747edb"} Jul 11 23:58:35.726164 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:35.725797 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c17fd92b-7812-4cf6-a66f-f290c4daae0d","Type":"ContainerStarted","Data":"f7b660272a61ec50f2fe340f8aa38e6a83e4a0e7b09205759d1239d48d1986fc"} Jul 11 23:58:35.726164 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:35.725821 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c17fd92b-7812-4cf6-a66f-f290c4daae0d","Type":"ContainerStarted","Data":"b99716902ddc77af224b9d76fa548860b83077162cf402c52c1063291e60f44b"} Jul 11 23:58:35.726164 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:35.725843 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c17fd92b-7812-4cf6-a66f-f290c4daae0d","Type":"ContainerStarted","Data":"82f887c178654db040d0c788ad8c8d11b3992a344c22cbb2e50a82549a6af771"} Jul 11 23:58:35.726164 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:35.725868 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c17fd92b-7812-4cf6-a66f-f290c4daae0d","Type":"ContainerStarted","Data":"61785f82529a48dab852433c6e7007e4f1345d4931affb9b74376c9cc5652bb1"} Jul 11 23:58:35.753000 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:35.752955 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.707375625 podStartE2EDuration="8.752938449s" totalImagesPullingTime="3.013883083s" totalInitContainerRuntime="31.679741ms" isStatefulPod=false podCreationTimestamp="2026-07-11 23:58:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:58:35.751588358 +0000 UTC m=+78.927384998" watchObservedRunningTime="2026-07-11 23:58:35.752938449 +0000 UTC m=+78.928735090" Jul 11 23:58:37.323170 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:37.323137 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f79b7c56-qbszx" Jul 11 23:58:37.323649 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:37.323192 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f79b7c56-qbszx" Jul 11 23:58:37.327667 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:37.327647 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f79b7c56-qbszx" Jul 11 23:58:37.737895 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:37.737865 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f79b7c56-qbszx" Jul 11 23:58:37.781633 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:37.781602 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74bc586ff-mgg5q"] Jul 11 23:58:38.205070 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:38.205042 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:58:38.717398 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:38.717373 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-557df4ff8b-fc8gh" Jul 11 23:58:46.360955 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:46.360923 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" Jul 11 23:58:46.361453 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:58:46.360976 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" Jul 11 23:59:02.708514 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:02.708485 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-r8fwq" Jul 11 23:59:02.802759 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:02.802703 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-74bc586ff-mgg5q" podUID="3021087f-e6ae-4e92-b22e-c531602a1341" containerName="console" containerID="cri-o://3ecb95d0007f11ac40aa7911146fbd4e2d6e9618f6e932806ed8b4794ca15add" gracePeriod=15 Jul 11 23:59:03.567140 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.567119 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:59:03.711028 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.710970 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3021087f-e6ae-4e92-b22e-c531602a1341-console-config\") pod \"3021087f-e6ae-4e92-b22e-c531602a1341\" (UID: \"3021087f-e6ae-4e92-b22e-c531602a1341\") " Jul 11 23:59:03.711431 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.711031 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3021087f-e6ae-4e92-b22e-c531602a1341-service-ca\") pod \"3021087f-e6ae-4e92-b22e-c531602a1341\" (UID: \"3021087f-e6ae-4e92-b22e-c531602a1341\") " Jul 11 23:59:03.711431 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.711128 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3021087f-e6ae-4e92-b22e-c531602a1341-trusted-ca-bundle\") pod \"3021087f-e6ae-4e92-b22e-c531602a1341\" (UID: \"3021087f-e6ae-4e92-b22e-c531602a1341\") " Jul 11 23:59:03.711431 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.711201 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3021087f-e6ae-4e92-b22e-c531602a1341-console-serving-cert\") pod \"3021087f-e6ae-4e92-b22e-c531602a1341\" (UID: \"3021087f-e6ae-4e92-b22e-c531602a1341\") " Jul 11 23:59:03.711431 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.711233 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3021087f-e6ae-4e92-b22e-c531602a1341-oauth-serving-cert\") pod \"3021087f-e6ae-4e92-b22e-c531602a1341\" (UID: \"3021087f-e6ae-4e92-b22e-c531602a1341\") " Jul 11 23:59:03.711431 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.711277 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cms9t\" (UniqueName: \"kubernetes.io/projected/3021087f-e6ae-4e92-b22e-c531602a1341-kube-api-access-cms9t\") pod \"3021087f-e6ae-4e92-b22e-c531602a1341\" (UID: \"3021087f-e6ae-4e92-b22e-c531602a1341\") " Jul 11 23:59:03.711431 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.711319 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3021087f-e6ae-4e92-b22e-c531602a1341-console-oauth-config\") pod \"3021087f-e6ae-4e92-b22e-c531602a1341\" (UID: \"3021087f-e6ae-4e92-b22e-c531602a1341\") " Jul 11 23:59:03.711431 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.711360 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3021087f-e6ae-4e92-b22e-c531602a1341-console-config" (OuterVolumeSpecName: "console-config") pod "3021087f-e6ae-4e92-b22e-c531602a1341" (UID: "3021087f-e6ae-4e92-b22e-c531602a1341"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 23:59:03.711774 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.711575 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3021087f-e6ae-4e92-b22e-c531602a1341-console-config\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 11 23:59:03.711774 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.711387 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3021087f-e6ae-4e92-b22e-c531602a1341-service-ca" (OuterVolumeSpecName: "service-ca") pod "3021087f-e6ae-4e92-b22e-c531602a1341" (UID: "3021087f-e6ae-4e92-b22e-c531602a1341"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 23:59:03.711774 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.711612 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3021087f-e6ae-4e92-b22e-c531602a1341-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3021087f-e6ae-4e92-b22e-c531602a1341" (UID: "3021087f-e6ae-4e92-b22e-c531602a1341"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 23:59:03.711774 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.711654 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3021087f-e6ae-4e92-b22e-c531602a1341-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3021087f-e6ae-4e92-b22e-c531602a1341" (UID: "3021087f-e6ae-4e92-b22e-c531602a1341"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 11 23:59:03.713658 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.713631 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3021087f-e6ae-4e92-b22e-c531602a1341-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3021087f-e6ae-4e92-b22e-c531602a1341" (UID: "3021087f-e6ae-4e92-b22e-c531602a1341"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 23:59:03.713761 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.713679 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3021087f-e6ae-4e92-b22e-c531602a1341-kube-api-access-cms9t" (OuterVolumeSpecName: "kube-api-access-cms9t") pod "3021087f-e6ae-4e92-b22e-c531602a1341" (UID: "3021087f-e6ae-4e92-b22e-c531602a1341"). InnerVolumeSpecName "kube-api-access-cms9t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 11 23:59:03.713761 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.713681 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3021087f-e6ae-4e92-b22e-c531602a1341-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3021087f-e6ae-4e92-b22e-c531602a1341" (UID: "3021087f-e6ae-4e92-b22e-c531602a1341"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 11 23:59:03.812362 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.812341 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3021087f-e6ae-4e92-b22e-c531602a1341-service-ca\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 11 23:59:03.812362 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.812362 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3021087f-e6ae-4e92-b22e-c531602a1341-trusted-ca-bundle\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 11 23:59:03.812490 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.812372 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3021087f-e6ae-4e92-b22e-c531602a1341-console-serving-cert\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 11 23:59:03.812490 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.812380 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3021087f-e6ae-4e92-b22e-c531602a1341-oauth-serving-cert\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 11 23:59:03.812490 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.812401 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cms9t\" (UniqueName: \"kubernetes.io/projected/3021087f-e6ae-4e92-b22e-c531602a1341-kube-api-access-cms9t\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 11 23:59:03.812490 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.812410 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3021087f-e6ae-4e92-b22e-c531602a1341-console-oauth-config\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 11 23:59:03.841085 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.841055 2564 generic.go:356] "Generic (PLEG): container finished" podID="3021087f-e6ae-4e92-b22e-c531602a1341" containerID="3ecb95d0007f11ac40aa7911146fbd4e2d6e9618f6e932806ed8b4794ca15add" exitCode=0 Jul 11 23:59:03.841219 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.841123 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74bc586ff-mgg5q" Jul 11 23:59:03.841219 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.841121 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74bc586ff-mgg5q" event={"ID":"3021087f-e6ae-4e92-b22e-c531602a1341","Type":"ContainerDied","Data":"3ecb95d0007f11ac40aa7911146fbd4e2d6e9618f6e932806ed8b4794ca15add"} Jul 11 23:59:03.841219 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.841181 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74bc586ff-mgg5q" event={"ID":"3021087f-e6ae-4e92-b22e-c531602a1341","Type":"ContainerDied","Data":"b723b359e7c6d1bc93f3ff9799db79ca4d60d35f98771d39e108d4a2f0b4e7f8"} Jul 11 23:59:03.841219 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.841201 2564 scope.go:117] "RemoveContainer" containerID="3ecb95d0007f11ac40aa7911146fbd4e2d6e9618f6e932806ed8b4794ca15add" Jul 11 23:59:03.849719 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.849704 2564 scope.go:117] "RemoveContainer" containerID="3ecb95d0007f11ac40aa7911146fbd4e2d6e9618f6e932806ed8b4794ca15add" Jul 11 23:59:03.849970 ip-10-0-132-227 kubenswrapper[2564]: E0711 23:59:03.849954 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ecb95d0007f11ac40aa7911146fbd4e2d6e9618f6e932806ed8b4794ca15add\": container with ID starting with 3ecb95d0007f11ac40aa7911146fbd4e2d6e9618f6e932806ed8b4794ca15add not found: ID does not exist" containerID="3ecb95d0007f11ac40aa7911146fbd4e2d6e9618f6e932806ed8b4794ca15add" Jul 11 23:59:03.850026 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.849977 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ecb95d0007f11ac40aa7911146fbd4e2d6e9618f6e932806ed8b4794ca15add"} err="failed to get container status \"3ecb95d0007f11ac40aa7911146fbd4e2d6e9618f6e932806ed8b4794ca15add\": rpc error: code = NotFound desc = could not find container \"3ecb95d0007f11ac40aa7911146fbd4e2d6e9618f6e932806ed8b4794ca15add\": container with ID starting with 3ecb95d0007f11ac40aa7911146fbd4e2d6e9618f6e932806ed8b4794ca15add not found: ID does not exist" Jul 11 23:59:03.861186 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.861169 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74bc586ff-mgg5q"] Jul 11 23:59:03.862720 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:03.862701 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74bc586ff-mgg5q"] Jul 11 23:59:05.335099 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:05.335068 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3021087f-e6ae-4e92-b22e-c531602a1341" path="/var/lib/kubelet/pods/3021087f-e6ae-4e92-b22e-c531602a1341/volumes" Jul 11 23:59:06.365921 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:06.365884 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" Jul 11 23:59:06.369600 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:06.369583 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-658cdbb5d4-2kqgl" Jul 11 23:59:28.205732 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:28.205698 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:59:28.230686 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:28.230661 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:59:28.964934 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:28.964909 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 11 23:59:45.914611 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:45.914578 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv"] Jul 11 23:59:45.915203 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:45.915058 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3021087f-e6ae-4e92-b22e-c531602a1341" containerName="console" Jul 11 23:59:45.915203 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:45.915077 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3021087f-e6ae-4e92-b22e-c531602a1341" containerName="console" Jul 11 23:59:45.915203 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:45.915199 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3021087f-e6ae-4e92-b22e-c531602a1341" containerName="console" Jul 11 23:59:45.917227 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:45.917206 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" Jul 11 23:59:45.920634 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:45.919930 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 11 23:59:45.920634 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:45.920173 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wxtjr\"" Jul 11 23:59:45.920634 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:45.920353 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 11 23:59:45.920634 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:45.920574 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 11 23:59:45.920905 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:45.920637 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 11 23:59:45.920905 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:45.920779 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 11 23:59:45.925331 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:45.925308 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 11 23:59:45.929074 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:45.929051 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv"] Jul 11 23:59:46.043863 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:46.043836 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2ed8305-c0cd-4376-9437-40a53257ec41-metrics-client-ca\") pod \"telemeter-client-58c4d6d95b-9jjmv\" (UID: \"a2ed8305-c0cd-4376-9437-40a53257ec41\") " pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" Jul 11 23:59:46.044040 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:46.043881 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2ed8305-c0cd-4376-9437-40a53257ec41-serving-certs-ca-bundle\") pod \"telemeter-client-58c4d6d95b-9jjmv\" (UID: \"a2ed8305-c0cd-4376-9437-40a53257ec41\") " pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" Jul 11 23:59:46.044040 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:46.043940 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2ed8305-c0cd-4376-9437-40a53257ec41-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-58c4d6d95b-9jjmv\" (UID: \"a2ed8305-c0cd-4376-9437-40a53257ec41\") " pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" Jul 11 23:59:46.044040 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:46.043960 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a2ed8305-c0cd-4376-9437-40a53257ec41-secret-telemeter-client\") pod \"telemeter-client-58c4d6d95b-9jjmv\" (UID: \"a2ed8305-c0cd-4376-9437-40a53257ec41\") " pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" Jul 11 23:59:46.044040 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:46.044006 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a2ed8305-c0cd-4376-9437-40a53257ec41-telemeter-client-tls\") pod \"telemeter-client-58c4d6d95b-9jjmv\" (UID: \"a2ed8305-c0cd-4376-9437-40a53257ec41\") " pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" Jul 11 23:59:46.044250 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:46.044040 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a2ed8305-c0cd-4376-9437-40a53257ec41-federate-client-tls\") pod \"telemeter-client-58c4d6d95b-9jjmv\" (UID: \"a2ed8305-c0cd-4376-9437-40a53257ec41\") " pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" Jul 11 23:59:46.044250 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:46.044073 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2ed8305-c0cd-4376-9437-40a53257ec41-telemeter-trusted-ca-bundle\") pod \"telemeter-client-58c4d6d95b-9jjmv\" (UID: \"a2ed8305-c0cd-4376-9437-40a53257ec41\") " pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" Jul 11 23:59:46.044250 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:46.044129 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znbjv\" (UniqueName: \"kubernetes.io/projected/a2ed8305-c0cd-4376-9437-40a53257ec41-kube-api-access-znbjv\") pod \"telemeter-client-58c4d6d95b-9jjmv\" (UID: \"a2ed8305-c0cd-4376-9437-40a53257ec41\") " pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" Jul 11 23:59:46.144956 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:46.144917 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znbjv\" (UniqueName: \"kubernetes.io/projected/a2ed8305-c0cd-4376-9437-40a53257ec41-kube-api-access-znbjv\") pod \"telemeter-client-58c4d6d95b-9jjmv\" (UID: \"a2ed8305-c0cd-4376-9437-40a53257ec41\") " pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" Jul 11 23:59:46.145193 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:46.144975 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2ed8305-c0cd-4376-9437-40a53257ec41-metrics-client-ca\") pod \"telemeter-client-58c4d6d95b-9jjmv\" (UID: \"a2ed8305-c0cd-4376-9437-40a53257ec41\") " pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" Jul 11 23:59:46.145193 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:46.145011 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2ed8305-c0cd-4376-9437-40a53257ec41-serving-certs-ca-bundle\") pod \"telemeter-client-58c4d6d95b-9jjmv\" (UID: \"a2ed8305-c0cd-4376-9437-40a53257ec41\") " pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" Jul 11 23:59:46.145193 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:46.145055 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2ed8305-c0cd-4376-9437-40a53257ec41-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-58c4d6d95b-9jjmv\" (UID: \"a2ed8305-c0cd-4376-9437-40a53257ec41\") " pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" Jul 11 23:59:46.145193 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:46.145079 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a2ed8305-c0cd-4376-9437-40a53257ec41-secret-telemeter-client\") pod \"telemeter-client-58c4d6d95b-9jjmv\" (UID: \"a2ed8305-c0cd-4376-9437-40a53257ec41\") " pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" Jul 11 23:59:46.145193 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:46.145134 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a2ed8305-c0cd-4376-9437-40a53257ec41-telemeter-client-tls\") pod \"telemeter-client-58c4d6d95b-9jjmv\" (UID: \"a2ed8305-c0cd-4376-9437-40a53257ec41\") " pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" Jul 11 23:59:46.145193 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:46.145158 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a2ed8305-c0cd-4376-9437-40a53257ec41-federate-client-tls\") pod \"telemeter-client-58c4d6d95b-9jjmv\" (UID: \"a2ed8305-c0cd-4376-9437-40a53257ec41\") " pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" Jul 11 23:59:46.145193 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:46.145183 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2ed8305-c0cd-4376-9437-40a53257ec41-telemeter-trusted-ca-bundle\") pod \"telemeter-client-58c4d6d95b-9jjmv\" (UID: \"a2ed8305-c0cd-4376-9437-40a53257ec41\") " pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" Jul 11 23:59:46.145836 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:46.145807 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2ed8305-c0cd-4376-9437-40a53257ec41-serving-certs-ca-bundle\") pod \"telemeter-client-58c4d6d95b-9jjmv\" (UID: \"a2ed8305-c0cd-4376-9437-40a53257ec41\") " pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" Jul 11 23:59:46.145964 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:46.145892 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2ed8305-c0cd-4376-9437-40a53257ec41-metrics-client-ca\") pod \"telemeter-client-58c4d6d95b-9jjmv\" (UID: \"a2ed8305-c0cd-4376-9437-40a53257ec41\") " pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" Jul 11 23:59:46.146136 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:46.146089 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2ed8305-c0cd-4376-9437-40a53257ec41-telemeter-trusted-ca-bundle\") pod \"telemeter-client-58c4d6d95b-9jjmv\" (UID: \"a2ed8305-c0cd-4376-9437-40a53257ec41\") " pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" Jul 11 23:59:46.147763 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:46.147733 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a2ed8305-c0cd-4376-9437-40a53257ec41-telemeter-client-tls\") pod \"telemeter-client-58c4d6d95b-9jjmv\" (UID: \"a2ed8305-c0cd-4376-9437-40a53257ec41\") " pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" Jul 11 23:59:46.147909 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:46.147887 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a2ed8305-c0cd-4376-9437-40a53257ec41-secret-telemeter-client\") pod \"telemeter-client-58c4d6d95b-9jjmv\" (UID: \"a2ed8305-c0cd-4376-9437-40a53257ec41\") " pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" Jul 11 23:59:46.148091 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:46.148074 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a2ed8305-c0cd-4376-9437-40a53257ec41-federate-client-tls\") pod \"telemeter-client-58c4d6d95b-9jjmv\" (UID: \"a2ed8305-c0cd-4376-9437-40a53257ec41\") " pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" Jul 11 23:59:46.148179 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:46.148125 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2ed8305-c0cd-4376-9437-40a53257ec41-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-58c4d6d95b-9jjmv\" (UID: \"a2ed8305-c0cd-4376-9437-40a53257ec41\") " pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" Jul 11 23:59:46.152269 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:46.152240 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znbjv\" (UniqueName: \"kubernetes.io/projected/a2ed8305-c0cd-4376-9437-40a53257ec41-kube-api-access-znbjv\") pod \"telemeter-client-58c4d6d95b-9jjmv\" (UID: \"a2ed8305-c0cd-4376-9437-40a53257ec41\") " pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" Jul 11 23:59:46.230295 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:46.230275 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" Jul 11 23:59:46.386966 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:46.386941 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv"] Jul 11 23:59:46.389320 ip-10-0-132-227 kubenswrapper[2564]: W0711 23:59:46.389299 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2ed8305_c0cd_4376_9437_40a53257ec41.slice/crio-c7730d307e06007732e2cd2d83a3f3812775a9043fbf62aaf9e2f52e5658eefd WatchSource:0}: Error finding container c7730d307e06007732e2cd2d83a3f3812775a9043fbf62aaf9e2f52e5658eefd: Status 404 returned error can't find the container with id c7730d307e06007732e2cd2d83a3f3812775a9043fbf62aaf9e2f52e5658eefd Jul 11 23:59:47.011484 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:47.011450 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" event={"ID":"a2ed8305-c0cd-4376-9437-40a53257ec41","Type":"ContainerStarted","Data":"c7730d307e06007732e2cd2d83a3f3812775a9043fbf62aaf9e2f52e5658eefd"} Jul 11 23:59:49.021002 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:49.020971 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" event={"ID":"a2ed8305-c0cd-4376-9437-40a53257ec41","Type":"ContainerStarted","Data":"d451050cd325fe2028432a9e601a703243b709f03d2691b8fafb1ab33850dee7"} Jul 11 23:59:49.021370 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:49.021025 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" event={"ID":"a2ed8305-c0cd-4376-9437-40a53257ec41","Type":"ContainerStarted","Data":"93c2bb6dc9c234a86435b4ec9468470312eb4182ab7f5176ad3552b1c01980f7"} Jul 11 23:59:49.021370 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:49.021044 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" event={"ID":"a2ed8305-c0cd-4376-9437-40a53257ec41","Type":"ContainerStarted","Data":"6668ddf065dbdc12f8542e16b0c5426ce9c0781a95d87cbefb7025dc689dad6d"} Jul 11 23:59:49.041837 ip-10-0-132-227 kubenswrapper[2564]: I0711 23:59:49.041790 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-58c4d6d95b-9jjmv" podStartSLOduration=2.290781449 podStartE2EDuration="4.041773888s" totalImagesPullingTime="1.750992439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-11 23:59:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-11 23:59:49.039444418 +0000 UTC m=+152.215241077" watchObservedRunningTime="2026-07-11 23:59:49.041773888 +0000 UTC m=+152.217570527" Jul 12 00:00:07.978062 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:07.978029 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f79b7c56-qbszx"] Jul 12 00:00:32.998697 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:32.998654 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f79b7c56-qbszx" podUID="399f419a-d051-401c-bf50-71d49f26a3ba" containerName="console" containerID="cri-o://1a1350a4e0710a6a85f789c0fef98036893cd6b25208384248cb786cff25d2d0" gracePeriod=15 Jul 12 00:00:33.199477 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:33.199449 2564 generic.go:356] "Generic (PLEG): container finished" podID="399f419a-d051-401c-bf50-71d49f26a3ba" containerID="1a1350a4e0710a6a85f789c0fef98036893cd6b25208384248cb786cff25d2d0" exitCode=0 Jul 12 00:00:33.199602 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:33.199520 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f79b7c56-qbszx" event={"ID":"399f419a-d051-401c-bf50-71d49f26a3ba","Type":"ContainerDied","Data":"1a1350a4e0710a6a85f789c0fef98036893cd6b25208384248cb786cff25d2d0"} Jul 12 00:00:33.235638 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:33.235617 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f79b7c56-qbszx" Jul 12 00:00:33.310615 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:33.310557 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/399f419a-d051-401c-bf50-71d49f26a3ba-trusted-ca-bundle\") pod \"399f419a-d051-401c-bf50-71d49f26a3ba\" (UID: \"399f419a-d051-401c-bf50-71d49f26a3ba\") " Jul 12 00:00:33.310615 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:33.310587 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/399f419a-d051-401c-bf50-71d49f26a3ba-console-oauth-config\") pod \"399f419a-d051-401c-bf50-71d49f26a3ba\" (UID: \"399f419a-d051-401c-bf50-71d49f26a3ba\") " Jul 12 00:00:33.310761 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:33.310622 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fr6rk\" (UniqueName: \"kubernetes.io/projected/399f419a-d051-401c-bf50-71d49f26a3ba-kube-api-access-fr6rk\") pod \"399f419a-d051-401c-bf50-71d49f26a3ba\" (UID: \"399f419a-d051-401c-bf50-71d49f26a3ba\") " Jul 12 00:00:33.310761 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:33.310647 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/399f419a-d051-401c-bf50-71d49f26a3ba-oauth-serving-cert\") pod \"399f419a-d051-401c-bf50-71d49f26a3ba\" (UID: \"399f419a-d051-401c-bf50-71d49f26a3ba\") " Jul 12 00:00:33.310761 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:33.310670 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/399f419a-d051-401c-bf50-71d49f26a3ba-console-serving-cert\") pod \"399f419a-d051-401c-bf50-71d49f26a3ba\" (UID: \"399f419a-d051-401c-bf50-71d49f26a3ba\") " Jul 12 00:00:33.310761 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:33.310689 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/399f419a-d051-401c-bf50-71d49f26a3ba-service-ca\") pod \"399f419a-d051-401c-bf50-71d49f26a3ba\" (UID: \"399f419a-d051-401c-bf50-71d49f26a3ba\") " Jul 12 00:00:33.310931 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:33.310760 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/399f419a-d051-401c-bf50-71d49f26a3ba-console-config\") pod \"399f419a-d051-401c-bf50-71d49f26a3ba\" (UID: \"399f419a-d051-401c-bf50-71d49f26a3ba\") " Jul 12 00:00:33.311006 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:33.310975 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/399f419a-d051-401c-bf50-71d49f26a3ba-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "399f419a-d051-401c-bf50-71d49f26a3ba" (UID: "399f419a-d051-401c-bf50-71d49f26a3ba"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 00:00:33.311214 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:33.311142 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/399f419a-d051-401c-bf50-71d49f26a3ba-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "399f419a-d051-401c-bf50-71d49f26a3ba" (UID: "399f419a-d051-401c-bf50-71d49f26a3ba"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 00:00:33.311214 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:33.311199 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/399f419a-d051-401c-bf50-71d49f26a3ba-service-ca" (OuterVolumeSpecName: "service-ca") pod "399f419a-d051-401c-bf50-71d49f26a3ba" (UID: "399f419a-d051-401c-bf50-71d49f26a3ba"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 00:00:33.311316 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:33.311303 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/399f419a-d051-401c-bf50-71d49f26a3ba-console-config" (OuterVolumeSpecName: "console-config") pod "399f419a-d051-401c-bf50-71d49f26a3ba" (UID: "399f419a-d051-401c-bf50-71d49f26a3ba"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 00:00:33.312701 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:33.312677 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/399f419a-d051-401c-bf50-71d49f26a3ba-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "399f419a-d051-401c-bf50-71d49f26a3ba" (UID: "399f419a-d051-401c-bf50-71d49f26a3ba"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 00:00:33.313131 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:33.313091 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/399f419a-d051-401c-bf50-71d49f26a3ba-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "399f419a-d051-401c-bf50-71d49f26a3ba" (UID: "399f419a-d051-401c-bf50-71d49f26a3ba"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 00:00:33.313213 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:33.313161 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/399f419a-d051-401c-bf50-71d49f26a3ba-kube-api-access-fr6rk" (OuterVolumeSpecName: "kube-api-access-fr6rk") pod "399f419a-d051-401c-bf50-71d49f26a3ba" (UID: "399f419a-d051-401c-bf50-71d49f26a3ba"). InnerVolumeSpecName "kube-api-access-fr6rk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 00:00:33.411776 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:33.411754 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/399f419a-d051-401c-bf50-71d49f26a3ba-console-config\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:00:33.411776 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:33.411774 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/399f419a-d051-401c-bf50-71d49f26a3ba-trusted-ca-bundle\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:00:33.411897 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:33.411782 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/399f419a-d051-401c-bf50-71d49f26a3ba-console-oauth-config\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:00:33.411897 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:33.411791 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fr6rk\" (UniqueName: \"kubernetes.io/projected/399f419a-d051-401c-bf50-71d49f26a3ba-kube-api-access-fr6rk\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:00:33.411897 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:33.411800 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/399f419a-d051-401c-bf50-71d49f26a3ba-oauth-serving-cert\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:00:33.411897 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:33.411809 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/399f419a-d051-401c-bf50-71d49f26a3ba-console-serving-cert\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:00:33.411897 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:33.411818 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/399f419a-d051-401c-bf50-71d49f26a3ba-service-ca\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:00:34.205167 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:34.205140 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f79b7c56-qbszx" Jul 12 00:00:34.205167 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:34.205157 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f79b7c56-qbszx" event={"ID":"399f419a-d051-401c-bf50-71d49f26a3ba","Type":"ContainerDied","Data":"6d9c3a6a0f40a0d04a2bf536921912de268227223ec5df59aa53d584377a7902"} Jul 12 00:00:34.205604 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:34.205214 2564 scope.go:117] "RemoveContainer" containerID="1a1350a4e0710a6a85f789c0fef98036893cd6b25208384248cb786cff25d2d0" Jul 12 00:00:34.220183 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:34.220162 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f79b7c56-qbszx"] Jul 12 00:00:34.221639 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:34.221622 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f79b7c56-qbszx"] Jul 12 00:00:35.334720 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:00:35.334687 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="399f419a-d051-401c-bf50-71d49f26a3ba" path="/var/lib/kubelet/pods/399f419a-d051-401c-bf50-71d49f26a3ba/volumes" Jul 12 00:01:39.851407 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:39.851333 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-kgbjx"] Jul 12 00:01:39.851758 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:39.851669 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="399f419a-d051-401c-bf50-71d49f26a3ba" containerName="console" Jul 12 00:01:39.851758 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:39.851680 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="399f419a-d051-401c-bf50-71d49f26a3ba" containerName="console" Jul 12 00:01:39.851834 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:39.851761 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="399f419a-d051-401c-bf50-71d49f26a3ba" containerName="console" Jul 12 00:01:39.854566 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:39.854551 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-kgbjx" Jul 12 00:01:39.856994 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:39.856975 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 12 00:01:39.858167 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:39.858150 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-vlfb2\"" Jul 12 00:01:39.858255 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:39.858157 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 12 00:01:39.862939 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:39.862920 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-kgbjx"] Jul 12 00:01:39.913721 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:39.913693 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d54007ee-2a09-4654-b033-6e048c065f41-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-kgbjx\" (UID: \"d54007ee-2a09-4654-b033-6e048c065f41\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kgbjx" Jul 12 00:01:39.913816 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:39.913756 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtzdt\" (UniqueName: \"kubernetes.io/projected/d54007ee-2a09-4654-b033-6e048c065f41-kube-api-access-wtzdt\") pod \"cert-manager-webhook-6486ffd997-kgbjx\" (UID: \"d54007ee-2a09-4654-b033-6e048c065f41\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kgbjx" Jul 12 00:01:40.014280 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:40.014257 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtzdt\" (UniqueName: \"kubernetes.io/projected/d54007ee-2a09-4654-b033-6e048c065f41-kube-api-access-wtzdt\") pod \"cert-manager-webhook-6486ffd997-kgbjx\" (UID: \"d54007ee-2a09-4654-b033-6e048c065f41\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kgbjx" Jul 12 00:01:40.014365 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:40.014347 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d54007ee-2a09-4654-b033-6e048c065f41-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-kgbjx\" (UID: \"d54007ee-2a09-4654-b033-6e048c065f41\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kgbjx" Jul 12 00:01:40.021839 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:40.021821 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d54007ee-2a09-4654-b033-6e048c065f41-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-kgbjx\" (UID: \"d54007ee-2a09-4654-b033-6e048c065f41\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kgbjx" Jul 12 00:01:40.021839 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:40.021830 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtzdt\" (UniqueName: \"kubernetes.io/projected/d54007ee-2a09-4654-b033-6e048c065f41-kube-api-access-wtzdt\") pod \"cert-manager-webhook-6486ffd997-kgbjx\" (UID: \"d54007ee-2a09-4654-b033-6e048c065f41\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kgbjx" Jul 12 00:01:40.179610 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:40.179593 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-kgbjx" Jul 12 00:01:40.303394 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:40.303370 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-kgbjx"] Jul 12 00:01:40.305512 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:01:40.305486 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd54007ee_2a09_4654_b033_6e048c065f41.slice/crio-db0739734925038306e20bcbcc0b7c7de5cd17e02b00be389d333e47616f5e98 WatchSource:0}: Error finding container db0739734925038306e20bcbcc0b7c7de5cd17e02b00be389d333e47616f5e98: Status 404 returned error can't find the container with id db0739734925038306e20bcbcc0b7c7de5cd17e02b00be389d333e47616f5e98 Jul 12 00:01:40.462197 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:40.462133 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-kgbjx" event={"ID":"d54007ee-2a09-4654-b033-6e048c065f41","Type":"ContainerStarted","Data":"db0739734925038306e20bcbcc0b7c7de5cd17e02b00be389d333e47616f5e98"} Jul 12 00:01:41.482973 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:41.482945 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4rdww"] Jul 12 00:01:41.486684 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:41.486660 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4rdww" Jul 12 00:01:41.489283 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:41.489259 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-sfgn5\"" Jul 12 00:01:41.500883 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:41.499892 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4rdww"] Jul 12 00:01:41.524157 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:41.524127 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrb2n\" (UniqueName: \"kubernetes.io/projected/7a135659-1753-4267-b39f-4908f89b6c78-kube-api-access-zrb2n\") pod \"cert-manager-cainjector-559cdd8c87-4rdww\" (UID: \"7a135659-1753-4267-b39f-4908f89b6c78\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4rdww" Jul 12 00:01:41.524281 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:41.524199 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a135659-1753-4267-b39f-4908f89b6c78-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4rdww\" (UID: \"7a135659-1753-4267-b39f-4908f89b6c78\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4rdww" Jul 12 00:01:41.625231 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:41.625195 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrb2n\" (UniqueName: \"kubernetes.io/projected/7a135659-1753-4267-b39f-4908f89b6c78-kube-api-access-zrb2n\") pod \"cert-manager-cainjector-559cdd8c87-4rdww\" (UID: \"7a135659-1753-4267-b39f-4908f89b6c78\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4rdww" Jul 12 00:01:41.625389 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:41.625268 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a135659-1753-4267-b39f-4908f89b6c78-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4rdww\" (UID: \"7a135659-1753-4267-b39f-4908f89b6c78\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4rdww" Jul 12 00:01:41.639392 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:41.639341 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a135659-1753-4267-b39f-4908f89b6c78-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4rdww\" (UID: \"7a135659-1753-4267-b39f-4908f89b6c78\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4rdww" Jul 12 00:01:41.639563 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:41.639540 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrb2n\" (UniqueName: \"kubernetes.io/projected/7a135659-1753-4267-b39f-4908f89b6c78-kube-api-access-zrb2n\") pod \"cert-manager-cainjector-559cdd8c87-4rdww\" (UID: \"7a135659-1753-4267-b39f-4908f89b6c78\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4rdww" Jul 12 00:01:41.805009 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:41.804889 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4rdww" Jul 12 00:01:41.956782 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:41.956755 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4rdww"] Jul 12 00:01:41.959507 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:01:41.959478 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a135659_1753_4267_b39f_4908f89b6c78.slice/crio-10866de8fb143143d9fc24a78f27cf8003970b02c37869309e251876bae78529 WatchSource:0}: Error finding container 10866de8fb143143d9fc24a78f27cf8003970b02c37869309e251876bae78529: Status 404 returned error can't find the container with id 10866de8fb143143d9fc24a78f27cf8003970b02c37869309e251876bae78529 Jul 12 00:01:42.474346 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:42.474306 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4rdww" event={"ID":"7a135659-1753-4267-b39f-4908f89b6c78","Type":"ContainerStarted","Data":"10866de8fb143143d9fc24a78f27cf8003970b02c37869309e251876bae78529"} Jul 12 00:01:44.484178 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:44.484133 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-kgbjx" event={"ID":"d54007ee-2a09-4654-b033-6e048c065f41","Type":"ContainerStarted","Data":"02ac4b578705317bd2345b9173581ae3b841565540dfa08ca5853f8a2d3fac0c"} Jul 12 00:01:44.484704 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:44.484188 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-kgbjx" Jul 12 00:01:44.485675 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:44.485649 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4rdww" event={"ID":"7a135659-1753-4267-b39f-4908f89b6c78","Type":"ContainerStarted","Data":"e35023b9293f8ccb91d478fae0f4435061773cd89b69f94a90927f2accf32c70"} Jul 12 00:01:44.501418 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:44.501381 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-kgbjx" podStartSLOduration=2.138286268 podStartE2EDuration="5.501366978s" totalImagesPullingTime="3.36308071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:01:44.500312268 +0000 UTC m=+267.676108904" watchObservedRunningTime="2026-07-12 00:01:44.501366978 +0000 UTC m=+267.677163615" Jul 12 00:01:44.519270 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:44.519226 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4rdww" podStartSLOduration=1.810331638 podStartE2EDuration="3.519213361s" totalImagesPullingTime="1.708881723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:01:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:01:44.517454238 +0000 UTC m=+267.693250876" watchObservedRunningTime="2026-07-12 00:01:44.519213361 +0000 UTC m=+267.695009998" Jul 12 00:01:50.492155 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:01:50.492123 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-kgbjx" Jul 12 00:02:14.684461 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:14.684434 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-nvp94"] Jul 12 00:02:14.727053 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:14.727021 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-nvp94"] Jul 12 00:02:14.727218 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:14.727146 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-nvp94" Jul 12 00:02:14.729864 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:14.729839 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lrlqr\"" Jul 12 00:02:14.729864 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:14.729858 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 12 00:02:14.730055 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:14.729892 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 12 00:02:14.730055 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:14.729922 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 12 00:02:14.730279 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:14.730265 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 12 00:02:14.893184 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:14.893143 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755-tmp\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-nvp94\" (UID: \"9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-nvp94" Jul 12 00:02:14.893342 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:14.893246 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755-manifests\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-nvp94\" (UID: \"9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-nvp94" Jul 12 00:02:14.893424 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:14.893367 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnpzd\" (UniqueName: \"kubernetes.io/projected/9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755-kube-api-access-jnpzd\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-nvp94\" (UID: \"9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-nvp94" Jul 12 00:02:14.893480 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:14.893422 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-nvp94\" (UID: \"9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-nvp94" Jul 12 00:02:14.893480 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:14.893454 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-nvp94\" (UID: \"9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-nvp94" Jul 12 00:02:14.994335 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:14.994239 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755-tmp\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-nvp94\" (UID: \"9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-nvp94" Jul 12 00:02:14.994335 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:14.994290 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755-manifests\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-nvp94\" (UID: \"9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-nvp94" Jul 12 00:02:14.994560 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:14.994345 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnpzd\" (UniqueName: \"kubernetes.io/projected/9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755-kube-api-access-jnpzd\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-nvp94\" (UID: \"9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-nvp94" Jul 12 00:02:14.994560 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:14.994380 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-nvp94\" (UID: \"9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-nvp94" Jul 12 00:02:14.994560 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:14.994404 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-nvp94\" (UID: \"9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-nvp94" Jul 12 00:02:14.994751 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:14.994723 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755-manifests\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-nvp94\" (UID: \"9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-nvp94" Jul 12 00:02:14.996711 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:14.996678 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755-tmp\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-nvp94\" (UID: \"9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-nvp94" Jul 12 00:02:14.996830 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:14.996777 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-nvp94\" (UID: \"9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-nvp94" Jul 12 00:02:14.996830 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:14.996820 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-nvp94\" (UID: \"9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-nvp94" Jul 12 00:02:15.005070 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:15.005049 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnpzd\" (UniqueName: \"kubernetes.io/projected/9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755-kube-api-access-jnpzd\") pod \"opendatahub-operator-controller-manager-5c8b78dfc9-nvp94\" (UID: \"9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755\") " pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-nvp94" Jul 12 00:02:15.037243 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:15.037222 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-nvp94" Jul 12 00:02:15.188460 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:15.188435 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-nvp94"] Jul 12 00:02:15.190908 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:02:15.190883 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff5d957_8ccb_4c9e_9ac5_1cf340ba1755.slice/crio-e15c3f7c5fe405d24c1a4e452cc2dfeabec6104c1c1b8ebda75671e6122e7be6 WatchSource:0}: Error finding container e15c3f7c5fe405d24c1a4e452cc2dfeabec6104c1c1b8ebda75671e6122e7be6: Status 404 returned error can't find the container with id e15c3f7c5fe405d24c1a4e452cc2dfeabec6104c1c1b8ebda75671e6122e7be6 Jul 12 00:02:15.607091 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:15.607059 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-nvp94" event={"ID":"9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755","Type":"ContainerStarted","Data":"e15c3f7c5fe405d24c1a4e452cc2dfeabec6104c1c1b8ebda75671e6122e7be6"} Jul 12 00:02:17.267305 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:17.267280 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcdr8_8bdecd8b-9853-4a8f-8441-68bad8a709c2/ovn-acl-logging/0.log" Jul 12 00:02:17.268486 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:17.268467 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcdr8_8bdecd8b-9853-4a8f-8441-68bad8a709c2/ovn-acl-logging/0.log" Jul 12 00:02:17.274203 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:17.274185 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 12 00:02:18.623373 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:18.623300 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-nvp94" event={"ID":"9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755","Type":"ContainerStarted","Data":"8e7419c44df48796de71bddc2f5bf3c093b6b73000c2ccdf7ed9b4fe61141702"} Jul 12 00:02:19.629301 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:19.629218 2564 generic.go:356] "Generic (PLEG): container finished" podID="9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755" containerID="8e7419c44df48796de71bddc2f5bf3c093b6b73000c2ccdf7ed9b4fe61141702" exitCode=0 Jul 12 00:02:19.629636 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:19.629300 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-nvp94" event={"ID":"9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755","Type":"ContainerDied","Data":"8e7419c44df48796de71bddc2f5bf3c093b6b73000c2ccdf7ed9b4fe61141702"} Jul 12 00:02:19.629769 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:19.629755 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 12 00:02:20.635881 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:20.635850 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-nvp94" event={"ID":"9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755","Type":"ContainerStarted","Data":"b2680a478c6e599218bb7c97608f150e1a271bf4639a005766a50ee6e024a865"} Jul 12 00:02:20.636293 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:20.635956 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-nvp94" Jul 12 00:02:20.657287 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:20.657249 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-nvp94" podStartSLOduration=2.363901403 podStartE2EDuration="6.657235148s" totalImagesPullingTime="3.287873032s" totalInitContainerRuntime="1.005460713s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:02:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:02:20.65479004 +0000 UTC m=+303.830586668" watchObservedRunningTime="2026-07-12 00:02:20.657235148 +0000 UTC m=+303.833031787" Jul 12 00:02:31.642731 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:31.642701 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c8b78dfc9-nvp94" Jul 12 00:02:42.606665 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:42.606623 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-fggvj"] Jul 12 00:02:42.610004 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:42.609983 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-fggvj" Jul 12 00:02:42.613786 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:42.613560 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 12 00:02:42.613909 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:42.613804 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 12 00:02:42.613999 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:42.613904 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5ps4q\"" Jul 12 00:02:42.613999 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:42.613907 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 12 00:02:42.613999 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:42.613938 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 12 00:02:42.614177 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:42.614000 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 12 00:02:42.620038 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:42.620014 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-fggvj"] Jul 12 00:02:42.713902 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:42.713874 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3c9d0e65-98ef-4a91-bc29-c96315d0c612-manager-config\") pod \"lws-controller-manager-6bf7bdd7c5-fggvj\" (UID: \"3c9d0e65-98ef-4a91-bc29-c96315d0c612\") " pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-fggvj" Jul 12 00:02:42.714053 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:42.713930 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3c9d0e65-98ef-4a91-bc29-c96315d0c612-metrics-cert\") pod \"lws-controller-manager-6bf7bdd7c5-fggvj\" (UID: \"3c9d0e65-98ef-4a91-bc29-c96315d0c612\") " pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-fggvj" Jul 12 00:02:42.714053 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:42.713954 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w89fc\" (UniqueName: \"kubernetes.io/projected/3c9d0e65-98ef-4a91-bc29-c96315d0c612-kube-api-access-w89fc\") pod \"lws-controller-manager-6bf7bdd7c5-fggvj\" (UID: \"3c9d0e65-98ef-4a91-bc29-c96315d0c612\") " pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-fggvj" Jul 12 00:02:42.714053 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:42.714025 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c9d0e65-98ef-4a91-bc29-c96315d0c612-cert\") pod \"lws-controller-manager-6bf7bdd7c5-fggvj\" (UID: \"3c9d0e65-98ef-4a91-bc29-c96315d0c612\") " pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-fggvj" Jul 12 00:02:42.814794 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:42.814766 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3c9d0e65-98ef-4a91-bc29-c96315d0c612-metrics-cert\") pod \"lws-controller-manager-6bf7bdd7c5-fggvj\" (UID: \"3c9d0e65-98ef-4a91-bc29-c96315d0c612\") " pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-fggvj" Jul 12 00:02:42.814937 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:42.814798 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w89fc\" (UniqueName: \"kubernetes.io/projected/3c9d0e65-98ef-4a91-bc29-c96315d0c612-kube-api-access-w89fc\") pod \"lws-controller-manager-6bf7bdd7c5-fggvj\" (UID: \"3c9d0e65-98ef-4a91-bc29-c96315d0c612\") " pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-fggvj" Jul 12 00:02:42.814937 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:42.814844 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c9d0e65-98ef-4a91-bc29-c96315d0c612-cert\") pod \"lws-controller-manager-6bf7bdd7c5-fggvj\" (UID: \"3c9d0e65-98ef-4a91-bc29-c96315d0c612\") " pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-fggvj" Jul 12 00:02:42.814937 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:42.814879 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3c9d0e65-98ef-4a91-bc29-c96315d0c612-manager-config\") pod \"lws-controller-manager-6bf7bdd7c5-fggvj\" (UID: \"3c9d0e65-98ef-4a91-bc29-c96315d0c612\") " pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-fggvj" Jul 12 00:02:42.815527 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:42.815509 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3c9d0e65-98ef-4a91-bc29-c96315d0c612-manager-config\") pod \"lws-controller-manager-6bf7bdd7c5-fggvj\" (UID: \"3c9d0e65-98ef-4a91-bc29-c96315d0c612\") " pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-fggvj" Jul 12 00:02:42.817177 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:42.817156 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c9d0e65-98ef-4a91-bc29-c96315d0c612-cert\") pod \"lws-controller-manager-6bf7bdd7c5-fggvj\" (UID: \"3c9d0e65-98ef-4a91-bc29-c96315d0c612\") " pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-fggvj" Jul 12 00:02:42.817249 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:42.817212 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3c9d0e65-98ef-4a91-bc29-c96315d0c612-metrics-cert\") pod \"lws-controller-manager-6bf7bdd7c5-fggvj\" (UID: \"3c9d0e65-98ef-4a91-bc29-c96315d0c612\") " pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-fggvj" Jul 12 00:02:42.830301 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:42.830280 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w89fc\" (UniqueName: \"kubernetes.io/projected/3c9d0e65-98ef-4a91-bc29-c96315d0c612-kube-api-access-w89fc\") pod \"lws-controller-manager-6bf7bdd7c5-fggvj\" (UID: \"3c9d0e65-98ef-4a91-bc29-c96315d0c612\") " pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-fggvj" Jul 12 00:02:42.922610 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:42.922539 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-fggvj" Jul 12 00:02:43.063415 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:43.063389 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-fggvj"] Jul 12 00:02:43.064970 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:02:43.064945 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c9d0e65_98ef_4a91_bc29_c96315d0c612.slice/crio-903d8c9f9ae862dfc091a203195dce89921c352c3ba59bc8db3938300152cd9a WatchSource:0}: Error finding container 903d8c9f9ae862dfc091a203195dce89921c352c3ba59bc8db3938300152cd9a: Status 404 returned error can't find the container with id 903d8c9f9ae862dfc091a203195dce89921c352c3ba59bc8db3938300152cd9a Jul 12 00:02:43.743541 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:43.743506 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-fggvj" event={"ID":"3c9d0e65-98ef-4a91-bc29-c96315d0c612","Type":"ContainerStarted","Data":"903d8c9f9ae862dfc091a203195dce89921c352c3ba59bc8db3938300152cd9a"} Jul 12 00:02:44.262675 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:44.262646 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zg554"] Jul 12 00:02:44.274354 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:44.274329 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zh9fb"] Jul 12 00:02:44.274520 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:44.274463 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zg554" Jul 12 00:02:44.276922 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:44.276903 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-984lg\"" Jul 12 00:02:44.277128 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:44.277095 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 12 00:02:44.282731 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:44.282287 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zg554"] Jul 12 00:02:44.282731 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:44.282391 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zh9fb" Jul 12 00:02:44.284690 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:44.284666 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 12 00:02:44.284792 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:44.284737 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-q48wj\"" Jul 12 00:02:44.287870 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:44.287843 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zh9fb"] Jul 12 00:02:44.327630 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:44.327610 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4df588d-b35e-40fb-aef6-b0e12128e5cd-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zh9fb\" (UID: \"a4df588d-b35e-40fb-aef6-b0e12128e5cd\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zh9fb" Jul 12 00:02:44.327740 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:44.327644 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rwzr\" (UniqueName: \"kubernetes.io/projected/600c047f-a7bf-4474-9522-c30b342af2cd-kube-api-access-9rwzr\") pod \"kserve-controller-manager-d6f4b65b8-zg554\" (UID: \"600c047f-a7bf-4474-9522-c30b342af2cd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zg554" Jul 12 00:02:44.327740 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:44.327669 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/600c047f-a7bf-4474-9522-c30b342af2cd-cert\") pod \"kserve-controller-manager-d6f4b65b8-zg554\" (UID: \"600c047f-a7bf-4474-9522-c30b342af2cd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zg554" Jul 12 00:02:44.327811 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:44.327779 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhlpf\" (UniqueName: \"kubernetes.io/projected/a4df588d-b35e-40fb-aef6-b0e12128e5cd-kube-api-access-zhlpf\") pod \"llmisvc-controller-manager-777c6bd7d5-zh9fb\" (UID: \"a4df588d-b35e-40fb-aef6-b0e12128e5cd\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zh9fb" Jul 12 00:02:44.428687 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:44.428651 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhlpf\" (UniqueName: \"kubernetes.io/projected/a4df588d-b35e-40fb-aef6-b0e12128e5cd-kube-api-access-zhlpf\") pod \"llmisvc-controller-manager-777c6bd7d5-zh9fb\" (UID: \"a4df588d-b35e-40fb-aef6-b0e12128e5cd\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zh9fb" Jul 12 00:02:44.428849 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:44.428744 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4df588d-b35e-40fb-aef6-b0e12128e5cd-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zh9fb\" (UID: \"a4df588d-b35e-40fb-aef6-b0e12128e5cd\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zh9fb" Jul 12 00:02:44.428849 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:44.428782 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rwzr\" (UniqueName: \"kubernetes.io/projected/600c047f-a7bf-4474-9522-c30b342af2cd-kube-api-access-9rwzr\") pod \"kserve-controller-manager-d6f4b65b8-zg554\" (UID: \"600c047f-a7bf-4474-9522-c30b342af2cd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zg554" Jul 12 00:02:44.428849 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:44.428815 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/600c047f-a7bf-4474-9522-c30b342af2cd-cert\") pod \"kserve-controller-manager-d6f4b65b8-zg554\" (UID: \"600c047f-a7bf-4474-9522-c30b342af2cd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zg554" Jul 12 00:02:44.429003 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:02:44.428944 2564 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 12 00:02:44.429057 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:02:44.429017 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/600c047f-a7bf-4474-9522-c30b342af2cd-cert podName:600c047f-a7bf-4474-9522-c30b342af2cd nodeName:}" failed. No retries permitted until 2026-07-12 00:02:44.928996125 +0000 UTC m=+328.104792743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/600c047f-a7bf-4474-9522-c30b342af2cd-cert") pod "kserve-controller-manager-d6f4b65b8-zg554" (UID: "600c047f-a7bf-4474-9522-c30b342af2cd") : secret "kserve-webhook-server-cert" not found Jul 12 00:02:44.432721 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:44.432671 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a4df588d-b35e-40fb-aef6-b0e12128e5cd-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zh9fb\" (UID: \"a4df588d-b35e-40fb-aef6-b0e12128e5cd\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zh9fb" Jul 12 00:02:44.455028 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:44.454968 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rwzr\" (UniqueName: \"kubernetes.io/projected/600c047f-a7bf-4474-9522-c30b342af2cd-kube-api-access-9rwzr\") pod \"kserve-controller-manager-d6f4b65b8-zg554\" (UID: \"600c047f-a7bf-4474-9522-c30b342af2cd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zg554" Jul 12 00:02:44.456540 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:44.456505 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhlpf\" (UniqueName: \"kubernetes.io/projected/a4df588d-b35e-40fb-aef6-b0e12128e5cd-kube-api-access-zhlpf\") pod \"llmisvc-controller-manager-777c6bd7d5-zh9fb\" (UID: \"a4df588d-b35e-40fb-aef6-b0e12128e5cd\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zh9fb" Jul 12 00:02:44.595183 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:44.595095 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zh9fb" Jul 12 00:02:44.759728 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:44.759688 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zh9fb"] Jul 12 00:02:44.762092 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:02:44.762061 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda4df588d_b35e_40fb_aef6_b0e12128e5cd.slice/crio-ad5a14e203884adaafef2f8fe4e88d088a7c00e0de3b2d2614e94d6a76c5b2a3 WatchSource:0}: Error finding container ad5a14e203884adaafef2f8fe4e88d088a7c00e0de3b2d2614e94d6a76c5b2a3: Status 404 returned error can't find the container with id ad5a14e203884adaafef2f8fe4e88d088a7c00e0de3b2d2614e94d6a76c5b2a3 Jul 12 00:02:44.935309 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:44.935275 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/600c047f-a7bf-4474-9522-c30b342af2cd-cert\") pod \"kserve-controller-manager-d6f4b65b8-zg554\" (UID: \"600c047f-a7bf-4474-9522-c30b342af2cd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zg554" Jul 12 00:02:44.935514 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:02:44.935447 2564 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 12 00:02:44.935595 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:02:44.935526 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/600c047f-a7bf-4474-9522-c30b342af2cd-cert podName:600c047f-a7bf-4474-9522-c30b342af2cd nodeName:}" failed. No retries permitted until 2026-07-12 00:02:45.935505421 +0000 UTC m=+329.111302041 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/600c047f-a7bf-4474-9522-c30b342af2cd-cert") pod "kserve-controller-manager-d6f4b65b8-zg554" (UID: "600c047f-a7bf-4474-9522-c30b342af2cd") : secret "kserve-webhook-server-cert" not found Jul 12 00:02:45.755699 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:45.755668 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zh9fb" event={"ID":"a4df588d-b35e-40fb-aef6-b0e12128e5cd","Type":"ContainerStarted","Data":"ad5a14e203884adaafef2f8fe4e88d088a7c00e0de3b2d2614e94d6a76c5b2a3"} Jul 12 00:02:45.945662 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:45.945629 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/600c047f-a7bf-4474-9522-c30b342af2cd-cert\") pod \"kserve-controller-manager-d6f4b65b8-zg554\" (UID: \"600c047f-a7bf-4474-9522-c30b342af2cd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zg554" Jul 12 00:02:45.948362 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:45.948335 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/600c047f-a7bf-4474-9522-c30b342af2cd-cert\") pod \"kserve-controller-manager-d6f4b65b8-zg554\" (UID: \"600c047f-a7bf-4474-9522-c30b342af2cd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zg554" Jul 12 00:02:46.089014 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.088921 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zg554" Jul 12 00:02:46.156165 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.156138 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp"] Jul 12 00:02:46.159333 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.159313 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.162180 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.162136 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 12 00:02:46.162322 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.162200 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-sspz4\"" Jul 12 00:02:46.162322 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.162262 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 12 00:02:46.162322 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.162205 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 12 00:02:46.175521 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.175497 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp"] Jul 12 00:02:46.247959 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.247931 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d64989d-f5c2-4029-a088-7531e9d1cf8f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lhxvp\" (UID: \"5d64989d-f5c2-4029-a088-7531e9d1cf8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.248115 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.248003 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d64989d-f5c2-4029-a088-7531e9d1cf8f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lhxvp\" (UID: \"5d64989d-f5c2-4029-a088-7531e9d1cf8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.248115 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.248052 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d64989d-f5c2-4029-a088-7531e9d1cf8f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lhxvp\" (UID: \"5d64989d-f5c2-4029-a088-7531e9d1cf8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.248115 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.248076 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk2nz\" (UniqueName: \"kubernetes.io/projected/5d64989d-f5c2-4029-a088-7531e9d1cf8f-kube-api-access-wk2nz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lhxvp\" (UID: \"5d64989d-f5c2-4029-a088-7531e9d1cf8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.248115 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.248112 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d64989d-f5c2-4029-a088-7531e9d1cf8f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lhxvp\" (UID: \"5d64989d-f5c2-4029-a088-7531e9d1cf8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.248332 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.248169 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d64989d-f5c2-4029-a088-7531e9d1cf8f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lhxvp\" (UID: \"5d64989d-f5c2-4029-a088-7531e9d1cf8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.248332 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.248211 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d64989d-f5c2-4029-a088-7531e9d1cf8f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lhxvp\" (UID: \"5d64989d-f5c2-4029-a088-7531e9d1cf8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.248332 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.248233 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d64989d-f5c2-4029-a088-7531e9d1cf8f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lhxvp\" (UID: \"5d64989d-f5c2-4029-a088-7531e9d1cf8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.248332 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.248270 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d64989d-f5c2-4029-a088-7531e9d1cf8f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lhxvp\" (UID: \"5d64989d-f5c2-4029-a088-7531e9d1cf8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.307988 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.307967 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zg554"] Jul 12 00:02:46.311780 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:02:46.311756 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod600c047f_a7bf_4474_9522_c30b342af2cd.slice/crio-e34ec475cce22c360b3bbeb92e72c4444b1f3d1bdea8a4f10153e08ef67466ed WatchSource:0}: Error finding container e34ec475cce22c360b3bbeb92e72c4444b1f3d1bdea8a4f10153e08ef67466ed: Status 404 returned error can't find the container with id e34ec475cce22c360b3bbeb92e72c4444b1f3d1bdea8a4f10153e08ef67466ed Jul 12 00:02:46.350896 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.349476 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d64989d-f5c2-4029-a088-7531e9d1cf8f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lhxvp\" (UID: \"5d64989d-f5c2-4029-a088-7531e9d1cf8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.350896 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.350150 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d64989d-f5c2-4029-a088-7531e9d1cf8f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lhxvp\" (UID: \"5d64989d-f5c2-4029-a088-7531e9d1cf8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.350896 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.350195 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d64989d-f5c2-4029-a088-7531e9d1cf8f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lhxvp\" (UID: \"5d64989d-f5c2-4029-a088-7531e9d1cf8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.350896 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.350224 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk2nz\" (UniqueName: \"kubernetes.io/projected/5d64989d-f5c2-4029-a088-7531e9d1cf8f-kube-api-access-wk2nz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lhxvp\" (UID: \"5d64989d-f5c2-4029-a088-7531e9d1cf8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.350896 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.350261 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d64989d-f5c2-4029-a088-7531e9d1cf8f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lhxvp\" (UID: \"5d64989d-f5c2-4029-a088-7531e9d1cf8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.350896 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.350309 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d64989d-f5c2-4029-a088-7531e9d1cf8f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lhxvp\" (UID: \"5d64989d-f5c2-4029-a088-7531e9d1cf8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.350896 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.350358 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d64989d-f5c2-4029-a088-7531e9d1cf8f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lhxvp\" (UID: \"5d64989d-f5c2-4029-a088-7531e9d1cf8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.350896 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.350382 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d64989d-f5c2-4029-a088-7531e9d1cf8f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lhxvp\" (UID: \"5d64989d-f5c2-4029-a088-7531e9d1cf8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.350896 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.350428 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d64989d-f5c2-4029-a088-7531e9d1cf8f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lhxvp\" (UID: \"5d64989d-f5c2-4029-a088-7531e9d1cf8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.350896 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.350803 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d64989d-f5c2-4029-a088-7531e9d1cf8f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lhxvp\" (UID: \"5d64989d-f5c2-4029-a088-7531e9d1cf8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.350896 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.350827 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d64989d-f5c2-4029-a088-7531e9d1cf8f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lhxvp\" (UID: \"5d64989d-f5c2-4029-a088-7531e9d1cf8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.351555 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.351492 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d64989d-f5c2-4029-a088-7531e9d1cf8f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lhxvp\" (UID: \"5d64989d-f5c2-4029-a088-7531e9d1cf8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.351695 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.351661 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d64989d-f5c2-4029-a088-7531e9d1cf8f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lhxvp\" (UID: \"5d64989d-f5c2-4029-a088-7531e9d1cf8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.352079 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.352027 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d64989d-f5c2-4029-a088-7531e9d1cf8f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lhxvp\" (UID: \"5d64989d-f5c2-4029-a088-7531e9d1cf8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.354381 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.354358 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d64989d-f5c2-4029-a088-7531e9d1cf8f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lhxvp\" (UID: \"5d64989d-f5c2-4029-a088-7531e9d1cf8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.354819 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.354787 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d64989d-f5c2-4029-a088-7531e9d1cf8f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lhxvp\" (UID: \"5d64989d-f5c2-4029-a088-7531e9d1cf8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.365939 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.365904 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d64989d-f5c2-4029-a088-7531e9d1cf8f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lhxvp\" (UID: \"5d64989d-f5c2-4029-a088-7531e9d1cf8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.366244 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.366216 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk2nz\" (UniqueName: \"kubernetes.io/projected/5d64989d-f5c2-4029-a088-7531e9d1cf8f-kube-api-access-wk2nz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4lhxvp\" (UID: \"5d64989d-f5c2-4029-a088-7531e9d1cf8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.474186 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.474151 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:46.763266 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.763221 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zg554" event={"ID":"600c047f-a7bf-4474-9522-c30b342af2cd","Type":"ContainerStarted","Data":"e34ec475cce22c360b3bbeb92e72c4444b1f3d1bdea8a4f10153e08ef67466ed"} Jul 12 00:02:46.764969 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.764942 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-fggvj" event={"ID":"3c9d0e65-98ef-4a91-bc29-c96315d0c612","Type":"ContainerStarted","Data":"2e6231ae9df36fff10bdd74ad4dcb2511bf8248aa2eff233419135d5226cf457"} Jul 12 00:02:46.765126 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.765071 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-fggvj" Jul 12 00:02:46.780345 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.780322 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp"] Jul 12 00:02:46.781916 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:46.781875 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-fggvj" podStartSLOduration=1.648315031 podStartE2EDuration="4.781861952s" totalImagesPullingTime="3.133546921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:02:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:02:46.78060825 +0000 UTC m=+329.956404926" watchObservedRunningTime="2026-07-12 00:02:46.781861952 +0000 UTC m=+329.957658590" Jul 12 00:02:46.825136 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:02:46.825083 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d64989d_f5c2_4029_a088_7531e9d1cf8f.slice/crio-808567d20315c8fe88500c52fa1da387ee8a95b595b2546e380fd10d102a197d WatchSource:0}: Error finding container 808567d20315c8fe88500c52fa1da387ee8a95b595b2546e380fd10d102a197d: Status 404 returned error can't find the container with id 808567d20315c8fe88500c52fa1da387ee8a95b595b2546e380fd10d102a197d Jul 12 00:02:47.775927 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:47.775764 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" event={"ID":"5d64989d-f5c2-4029-a088-7531e9d1cf8f","Type":"ContainerStarted","Data":"808567d20315c8fe88500c52fa1da387ee8a95b595b2546e380fd10d102a197d"} Jul 12 00:02:50.452998 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:50.451999 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:02:50.452998 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:50.452097 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:02:50.452998 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:50.452256 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:02:50.794724 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:50.794685 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zh9fb" event={"ID":"a4df588d-b35e-40fb-aef6-b0e12128e5cd","Type":"ContainerStarted","Data":"e9b1f68f81eb148f76aeea8a914213eddfc17b4cfdbbf0a6ea5dc6041714e6d4"} Jul 12 00:02:50.794918 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:50.794848 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zh9fb" Jul 12 00:02:50.796331 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:50.796308 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zg554" event={"ID":"600c047f-a7bf-4474-9522-c30b342af2cd","Type":"ContainerStarted","Data":"54f592084e92c4c86e2e24de2d01b1a422f37e83b5e51cffb484896b286ef0cf"} Jul 12 00:02:50.796442 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:50.796428 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zg554" Jul 12 00:02:50.798079 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:50.798056 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" event={"ID":"5d64989d-f5c2-4029-a088-7531e9d1cf8f","Type":"ContainerStarted","Data":"aa0d650963068d81b4ba8b11b4130f929cfe271e5982a5ae5b25f50e9ca43fb0"} Jul 12 00:02:50.813337 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:50.813293 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zh9fb" podStartSLOduration=1.130480898 podStartE2EDuration="6.813279493s" totalImagesPullingTime="5.682798595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:02:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:02:50.811425174 +0000 UTC m=+333.987221810" watchObservedRunningTime="2026-07-12 00:02:50.813279493 +0000 UTC m=+333.989076130" Jul 12 00:02:50.827136 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:50.827083 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zg554" podStartSLOduration=2.696964723 podStartE2EDuration="6.827069452s" totalImagesPullingTime="4.130104729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:02:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:02:50.825851376 +0000 UTC m=+334.001648013" watchObservedRunningTime="2026-07-12 00:02:50.827069452 +0000 UTC m=+334.002866089" Jul 12 00:02:50.845146 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:50.845090 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" podStartSLOduration=1.220407049 podStartE2EDuration="4.845075355s" totalImagesPullingTime="3.624668306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:02:50.84258276 +0000 UTC m=+334.018379398" watchObservedRunningTime="2026-07-12 00:02:50.845075355 +0000 UTC m=+334.020871991" Jul 12 00:02:51.475354 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:51.475323 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:51.480321 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:51.480294 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:51.802822 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:51.802731 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:51.803619 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:51.803598 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4lhxvp" Jul 12 00:02:57.777652 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:02:57.777623 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6bf7bdd7c5-fggvj" Jul 12 00:03:21.805125 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:21.805079 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zh9fb" Jul 12 00:03:21.808201 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:21.808183 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zg554" Jul 12 00:03:35.820706 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:35.820669 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pxjpm"] Jul 12 00:03:35.831159 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:35.831132 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pxjpm" Jul 12 00:03:35.831309 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:35.831165 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pxjpm"] Jul 12 00:03:35.833456 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:35.833432 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 12 00:03:35.834327 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:35.834307 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-hwws9\"" Jul 12 00:03:35.834447 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:35.834332 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 12 00:03:35.878658 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:35.878633 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf48v\" (UniqueName: \"kubernetes.io/projected/caf3beea-66f5-4e82-86b1-d4b7debdf6eb-kube-api-access-tf48v\") pod \"kuadrant-operator-catalog-pxjpm\" (UID: \"caf3beea-66f5-4e82-86b1-d4b7debdf6eb\") " pod="kuadrant-system/kuadrant-operator-catalog-pxjpm" Jul 12 00:03:35.980044 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:35.980017 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf48v\" (UniqueName: \"kubernetes.io/projected/caf3beea-66f5-4e82-86b1-d4b7debdf6eb-kube-api-access-tf48v\") pod \"kuadrant-operator-catalog-pxjpm\" (UID: \"caf3beea-66f5-4e82-86b1-d4b7debdf6eb\") " pod="kuadrant-system/kuadrant-operator-catalog-pxjpm" Jul 12 00:03:35.989683 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:35.989657 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf48v\" (UniqueName: \"kubernetes.io/projected/caf3beea-66f5-4e82-86b1-d4b7debdf6eb-kube-api-access-tf48v\") pod \"kuadrant-operator-catalog-pxjpm\" (UID: \"caf3beea-66f5-4e82-86b1-d4b7debdf6eb\") " pod="kuadrant-system/kuadrant-operator-catalog-pxjpm" Jul 12 00:03:36.143412 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:36.143349 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pxjpm" Jul 12 00:03:36.206302 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:36.206255 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pxjpm"] Jul 12 00:03:36.270795 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:36.270774 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pxjpm"] Jul 12 00:03:36.272965 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:03:36.272938 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf3beea_66f5_4e82_86b1_d4b7debdf6eb.slice/crio-2f973daa6aa3950e28e25330429c52c2b3d4512659b1a8f77cbf6af643cc30e1 WatchSource:0}: Error finding container 2f973daa6aa3950e28e25330429c52c2b3d4512659b1a8f77cbf6af643cc30e1: Status 404 returned error can't find the container with id 2f973daa6aa3950e28e25330429c52c2b3d4512659b1a8f77cbf6af643cc30e1 Jul 12 00:03:36.405766 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:36.405706 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vfl9d"] Jul 12 00:03:36.408256 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:36.408241 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vfl9d" Jul 12 00:03:36.417223 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:36.417200 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vfl9d"] Jul 12 00:03:36.485227 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:36.485205 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl5pg\" (UniqueName: \"kubernetes.io/projected/01216096-1bc9-4da3-bb6c-d61955349722-kube-api-access-bl5pg\") pod \"kuadrant-operator-catalog-vfl9d\" (UID: \"01216096-1bc9-4da3-bb6c-d61955349722\") " pod="kuadrant-system/kuadrant-operator-catalog-vfl9d" Jul 12 00:03:36.586059 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:36.586023 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl5pg\" (UniqueName: \"kubernetes.io/projected/01216096-1bc9-4da3-bb6c-d61955349722-kube-api-access-bl5pg\") pod \"kuadrant-operator-catalog-vfl9d\" (UID: \"01216096-1bc9-4da3-bb6c-d61955349722\") " pod="kuadrant-system/kuadrant-operator-catalog-vfl9d" Jul 12 00:03:36.595045 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:36.595025 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl5pg\" (UniqueName: \"kubernetes.io/projected/01216096-1bc9-4da3-bb6c-d61955349722-kube-api-access-bl5pg\") pod \"kuadrant-operator-catalog-vfl9d\" (UID: \"01216096-1bc9-4da3-bb6c-d61955349722\") " pod="kuadrant-system/kuadrant-operator-catalog-vfl9d" Jul 12 00:03:36.718136 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:36.718091 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vfl9d" Jul 12 00:03:36.846664 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:36.846639 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vfl9d"] Jul 12 00:03:36.848870 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:03:36.848843 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01216096_1bc9_4da3_bb6c_d61955349722.slice/crio-27c1339fc41d52dad27052f6136c673709813dca052db1d53861e5709004eca6 WatchSource:0}: Error finding container 27c1339fc41d52dad27052f6136c673709813dca052db1d53861e5709004eca6: Status 404 returned error can't find the container with id 27c1339fc41d52dad27052f6136c673709813dca052db1d53861e5709004eca6 Jul 12 00:03:37.008392 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:37.008312 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vfl9d" event={"ID":"01216096-1bc9-4da3-bb6c-d61955349722","Type":"ContainerStarted","Data":"27c1339fc41d52dad27052f6136c673709813dca052db1d53861e5709004eca6"} Jul 12 00:03:37.009505 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:37.009482 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pxjpm" event={"ID":"caf3beea-66f5-4e82-86b1-d4b7debdf6eb","Type":"ContainerStarted","Data":"2f973daa6aa3950e28e25330429c52c2b3d4512659b1a8f77cbf6af643cc30e1"} Jul 12 00:03:39.021306 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:39.021268 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pxjpm" event={"ID":"caf3beea-66f5-4e82-86b1-d4b7debdf6eb","Type":"ContainerStarted","Data":"9297502abbd85243fb9455ba7be12add4666fed11e05ac2dc2d8413991ae8fa8"} Jul 12 00:03:39.021306 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:39.021283 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-pxjpm" podUID="caf3beea-66f5-4e82-86b1-d4b7debdf6eb" containerName="registry-server" containerID="cri-o://9297502abbd85243fb9455ba7be12add4666fed11e05ac2dc2d8413991ae8fa8" gracePeriod=2 Jul 12 00:03:39.022877 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:39.022856 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vfl9d" event={"ID":"01216096-1bc9-4da3-bb6c-d61955349722","Type":"ContainerStarted","Data":"adfe86befd962d50a8bc6bafcdf76b9eb0f9ec0dba0b17424ede4da7db7add93"} Jul 12 00:03:39.037689 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:39.037620 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-pxjpm" podStartSLOduration=1.955321101 podStartE2EDuration="4.037605175s" totalImagesPullingTime="2.082284074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:03:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:03:39.035011172 +0000 UTC m=+382.210807810" watchObservedRunningTime="2026-07-12 00:03:39.037605175 +0000 UTC m=+382.213401803" Jul 12 00:03:39.049941 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:39.049904 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-vfl9d" podStartSLOduration=1.540398754 podStartE2EDuration="3.049891118s" totalImagesPullingTime="1.509492364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:03:39.04809505 +0000 UTC m=+382.223891688" watchObservedRunningTime="2026-07-12 00:03:39.049891118 +0000 UTC m=+382.225687772" Jul 12 00:03:39.262468 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:39.262446 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pxjpm" Jul 12 00:03:39.311021 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:39.310955 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tf48v\" (UniqueName: \"kubernetes.io/projected/caf3beea-66f5-4e82-86b1-d4b7debdf6eb-kube-api-access-tf48v\") pod \"caf3beea-66f5-4e82-86b1-d4b7debdf6eb\" (UID: \"caf3beea-66f5-4e82-86b1-d4b7debdf6eb\") " Jul 12 00:03:39.312951 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:39.312924 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caf3beea-66f5-4e82-86b1-d4b7debdf6eb-kube-api-access-tf48v" (OuterVolumeSpecName: "kube-api-access-tf48v") pod "caf3beea-66f5-4e82-86b1-d4b7debdf6eb" (UID: "caf3beea-66f5-4e82-86b1-d4b7debdf6eb"). InnerVolumeSpecName "kube-api-access-tf48v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 00:03:39.412772 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:39.412742 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tf48v\" (UniqueName: \"kubernetes.io/projected/caf3beea-66f5-4e82-86b1-d4b7debdf6eb-kube-api-access-tf48v\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:03:40.028339 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:40.028302 2564 generic.go:356] "Generic (PLEG): container finished" podID="caf3beea-66f5-4e82-86b1-d4b7debdf6eb" containerID="9297502abbd85243fb9455ba7be12add4666fed11e05ac2dc2d8413991ae8fa8" exitCode=0 Jul 12 00:03:40.028720 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:40.028350 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pxjpm" Jul 12 00:03:40.028720 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:40.028376 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pxjpm" event={"ID":"caf3beea-66f5-4e82-86b1-d4b7debdf6eb","Type":"ContainerDied","Data":"9297502abbd85243fb9455ba7be12add4666fed11e05ac2dc2d8413991ae8fa8"} Jul 12 00:03:40.028720 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:40.028417 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pxjpm" event={"ID":"caf3beea-66f5-4e82-86b1-d4b7debdf6eb","Type":"ContainerDied","Data":"2f973daa6aa3950e28e25330429c52c2b3d4512659b1a8f77cbf6af643cc30e1"} Jul 12 00:03:40.028720 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:40.028437 2564 scope.go:117] "RemoveContainer" containerID="9297502abbd85243fb9455ba7be12add4666fed11e05ac2dc2d8413991ae8fa8" Jul 12 00:03:40.037233 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:40.037217 2564 scope.go:117] "RemoveContainer" containerID="9297502abbd85243fb9455ba7be12add4666fed11e05ac2dc2d8413991ae8fa8" Jul 12 00:03:40.037480 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:03:40.037461 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9297502abbd85243fb9455ba7be12add4666fed11e05ac2dc2d8413991ae8fa8\": container with ID starting with 9297502abbd85243fb9455ba7be12add4666fed11e05ac2dc2d8413991ae8fa8 not found: ID does not exist" containerID="9297502abbd85243fb9455ba7be12add4666fed11e05ac2dc2d8413991ae8fa8" Jul 12 00:03:40.037525 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:40.037489 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9297502abbd85243fb9455ba7be12add4666fed11e05ac2dc2d8413991ae8fa8"} err="failed to get container status \"9297502abbd85243fb9455ba7be12add4666fed11e05ac2dc2d8413991ae8fa8\": rpc error: code = NotFound desc = could not find container \"9297502abbd85243fb9455ba7be12add4666fed11e05ac2dc2d8413991ae8fa8\": container with ID starting with 9297502abbd85243fb9455ba7be12add4666fed11e05ac2dc2d8413991ae8fa8 not found: ID does not exist" Jul 12 00:03:40.044449 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:40.044429 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pxjpm"] Jul 12 00:03:40.048358 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:40.048336 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pxjpm"] Jul 12 00:03:41.336123 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:41.336084 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caf3beea-66f5-4e82-86b1-d4b7debdf6eb" path="/var/lib/kubelet/pods/caf3beea-66f5-4e82-86b1-d4b7debdf6eb/volumes" Jul 12 00:03:46.718455 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:46.718423 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-vfl9d" Jul 12 00:03:46.718825 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:46.718479 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-vfl9d" Jul 12 00:03:46.740627 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:46.740604 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-vfl9d" Jul 12 00:03:47.082686 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:03:47.082611 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-vfl9d" Jul 12 00:04:10.757182 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:10.757150 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znlpc"] Jul 12 00:04:10.757683 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:10.757505 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caf3beea-66f5-4e82-86b1-d4b7debdf6eb" containerName="registry-server" Jul 12 00:04:10.757683 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:10.757515 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="caf3beea-66f5-4e82-86b1-d4b7debdf6eb" containerName="registry-server" Jul 12 00:04:10.757683 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:10.757589 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="caf3beea-66f5-4e82-86b1-d4b7debdf6eb" containerName="registry-server" Jul 12 00:04:10.762775 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:10.762757 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znlpc" Jul 12 00:04:10.765320 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:10.765303 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9zlg8\"" Jul 12 00:04:10.771239 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:10.771220 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znlpc"] Jul 12 00:04:10.793443 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:10.793420 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhgjm\" (UniqueName: \"kubernetes.io/projected/f0600053-bfc8-4b26-b685-158961fe2177-kube-api-access-mhgjm\") pod \"limitador-operator-controller-manager-859d7b78bd-znlpc\" (UID: \"f0600053-bfc8-4b26-b685-158961fe2177\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znlpc" Jul 12 00:04:10.894139 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:10.894113 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhgjm\" (UniqueName: \"kubernetes.io/projected/f0600053-bfc8-4b26-b685-158961fe2177-kube-api-access-mhgjm\") pod \"limitador-operator-controller-manager-859d7b78bd-znlpc\" (UID: \"f0600053-bfc8-4b26-b685-158961fe2177\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znlpc" Jul 12 00:04:10.913370 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:10.913347 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhgjm\" (UniqueName: \"kubernetes.io/projected/f0600053-bfc8-4b26-b685-158961fe2177-kube-api-access-mhgjm\") pod \"limitador-operator-controller-manager-859d7b78bd-znlpc\" (UID: \"f0600053-bfc8-4b26-b685-158961fe2177\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znlpc" Jul 12 00:04:11.073094 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:11.073038 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znlpc" Jul 12 00:04:11.206627 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:11.206601 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znlpc"] Jul 12 00:04:11.208811 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:04:11.208781 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0600053_bfc8_4b26_b685_158961fe2177.slice/crio-35c228c6c03de34948c2d6a9afcb887db8e08c416f72d0dfa206df0a38c5b890 WatchSource:0}: Error finding container 35c228c6c03de34948c2d6a9afcb887db8e08c416f72d0dfa206df0a38c5b890: Status 404 returned error can't find the container with id 35c228c6c03de34948c2d6a9afcb887db8e08c416f72d0dfa206df0a38c5b890 Jul 12 00:04:12.176130 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:12.176086 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znlpc" event={"ID":"f0600053-bfc8-4b26-b685-158961fe2177","Type":"ContainerStarted","Data":"35c228c6c03de34948c2d6a9afcb887db8e08c416f72d0dfa206df0a38c5b890"} Jul 12 00:04:13.181601 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:13.181570 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znlpc" event={"ID":"f0600053-bfc8-4b26-b685-158961fe2177","Type":"ContainerStarted","Data":"2561a094b179a46fe4c33f0df190ba4bd23135a2ce2f9109e03e75867d8bdfd6"} Jul 12 00:04:13.182029 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:13.181636 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znlpc" Jul 12 00:04:13.198998 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:13.198950 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znlpc" podStartSLOduration=1.445024077 podStartE2EDuration="3.198933889s" totalImagesPullingTime="1.753909812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:04:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:04:13.197456034 +0000 UTC m=+416.373252673" watchObservedRunningTime="2026-07-12 00:04:13.198933889 +0000 UTC m=+416.374730524" Jul 12 00:04:17.366676 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:17.366646 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9fb8q"] Jul 12 00:04:17.371393 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:17.371372 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9fb8q" Jul 12 00:04:17.373618 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:17.373593 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 12 00:04:17.373735 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:17.373687 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-lk9dl\"" Jul 12 00:04:17.377862 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:17.377841 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9fb8q"] Jul 12 00:04:17.451122 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:17.451074 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrtbs\" (UniqueName: \"kubernetes.io/projected/64b01c35-6e22-4df6-8c25-62f8cafe3951-kube-api-access-wrtbs\") pod \"dns-operator-controller-manager-864dd78c4c-9fb8q\" (UID: \"64b01c35-6e22-4df6-8c25-62f8cafe3951\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9fb8q" Jul 12 00:04:17.552014 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:17.551942 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrtbs\" (UniqueName: \"kubernetes.io/projected/64b01c35-6e22-4df6-8c25-62f8cafe3951-kube-api-access-wrtbs\") pod \"dns-operator-controller-manager-864dd78c4c-9fb8q\" (UID: \"64b01c35-6e22-4df6-8c25-62f8cafe3951\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9fb8q" Jul 12 00:04:17.560016 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:17.559983 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrtbs\" (UniqueName: \"kubernetes.io/projected/64b01c35-6e22-4df6-8c25-62f8cafe3951-kube-api-access-wrtbs\") pod \"dns-operator-controller-manager-864dd78c4c-9fb8q\" (UID: \"64b01c35-6e22-4df6-8c25-62f8cafe3951\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9fb8q" Jul 12 00:04:17.682537 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:17.682507 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9fb8q" Jul 12 00:04:17.812472 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:17.812436 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9fb8q"] Jul 12 00:04:17.815208 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:04:17.815171 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64b01c35_6e22_4df6_8c25_62f8cafe3951.slice/crio-82e7d51e70e3c93606e01f1803e00f44bbb61b46b02e4fb44ae75db95f1464af WatchSource:0}: Error finding container 82e7d51e70e3c93606e01f1803e00f44bbb61b46b02e4fb44ae75db95f1464af: Status 404 returned error can't find the container with id 82e7d51e70e3c93606e01f1803e00f44bbb61b46b02e4fb44ae75db95f1464af Jul 12 00:04:18.207756 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:18.207721 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9fb8q" event={"ID":"64b01c35-6e22-4df6-8c25-62f8cafe3951","Type":"ContainerStarted","Data":"82e7d51e70e3c93606e01f1803e00f44bbb61b46b02e4fb44ae75db95f1464af"} Jul 12 00:04:20.219429 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:20.219381 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9fb8q" event={"ID":"64b01c35-6e22-4df6-8c25-62f8cafe3951","Type":"ContainerStarted","Data":"b20cde07e26c10246845d148765d8044af660c8c8ce02040c40889324102465f"} Jul 12 00:04:20.219812 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:20.219484 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9fb8q" Jul 12 00:04:20.235862 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:20.235819 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9fb8q" podStartSLOduration=1.440276555 podStartE2EDuration="3.235806873s" totalImagesPullingTime="1.795530318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:04:20.23501993 +0000 UTC m=+423.410816571" watchObservedRunningTime="2026-07-12 00:04:20.235806873 +0000 UTC m=+423.411603509" Jul 12 00:04:24.191435 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:24.191406 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znlpc" Jul 12 00:04:27.819408 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:27.819371 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng82x"] Jul 12 00:04:27.822918 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:27.822900 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng82x" Jul 12 00:04:27.826090 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:27.826070 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gtxcj\"" Jul 12 00:04:27.843203 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:27.843171 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng82x"] Jul 12 00:04:27.971798 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:27.971763 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-947hz\" (UniqueName: \"kubernetes.io/projected/544012b8-a048-4fce-8b94-0c04bf66f7ed-kube-api-access-947hz\") pod \"kuadrant-operator-controller-manager-55467d9f7-ng82x\" (UID: \"544012b8-a048-4fce-8b94-0c04bf66f7ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng82x" Jul 12 00:04:27.971980 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:27.971824 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/544012b8-a048-4fce-8b94-0c04bf66f7ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ng82x\" (UID: \"544012b8-a048-4fce-8b94-0c04bf66f7ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng82x" Jul 12 00:04:28.073161 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.073046 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-947hz\" (UniqueName: \"kubernetes.io/projected/544012b8-a048-4fce-8b94-0c04bf66f7ed-kube-api-access-947hz\") pod \"kuadrant-operator-controller-manager-55467d9f7-ng82x\" (UID: \"544012b8-a048-4fce-8b94-0c04bf66f7ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng82x" Jul 12 00:04:28.073161 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.073129 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/544012b8-a048-4fce-8b94-0c04bf66f7ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ng82x\" (UID: \"544012b8-a048-4fce-8b94-0c04bf66f7ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng82x" Jul 12 00:04:28.073529 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.073511 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/544012b8-a048-4fce-8b94-0c04bf66f7ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ng82x\" (UID: \"544012b8-a048-4fce-8b94-0c04bf66f7ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng82x" Jul 12 00:04:28.091542 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.091503 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-947hz\" (UniqueName: \"kubernetes.io/projected/544012b8-a048-4fce-8b94-0c04bf66f7ed-kube-api-access-947hz\") pod \"kuadrant-operator-controller-manager-55467d9f7-ng82x\" (UID: \"544012b8-a048-4fce-8b94-0c04bf66f7ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng82x" Jul 12 00:04:28.133206 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.133180 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng82x" Jul 12 00:04:28.241895 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.241864 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng82x"] Jul 12 00:04:28.246210 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.246183 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng82x"] Jul 12 00:04:28.258012 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:04:28.257984 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod544012b8_a048_4fce_8b94_0c04bf66f7ed.slice/crio-fcaa120b220b6c4267e8b4c6e26b2244a31e7bdf1b46365e7002335a6eb190bc WatchSource:0}: Error finding container fcaa120b220b6c4267e8b4c6e26b2244a31e7bdf1b46365e7002335a6eb190bc: Status 404 returned error can't find the container with id fcaa120b220b6c4267e8b4c6e26b2244a31e7bdf1b46365e7002335a6eb190bc Jul 12 00:04:28.277999 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.277970 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww8cd"] Jul 12 00:04:28.282527 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.282512 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww8cd" Jul 12 00:04:28.291880 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.290916 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znlpc"] Jul 12 00:04:28.291880 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.291424 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znlpc" podUID="f0600053-bfc8-4b26-b685-158961fe2177" containerName="manager" containerID="cri-o://2561a094b179a46fe4c33f0df190ba4bd23135a2ce2f9109e03e75867d8bdfd6" gracePeriod=2 Jul 12 00:04:28.294364 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.294332 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww8cd"] Jul 12 00:04:28.303927 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.303890 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znlpc"] Jul 12 00:04:28.311526 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:04:28.311308 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-znlpc\" is forbidden: User \"system:node:ip-10-0-132-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-227.ec2.internal' and this object" podUID="f0600053-bfc8-4b26-b685-158961fe2177" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znlpc" Jul 12 00:04:28.314337 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.314310 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5gh2"] Jul 12 00:04:28.314862 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.314839 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0600053-bfc8-4b26-b685-158961fe2177" containerName="manager" Jul 12 00:04:28.314862 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.314861 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0600053-bfc8-4b26-b685-158961fe2177" containerName="manager" Jul 12 00:04:28.315028 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.314929 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0600053-bfc8-4b26-b685-158961fe2177" containerName="manager" Jul 12 00:04:28.319411 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.319391 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5gh2" Jul 12 00:04:28.321726 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:04:28.321700 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-znlpc\" is forbidden: User \"system:node:ip-10-0-132-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-227.ec2.internal' and this object" podUID="f0600053-bfc8-4b26-b685-158961fe2177" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znlpc" Jul 12 00:04:28.333884 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.333801 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5gh2"] Jul 12 00:04:28.377404 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.377371 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljpvx\" (UniqueName: \"kubernetes.io/projected/5920034c-6ae5-4897-a958-6ea0f5b333d3-kube-api-access-ljpvx\") pod \"kuadrant-operator-controller-manager-55467d9f7-ww8cd\" (UID: \"5920034c-6ae5-4897-a958-6ea0f5b333d3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww8cd" Jul 12 00:04:28.377556 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.377497 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5920034c-6ae5-4897-a958-6ea0f5b333d3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ww8cd\" (UID: \"5920034c-6ae5-4897-a958-6ea0f5b333d3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww8cd" Jul 12 00:04:28.478872 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.478834 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5920034c-6ae5-4897-a958-6ea0f5b333d3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ww8cd\" (UID: \"5920034c-6ae5-4897-a958-6ea0f5b333d3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww8cd" Jul 12 00:04:28.479041 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.478941 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljpvx\" (UniqueName: \"kubernetes.io/projected/5920034c-6ae5-4897-a958-6ea0f5b333d3-kube-api-access-ljpvx\") pod \"kuadrant-operator-controller-manager-55467d9f7-ww8cd\" (UID: \"5920034c-6ae5-4897-a958-6ea0f5b333d3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww8cd" Jul 12 00:04:28.479041 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.478978 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvsrb\" (UniqueName: \"kubernetes.io/projected/8511cf9e-87d4-4a85-bad0-8466f18486cf-kube-api-access-cvsrb\") pod \"limitador-operator-controller-manager-859d7b78bd-d5gh2\" (UID: \"8511cf9e-87d4-4a85-bad0-8466f18486cf\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5gh2" Jul 12 00:04:28.479309 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.479285 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5920034c-6ae5-4897-a958-6ea0f5b333d3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ww8cd\" (UID: \"5920034c-6ae5-4897-a958-6ea0f5b333d3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww8cd" Jul 12 00:04:28.495455 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.495428 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljpvx\" (UniqueName: \"kubernetes.io/projected/5920034c-6ae5-4897-a958-6ea0f5b333d3-kube-api-access-ljpvx\") pod \"kuadrant-operator-controller-manager-55467d9f7-ww8cd\" (UID: \"5920034c-6ae5-4897-a958-6ea0f5b333d3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww8cd" Jul 12 00:04:28.523920 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.523896 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znlpc" Jul 12 00:04:28.526486 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:04:28.526456 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-znlpc\" is forbidden: User \"system:node:ip-10-0-132-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-227.ec2.internal' and this object" podUID="f0600053-bfc8-4b26-b685-158961fe2177" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znlpc" Jul 12 00:04:28.580480 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.580444 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvsrb\" (UniqueName: \"kubernetes.io/projected/8511cf9e-87d4-4a85-bad0-8466f18486cf-kube-api-access-cvsrb\") pod \"limitador-operator-controller-manager-859d7b78bd-d5gh2\" (UID: \"8511cf9e-87d4-4a85-bad0-8466f18486cf\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5gh2" Jul 12 00:04:28.590716 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.590646 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvsrb\" (UniqueName: \"kubernetes.io/projected/8511cf9e-87d4-4a85-bad0-8466f18486cf-kube-api-access-cvsrb\") pod \"limitador-operator-controller-manager-859d7b78bd-d5gh2\" (UID: \"8511cf9e-87d4-4a85-bad0-8466f18486cf\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5gh2" Jul 12 00:04:28.597458 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.597426 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww8cd" Jul 12 00:04:28.681619 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.681583 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhgjm\" (UniqueName: \"kubernetes.io/projected/f0600053-bfc8-4b26-b685-158961fe2177-kube-api-access-mhgjm\") pod \"f0600053-bfc8-4b26-b685-158961fe2177\" (UID: \"f0600053-bfc8-4b26-b685-158961fe2177\") " Jul 12 00:04:28.684510 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.684475 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0600053-bfc8-4b26-b685-158961fe2177-kube-api-access-mhgjm" (OuterVolumeSpecName: "kube-api-access-mhgjm") pod "f0600053-bfc8-4b26-b685-158961fe2177" (UID: "f0600053-bfc8-4b26-b685-158961fe2177"). InnerVolumeSpecName "kube-api-access-mhgjm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 00:04:28.691660 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.691637 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5gh2" Jul 12 00:04:28.736041 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.736013 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww8cd"] Jul 12 00:04:28.739031 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:04:28.739003 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5920034c_6ae5_4897_a958_6ea0f5b333d3.slice/crio-63070be63a1047764d398cbf004285bc2f879b3c426fa416dfb2163f0911fcbb WatchSource:0}: Error finding container 63070be63a1047764d398cbf004285bc2f879b3c426fa416dfb2163f0911fcbb: Status 404 returned error can't find the container with id 63070be63a1047764d398cbf004285bc2f879b3c426fa416dfb2163f0911fcbb Jul 12 00:04:28.782942 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.782907 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhgjm\" (UniqueName: \"kubernetes.io/projected/f0600053-bfc8-4b26-b685-158961fe2177-kube-api-access-mhgjm\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:04:28.840384 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:28.840344 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5gh2"] Jul 12 00:04:28.844946 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:04:28.844911 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8511cf9e_87d4_4a85_bad0_8466f18486cf.slice/crio-8be763678dacc7b571adb31066274bfcc9fb02a64753a7f1587674243753de57 WatchSource:0}: Error finding container 8be763678dacc7b571adb31066274bfcc9fb02a64753a7f1587674243753de57: Status 404 returned error can't find the container with id 8be763678dacc7b571adb31066274bfcc9fb02a64753a7f1587674243753de57 Jul 12 00:04:29.268077 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:29.268041 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5gh2" event={"ID":"8511cf9e-87d4-4a85-bad0-8466f18486cf","Type":"ContainerStarted","Data":"8fd7f3b05d74bdb27ab63c4a97a1cfcf0602f9df5a83f490762058a2a1a8c6cb"} Jul 12 00:04:29.268271 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:29.268124 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5gh2" event={"ID":"8511cf9e-87d4-4a85-bad0-8466f18486cf","Type":"ContainerStarted","Data":"8be763678dacc7b571adb31066274bfcc9fb02a64753a7f1587674243753de57"} Jul 12 00:04:29.268271 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:29.268254 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5gh2" Jul 12 00:04:29.269621 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:29.269596 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww8cd" event={"ID":"5920034c-6ae5-4897-a958-6ea0f5b333d3","Type":"ContainerStarted","Data":"63070be63a1047764d398cbf004285bc2f879b3c426fa416dfb2163f0911fcbb"} Jul 12 00:04:29.270771 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:04:29.270740 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-znlpc\" is forbidden: User \"system:node:ip-10-0-132-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-227.ec2.internal' and this object" podUID="f0600053-bfc8-4b26-b685-158961fe2177" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znlpc" Jul 12 00:04:29.270897 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:29.270844 2564 generic.go:356] "Generic (PLEG): container finished" podID="f0600053-bfc8-4b26-b685-158961fe2177" containerID="2561a094b179a46fe4c33f0df190ba4bd23135a2ce2f9109e03e75867d8bdfd6" exitCode=0 Jul 12 00:04:29.270967 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:29.270913 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znlpc" Jul 12 00:04:29.270967 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:29.270938 2564 scope.go:117] "RemoveContainer" containerID="2561a094b179a46fe4c33f0df190ba4bd23135a2ce2f9109e03e75867d8bdfd6" Jul 12 00:04:29.282422 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:29.282401 2564 scope.go:117] "RemoveContainer" containerID="2561a094b179a46fe4c33f0df190ba4bd23135a2ce2f9109e03e75867d8bdfd6" Jul 12 00:04:29.282849 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:04:29.282821 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2561a094b179a46fe4c33f0df190ba4bd23135a2ce2f9109e03e75867d8bdfd6\": container with ID starting with 2561a094b179a46fe4c33f0df190ba4bd23135a2ce2f9109e03e75867d8bdfd6 not found: ID does not exist" containerID="2561a094b179a46fe4c33f0df190ba4bd23135a2ce2f9109e03e75867d8bdfd6" Jul 12 00:04:29.282946 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:29.282858 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2561a094b179a46fe4c33f0df190ba4bd23135a2ce2f9109e03e75867d8bdfd6"} err="failed to get container status \"2561a094b179a46fe4c33f0df190ba4bd23135a2ce2f9109e03e75867d8bdfd6\": rpc error: code = NotFound desc = could not find container \"2561a094b179a46fe4c33f0df190ba4bd23135a2ce2f9109e03e75867d8bdfd6\": container with ID starting with 2561a094b179a46fe4c33f0df190ba4bd23135a2ce2f9109e03e75867d8bdfd6 not found: ID does not exist" Jul 12 00:04:29.295157 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:29.295084 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5gh2" podStartSLOduration=1.2950608080000001 podStartE2EDuration="1.295060808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:04:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:04:29.293686706 +0000 UTC m=+432.469483345" watchObservedRunningTime="2026-07-12 00:04:29.295060808 +0000 UTC m=+432.470857425" Jul 12 00:04:29.295870 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:04:29.295836 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-znlpc\" is forbidden: User \"system:node:ip-10-0-132-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-227.ec2.internal' and this object" podUID="f0600053-bfc8-4b26-b685-158961fe2177" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-znlpc" Jul 12 00:04:29.338786 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:29.338750 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0600053-bfc8-4b26-b685-158961fe2177" path="/var/lib/kubelet/pods/f0600053-bfc8-4b26-b685-158961fe2177/volumes" Jul 12 00:04:31.227180 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:31.227148 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9fb8q" Jul 12 00:04:33.295908 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:33.295870 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng82x" podUID="544012b8-a048-4fce-8b94-0c04bf66f7ed" containerName="manager" containerID="cri-o://4f06dac6d286ad55055bd8dd03364a21c8130777b542d397a3b8db5e3f2f3dc1" gracePeriod=2 Jul 12 00:04:33.297622 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:33.297591 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww8cd" event={"ID":"5920034c-6ae5-4897-a958-6ea0f5b333d3","Type":"ContainerStarted","Data":"4009bb00bae73a9d7935734114e255255b6b8180c1ec5beef8240486a53ff683"} Jul 12 00:04:33.297754 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:33.297702 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww8cd" Jul 12 00:04:33.325388 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:33.325344 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww8cd" podStartSLOduration=1.7119379239999999 podStartE2EDuration="5.325329362s" totalImagesPullingTime="3.613391438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:04:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:04:33.324287475 +0000 UTC m=+436.500084106" watchObservedRunningTime="2026-07-12 00:04:33.325329362 +0000 UTC m=+436.501125999" Jul 12 00:04:33.550667 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:33.550616 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng82x" Jul 12 00:04:33.734938 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:33.734906 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-947hz\" (UniqueName: \"kubernetes.io/projected/544012b8-a048-4fce-8b94-0c04bf66f7ed-kube-api-access-947hz\") pod \"544012b8-a048-4fce-8b94-0c04bf66f7ed\" (UID: \"544012b8-a048-4fce-8b94-0c04bf66f7ed\") " Jul 12 00:04:33.735140 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:33.734956 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/544012b8-a048-4fce-8b94-0c04bf66f7ed-extensions-socket-volume\") pod \"544012b8-a048-4fce-8b94-0c04bf66f7ed\" (UID: \"544012b8-a048-4fce-8b94-0c04bf66f7ed\") " Jul 12 00:04:33.735252 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:33.735226 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/544012b8-a048-4fce-8b94-0c04bf66f7ed-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "544012b8-a048-4fce-8b94-0c04bf66f7ed" (UID: "544012b8-a048-4fce-8b94-0c04bf66f7ed"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 00:04:33.736896 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:33.736866 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/544012b8-a048-4fce-8b94-0c04bf66f7ed-kube-api-access-947hz" (OuterVolumeSpecName: "kube-api-access-947hz") pod "544012b8-a048-4fce-8b94-0c04bf66f7ed" (UID: "544012b8-a048-4fce-8b94-0c04bf66f7ed"). InnerVolumeSpecName "kube-api-access-947hz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 00:04:33.836512 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:33.836451 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-947hz\" (UniqueName: \"kubernetes.io/projected/544012b8-a048-4fce-8b94-0c04bf66f7ed-kube-api-access-947hz\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:04:33.836512 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:33.836475 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/544012b8-a048-4fce-8b94-0c04bf66f7ed-extensions-socket-volume\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:04:34.304015 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:34.303981 2564 generic.go:356] "Generic (PLEG): container finished" podID="544012b8-a048-4fce-8b94-0c04bf66f7ed" containerID="4f06dac6d286ad55055bd8dd03364a21c8130777b542d397a3b8db5e3f2f3dc1" exitCode=2 Jul 12 00:04:34.304469 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:34.304025 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng82x" Jul 12 00:04:34.304469 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:34.304084 2564 scope.go:117] "RemoveContainer" containerID="4f06dac6d286ad55055bd8dd03364a21c8130777b542d397a3b8db5e3f2f3dc1" Jul 12 00:04:34.306393 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:04:34.306364 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-ng82x\" is forbidden: User \"system:node:ip-10-0-132-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-227.ec2.internal' and this object" podUID="544012b8-a048-4fce-8b94-0c04bf66f7ed" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng82x" Jul 12 00:04:34.312943 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:34.312927 2564 scope.go:117] "RemoveContainer" containerID="4f06dac6d286ad55055bd8dd03364a21c8130777b542d397a3b8db5e3f2f3dc1" Jul 12 00:04:34.313198 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:04:34.313182 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f06dac6d286ad55055bd8dd03364a21c8130777b542d397a3b8db5e3f2f3dc1\": container with ID starting with 4f06dac6d286ad55055bd8dd03364a21c8130777b542d397a3b8db5e3f2f3dc1 not found: ID does not exist" containerID="4f06dac6d286ad55055bd8dd03364a21c8130777b542d397a3b8db5e3f2f3dc1" Jul 12 00:04:34.313273 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:34.313205 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f06dac6d286ad55055bd8dd03364a21c8130777b542d397a3b8db5e3f2f3dc1"} err="failed to get container status \"4f06dac6d286ad55055bd8dd03364a21c8130777b542d397a3b8db5e3f2f3dc1\": rpc error: code = NotFound desc = could not find container \"4f06dac6d286ad55055bd8dd03364a21c8130777b542d397a3b8db5e3f2f3dc1\": container with ID starting with 4f06dac6d286ad55055bd8dd03364a21c8130777b542d397a3b8db5e3f2f3dc1 not found: ID does not exist" Jul 12 00:04:34.314283 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:04:34.314266 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-ng82x\" is forbidden: User \"system:node:ip-10-0-132-227.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-227.ec2.internal' and this object" podUID="544012b8-a048-4fce-8b94-0c04bf66f7ed" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ng82x" Jul 12 00:04:35.335627 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:35.335599 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="544012b8-a048-4fce-8b94-0c04bf66f7ed" path="/var/lib/kubelet/pods/544012b8-a048-4fce-8b94-0c04bf66f7ed/volumes" Jul 12 00:04:40.282183 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:40.282084 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d5gh2" Jul 12 00:04:44.306914 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:44.306880 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww8cd" Jul 12 00:04:56.676081 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:56.676047 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww8cd"] Jul 12 00:04:56.676538 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:56.676246 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww8cd" podUID="5920034c-6ae5-4897-a958-6ea0f5b333d3" containerName="manager" containerID="cri-o://4009bb00bae73a9d7935734114e255255b6b8180c1ec5beef8240486a53ff683" gracePeriod=10 Jul 12 00:04:56.939594 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:56.939542 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww8cd" Jul 12 00:04:57.032067 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:57.032026 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljpvx\" (UniqueName: \"kubernetes.io/projected/5920034c-6ae5-4897-a958-6ea0f5b333d3-kube-api-access-ljpvx\") pod \"5920034c-6ae5-4897-a958-6ea0f5b333d3\" (UID: \"5920034c-6ae5-4897-a958-6ea0f5b333d3\") " Jul 12 00:04:57.032226 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:57.032157 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5920034c-6ae5-4897-a958-6ea0f5b333d3-extensions-socket-volume\") pod \"5920034c-6ae5-4897-a958-6ea0f5b333d3\" (UID: \"5920034c-6ae5-4897-a958-6ea0f5b333d3\") " Jul 12 00:04:57.032603 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:57.032571 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5920034c-6ae5-4897-a958-6ea0f5b333d3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5920034c-6ae5-4897-a958-6ea0f5b333d3" (UID: "5920034c-6ae5-4897-a958-6ea0f5b333d3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 00:04:57.033980 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:57.033954 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5920034c-6ae5-4897-a958-6ea0f5b333d3-kube-api-access-ljpvx" (OuterVolumeSpecName: "kube-api-access-ljpvx") pod "5920034c-6ae5-4897-a958-6ea0f5b333d3" (UID: "5920034c-6ae5-4897-a958-6ea0f5b333d3"). InnerVolumeSpecName "kube-api-access-ljpvx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 00:04:57.132825 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:57.132796 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljpvx\" (UniqueName: \"kubernetes.io/projected/5920034c-6ae5-4897-a958-6ea0f5b333d3-kube-api-access-ljpvx\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:04:57.132825 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:57.132821 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5920034c-6ae5-4897-a958-6ea0f5b333d3-extensions-socket-volume\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:04:57.414293 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:57.414265 2564 generic.go:356] "Generic (PLEG): container finished" podID="5920034c-6ae5-4897-a958-6ea0f5b333d3" containerID="4009bb00bae73a9d7935734114e255255b6b8180c1ec5beef8240486a53ff683" exitCode=0 Jul 12 00:04:57.414434 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:57.414303 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww8cd" Jul 12 00:04:57.414434 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:57.414303 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww8cd" event={"ID":"5920034c-6ae5-4897-a958-6ea0f5b333d3","Type":"ContainerDied","Data":"4009bb00bae73a9d7935734114e255255b6b8180c1ec5beef8240486a53ff683"} Jul 12 00:04:57.414434 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:57.414355 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww8cd" event={"ID":"5920034c-6ae5-4897-a958-6ea0f5b333d3","Type":"ContainerDied","Data":"63070be63a1047764d398cbf004285bc2f879b3c426fa416dfb2163f0911fcbb"} Jul 12 00:04:57.414434 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:57.414383 2564 scope.go:117] "RemoveContainer" containerID="4009bb00bae73a9d7935734114e255255b6b8180c1ec5beef8240486a53ff683" Jul 12 00:04:57.422945 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:57.422930 2564 scope.go:117] "RemoveContainer" containerID="4009bb00bae73a9d7935734114e255255b6b8180c1ec5beef8240486a53ff683" Jul 12 00:04:57.423237 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:04:57.423218 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4009bb00bae73a9d7935734114e255255b6b8180c1ec5beef8240486a53ff683\": container with ID starting with 4009bb00bae73a9d7935734114e255255b6b8180c1ec5beef8240486a53ff683 not found: ID does not exist" containerID="4009bb00bae73a9d7935734114e255255b6b8180c1ec5beef8240486a53ff683" Jul 12 00:04:57.423293 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:57.423245 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4009bb00bae73a9d7935734114e255255b6b8180c1ec5beef8240486a53ff683"} err="failed to get container status \"4009bb00bae73a9d7935734114e255255b6b8180c1ec5beef8240486a53ff683\": rpc error: code = NotFound desc = could not find container \"4009bb00bae73a9d7935734114e255255b6b8180c1ec5beef8240486a53ff683\": container with ID starting with 4009bb00bae73a9d7935734114e255255b6b8180c1ec5beef8240486a53ff683 not found: ID does not exist" Jul 12 00:04:57.432817 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:57.432794 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww8cd"] Jul 12 00:04:57.441790 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:57.437146 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww8cd"] Jul 12 00:04:59.335663 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:04:59.335627 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5920034c-6ae5-4897-a958-6ea0f5b333d3" path="/var/lib/kubelet/pods/5920034c-6ae5-4897-a958-6ea0f5b333d3/volumes" Jul 12 00:05:00.772059 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.772025 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7"] Jul 12 00:05:00.772523 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.772506 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5920034c-6ae5-4897-a958-6ea0f5b333d3" containerName="manager" Jul 12 00:05:00.772523 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.772524 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5920034c-6ae5-4897-a958-6ea0f5b333d3" containerName="manager" Jul 12 00:05:00.772641 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.772547 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="544012b8-a048-4fce-8b94-0c04bf66f7ed" containerName="manager" Jul 12 00:05:00.772641 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.772555 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="544012b8-a048-4fce-8b94-0c04bf66f7ed" containerName="manager" Jul 12 00:05:00.772709 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.772643 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5920034c-6ae5-4897-a958-6ea0f5b333d3" containerName="manager" Jul 12 00:05:00.772709 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.772653 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="544012b8-a048-4fce-8b94-0c04bf66f7ed" containerName="manager" Jul 12 00:05:00.777628 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.777609 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:00.780077 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.780057 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-r8275\"" Jul 12 00:05:00.786615 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.786593 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7"] Jul 12 00:05:00.862467 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.862438 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23091102-0999-42cd-8673-1e4809b9451d-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9rkm7\" (UID: \"23091102-0999-42cd-8673-1e4809b9451d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:00.862578 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.862474 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23091102-0999-42cd-8673-1e4809b9451d-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9rkm7\" (UID: \"23091102-0999-42cd-8673-1e4809b9451d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:00.862578 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.862500 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23091102-0999-42cd-8673-1e4809b9451d-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9rkm7\" (UID: \"23091102-0999-42cd-8673-1e4809b9451d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:00.862578 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.862525 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23091102-0999-42cd-8673-1e4809b9451d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9rkm7\" (UID: \"23091102-0999-42cd-8673-1e4809b9451d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:00.862682 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.862583 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23091102-0999-42cd-8673-1e4809b9451d-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9rkm7\" (UID: \"23091102-0999-42cd-8673-1e4809b9451d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:00.862682 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.862638 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9m9g\" (UniqueName: \"kubernetes.io/projected/23091102-0999-42cd-8673-1e4809b9451d-kube-api-access-d9m9g\") pod \"maas-default-gateway-openshift-default-56654dcf7-9rkm7\" (UID: \"23091102-0999-42cd-8673-1e4809b9451d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:00.862682 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.862668 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23091102-0999-42cd-8673-1e4809b9451d-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9rkm7\" (UID: \"23091102-0999-42cd-8673-1e4809b9451d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:00.862774 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.862685 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23091102-0999-42cd-8673-1e4809b9451d-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9rkm7\" (UID: \"23091102-0999-42cd-8673-1e4809b9451d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:00.862774 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.862714 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23091102-0999-42cd-8673-1e4809b9451d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9rkm7\" (UID: \"23091102-0999-42cd-8673-1e4809b9451d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:00.963289 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.963263 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23091102-0999-42cd-8673-1e4809b9451d-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9rkm7\" (UID: \"23091102-0999-42cd-8673-1e4809b9451d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:00.963446 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.963297 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23091102-0999-42cd-8673-1e4809b9451d-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9rkm7\" (UID: \"23091102-0999-42cd-8673-1e4809b9451d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:00.963446 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.963318 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23091102-0999-42cd-8673-1e4809b9451d-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9rkm7\" (UID: \"23091102-0999-42cd-8673-1e4809b9451d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:00.963446 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.963334 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23091102-0999-42cd-8673-1e4809b9451d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9rkm7\" (UID: \"23091102-0999-42cd-8673-1e4809b9451d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:00.963446 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.963356 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23091102-0999-42cd-8673-1e4809b9451d-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9rkm7\" (UID: \"23091102-0999-42cd-8673-1e4809b9451d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:00.963446 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.963396 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9m9g\" (UniqueName: \"kubernetes.io/projected/23091102-0999-42cd-8673-1e4809b9451d-kube-api-access-d9m9g\") pod \"maas-default-gateway-openshift-default-56654dcf7-9rkm7\" (UID: \"23091102-0999-42cd-8673-1e4809b9451d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:00.963713 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.963568 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23091102-0999-42cd-8673-1e4809b9451d-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9rkm7\" (UID: \"23091102-0999-42cd-8673-1e4809b9451d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:00.963713 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.963628 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23091102-0999-42cd-8673-1e4809b9451d-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9rkm7\" (UID: \"23091102-0999-42cd-8673-1e4809b9451d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:00.963713 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.963672 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23091102-0999-42cd-8673-1e4809b9451d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9rkm7\" (UID: \"23091102-0999-42cd-8673-1e4809b9451d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:00.963867 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.963722 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23091102-0999-42cd-8673-1e4809b9451d-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9rkm7\" (UID: \"23091102-0999-42cd-8673-1e4809b9451d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:00.963867 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.963801 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23091102-0999-42cd-8673-1e4809b9451d-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9rkm7\" (UID: \"23091102-0999-42cd-8673-1e4809b9451d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:00.963867 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.963831 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23091102-0999-42cd-8673-1e4809b9451d-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9rkm7\" (UID: \"23091102-0999-42cd-8673-1e4809b9451d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:00.964027 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.963885 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23091102-0999-42cd-8673-1e4809b9451d-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9rkm7\" (UID: \"23091102-0999-42cd-8673-1e4809b9451d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:00.964146 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.964090 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23091102-0999-42cd-8673-1e4809b9451d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9rkm7\" (UID: \"23091102-0999-42cd-8673-1e4809b9451d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:00.965856 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.965833 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23091102-0999-42cd-8673-1e4809b9451d-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9rkm7\" (UID: \"23091102-0999-42cd-8673-1e4809b9451d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:00.966158 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.966138 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23091102-0999-42cd-8673-1e4809b9451d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9rkm7\" (UID: \"23091102-0999-42cd-8673-1e4809b9451d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:00.971214 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.971184 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23091102-0999-42cd-8673-1e4809b9451d-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9rkm7\" (UID: \"23091102-0999-42cd-8673-1e4809b9451d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:00.971408 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:00.971389 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9m9g\" (UniqueName: \"kubernetes.io/projected/23091102-0999-42cd-8673-1e4809b9451d-kube-api-access-d9m9g\") pod \"maas-default-gateway-openshift-default-56654dcf7-9rkm7\" (UID: \"23091102-0999-42cd-8673-1e4809b9451d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:01.089030 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:01.088959 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:01.222779 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:01.222754 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7"] Jul 12 00:05:01.224983 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:05:01.224948 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23091102_0999_42cd_8673_1e4809b9451d.slice/crio-dc85736a2e11487369aeb10e9ab91d39e19ca5c88ead0fb9983c1a7d433206b9 WatchSource:0}: Error finding container dc85736a2e11487369aeb10e9ab91d39e19ca5c88ead0fb9983c1a7d433206b9: Status 404 returned error can't find the container with id dc85736a2e11487369aeb10e9ab91d39e19ca5c88ead0fb9983c1a7d433206b9 Jul 12 00:05:01.227255 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:01.227219 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:05:01.227365 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:01.227317 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:05:01.227427 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:01.227367 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:05:01.438069 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:01.438034 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" event={"ID":"23091102-0999-42cd-8673-1e4809b9451d","Type":"ContainerStarted","Data":"b4209069a923634823f9169c6e168334861ca93414b3a33d6634a457241d18ed"} Jul 12 00:05:01.438250 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:01.438086 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" event={"ID":"23091102-0999-42cd-8673-1e4809b9451d","Type":"ContainerStarted","Data":"dc85736a2e11487369aeb10e9ab91d39e19ca5c88ead0fb9983c1a7d433206b9"} Jul 12 00:05:01.459338 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:01.459288 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" podStartSLOduration=1.4592724879999999 podStartE2EDuration="1.459272488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:05:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:05:01.457997831 +0000 UTC m=+464.633794463" watchObservedRunningTime="2026-07-12 00:05:01.459272488 +0000 UTC m=+464.635069124" Jul 12 00:05:02.089250 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:02.089219 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:02.093523 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:02.093503 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:02.443041 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:02.443015 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:02.444136 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:02.444119 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:05:14.457261 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:14.457224 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jr7qd"] Jul 12 00:05:14.461301 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:14.461281 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jr7qd" Jul 12 00:05:14.463821 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:14.463802 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-82w8r\"" Jul 12 00:05:14.463888 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:14.463828 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 12 00:05:14.470318 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:14.470296 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jr7qd"] Jul 12 00:05:14.553885 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:14.553856 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jr7qd"] Jul 12 00:05:14.585201 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:14.585169 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6cbb825f-654c-4141-9f00-7cb4114c4397-config-file\") pod \"limitador-limitador-64c94fd64f-jr7qd\" (UID: \"6cbb825f-654c-4141-9f00-7cb4114c4397\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jr7qd" Jul 12 00:05:14.585201 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:14.585200 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gxzc\" (UniqueName: \"kubernetes.io/projected/6cbb825f-654c-4141-9f00-7cb4114c4397-kube-api-access-2gxzc\") pod \"limitador-limitador-64c94fd64f-jr7qd\" (UID: \"6cbb825f-654c-4141-9f00-7cb4114c4397\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jr7qd" Jul 12 00:05:14.686143 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:14.686083 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6cbb825f-654c-4141-9f00-7cb4114c4397-config-file\") pod \"limitador-limitador-64c94fd64f-jr7qd\" (UID: \"6cbb825f-654c-4141-9f00-7cb4114c4397\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jr7qd" Jul 12 00:05:14.686143 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:14.686145 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gxzc\" (UniqueName: \"kubernetes.io/projected/6cbb825f-654c-4141-9f00-7cb4114c4397-kube-api-access-2gxzc\") pod \"limitador-limitador-64c94fd64f-jr7qd\" (UID: \"6cbb825f-654c-4141-9f00-7cb4114c4397\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jr7qd" Jul 12 00:05:14.686703 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:14.686686 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6cbb825f-654c-4141-9f00-7cb4114c4397-config-file\") pod \"limitador-limitador-64c94fd64f-jr7qd\" (UID: \"6cbb825f-654c-4141-9f00-7cb4114c4397\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jr7qd" Jul 12 00:05:14.693396 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:14.693372 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gxzc\" (UniqueName: \"kubernetes.io/projected/6cbb825f-654c-4141-9f00-7cb4114c4397-kube-api-access-2gxzc\") pod \"limitador-limitador-64c94fd64f-jr7qd\" (UID: \"6cbb825f-654c-4141-9f00-7cb4114c4397\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jr7qd" Jul 12 00:05:14.773505 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:14.773449 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jr7qd" Jul 12 00:05:14.906346 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:14.904359 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jr7qd"] Jul 12 00:05:14.907356 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:05:14.907331 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cbb825f_654c_4141_9f00_7cb4114c4397.slice/crio-535f2e1b5fafb4bf559981b38471a28b03181ced9cc1c8a05912b4847d209f73 WatchSource:0}: Error finding container 535f2e1b5fafb4bf559981b38471a28b03181ced9cc1c8a05912b4847d209f73: Status 404 returned error can't find the container with id 535f2e1b5fafb4bf559981b38471a28b03181ced9cc1c8a05912b4847d209f73 Jul 12 00:05:15.513118 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:15.513065 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jr7qd" event={"ID":"6cbb825f-654c-4141-9f00-7cb4114c4397","Type":"ContainerStarted","Data":"535f2e1b5fafb4bf559981b38471a28b03181ced9cc1c8a05912b4847d209f73"} Jul 12 00:05:18.530427 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:18.530394 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jr7qd" event={"ID":"6cbb825f-654c-4141-9f00-7cb4114c4397","Type":"ContainerStarted","Data":"d861b1edf063b90ae74011c147f23ca77ba9e8bc167a2036e07bbd60cdfa92ac"} Jul 12 00:05:18.530821 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:18.530541 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jr7qd" Jul 12 00:05:18.545938 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:18.545898 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-jr7qd" podStartSLOduration=1.914083271 podStartE2EDuration="4.545886939s" totalImagesPullingTime="2.631803668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:05:18.544930349 +0000 UTC m=+481.720726988" watchObservedRunningTime="2026-07-12 00:05:18.545886939 +0000 UTC m=+481.721683576" Jul 12 00:05:28.796074 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:28.796039 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jr7qd"] Jul 12 00:05:28.796605 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:28.796230 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-jr7qd" podUID="6cbb825f-654c-4141-9f00-7cb4114c4397" containerName="limitador" containerID="cri-o://d861b1edf063b90ae74011c147f23ca77ba9e8bc167a2036e07bbd60cdfa92ac" gracePeriod=30 Jul 12 00:05:28.797067 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:28.796863 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jr7qd" Jul 12 00:05:29.348024 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:29.348001 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jr7qd" Jul 12 00:05:29.408029 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:29.407967 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gxzc\" (UniqueName: \"kubernetes.io/projected/6cbb825f-654c-4141-9f00-7cb4114c4397-kube-api-access-2gxzc\") pod \"6cbb825f-654c-4141-9f00-7cb4114c4397\" (UID: \"6cbb825f-654c-4141-9f00-7cb4114c4397\") " Jul 12 00:05:29.408029 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:29.408026 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6cbb825f-654c-4141-9f00-7cb4114c4397-config-file\") pod \"6cbb825f-654c-4141-9f00-7cb4114c4397\" (UID: \"6cbb825f-654c-4141-9f00-7cb4114c4397\") " Jul 12 00:05:29.408376 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:29.408353 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cbb825f-654c-4141-9f00-7cb4114c4397-config-file" (OuterVolumeSpecName: "config-file") pod "6cbb825f-654c-4141-9f00-7cb4114c4397" (UID: "6cbb825f-654c-4141-9f00-7cb4114c4397"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 00:05:29.409905 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:29.409885 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cbb825f-654c-4141-9f00-7cb4114c4397-kube-api-access-2gxzc" (OuterVolumeSpecName: "kube-api-access-2gxzc") pod "6cbb825f-654c-4141-9f00-7cb4114c4397" (UID: "6cbb825f-654c-4141-9f00-7cb4114c4397"). InnerVolumeSpecName "kube-api-access-2gxzc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 00:05:29.508618 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:29.508591 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gxzc\" (UniqueName: \"kubernetes.io/projected/6cbb825f-654c-4141-9f00-7cb4114c4397-kube-api-access-2gxzc\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:05:29.508618 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:29.508615 2564 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6cbb825f-654c-4141-9f00-7cb4114c4397-config-file\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:05:29.585525 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:29.585497 2564 generic.go:356] "Generic (PLEG): container finished" podID="6cbb825f-654c-4141-9f00-7cb4114c4397" containerID="d861b1edf063b90ae74011c147f23ca77ba9e8bc167a2036e07bbd60cdfa92ac" exitCode=0 Jul 12 00:05:29.585648 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:29.585541 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jr7qd" Jul 12 00:05:29.585648 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:29.585569 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jr7qd" event={"ID":"6cbb825f-654c-4141-9f00-7cb4114c4397","Type":"ContainerDied","Data":"d861b1edf063b90ae74011c147f23ca77ba9e8bc167a2036e07bbd60cdfa92ac"} Jul 12 00:05:29.585648 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:29.585610 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jr7qd" event={"ID":"6cbb825f-654c-4141-9f00-7cb4114c4397","Type":"ContainerDied","Data":"535f2e1b5fafb4bf559981b38471a28b03181ced9cc1c8a05912b4847d209f73"} Jul 12 00:05:29.585648 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:29.585632 2564 scope.go:117] "RemoveContainer" containerID="d861b1edf063b90ae74011c147f23ca77ba9e8bc167a2036e07bbd60cdfa92ac" Jul 12 00:05:29.594656 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:29.594635 2564 scope.go:117] "RemoveContainer" containerID="d861b1edf063b90ae74011c147f23ca77ba9e8bc167a2036e07bbd60cdfa92ac" Jul 12 00:05:29.594933 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:05:29.594915 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d861b1edf063b90ae74011c147f23ca77ba9e8bc167a2036e07bbd60cdfa92ac\": container with ID starting with d861b1edf063b90ae74011c147f23ca77ba9e8bc167a2036e07bbd60cdfa92ac not found: ID does not exist" containerID="d861b1edf063b90ae74011c147f23ca77ba9e8bc167a2036e07bbd60cdfa92ac" Jul 12 00:05:29.594982 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:29.594941 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d861b1edf063b90ae74011c147f23ca77ba9e8bc167a2036e07bbd60cdfa92ac"} err="failed to get container status \"d861b1edf063b90ae74011c147f23ca77ba9e8bc167a2036e07bbd60cdfa92ac\": rpc error: code = NotFound desc = could not find container \"d861b1edf063b90ae74011c147f23ca77ba9e8bc167a2036e07bbd60cdfa92ac\": container with ID starting with d861b1edf063b90ae74011c147f23ca77ba9e8bc167a2036e07bbd60cdfa92ac not found: ID does not exist" Jul 12 00:05:29.606355 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:29.606332 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jr7qd"] Jul 12 00:05:29.609685 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:29.609665 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jr7qd"] Jul 12 00:05:31.335860 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:31.335825 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cbb825f-654c-4141-9f00-7cb4114c4397" path="/var/lib/kubelet/pods/6cbb825f-654c-4141-9f00-7cb4114c4397/volumes" Jul 12 00:05:34.663452 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:34.663422 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zx7z5"] Jul 12 00:05:34.663937 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:34.663919 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cbb825f-654c-4141-9f00-7cb4114c4397" containerName="limitador" Jul 12 00:05:34.663937 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:34.663938 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cbb825f-654c-4141-9f00-7cb4114c4397" containerName="limitador" Jul 12 00:05:34.664032 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:34.664003 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cbb825f-654c-4141-9f00-7cb4114c4397" containerName="limitador" Jul 12 00:05:34.668360 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:34.668343 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zx7z5" Jul 12 00:05:34.670723 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:34.670695 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 12 00:05:34.670876 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:34.670858 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 12 00:05:34.670923 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:34.670886 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 12 00:05:34.671844 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:34.671826 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-zr7l5\"" Jul 12 00:05:34.674240 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:34.674220 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zx7z5"] Jul 12 00:05:34.744017 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:34.743984 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a3b2bc3d-8984-47c5-a7af-11fa608ec9f1-data\") pod \"postgres-69fb4594cf-zx7z5\" (UID: \"a3b2bc3d-8984-47c5-a7af-11fa608ec9f1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zx7z5" Jul 12 00:05:34.744154 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:34.744050 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq59c\" (UniqueName: \"kubernetes.io/projected/a3b2bc3d-8984-47c5-a7af-11fa608ec9f1-kube-api-access-nq59c\") pod \"postgres-69fb4594cf-zx7z5\" (UID: \"a3b2bc3d-8984-47c5-a7af-11fa608ec9f1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zx7z5" Jul 12 00:05:34.845022 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:34.844994 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a3b2bc3d-8984-47c5-a7af-11fa608ec9f1-data\") pod \"postgres-69fb4594cf-zx7z5\" (UID: \"a3b2bc3d-8984-47c5-a7af-11fa608ec9f1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zx7z5" Jul 12 00:05:34.845163 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:34.845036 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq59c\" (UniqueName: \"kubernetes.io/projected/a3b2bc3d-8984-47c5-a7af-11fa608ec9f1-kube-api-access-nq59c\") pod \"postgres-69fb4594cf-zx7z5\" (UID: \"a3b2bc3d-8984-47c5-a7af-11fa608ec9f1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zx7z5" Jul 12 00:05:34.845434 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:34.845414 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a3b2bc3d-8984-47c5-a7af-11fa608ec9f1-data\") pod \"postgres-69fb4594cf-zx7z5\" (UID: \"a3b2bc3d-8984-47c5-a7af-11fa608ec9f1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zx7z5" Jul 12 00:05:34.852789 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:34.852767 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq59c\" (UniqueName: \"kubernetes.io/projected/a3b2bc3d-8984-47c5-a7af-11fa608ec9f1-kube-api-access-nq59c\") pod \"postgres-69fb4594cf-zx7z5\" (UID: \"a3b2bc3d-8984-47c5-a7af-11fa608ec9f1\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zx7z5" Jul 12 00:05:34.980011 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:34.979983 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zx7z5" Jul 12 00:05:35.111907 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:35.111881 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zx7z5"] Jul 12 00:05:35.113862 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:05:35.113836 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3b2bc3d_8984_47c5_a7af_11fa608ec9f1.slice/crio-39a0a1ad1ecd02148ce65769272e0034d23b3d8b4ab6ea4a6dbcfe848216e8d5 WatchSource:0}: Error finding container 39a0a1ad1ecd02148ce65769272e0034d23b3d8b4ab6ea4a6dbcfe848216e8d5: Status 404 returned error can't find the container with id 39a0a1ad1ecd02148ce65769272e0034d23b3d8b4ab6ea4a6dbcfe848216e8d5 Jul 12 00:05:35.615343 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:35.615306 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zx7z5" event={"ID":"a3b2bc3d-8984-47c5-a7af-11fa608ec9f1","Type":"ContainerStarted","Data":"39a0a1ad1ecd02148ce65769272e0034d23b3d8b4ab6ea4a6dbcfe848216e8d5"} Jul 12 00:05:40.642915 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:40.642879 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zx7z5" event={"ID":"a3b2bc3d-8984-47c5-a7af-11fa608ec9f1","Type":"ContainerStarted","Data":"2092889e624ab782327d9dee68806c403d9f0b5ea41b7b0b11e611d4e8eec097"} Jul 12 00:05:40.643382 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:40.643077 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zx7z5" Jul 12 00:05:40.660753 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:40.660703 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zx7z5" podStartSLOduration=2.066453924 podStartE2EDuration="6.66068769s" totalImagesPullingTime="4.594233766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:05:40.658715537 +0000 UTC m=+503.834512174" watchObservedRunningTime="2026-07-12 00:05:40.66068769 +0000 UTC m=+503.836484327" Jul 12 00:05:46.682788 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:46.682752 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zx7z5" Jul 12 00:05:53.608801 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:53.608766 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-559bbf7d4-2zc2q"] Jul 12 00:05:53.768693 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:53.768656 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-559bbf7d4-2zc2q"] Jul 12 00:05:53.768852 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:53.768767 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-559bbf7d4-2zc2q" Jul 12 00:05:53.771408 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:53.771386 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 12 00:05:53.771566 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:53.771386 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7d756\"" Jul 12 00:05:53.772347 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:53.772323 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 12 00:05:53.808494 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:53.808464 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4cdce27-6132-4ad0-9bda-2d1ca8d1385b-webhook-cert\") pod \"maas-controller-559bbf7d4-2zc2q\" (UID: \"d4cdce27-6132-4ad0-9bda-2d1ca8d1385b\") " pod="opendatahub/maas-controller-559bbf7d4-2zc2q" Jul 12 00:05:53.808494 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:53.808500 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9qbl\" (UniqueName: \"kubernetes.io/projected/d4cdce27-6132-4ad0-9bda-2d1ca8d1385b-kube-api-access-d9qbl\") pod \"maas-controller-559bbf7d4-2zc2q\" (UID: \"d4cdce27-6132-4ad0-9bda-2d1ca8d1385b\") " pod="opendatahub/maas-controller-559bbf7d4-2zc2q" Jul 12 00:05:53.909832 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:53.909750 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4cdce27-6132-4ad0-9bda-2d1ca8d1385b-webhook-cert\") pod \"maas-controller-559bbf7d4-2zc2q\" (UID: \"d4cdce27-6132-4ad0-9bda-2d1ca8d1385b\") " pod="opendatahub/maas-controller-559bbf7d4-2zc2q" Jul 12 00:05:53.909832 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:53.909790 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9qbl\" (UniqueName: \"kubernetes.io/projected/d4cdce27-6132-4ad0-9bda-2d1ca8d1385b-kube-api-access-d9qbl\") pod \"maas-controller-559bbf7d4-2zc2q\" (UID: \"d4cdce27-6132-4ad0-9bda-2d1ca8d1385b\") " pod="opendatahub/maas-controller-559bbf7d4-2zc2q" Jul 12 00:05:53.910011 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:05:53.909893 2564 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 12 00:05:53.910011 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:05:53.909985 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4cdce27-6132-4ad0-9bda-2d1ca8d1385b-webhook-cert podName:d4cdce27-6132-4ad0-9bda-2d1ca8d1385b nodeName:}" failed. No retries permitted until 2026-07-12 00:05:54.409968522 +0000 UTC m=+517.585765136 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/d4cdce27-6132-4ad0-9bda-2d1ca8d1385b-webhook-cert") pod "maas-controller-559bbf7d4-2zc2q" (UID: "d4cdce27-6132-4ad0-9bda-2d1ca8d1385b") : secret "maas-controller-webhook-cert" not found Jul 12 00:05:53.918225 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:53.918196 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9qbl\" (UniqueName: \"kubernetes.io/projected/d4cdce27-6132-4ad0-9bda-2d1ca8d1385b-kube-api-access-d9qbl\") pod \"maas-controller-559bbf7d4-2zc2q\" (UID: \"d4cdce27-6132-4ad0-9bda-2d1ca8d1385b\") " pod="opendatahub/maas-controller-559bbf7d4-2zc2q" Jul 12 00:05:54.414138 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:54.414082 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4cdce27-6132-4ad0-9bda-2d1ca8d1385b-webhook-cert\") pod \"maas-controller-559bbf7d4-2zc2q\" (UID: \"d4cdce27-6132-4ad0-9bda-2d1ca8d1385b\") " pod="opendatahub/maas-controller-559bbf7d4-2zc2q" Jul 12 00:05:54.416512 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:54.416486 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4cdce27-6132-4ad0-9bda-2d1ca8d1385b-webhook-cert\") pod \"maas-controller-559bbf7d4-2zc2q\" (UID: \"d4cdce27-6132-4ad0-9bda-2d1ca8d1385b\") " pod="opendatahub/maas-controller-559bbf7d4-2zc2q" Jul 12 00:05:54.679526 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:54.679496 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-559bbf7d4-2zc2q" Jul 12 00:05:54.809247 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:54.809066 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-559bbf7d4-2zc2q"] Jul 12 00:05:54.811449 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:05:54.811426 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4cdce27_6132_4ad0_9bda_2d1ca8d1385b.slice/crio-017b861650420deede5522d7aee772daef3efe27dbe34144fcce750b56066043 WatchSource:0}: Error finding container 017b861650420deede5522d7aee772daef3efe27dbe34144fcce750b56066043: Status 404 returned error can't find the container with id 017b861650420deede5522d7aee772daef3efe27dbe34144fcce750b56066043 Jul 12 00:05:55.717367 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:55.717326 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-559bbf7d4-2zc2q" event={"ID":"d4cdce27-6132-4ad0-9bda-2d1ca8d1385b","Type":"ContainerStarted","Data":"017b861650420deede5522d7aee772daef3efe27dbe34144fcce750b56066043"} Jul 12 00:05:57.729815 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:57.729777 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-559bbf7d4-2zc2q" event={"ID":"d4cdce27-6132-4ad0-9bda-2d1ca8d1385b","Type":"ContainerStarted","Data":"1c9cfef55e5d56f335ebbc60637c82636f51d8ef331b032ea9829dddda33d9d4"} Jul 12 00:05:57.730195 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:57.729833 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-559bbf7d4-2zc2q" Jul 12 00:05:57.750231 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:05:57.750184 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-559bbf7d4-2zc2q" podStartSLOduration=2.792700052 podStartE2EDuration="4.7501684s" totalImagesPullingTime="1.957468348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:05:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:05:57.747640022 +0000 UTC m=+520.923436659" watchObservedRunningTime="2026-07-12 00:05:57.7501684 +0000 UTC m=+520.925965039" Jul 12 00:06:08.736497 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:08.736465 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-559bbf7d4-2zc2q" Jul 12 00:06:08.948029 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:08.947999 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-559bbf7d4-2zc2q"] Jul 12 00:06:08.948244 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:08.948218 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-559bbf7d4-2zc2q" podUID="d4cdce27-6132-4ad0-9bda-2d1ca8d1385b" containerName="manager" containerID="cri-o://1c9cfef55e5d56f335ebbc60637c82636f51d8ef331b032ea9829dddda33d9d4" gracePeriod=30 Jul 12 00:06:09.196408 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:09.196382 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-559bbf7d4-2zc2q" Jul 12 00:06:09.359720 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:09.359617 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4cdce27-6132-4ad0-9bda-2d1ca8d1385b-webhook-cert\") pod \"d4cdce27-6132-4ad0-9bda-2d1ca8d1385b\" (UID: \"d4cdce27-6132-4ad0-9bda-2d1ca8d1385b\") " Jul 12 00:06:09.359881 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:09.359779 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9qbl\" (UniqueName: \"kubernetes.io/projected/d4cdce27-6132-4ad0-9bda-2d1ca8d1385b-kube-api-access-d9qbl\") pod \"d4cdce27-6132-4ad0-9bda-2d1ca8d1385b\" (UID: \"d4cdce27-6132-4ad0-9bda-2d1ca8d1385b\") " Jul 12 00:06:09.361923 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:09.361888 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4cdce27-6132-4ad0-9bda-2d1ca8d1385b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d4cdce27-6132-4ad0-9bda-2d1ca8d1385b" (UID: "d4cdce27-6132-4ad0-9bda-2d1ca8d1385b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 00:06:09.362030 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:09.361890 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4cdce27-6132-4ad0-9bda-2d1ca8d1385b-kube-api-access-d9qbl" (OuterVolumeSpecName: "kube-api-access-d9qbl") pod "d4cdce27-6132-4ad0-9bda-2d1ca8d1385b" (UID: "d4cdce27-6132-4ad0-9bda-2d1ca8d1385b"). InnerVolumeSpecName "kube-api-access-d9qbl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 00:06:09.461327 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:09.461276 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9qbl\" (UniqueName: \"kubernetes.io/projected/d4cdce27-6132-4ad0-9bda-2d1ca8d1385b-kube-api-access-d9qbl\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:06:09.461327 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:09.461318 2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4cdce27-6132-4ad0-9bda-2d1ca8d1385b-webhook-cert\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:06:09.791764 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:09.791729 2564 generic.go:356] "Generic (PLEG): container finished" podID="d4cdce27-6132-4ad0-9bda-2d1ca8d1385b" containerID="1c9cfef55e5d56f335ebbc60637c82636f51d8ef331b032ea9829dddda33d9d4" exitCode=0 Jul 12 00:06:09.792159 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:09.791772 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-559bbf7d4-2zc2q" Jul 12 00:06:09.792159 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:09.791814 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-559bbf7d4-2zc2q" event={"ID":"d4cdce27-6132-4ad0-9bda-2d1ca8d1385b","Type":"ContainerDied","Data":"1c9cfef55e5d56f335ebbc60637c82636f51d8ef331b032ea9829dddda33d9d4"} Jul 12 00:06:09.792159 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:09.791862 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-559bbf7d4-2zc2q" event={"ID":"d4cdce27-6132-4ad0-9bda-2d1ca8d1385b","Type":"ContainerDied","Data":"017b861650420deede5522d7aee772daef3efe27dbe34144fcce750b56066043"} Jul 12 00:06:09.792159 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:09.791884 2564 scope.go:117] "RemoveContainer" containerID="1c9cfef55e5d56f335ebbc60637c82636f51d8ef331b032ea9829dddda33d9d4" Jul 12 00:06:09.801053 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:09.801033 2564 scope.go:117] "RemoveContainer" containerID="1c9cfef55e5d56f335ebbc60637c82636f51d8ef331b032ea9829dddda33d9d4" Jul 12 00:06:09.801330 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:06:09.801311 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c9cfef55e5d56f335ebbc60637c82636f51d8ef331b032ea9829dddda33d9d4\": container with ID starting with 1c9cfef55e5d56f335ebbc60637c82636f51d8ef331b032ea9829dddda33d9d4 not found: ID does not exist" containerID="1c9cfef55e5d56f335ebbc60637c82636f51d8ef331b032ea9829dddda33d9d4" Jul 12 00:06:09.801382 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:09.801338 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c9cfef55e5d56f335ebbc60637c82636f51d8ef331b032ea9829dddda33d9d4"} err="failed to get container status \"1c9cfef55e5d56f335ebbc60637c82636f51d8ef331b032ea9829dddda33d9d4\": rpc error: code = NotFound desc = could not find container \"1c9cfef55e5d56f335ebbc60637c82636f51d8ef331b032ea9829dddda33d9d4\": container with ID starting with 1c9cfef55e5d56f335ebbc60637c82636f51d8ef331b032ea9829dddda33d9d4 not found: ID does not exist" Jul 12 00:06:09.811996 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:09.811969 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-559bbf7d4-2zc2q"] Jul 12 00:06:09.813635 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:09.813615 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-559bbf7d4-2zc2q"] Jul 12 00:06:11.336683 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:11.336650 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4cdce27-6132-4ad0-9bda-2d1ca8d1385b" path="/var/lib/kubelet/pods/d4cdce27-6132-4ad0-9bda-2d1ca8d1385b/volumes" Jul 12 00:06:29.198868 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.198835 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7d7cb7bff4-wnp69"] Jul 12 00:06:29.199423 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.199406 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4cdce27-6132-4ad0-9bda-2d1ca8d1385b" containerName="manager" Jul 12 00:06:29.199423 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.199424 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4cdce27-6132-4ad0-9bda-2d1ca8d1385b" containerName="manager" Jul 12 00:06:29.199511 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.199505 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4cdce27-6132-4ad0-9bda-2d1ca8d1385b" containerName="manager" Jul 12 00:06:29.204232 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.204213 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7d7cb7bff4-wnp69" Jul 12 00:06:29.206754 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.206727 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 12 00:06:29.206882 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.206849 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bzlt9\"" Jul 12 00:06:29.214942 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.214918 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d7cb7bff4-wnp69"] Jul 12 00:06:29.237093 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.237072 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7stn6\" (UniqueName: \"kubernetes.io/projected/1e3d83f0-73e7-4ea9-bcc1-cb8be3753893-kube-api-access-7stn6\") pod \"maas-api-7d7cb7bff4-wnp69\" (UID: \"1e3d83f0-73e7-4ea9-bcc1-cb8be3753893\") " pod="odh-ai-gateway-infra/maas-api-7d7cb7bff4-wnp69" Jul 12 00:06:29.237273 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.237257 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e3d83f0-73e7-4ea9-bcc1-cb8be3753893-maas-api-tls\") pod \"maas-api-7d7cb7bff4-wnp69\" (UID: \"1e3d83f0-73e7-4ea9-bcc1-cb8be3753893\") " pod="odh-ai-gateway-infra/maas-api-7d7cb7bff4-wnp69" Jul 12 00:06:29.237339 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.237315 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e3d83f0-73e7-4ea9-bcc1-cb8be3753893-openshift-service-ca\") pod \"maas-api-7d7cb7bff4-wnp69\" (UID: \"1e3d83f0-73e7-4ea9-bcc1-cb8be3753893\") " pod="odh-ai-gateway-infra/maas-api-7d7cb7bff4-wnp69" Jul 12 00:06:29.338417 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.338383 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7stn6\" (UniqueName: \"kubernetes.io/projected/1e3d83f0-73e7-4ea9-bcc1-cb8be3753893-kube-api-access-7stn6\") pod \"maas-api-7d7cb7bff4-wnp69\" (UID: \"1e3d83f0-73e7-4ea9-bcc1-cb8be3753893\") " pod="odh-ai-gateway-infra/maas-api-7d7cb7bff4-wnp69" Jul 12 00:06:29.338594 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.338443 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e3d83f0-73e7-4ea9-bcc1-cb8be3753893-maas-api-tls\") pod \"maas-api-7d7cb7bff4-wnp69\" (UID: \"1e3d83f0-73e7-4ea9-bcc1-cb8be3753893\") " pod="odh-ai-gateway-infra/maas-api-7d7cb7bff4-wnp69" Jul 12 00:06:29.338594 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.338469 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e3d83f0-73e7-4ea9-bcc1-cb8be3753893-openshift-service-ca\") pod \"maas-api-7d7cb7bff4-wnp69\" (UID: \"1e3d83f0-73e7-4ea9-bcc1-cb8be3753893\") " pod="odh-ai-gateway-infra/maas-api-7d7cb7bff4-wnp69" Jul 12 00:06:29.338594 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:06:29.338578 2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 12 00:06:29.338716 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:06:29.338640 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e3d83f0-73e7-4ea9-bcc1-cb8be3753893-maas-api-tls podName:1e3d83f0-73e7-4ea9-bcc1-cb8be3753893 nodeName:}" failed. No retries permitted until 2026-07-12 00:06:29.838621266 +0000 UTC m=+553.014417888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1e3d83f0-73e7-4ea9-bcc1-cb8be3753893-maas-api-tls") pod "maas-api-7d7cb7bff4-wnp69" (UID: "1e3d83f0-73e7-4ea9-bcc1-cb8be3753893") : secret "maas-api-serving-cert" not found Jul 12 00:06:29.339171 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.339152 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e3d83f0-73e7-4ea9-bcc1-cb8be3753893-openshift-service-ca\") pod \"maas-api-7d7cb7bff4-wnp69\" (UID: \"1e3d83f0-73e7-4ea9-bcc1-cb8be3753893\") " pod="odh-ai-gateway-infra/maas-api-7d7cb7bff4-wnp69" Jul 12 00:06:29.346573 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.346548 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7stn6\" (UniqueName: \"kubernetes.io/projected/1e3d83f0-73e7-4ea9-bcc1-cb8be3753893-kube-api-access-7stn6\") pod \"maas-api-7d7cb7bff4-wnp69\" (UID: \"1e3d83f0-73e7-4ea9-bcc1-cb8be3753893\") " pod="odh-ai-gateway-infra/maas-api-7d7cb7bff4-wnp69" Jul 12 00:06:29.678038 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.678006 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-tg9lj"] Jul 12 00:06:29.681926 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.681909 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-tg9lj" Jul 12 00:06:29.684384 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.684369 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 12 00:06:29.684463 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.684379 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-t2rdh\"" Jul 12 00:06:29.690986 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.690963 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-tg9lj"] Jul 12 00:06:29.742403 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.742368 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/649b2b12-1d9b-4ad5-a87c-2b4de8ca86f9-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-tg9lj\" (UID: \"649b2b12-1d9b-4ad5-a87c-2b4de8ca86f9\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-tg9lj" Jul 12 00:06:29.742574 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.742539 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llvgt\" (UniqueName: \"kubernetes.io/projected/649b2b12-1d9b-4ad5-a87c-2b4de8ca86f9-kube-api-access-llvgt\") pod \"payload-pre-processing-74584bb9f8-tg9lj\" (UID: \"649b2b12-1d9b-4ad5-a87c-2b4de8ca86f9\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-tg9lj" Jul 12 00:06:29.843584 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.843542 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/649b2b12-1d9b-4ad5-a87c-2b4de8ca86f9-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-tg9lj\" (UID: \"649b2b12-1d9b-4ad5-a87c-2b4de8ca86f9\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-tg9lj" Jul 12 00:06:29.843766 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.843636 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e3d83f0-73e7-4ea9-bcc1-cb8be3753893-maas-api-tls\") pod \"maas-api-7d7cb7bff4-wnp69\" (UID: \"1e3d83f0-73e7-4ea9-bcc1-cb8be3753893\") " pod="odh-ai-gateway-infra/maas-api-7d7cb7bff4-wnp69" Jul 12 00:06:29.843766 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.843681 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llvgt\" (UniqueName: \"kubernetes.io/projected/649b2b12-1d9b-4ad5-a87c-2b4de8ca86f9-kube-api-access-llvgt\") pod \"payload-pre-processing-74584bb9f8-tg9lj\" (UID: \"649b2b12-1d9b-4ad5-a87c-2b4de8ca86f9\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-tg9lj" Jul 12 00:06:29.844298 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.844278 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/649b2b12-1d9b-4ad5-a87c-2b4de8ca86f9-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-tg9lj\" (UID: \"649b2b12-1d9b-4ad5-a87c-2b4de8ca86f9\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-tg9lj" Jul 12 00:06:29.846067 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.846045 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e3d83f0-73e7-4ea9-bcc1-cb8be3753893-maas-api-tls\") pod \"maas-api-7d7cb7bff4-wnp69\" (UID: \"1e3d83f0-73e7-4ea9-bcc1-cb8be3753893\") " pod="odh-ai-gateway-infra/maas-api-7d7cb7bff4-wnp69" Jul 12 00:06:29.851847 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.851824 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llvgt\" (UniqueName: \"kubernetes.io/projected/649b2b12-1d9b-4ad5-a87c-2b4de8ca86f9-kube-api-access-llvgt\") pod \"payload-pre-processing-74584bb9f8-tg9lj\" (UID: \"649b2b12-1d9b-4ad5-a87c-2b4de8ca86f9\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-tg9lj" Jul 12 00:06:29.993535 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:29.993453 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-tg9lj" Jul 12 00:06:30.115378 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:30.115348 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7d7cb7bff4-wnp69" Jul 12 00:06:30.123633 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:30.123612 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-tg9lj"] Jul 12 00:06:30.252080 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:30.252045 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d7cb7bff4-wnp69"] Jul 12 00:06:30.253926 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:06:30.253899 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e3d83f0_73e7_4ea9_bcc1_cb8be3753893.slice/crio-43f9ba37aa0bdabc04ad087073c563cc9849b541cf0670b31afea7b9a02ad6d1 WatchSource:0}: Error finding container 43f9ba37aa0bdabc04ad087073c563cc9849b541cf0670b31afea7b9a02ad6d1: Status 404 returned error can't find the container with id 43f9ba37aa0bdabc04ad087073c563cc9849b541cf0670b31afea7b9a02ad6d1 Jul 12 00:06:30.903928 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:30.903889 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-tg9lj" event={"ID":"649b2b12-1d9b-4ad5-a87c-2b4de8ca86f9","Type":"ContainerStarted","Data":"9ea86438ec93f971abaf7ab867ecd168c81d3bd2d5f7be3208cbd673f1a7c497"} Jul 12 00:06:30.905404 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:30.905372 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7d7cb7bff4-wnp69" event={"ID":"1e3d83f0-73e7-4ea9-bcc1-cb8be3753893","Type":"ContainerStarted","Data":"43f9ba37aa0bdabc04ad087073c563cc9849b541cf0670b31afea7b9a02ad6d1"} Jul 12 00:06:32.922312 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:32.922269 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7d7cb7bff4-wnp69" event={"ID":"1e3d83f0-73e7-4ea9-bcc1-cb8be3753893","Type":"ContainerStarted","Data":"62a5e106c0f8cf73eeb73a1f3928d18f768318fbd06861ff776d1d4897afa8f3"} Jul 12 00:06:32.922805 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:32.922455 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7d7cb7bff4-wnp69" Jul 12 00:06:32.923818 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:32.923794 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-tg9lj" event={"ID":"649b2b12-1d9b-4ad5-a87c-2b4de8ca86f9","Type":"ContainerStarted","Data":"ffbd915fb2090ebd815750118629301835fbbb0cf3ce9cc3ffee7fb2f3a7965a"} Jul 12 00:06:32.923934 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:32.923919 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-tg9lj" Jul 12 00:06:32.938595 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:32.938550 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7d7cb7bff4-wnp69" podStartSLOduration=1.9663445720000001 podStartE2EDuration="3.9385367s" totalImagesPullingTime="1.972192128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:06:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:06:32.937618163 +0000 UTC m=+556.113414804" watchObservedRunningTime="2026-07-12 00:06:32.9385367 +0000 UTC m=+556.114333338" Jul 12 00:06:32.952723 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:32.952685 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-tg9lj" podStartSLOduration=1.857908592 podStartE2EDuration="3.952672103s" totalImagesPullingTime="2.094763511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:06:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:06:32.950866592 +0000 UTC m=+556.126663230" watchObservedRunningTime="2026-07-12 00:06:32.952672103 +0000 UTC m=+556.128468739" Jul 12 00:06:37.951709 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:37.951678 2564 generic.go:356] "Generic (PLEG): container finished" podID="23091102-0999-42cd-8673-1e4809b9451d" containerID="b4209069a923634823f9169c6e168334861ca93414b3a33d6634a457241d18ed" exitCode=0 Jul 12 00:06:37.952115 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:37.951750 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" event={"ID":"23091102-0999-42cd-8673-1e4809b9451d","Type":"ContainerDied","Data":"b4209069a923634823f9169c6e168334861ca93414b3a33d6634a457241d18ed"} Jul 12 00:06:37.952115 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:37.952087 2564 scope.go:117] "RemoveContainer" containerID="b4209069a923634823f9169c6e168334861ca93414b3a33d6634a457241d18ed" Jul 12 00:06:37.953129 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:37.953085 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:06:37.953191 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:37.953168 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:06:37.953231 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:37.953203 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:06:38.936184 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:38.936154 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7d7cb7bff4-wnp69" Jul 12 00:06:38.958746 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:38.958712 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" event={"ID":"23091102-0999-42cd-8673-1e4809b9451d","Type":"ContainerStarted","Data":"d853c42c733677fda3376129de0e27aa26d53f1612e1240796a40533fd558cbf"} Jul 12 00:06:39.089374 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:39.089343 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:06:39.089546 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:39.089524 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9rkm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 12 00:06:39.089598 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:39.089580 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" podUID="23091102-0999-42cd-8673-1e4809b9451d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 12 00:06:40.089743 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:40.089703 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9rkm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 12 00:06:40.090336 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:40.090305 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" podUID="23091102-0999-42cd-8673-1e4809b9451d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 12 00:06:41.089805 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:41.089765 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9rkm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 12 00:06:41.090329 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:41.089832 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" podUID="23091102-0999-42cd-8673-1e4809b9451d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 12 00:06:42.090254 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:42.089778 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9rkm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 12 00:06:42.090254 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:42.089842 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" podUID="23091102-0999-42cd-8673-1e4809b9451d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 12 00:06:43.089655 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:43.089614 2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9rkm7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 12 00:06:43.089873 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:43.089691 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" podUID="23091102-0999-42cd-8673-1e4809b9451d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 12 00:06:43.933174 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:43.933144 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-tg9lj" Jul 12 00:06:44.092975 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:44.092943 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:06:44.093260 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:44.093236 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:06:44.093961 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:06:44.093943 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9rkm7" Jul 12 00:07:02.655576 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:02.655547 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s"] Jul 12 00:07:02.661385 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:02.661365 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s" Jul 12 00:07:02.664058 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:02.663878 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 12 00:07:02.664859 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:02.664835 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 12 00:07:02.664975 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:02.664900 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-czsp5\"" Jul 12 00:07:02.664975 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:02.664927 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 12 00:07:02.668957 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:02.668933 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s"] Jul 12 00:07:02.779376 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:02.779339 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fflzd\" (UniqueName: \"kubernetes.io/projected/5f21b231-43fe-4db9-ab03-8ea3d385ff27-kube-api-access-fflzd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s\" (UID: \"5f21b231-43fe-4db9-ab03-8ea3d385ff27\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s" Jul 12 00:07:02.779534 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:02.779395 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f21b231-43fe-4db9-ab03-8ea3d385ff27-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s\" (UID: \"5f21b231-43fe-4db9-ab03-8ea3d385ff27\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s" Jul 12 00:07:02.779534 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:02.779456 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f21b231-43fe-4db9-ab03-8ea3d385ff27-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s\" (UID: \"5f21b231-43fe-4db9-ab03-8ea3d385ff27\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s" Jul 12 00:07:02.779534 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:02.779503 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f21b231-43fe-4db9-ab03-8ea3d385ff27-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s\" (UID: \"5f21b231-43fe-4db9-ab03-8ea3d385ff27\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s" Jul 12 00:07:02.779534 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:02.779522 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f21b231-43fe-4db9-ab03-8ea3d385ff27-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s\" (UID: \"5f21b231-43fe-4db9-ab03-8ea3d385ff27\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s" Jul 12 00:07:02.779683 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:02.779569 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f21b231-43fe-4db9-ab03-8ea3d385ff27-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s\" (UID: \"5f21b231-43fe-4db9-ab03-8ea3d385ff27\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s" Jul 12 00:07:02.880440 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:02.880414 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fflzd\" (UniqueName: \"kubernetes.io/projected/5f21b231-43fe-4db9-ab03-8ea3d385ff27-kube-api-access-fflzd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s\" (UID: \"5f21b231-43fe-4db9-ab03-8ea3d385ff27\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s" Jul 12 00:07:02.880572 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:02.880450 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f21b231-43fe-4db9-ab03-8ea3d385ff27-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s\" (UID: \"5f21b231-43fe-4db9-ab03-8ea3d385ff27\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s" Jul 12 00:07:02.880572 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:02.880472 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f21b231-43fe-4db9-ab03-8ea3d385ff27-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s\" (UID: \"5f21b231-43fe-4db9-ab03-8ea3d385ff27\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s" Jul 12 00:07:02.880572 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:02.880510 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f21b231-43fe-4db9-ab03-8ea3d385ff27-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s\" (UID: \"5f21b231-43fe-4db9-ab03-8ea3d385ff27\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s" Jul 12 00:07:02.880572 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:02.880531 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f21b231-43fe-4db9-ab03-8ea3d385ff27-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s\" (UID: \"5f21b231-43fe-4db9-ab03-8ea3d385ff27\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s" Jul 12 00:07:02.880764 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:02.880583 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f21b231-43fe-4db9-ab03-8ea3d385ff27-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s\" (UID: \"5f21b231-43fe-4db9-ab03-8ea3d385ff27\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s" Jul 12 00:07:02.880901 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:02.880863 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f21b231-43fe-4db9-ab03-8ea3d385ff27-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s\" (UID: \"5f21b231-43fe-4db9-ab03-8ea3d385ff27\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s" Jul 12 00:07:02.881018 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:02.880963 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f21b231-43fe-4db9-ab03-8ea3d385ff27-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s\" (UID: \"5f21b231-43fe-4db9-ab03-8ea3d385ff27\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s" Jul 12 00:07:02.881081 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:02.881029 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f21b231-43fe-4db9-ab03-8ea3d385ff27-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s\" (UID: \"5f21b231-43fe-4db9-ab03-8ea3d385ff27\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s" Jul 12 00:07:02.882870 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:02.882842 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f21b231-43fe-4db9-ab03-8ea3d385ff27-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s\" (UID: \"5f21b231-43fe-4db9-ab03-8ea3d385ff27\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s" Jul 12 00:07:02.883124 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:02.883086 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f21b231-43fe-4db9-ab03-8ea3d385ff27-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s\" (UID: \"5f21b231-43fe-4db9-ab03-8ea3d385ff27\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s" Jul 12 00:07:02.887440 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:02.887417 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fflzd\" (UniqueName: \"kubernetes.io/projected/5f21b231-43fe-4db9-ab03-8ea3d385ff27-kube-api-access-fflzd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s\" (UID: \"5f21b231-43fe-4db9-ab03-8ea3d385ff27\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s" Jul 12 00:07:02.974175 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:02.974148 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s" Jul 12 00:07:03.107433 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:03.107406 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s"] Jul 12 00:07:03.109230 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:07:03.109202 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f21b231_43fe_4db9_ab03_8ea3d385ff27.slice/crio-72977098f70ae7eda169c825c4bedb2776028c4820ad3beed5aaf92745389511 WatchSource:0}: Error finding container 72977098f70ae7eda169c825c4bedb2776028c4820ad3beed5aaf92745389511: Status 404 returned error can't find the container with id 72977098f70ae7eda169c825c4bedb2776028c4820ad3beed5aaf92745389511 Jul 12 00:07:04.089675 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:04.089635 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s" event={"ID":"5f21b231-43fe-4db9-ab03-8ea3d385ff27","Type":"ContainerStarted","Data":"72977098f70ae7eda169c825c4bedb2776028c4820ad3beed5aaf92745389511"} Jul 12 00:07:05.096060 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:05.096023 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s" event={"ID":"5f21b231-43fe-4db9-ab03-8ea3d385ff27","Type":"ContainerStarted","Data":"e09b3bed692e52769083c3d6f79676d805ae62e2b8f8ad3d2e9e509575151d92"} Jul 12 00:07:05.116200 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:05.116149 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s" podStartSLOduration=2.021040575 podStartE2EDuration="3.11613247s" totalImagesPullingTime="1.095091895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:07:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:07:05.114132464 +0000 UTC m=+588.289929101" watchObservedRunningTime="2026-07-12 00:07:05.11613247 +0000 UTC m=+588.291929106" Jul 12 00:07:12.974306 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:12.974264 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s" Jul 12 00:07:12.974790 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:12.974339 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s" Jul 12 00:07:12.986794 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:12.986770 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s" Jul 12 00:07:13.148606 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:13.148582 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s" Jul 12 00:07:17.301684 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:17.301654 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcdr8_8bdecd8b-9853-4a8f-8441-68bad8a709c2/ovn-acl-logging/0.log" Jul 12 00:07:17.305642 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:17.305616 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcdr8_8bdecd8b-9853-4a8f-8441-68bad8a709c2/ovn-acl-logging/0.log" Jul 12 00:07:32.233196 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:32.233164 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq"] Jul 12 00:07:32.237319 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:32.237296 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq" Jul 12 00:07:32.239933 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:32.239913 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 12 00:07:32.245615 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:32.245596 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq"] Jul 12 00:07:32.259691 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:32.259664 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e021d6e6-445f-4802-8202-c8f4f3985b3a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq\" (UID: \"e021d6e6-445f-4802-8202-c8f4f3985b3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq" Jul 12 00:07:32.259783 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:32.259705 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e021d6e6-445f-4802-8202-c8f4f3985b3a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq\" (UID: \"e021d6e6-445f-4802-8202-c8f4f3985b3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq" Jul 12 00:07:32.259783 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:32.259730 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e021d6e6-445f-4802-8202-c8f4f3985b3a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq\" (UID: \"e021d6e6-445f-4802-8202-c8f4f3985b3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq" Jul 12 00:07:32.259853 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:32.259822 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q68qp\" (UniqueName: \"kubernetes.io/projected/e021d6e6-445f-4802-8202-c8f4f3985b3a-kube-api-access-q68qp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq\" (UID: \"e021d6e6-445f-4802-8202-c8f4f3985b3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq" Jul 12 00:07:32.259888 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:32.259856 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e021d6e6-445f-4802-8202-c8f4f3985b3a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq\" (UID: \"e021d6e6-445f-4802-8202-c8f4f3985b3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq" Jul 12 00:07:32.259940 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:32.259924 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e021d6e6-445f-4802-8202-c8f4f3985b3a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq\" (UID: \"e021d6e6-445f-4802-8202-c8f4f3985b3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq" Jul 12 00:07:32.360969 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:32.360942 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e021d6e6-445f-4802-8202-c8f4f3985b3a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq\" (UID: \"e021d6e6-445f-4802-8202-c8f4f3985b3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq" Jul 12 00:07:32.361079 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:32.360984 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e021d6e6-445f-4802-8202-c8f4f3985b3a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq\" (UID: \"e021d6e6-445f-4802-8202-c8f4f3985b3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq" Jul 12 00:07:32.361079 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:32.361019 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e021d6e6-445f-4802-8202-c8f4f3985b3a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq\" (UID: \"e021d6e6-445f-4802-8202-c8f4f3985b3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq" Jul 12 00:07:32.361205 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:32.361082 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q68qp\" (UniqueName: \"kubernetes.io/projected/e021d6e6-445f-4802-8202-c8f4f3985b3a-kube-api-access-q68qp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq\" (UID: \"e021d6e6-445f-4802-8202-c8f4f3985b3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq" Jul 12 00:07:32.361205 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:32.361141 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e021d6e6-445f-4802-8202-c8f4f3985b3a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq\" (UID: \"e021d6e6-445f-4802-8202-c8f4f3985b3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq" Jul 12 00:07:32.361205 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:32.361186 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e021d6e6-445f-4802-8202-c8f4f3985b3a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq\" (UID: \"e021d6e6-445f-4802-8202-c8f4f3985b3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq" Jul 12 00:07:32.361477 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:32.361443 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e021d6e6-445f-4802-8202-c8f4f3985b3a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq\" (UID: \"e021d6e6-445f-4802-8202-c8f4f3985b3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq" Jul 12 00:07:32.361589 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:32.361457 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e021d6e6-445f-4802-8202-c8f4f3985b3a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq\" (UID: \"e021d6e6-445f-4802-8202-c8f4f3985b3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq" Jul 12 00:07:32.361589 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:32.361528 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e021d6e6-445f-4802-8202-c8f4f3985b3a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq\" (UID: \"e021d6e6-445f-4802-8202-c8f4f3985b3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq" Jul 12 00:07:32.363247 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:32.363220 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e021d6e6-445f-4802-8202-c8f4f3985b3a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq\" (UID: \"e021d6e6-445f-4802-8202-c8f4f3985b3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq" Jul 12 00:07:32.363473 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:32.363459 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e021d6e6-445f-4802-8202-c8f4f3985b3a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq\" (UID: \"e021d6e6-445f-4802-8202-c8f4f3985b3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq" Jul 12 00:07:32.368561 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:32.368538 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q68qp\" (UniqueName: \"kubernetes.io/projected/e021d6e6-445f-4802-8202-c8f4f3985b3a-kube-api-access-q68qp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq\" (UID: \"e021d6e6-445f-4802-8202-c8f4f3985b3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq" Jul 12 00:07:32.549546 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:32.549467 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq" Jul 12 00:07:32.681381 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:32.681354 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq"] Jul 12 00:07:32.683307 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:07:32.683282 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode021d6e6_445f_4802_8202_c8f4f3985b3a.slice/crio-03f5c56792c36c30e1605e03fc87c4c2ff5137910dc618169431190bf9e2ccbb WatchSource:0}: Error finding container 03f5c56792c36c30e1605e03fc87c4c2ff5137910dc618169431190bf9e2ccbb: Status 404 returned error can't find the container with id 03f5c56792c36c30e1605e03fc87c4c2ff5137910dc618169431190bf9e2ccbb Jul 12 00:07:32.685020 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:32.685001 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 12 00:07:33.243881 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:33.243853 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq" event={"ID":"e021d6e6-445f-4802-8202-c8f4f3985b3a","Type":"ContainerStarted","Data":"3aa9ba23b97e5a85d2700ae6a1807832dd4c8471bab062de42e6e0fe6a9e29b1"} Jul 12 00:07:33.244237 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:33.243900 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq" event={"ID":"e021d6e6-445f-4802-8202-c8f4f3985b3a","Type":"ContainerStarted","Data":"03f5c56792c36c30e1605e03fc87c4c2ff5137910dc618169431190bf9e2ccbb"} Jul 12 00:07:33.260409 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:33.260365 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq" podStartSLOduration=1.104418996 podStartE2EDuration="1.260349755s" totalImagesPullingTime="155.930759ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:07:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:07:33.258799044 +0000 UTC m=+616.434595682" watchObservedRunningTime="2026-07-12 00:07:33.260349755 +0000 UTC m=+616.436146392" Jul 12 00:07:36.022605 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:36.022573 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2"] Jul 12 00:07:36.026657 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:36.026636 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2" Jul 12 00:07:36.029039 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:36.029020 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 12 00:07:36.036738 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:36.036717 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2"] Jul 12 00:07:36.096499 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:36.096461 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c53b85d-26b5-4a76-80a8-3359628dcd5b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lw4r2\" (UID: \"0c53b85d-26b5-4a76-80a8-3359628dcd5b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2" Jul 12 00:07:36.096499 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:36.096506 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c53b85d-26b5-4a76-80a8-3359628dcd5b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lw4r2\" (UID: \"0c53b85d-26b5-4a76-80a8-3359628dcd5b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2" Jul 12 00:07:36.096694 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:36.096567 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r4jd\" (UniqueName: \"kubernetes.io/projected/0c53b85d-26b5-4a76-80a8-3359628dcd5b-kube-api-access-6r4jd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lw4r2\" (UID: \"0c53b85d-26b5-4a76-80a8-3359628dcd5b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2" Jul 12 00:07:36.096694 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:36.096587 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c53b85d-26b5-4a76-80a8-3359628dcd5b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lw4r2\" (UID: \"0c53b85d-26b5-4a76-80a8-3359628dcd5b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2" Jul 12 00:07:36.096694 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:36.096614 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c53b85d-26b5-4a76-80a8-3359628dcd5b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lw4r2\" (UID: \"0c53b85d-26b5-4a76-80a8-3359628dcd5b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2" Jul 12 00:07:36.096694 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:36.096691 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c53b85d-26b5-4a76-80a8-3359628dcd5b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lw4r2\" (UID: \"0c53b85d-26b5-4a76-80a8-3359628dcd5b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2" Jul 12 00:07:36.198053 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:36.198024 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c53b85d-26b5-4a76-80a8-3359628dcd5b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lw4r2\" (UID: \"0c53b85d-26b5-4a76-80a8-3359628dcd5b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2" Jul 12 00:07:36.198053 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:36.198052 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c53b85d-26b5-4a76-80a8-3359628dcd5b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lw4r2\" (UID: \"0c53b85d-26b5-4a76-80a8-3359628dcd5b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2" Jul 12 00:07:36.198259 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:36.198086 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r4jd\" (UniqueName: \"kubernetes.io/projected/0c53b85d-26b5-4a76-80a8-3359628dcd5b-kube-api-access-6r4jd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lw4r2\" (UID: \"0c53b85d-26b5-4a76-80a8-3359628dcd5b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2" Jul 12 00:07:36.198259 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:36.198131 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c53b85d-26b5-4a76-80a8-3359628dcd5b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lw4r2\" (UID: \"0c53b85d-26b5-4a76-80a8-3359628dcd5b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2" Jul 12 00:07:36.198259 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:36.198163 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c53b85d-26b5-4a76-80a8-3359628dcd5b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lw4r2\" (UID: \"0c53b85d-26b5-4a76-80a8-3359628dcd5b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2" Jul 12 00:07:36.198259 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:36.198229 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c53b85d-26b5-4a76-80a8-3359628dcd5b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lw4r2\" (UID: \"0c53b85d-26b5-4a76-80a8-3359628dcd5b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2" Jul 12 00:07:36.198565 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:36.198534 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c53b85d-26b5-4a76-80a8-3359628dcd5b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lw4r2\" (UID: \"0c53b85d-26b5-4a76-80a8-3359628dcd5b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2" Jul 12 00:07:36.198674 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:36.198579 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c53b85d-26b5-4a76-80a8-3359628dcd5b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lw4r2\" (UID: \"0c53b85d-26b5-4a76-80a8-3359628dcd5b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2" Jul 12 00:07:36.198674 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:36.198645 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c53b85d-26b5-4a76-80a8-3359628dcd5b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lw4r2\" (UID: \"0c53b85d-26b5-4a76-80a8-3359628dcd5b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2" Jul 12 00:07:36.200288 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:36.200269 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c53b85d-26b5-4a76-80a8-3359628dcd5b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lw4r2\" (UID: \"0c53b85d-26b5-4a76-80a8-3359628dcd5b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2" Jul 12 00:07:36.200535 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:36.200518 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c53b85d-26b5-4a76-80a8-3359628dcd5b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lw4r2\" (UID: \"0c53b85d-26b5-4a76-80a8-3359628dcd5b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2" Jul 12 00:07:36.206438 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:36.206415 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r4jd\" (UniqueName: \"kubernetes.io/projected/0c53b85d-26b5-4a76-80a8-3359628dcd5b-kube-api-access-6r4jd\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-lw4r2\" (UID: \"0c53b85d-26b5-4a76-80a8-3359628dcd5b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2" Jul 12 00:07:36.338391 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:36.338317 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2" Jul 12 00:07:36.475331 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:36.475238 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2"] Jul 12 00:07:36.478097 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:07:36.478071 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c53b85d_26b5_4a76_80a8_3359628dcd5b.slice/crio-71ed2d5f6e3d16f435dfff1907c45d7681e88607e454fa28ce94dfaf1c6a14c0 WatchSource:0}: Error finding container 71ed2d5f6e3d16f435dfff1907c45d7681e88607e454fa28ce94dfaf1c6a14c0: Status 404 returned error can't find the container with id 71ed2d5f6e3d16f435dfff1907c45d7681e88607e454fa28ce94dfaf1c6a14c0 Jul 12 00:07:37.272374 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:37.272343 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2" event={"ID":"0c53b85d-26b5-4a76-80a8-3359628dcd5b","Type":"ContainerStarted","Data":"27cae4dd7ba012cc78cae2d7a95b5732a13c79a24fa04b820cfaadb24fd574ed"} Jul 12 00:07:37.272738 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:37.272391 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2" event={"ID":"0c53b85d-26b5-4a76-80a8-3359628dcd5b","Type":"ContainerStarted","Data":"71ed2d5f6e3d16f435dfff1907c45d7681e88607e454fa28ce94dfaf1c6a14c0"} Jul 12 00:07:42.550121 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:42.550025 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq" Jul 12 00:07:42.550121 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:42.550085 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq" Jul 12 00:07:42.562721 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:42.562694 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq" Jul 12 00:07:42.580200 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:42.580153 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2" podStartSLOduration=6.410572899 podStartE2EDuration="6.580139159s" totalImagesPullingTime="169.56626ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:07:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:07:37.29929824 +0000 UTC m=+620.475094877" watchObservedRunningTime="2026-07-12 00:07:42.580139159 +0000 UTC m=+625.755935844" Jul 12 00:07:43.313419 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:43.313391 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq" Jul 12 00:07:46.338548 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:46.338511 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2" Jul 12 00:07:46.339018 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:46.338611 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2" Jul 12 00:07:46.351337 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:46.351312 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2" Jul 12 00:07:47.337717 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:07:47.337688 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-lw4r2" Jul 12 00:12:17.340093 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:12:17.340064 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcdr8_8bdecd8b-9853-4a8f-8441-68bad8a709c2/ovn-acl-logging/0.log" Jul 12 00:12:17.344621 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:12:17.344600 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcdr8_8bdecd8b-9853-4a8f-8441-68bad8a709c2/ovn-acl-logging/0.log" Jul 12 00:17:17.374679 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:17:17.374645 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcdr8_8bdecd8b-9853-4a8f-8441-68bad8a709c2/ovn-acl-logging/0.log" Jul 12 00:17:17.383643 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:17:17.383621 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcdr8_8bdecd8b-9853-4a8f-8441-68bad8a709c2/ovn-acl-logging/0.log" Jul 12 00:22:17.412044 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:17.411932 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcdr8_8bdecd8b-9853-4a8f-8441-68bad8a709c2/ovn-acl-logging/0.log" Jul 12 00:22:17.420385 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:17.420364 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcdr8_8bdecd8b-9853-4a8f-8441-68bad8a709c2/ovn-acl-logging/0.log" Jul 12 00:22:31.965751 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:31.965715 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl"] Jul 12 00:22:31.969796 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:31.969521 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:31.971886 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:31.971866 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-cb79ec53-openshift-default-dockercfg-pgj66\"" Jul 12 00:22:31.988031 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:31.988000 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl"] Jul 12 00:22:32.118784 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.118745 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-workload-socket\") pod \"e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:32.119021 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.118816 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istio-token\") pod \"e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:32.119021 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.118861 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-credential-socket\") pod \"e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:32.119021 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.118903 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istio-data\") pod \"e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:32.119021 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.118927 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istio-envoy\") pod \"e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:32.119021 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.118952 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94ht8\" (UniqueName: \"kubernetes.io/projected/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-kube-api-access-94ht8\") pod \"e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:32.119258 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.119032 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istio-podinfo\") pod \"e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:32.119258 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.119065 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istiod-ca-cert\") pod \"e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:32.119258 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.119085 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-workload-certs\") pod \"e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:32.220022 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.219930 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94ht8\" (UniqueName: \"kubernetes.io/projected/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-kube-api-access-94ht8\") pod \"e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:32.220022 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.220002 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istio-podinfo\") pod \"e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:32.220287 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.220042 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istiod-ca-cert\") pod \"e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:32.220287 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.220072 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-workload-certs\") pod \"e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:32.220287 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.220099 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-workload-socket\") pod \"e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:32.220287 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.220200 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istio-token\") pod \"e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:32.220287 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.220231 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-credential-socket\") pod \"e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:32.220287 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.220276 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istio-data\") pod \"e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:32.220582 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.220309 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istio-envoy\") pod \"e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:32.220582 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.220529 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-workload-certs\") pod \"e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:32.220675 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.220582 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-workload-socket\") pod \"e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:32.220675 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.220662 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-credential-socket\") pod \"e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:32.220788 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.220772 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istio-data\") pod \"e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:32.221004 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.220980 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istiod-ca-cert\") pod \"e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:32.222390 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.222372 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istio-envoy\") pod \"e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:32.222484 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.222445 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istio-podinfo\") pod \"e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:32.227511 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.227483 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istio-token\") pod \"e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:32.227716 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.227695 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94ht8\" (UniqueName: \"kubernetes.io/projected/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-kube-api-access-94ht8\") pod \"e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:32.280985 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.280947 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:32.424714 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.424688 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl"] Jul 12 00:22:32.426455 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:22:32.426430 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ae21e9c_f18e_43a1_a776_0835d2a5eb1b.slice/crio-ad7a194c8e35a9fd4d0d4d5b3864c5a2273483bf9a3443f051dff80bc82995b3 WatchSource:0}: Error finding container ad7a194c8e35a9fd4d0d4d5b3864c5a2273483bf9a3443f051dff80bc82995b3: Status 404 returned error can't find the container with id ad7a194c8e35a9fd4d0d4d5b3864c5a2273483bf9a3443f051dff80bc82995b3 Jul 12 00:22:32.428503 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.428472 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:22:32.428588 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.428537 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:22:32.428588 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.428563 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:22:32.778520 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.778438 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" event={"ID":"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b","Type":"ContainerStarted","Data":"368ab875d24ee6e457bf4f37b84ecb7c35bb87ef03ceb6d678ed34fa394264a4"} Jul 12 00:22:32.778520 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.778492 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" event={"ID":"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b","Type":"ContainerStarted","Data":"ad7a194c8e35a9fd4d0d4d5b3864c5a2273483bf9a3443f051dff80bc82995b3"} Jul 12 00:22:32.798324 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:32.798273 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" podStartSLOduration=1.798253553 podStartE2EDuration="1.798253553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:22:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:22:32.796461031 +0000 UTC m=+1515.972257668" watchObservedRunningTime="2026-07-12 00:22:32.798253553 +0000 UTC m=+1515.974050189" Jul 12 00:22:33.281801 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:33.281763 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:33.298669 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:33.298638 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:33.783339 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:33.783309 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:33.784484 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:33.784461 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:45.851499 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:45.851466 2564 generic.go:356] "Generic (PLEG): container finished" podID="0ae21e9c-f18e-43a1-a776-0835d2a5eb1b" containerID="368ab875d24ee6e457bf4f37b84ecb7c35bb87ef03ceb6d678ed34fa394264a4" exitCode=0 Jul 12 00:22:45.852099 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:45.851549 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" event={"ID":"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b","Type":"ContainerDied","Data":"368ab875d24ee6e457bf4f37b84ecb7c35bb87ef03ceb6d678ed34fa394264a4"} Jul 12 00:22:45.852099 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:45.851934 2564 scope.go:117] "RemoveContainer" containerID="368ab875d24ee6e457bf4f37b84ecb7c35bb87ef03ceb6d678ed34fa394264a4" Jul 12 00:22:45.852908 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:45.852881 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:22:45.852963 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:45.852950 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:22:45.852998 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:45.852982 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:22:46.858238 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:46.858199 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" event={"ID":"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b","Type":"ContainerStarted","Data":"9df94f434a0366f336e9f219c45f04c948dfaa45821e27e11787379ef81477c2"} Jul 12 00:22:47.282511 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:47.282478 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:47.283222 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:47.282880 2564 patch_prober.go:28] interesting pod/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 12 00:22:47.283222 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:47.282933 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" podUID="0ae21e9c-f18e-43a1-a776-0835d2a5eb1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 12 00:22:48.282281 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:48.282231 2564 patch_prober.go:28] interesting pod/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 12 00:22:48.282804 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:48.282318 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" podUID="0ae21e9c-f18e-43a1-a776-0835d2a5eb1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 12 00:22:48.783997 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:48.783961 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:49.281593 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:49.281558 2564 patch_prober.go:28] interesting pod/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 12 00:22:49.281791 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:49.281639 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" podUID="0ae21e9c-f18e-43a1-a776-0835d2a5eb1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 12 00:22:50.281417 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:50.281375 2564 patch_prober.go:28] interesting pod/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 12 00:22:50.281874 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:50.281450 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" podUID="0ae21e9c-f18e-43a1-a776-0835d2a5eb1b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 12 00:22:51.284944 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:51.284910 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:22:51.285951 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:22:51.285930 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:23:53.521891 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:53.521851 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl"] Jul 12 00:23:53.522364 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:53.522025 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" podUID="0ae21e9c-f18e-43a1-a776-0835d2a5eb1b" containerName="istio-proxy" containerID="cri-o://9df94f434a0366f336e9f219c45f04c948dfaa45821e27e11787379ef81477c2" gracePeriod=30 Jul 12 00:23:58.776546 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:58.776522 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:23:58.912157 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:58.912129 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94ht8\" (UniqueName: \"kubernetes.io/projected/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-kube-api-access-94ht8\") pod \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " Jul 12 00:23:58.912268 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:58.912189 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istio-data\") pod \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " Jul 12 00:23:58.912268 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:58.912217 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-credential-socket\") pod \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " Jul 12 00:23:58.912268 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:58.912244 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istio-envoy\") pod \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " Jul 12 00:23:58.912417 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:58.912291 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istio-token\") pod \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " Jul 12 00:23:58.912417 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:58.912357 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istiod-ca-cert\") pod \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " Jul 12 00:23:58.912518 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:58.912439 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-workload-socket\") pod \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " Jul 12 00:23:58.912518 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:58.912493 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istio-podinfo\") pod \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " Jul 12 00:23:58.912518 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:58.912498 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0ae21e9c-f18e-43a1-a776-0835d2a5eb1b" (UID: "0ae21e9c-f18e-43a1-a776-0835d2a5eb1b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 00:23:58.912672 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:58.912542 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-workload-certs\") pod \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\" (UID: \"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b\") " Jul 12 00:23:58.912739 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:58.912675 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0ae21e9c-f18e-43a1-a776-0835d2a5eb1b" (UID: "0ae21e9c-f18e-43a1-a776-0835d2a5eb1b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 00:23:58.912790 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:58.912738 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0ae21e9c-f18e-43a1-a776-0835d2a5eb1b" (UID: "0ae21e9c-f18e-43a1-a776-0835d2a5eb1b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 00:23:58.912976 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:58.912948 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0ae21e9c-f18e-43a1-a776-0835d2a5eb1b" (UID: "0ae21e9c-f18e-43a1-a776-0835d2a5eb1b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 00:23:58.913128 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:58.913018 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-workload-socket\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:23:58.913128 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:58.913039 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-credential-socket\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:23:58.913128 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:58.913043 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istio-data" (OuterVolumeSpecName: "istio-data") pod "0ae21e9c-f18e-43a1-a776-0835d2a5eb1b" (UID: "0ae21e9c-f18e-43a1-a776-0835d2a5eb1b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 00:23:58.913128 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:58.913055 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istiod-ca-cert\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:23:58.914541 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:58.914511 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0ae21e9c-f18e-43a1-a776-0835d2a5eb1b" (UID: "0ae21e9c-f18e-43a1-a776-0835d2a5eb1b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 00:23:58.914659 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:58.914584 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0ae21e9c-f18e-43a1-a776-0835d2a5eb1b" (UID: "0ae21e9c-f18e-43a1-a776-0835d2a5eb1b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 12 00:23:58.914659 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:58.914610 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-kube-api-access-94ht8" (OuterVolumeSpecName: "kube-api-access-94ht8") pod "0ae21e9c-f18e-43a1-a776-0835d2a5eb1b" (UID: "0ae21e9c-f18e-43a1-a776-0835d2a5eb1b"). InnerVolumeSpecName "kube-api-access-94ht8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 00:23:58.914659 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:58.914640 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istio-token" (OuterVolumeSpecName: "istio-token") pod "0ae21e9c-f18e-43a1-a776-0835d2a5eb1b" (UID: "0ae21e9c-f18e-43a1-a776-0835d2a5eb1b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 00:23:59.013741 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:59.013716 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istio-podinfo\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:23:59.013741 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:59.013738 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-workload-certs\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:23:59.013895 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:59.013749 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94ht8\" (UniqueName: \"kubernetes.io/projected/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-kube-api-access-94ht8\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:23:59.013895 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:59.013760 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istio-data\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:23:59.013895 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:59.013768 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istio-envoy\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:23:59.013895 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:59.013775 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b-istio-token\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:23:59.231176 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:59.231145 2564 generic.go:356] "Generic (PLEG): container finished" podID="0ae21e9c-f18e-43a1-a776-0835d2a5eb1b" containerID="9df94f434a0366f336e9f219c45f04c948dfaa45821e27e11787379ef81477c2" exitCode=0 Jul 12 00:23:59.231313 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:59.231241 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" Jul 12 00:23:59.231313 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:59.231269 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" event={"ID":"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b","Type":"ContainerDied","Data":"9df94f434a0366f336e9f219c45f04c948dfaa45821e27e11787379ef81477c2"} Jul 12 00:23:59.231396 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:59.231323 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl" event={"ID":"0ae21e9c-f18e-43a1-a776-0835d2a5eb1b","Type":"ContainerDied","Data":"ad7a194c8e35a9fd4d0d4d5b3864c5a2273483bf9a3443f051dff80bc82995b3"} Jul 12 00:23:59.231396 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:59.231346 2564 scope.go:117] "RemoveContainer" containerID="9df94f434a0366f336e9f219c45f04c948dfaa45821e27e11787379ef81477c2" Jul 12 00:23:59.240847 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:59.240832 2564 scope.go:117] "RemoveContainer" containerID="368ab875d24ee6e457bf4f37b84ecb7c35bb87ef03ceb6d678ed34fa394264a4" Jul 12 00:23:59.248681 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:59.248665 2564 scope.go:117] "RemoveContainer" containerID="9df94f434a0366f336e9f219c45f04c948dfaa45821e27e11787379ef81477c2" Jul 12 00:23:59.248917 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:23:59.248902 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9df94f434a0366f336e9f219c45f04c948dfaa45821e27e11787379ef81477c2\": container with ID starting with 9df94f434a0366f336e9f219c45f04c948dfaa45821e27e11787379ef81477c2 not found: ID does not exist" containerID="9df94f434a0366f336e9f219c45f04c948dfaa45821e27e11787379ef81477c2" Jul 12 00:23:59.248955 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:59.248925 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9df94f434a0366f336e9f219c45f04c948dfaa45821e27e11787379ef81477c2"} err="failed to get container status \"9df94f434a0366f336e9f219c45f04c948dfaa45821e27e11787379ef81477c2\": rpc error: code = NotFound desc = could not find container \"9df94f434a0366f336e9f219c45f04c948dfaa45821e27e11787379ef81477c2\": container with ID starting with 9df94f434a0366f336e9f219c45f04c948dfaa45821e27e11787379ef81477c2 not found: ID does not exist" Jul 12 00:23:59.248955 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:59.248941 2564 scope.go:117] "RemoveContainer" containerID="368ab875d24ee6e457bf4f37b84ecb7c35bb87ef03ceb6d678ed34fa394264a4" Jul 12 00:23:59.249260 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:23:59.249240 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"368ab875d24ee6e457bf4f37b84ecb7c35bb87ef03ceb6d678ed34fa394264a4\": container with ID starting with 368ab875d24ee6e457bf4f37b84ecb7c35bb87ef03ceb6d678ed34fa394264a4 not found: ID does not exist" containerID="368ab875d24ee6e457bf4f37b84ecb7c35bb87ef03ceb6d678ed34fa394264a4" Jul 12 00:23:59.249315 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:59.249267 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"368ab875d24ee6e457bf4f37b84ecb7c35bb87ef03ceb6d678ed34fa394264a4"} err="failed to get container status \"368ab875d24ee6e457bf4f37b84ecb7c35bb87ef03ceb6d678ed34fa394264a4\": rpc error: code = NotFound desc = could not find container \"368ab875d24ee6e457bf4f37b84ecb7c35bb87ef03ceb6d678ed34fa394264a4\": container with ID starting with 368ab875d24ee6e457bf4f37b84ecb7c35bb87ef03ceb6d678ed34fa394264a4 not found: ID does not exist" Jul 12 00:23:59.252446 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:59.252426 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl"] Jul 12 00:23:59.256391 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:59.256372 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-cb79ec53-openshift-default-5767b86b85-878hl"] Jul 12 00:23:59.336815 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:23:59.336791 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ae21e9c-f18e-43a1-a776-0835d2a5eb1b" path="/var/lib/kubelet/pods/0ae21e9c-f18e-43a1-a776-0835d2a5eb1b/volumes" Jul 12 00:25:12.931814 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:25:12.931769 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-16b55c03-78f966b67d-bffrj"] Jul 12 00:25:12.932256 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:25:12.932236 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ae21e9c-f18e-43a1-a776-0835d2a5eb1b" containerName="istio-proxy" Jul 12 00:25:12.932256 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:25:12.932249 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ae21e9c-f18e-43a1-a776-0835d2a5eb1b" containerName="istio-proxy" Jul 12 00:25:12.932343 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:25:12.932260 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ae21e9c-f18e-43a1-a776-0835d2a5eb1b" containerName="istio-proxy" Jul 12 00:25:12.932343 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:25:12.932266 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ae21e9c-f18e-43a1-a776-0835d2a5eb1b" containerName="istio-proxy" Jul 12 00:25:12.932423 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:25:12.932383 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ae21e9c-f18e-43a1-a776-0835d2a5eb1b" containerName="istio-proxy" Jul 12 00:25:12.932423 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:25:12.932392 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ae21e9c-f18e-43a1-a776-0835d2a5eb1b" containerName="istio-proxy" Jul 12 00:25:12.935330 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:25:12.935314 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16b55c03-78f966b67d-bffrj" Jul 12 00:25:12.937614 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:25:12.937593 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-16b55c03-serving-cert\"" Jul 12 00:25:12.946553 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:25:12.946528 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-16b55c03-78f966b67d-bffrj"] Jul 12 00:25:13.043647 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:25:13.043613 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdzcw\" (UniqueName: \"kubernetes.io/projected/76fd5890-e6fe-49ce-b6cc-0736ac9be46b-kube-api-access-wdzcw\") pod \"maas-api-e2e-ait-16b55c03-78f966b67d-bffrj\" (UID: \"76fd5890-e6fe-49ce-b6cc-0736ac9be46b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16b55c03-78f966b67d-bffrj" Jul 12 00:25:13.043798 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:25:13.043736 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76fd5890-e6fe-49ce-b6cc-0736ac9be46b-openshift-service-ca\") pod \"maas-api-e2e-ait-16b55c03-78f966b67d-bffrj\" (UID: \"76fd5890-e6fe-49ce-b6cc-0736ac9be46b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16b55c03-78f966b67d-bffrj" Jul 12 00:25:13.043858 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:25:13.043803 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76fd5890-e6fe-49ce-b6cc-0736ac9be46b-maas-api-tls\") pod \"maas-api-e2e-ait-16b55c03-78f966b67d-bffrj\" (UID: \"76fd5890-e6fe-49ce-b6cc-0736ac9be46b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16b55c03-78f966b67d-bffrj" Jul 12 00:25:13.144428 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:25:13.144402 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdzcw\" (UniqueName: \"kubernetes.io/projected/76fd5890-e6fe-49ce-b6cc-0736ac9be46b-kube-api-access-wdzcw\") pod \"maas-api-e2e-ait-16b55c03-78f966b67d-bffrj\" (UID: \"76fd5890-e6fe-49ce-b6cc-0736ac9be46b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16b55c03-78f966b67d-bffrj" Jul 12 00:25:13.144553 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:25:13.144472 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76fd5890-e6fe-49ce-b6cc-0736ac9be46b-openshift-service-ca\") pod \"maas-api-e2e-ait-16b55c03-78f966b67d-bffrj\" (UID: \"76fd5890-e6fe-49ce-b6cc-0736ac9be46b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16b55c03-78f966b67d-bffrj" Jul 12 00:25:13.144553 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:25:13.144531 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76fd5890-e6fe-49ce-b6cc-0736ac9be46b-maas-api-tls\") pod \"maas-api-e2e-ait-16b55c03-78f966b67d-bffrj\" (UID: \"76fd5890-e6fe-49ce-b6cc-0736ac9be46b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16b55c03-78f966b67d-bffrj" Jul 12 00:25:13.145079 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:25:13.145058 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76fd5890-e6fe-49ce-b6cc-0736ac9be46b-openshift-service-ca\") pod \"maas-api-e2e-ait-16b55c03-78f966b67d-bffrj\" (UID: \"76fd5890-e6fe-49ce-b6cc-0736ac9be46b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16b55c03-78f966b67d-bffrj" Jul 12 00:25:13.146799 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:25:13.146780 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76fd5890-e6fe-49ce-b6cc-0736ac9be46b-maas-api-tls\") pod \"maas-api-e2e-ait-16b55c03-78f966b67d-bffrj\" (UID: \"76fd5890-e6fe-49ce-b6cc-0736ac9be46b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16b55c03-78f966b67d-bffrj" Jul 12 00:25:13.151646 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:25:13.151626 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdzcw\" (UniqueName: \"kubernetes.io/projected/76fd5890-e6fe-49ce-b6cc-0736ac9be46b-kube-api-access-wdzcw\") pod \"maas-api-e2e-ait-16b55c03-78f966b67d-bffrj\" (UID: \"76fd5890-e6fe-49ce-b6cc-0736ac9be46b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-16b55c03-78f966b67d-bffrj" Jul 12 00:25:13.247850 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:25:13.247796 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16b55c03-78f966b67d-bffrj" Jul 12 00:25:13.387683 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:25:13.387659 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-16b55c03-78f966b67d-bffrj"] Jul 12 00:25:13.389495 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:25:13.389467 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76fd5890_e6fe_49ce_b6cc_0736ac9be46b.slice/crio-2db139bcab2c9db263d63086874d0479f9049cc0f890c0b2b41b31e3bf75c339 WatchSource:0}: Error finding container 2db139bcab2c9db263d63086874d0479f9049cc0f890c0b2b41b31e3bf75c339: Status 404 returned error can't find the container with id 2db139bcab2c9db263d63086874d0479f9049cc0f890c0b2b41b31e3bf75c339 Jul 12 00:25:13.390847 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:25:13.390830 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 12 00:25:13.607796 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:25:13.607723 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16b55c03-78f966b67d-bffrj" event={"ID":"76fd5890-e6fe-49ce-b6cc-0736ac9be46b","Type":"ContainerStarted","Data":"2db139bcab2c9db263d63086874d0479f9049cc0f890c0b2b41b31e3bf75c339"} Jul 12 00:25:14.614214 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:25:14.614174 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16b55c03-78f966b67d-bffrj" event={"ID":"76fd5890-e6fe-49ce-b6cc-0736ac9be46b","Type":"ContainerStarted","Data":"412c59a21201d34fc330b00a2af66517311b8a1aafede7c4286ef839376dac33"} Jul 12 00:25:14.614723 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:25:14.614283 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16b55c03-78f966b67d-bffrj" Jul 12 00:25:14.634909 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:25:14.634864 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16b55c03-78f966b67d-bffrj" podStartSLOduration=2.204895971 podStartE2EDuration="2.634851397s" totalImagesPullingTime="429.955426ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:25:14.63330855 +0000 UTC m=+1677.809105187" watchObservedRunningTime="2026-07-12 00:25:14.634851397 +0000 UTC m=+1677.810648032" Jul 12 00:25:20.624216 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:25:20.624185 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16b55c03-78f966b67d-bffrj" Jul 12 00:26:28.557065 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:28.557033 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-16b55c03-78f966b67d-bffrj"] Jul 12 00:26:28.557642 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:28.557274 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16b55c03-78f966b67d-bffrj" podUID="76fd5890-e6fe-49ce-b6cc-0736ac9be46b" containerName="maas-api" containerID="cri-o://412c59a21201d34fc330b00a2af66517311b8a1aafede7c4286ef839376dac33" gracePeriod=30 Jul 12 00:26:28.814011 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:28.813953 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16b55c03-78f966b67d-bffrj" Jul 12 00:26:28.896364 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:28.896335 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76fd5890-e6fe-49ce-b6cc-0736ac9be46b-openshift-service-ca\") pod \"76fd5890-e6fe-49ce-b6cc-0736ac9be46b\" (UID: \"76fd5890-e6fe-49ce-b6cc-0736ac9be46b\") " Jul 12 00:26:28.896509 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:28.896395 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76fd5890-e6fe-49ce-b6cc-0736ac9be46b-maas-api-tls\") pod \"76fd5890-e6fe-49ce-b6cc-0736ac9be46b\" (UID: \"76fd5890-e6fe-49ce-b6cc-0736ac9be46b\") " Jul 12 00:26:28.896509 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:28.896455 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdzcw\" (UniqueName: \"kubernetes.io/projected/76fd5890-e6fe-49ce-b6cc-0736ac9be46b-kube-api-access-wdzcw\") pod \"76fd5890-e6fe-49ce-b6cc-0736ac9be46b\" (UID: \"76fd5890-e6fe-49ce-b6cc-0736ac9be46b\") " Jul 12 00:26:28.896718 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:28.896687 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76fd5890-e6fe-49ce-b6cc-0736ac9be46b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "76fd5890-e6fe-49ce-b6cc-0736ac9be46b" (UID: "76fd5890-e6fe-49ce-b6cc-0736ac9be46b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 00:26:28.898508 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:28.898478 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76fd5890-e6fe-49ce-b6cc-0736ac9be46b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "76fd5890-e6fe-49ce-b6cc-0736ac9be46b" (UID: "76fd5890-e6fe-49ce-b6cc-0736ac9be46b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 00:26:28.898617 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:28.898518 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76fd5890-e6fe-49ce-b6cc-0736ac9be46b-kube-api-access-wdzcw" (OuterVolumeSpecName: "kube-api-access-wdzcw") pod "76fd5890-e6fe-49ce-b6cc-0736ac9be46b" (UID: "76fd5890-e6fe-49ce-b6cc-0736ac9be46b"). InnerVolumeSpecName "kube-api-access-wdzcw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 00:26:28.986221 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:28.986191 2564 generic.go:356] "Generic (PLEG): container finished" podID="76fd5890-e6fe-49ce-b6cc-0736ac9be46b" containerID="412c59a21201d34fc330b00a2af66517311b8a1aafede7c4286ef839376dac33" exitCode=0 Jul 12 00:26:28.986377 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:28.986242 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16b55c03-78f966b67d-bffrj" Jul 12 00:26:28.986377 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:28.986275 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16b55c03-78f966b67d-bffrj" event={"ID":"76fd5890-e6fe-49ce-b6cc-0736ac9be46b","Type":"ContainerDied","Data":"412c59a21201d34fc330b00a2af66517311b8a1aafede7c4286ef839376dac33"} Jul 12 00:26:28.986377 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:28.986335 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-16b55c03-78f966b67d-bffrj" event={"ID":"76fd5890-e6fe-49ce-b6cc-0736ac9be46b","Type":"ContainerDied","Data":"2db139bcab2c9db263d63086874d0479f9049cc0f890c0b2b41b31e3bf75c339"} Jul 12 00:26:28.986377 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:28.986365 2564 scope.go:117] "RemoveContainer" containerID="412c59a21201d34fc330b00a2af66517311b8a1aafede7c4286ef839376dac33" Jul 12 00:26:28.995920 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:28.995902 2564 scope.go:117] "RemoveContainer" containerID="412c59a21201d34fc330b00a2af66517311b8a1aafede7c4286ef839376dac33" Jul 12 00:26:28.996154 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:26:28.996137 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"412c59a21201d34fc330b00a2af66517311b8a1aafede7c4286ef839376dac33\": container with ID starting with 412c59a21201d34fc330b00a2af66517311b8a1aafede7c4286ef839376dac33 not found: ID does not exist" containerID="412c59a21201d34fc330b00a2af66517311b8a1aafede7c4286ef839376dac33" Jul 12 00:26:28.996212 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:28.996160 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"412c59a21201d34fc330b00a2af66517311b8a1aafede7c4286ef839376dac33"} err="failed to get container status \"412c59a21201d34fc330b00a2af66517311b8a1aafede7c4286ef839376dac33\": rpc error: code = NotFound desc = could not find container \"412c59a21201d34fc330b00a2af66517311b8a1aafede7c4286ef839376dac33\": container with ID starting with 412c59a21201d34fc330b00a2af66517311b8a1aafede7c4286ef839376dac33 not found: ID does not exist" Jul 12 00:26:28.997548 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:28.997527 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdzcw\" (UniqueName: \"kubernetes.io/projected/76fd5890-e6fe-49ce-b6cc-0736ac9be46b-kube-api-access-wdzcw\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:26:28.997548 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:28.997549 2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76fd5890-e6fe-49ce-b6cc-0736ac9be46b-openshift-service-ca\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:26:28.997668 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:28.997559 2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76fd5890-e6fe-49ce-b6cc-0736ac9be46b-maas-api-tls\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:26:29.007420 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:29.007398 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-16b55c03-78f966b67d-bffrj"] Jul 12 00:26:29.013145 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:29.013126 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-16b55c03-78f966b67d-bffrj"] Jul 12 00:26:29.336753 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:29.336720 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76fd5890-e6fe-49ce-b6cc-0736ac9be46b" path="/var/lib/kubelet/pods/76fd5890-e6fe-49ce-b6cc-0736ac9be46b/volumes" Jul 12 00:26:44.502901 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.502866 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24"] Jul 12 00:26:44.503557 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.503536 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76fd5890-e6fe-49ce-b6cc-0736ac9be46b" containerName="maas-api" Jul 12 00:26:44.503688 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.503559 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="76fd5890-e6fe-49ce-b6cc-0736ac9be46b" containerName="maas-api" Jul 12 00:26:44.503688 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.503662 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="76fd5890-e6fe-49ce-b6cc-0736ac9be46b" containerName="maas-api" Jul 12 00:26:44.507908 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.507885 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.510792 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.510775 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-0aa3397f-openshift-default-dockercfg-nsfld\"" Jul 12 00:26:44.517157 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.517136 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24"] Jul 12 00:26:44.642716 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.642681 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63407fab-4c85-429d-b7d4-fb31207f5750-istiod-ca-cert\") pod \"e2e-derive-0aa3397f-openshift-default-c76498d59-glx24\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.642867 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.642722 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-credential-socket\") pod \"e2e-derive-0aa3397f-openshift-default-c76498d59-glx24\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.642867 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.642741 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-workload-certs\") pod \"e2e-derive-0aa3397f-openshift-default-c76498d59-glx24\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.642867 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.642804 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63407fab-4c85-429d-b7d4-fb31207f5750-istio-podinfo\") pod \"e2e-derive-0aa3397f-openshift-default-c76498d59-glx24\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.642867 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.642855 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-istio-envoy\") pod \"e2e-derive-0aa3397f-openshift-default-c76498d59-glx24\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.643003 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.642886 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-istio-data\") pod \"e2e-derive-0aa3397f-openshift-default-c76498d59-glx24\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.643003 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.642903 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fhts\" (UniqueName: \"kubernetes.io/projected/63407fab-4c85-429d-b7d4-fb31207f5750-kube-api-access-4fhts\") pod \"e2e-derive-0aa3397f-openshift-default-c76498d59-glx24\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.643003 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.642952 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63407fab-4c85-429d-b7d4-fb31207f5750-istio-token\") pod \"e2e-derive-0aa3397f-openshift-default-c76498d59-glx24\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.643003 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.642998 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-workload-socket\") pod \"e2e-derive-0aa3397f-openshift-default-c76498d59-glx24\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.743458 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.743434 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-istio-data\") pod \"e2e-derive-0aa3397f-openshift-default-c76498d59-glx24\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.743603 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.743464 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fhts\" (UniqueName: \"kubernetes.io/projected/63407fab-4c85-429d-b7d4-fb31207f5750-kube-api-access-4fhts\") pod \"e2e-derive-0aa3397f-openshift-default-c76498d59-glx24\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.743603 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.743486 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63407fab-4c85-429d-b7d4-fb31207f5750-istio-token\") pod \"e2e-derive-0aa3397f-openshift-default-c76498d59-glx24\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.743603 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.743526 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-workload-socket\") pod \"e2e-derive-0aa3397f-openshift-default-c76498d59-glx24\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.743603 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.743587 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63407fab-4c85-429d-b7d4-fb31207f5750-istiod-ca-cert\") pod \"e2e-derive-0aa3397f-openshift-default-c76498d59-glx24\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.743797 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.743622 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-credential-socket\") pod \"e2e-derive-0aa3397f-openshift-default-c76498d59-glx24\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.743797 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.743645 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-workload-certs\") pod \"e2e-derive-0aa3397f-openshift-default-c76498d59-glx24\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.743797 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.743678 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63407fab-4c85-429d-b7d4-fb31207f5750-istio-podinfo\") pod \"e2e-derive-0aa3397f-openshift-default-c76498d59-glx24\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.743797 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.743724 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-istio-envoy\") pod \"e2e-derive-0aa3397f-openshift-default-c76498d59-glx24\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.744003 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.743864 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-istio-data\") pod \"e2e-derive-0aa3397f-openshift-default-c76498d59-glx24\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.744003 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.743944 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-workload-socket\") pod \"e2e-derive-0aa3397f-openshift-default-c76498d59-glx24\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.744098 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.744017 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-workload-certs\") pod \"e2e-derive-0aa3397f-openshift-default-c76498d59-glx24\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.744098 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.744038 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-credential-socket\") pod \"e2e-derive-0aa3397f-openshift-default-c76498d59-glx24\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.744260 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.744241 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63407fab-4c85-429d-b7d4-fb31207f5750-istiod-ca-cert\") pod \"e2e-derive-0aa3397f-openshift-default-c76498d59-glx24\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.745998 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.745978 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-istio-envoy\") pod \"e2e-derive-0aa3397f-openshift-default-c76498d59-glx24\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.746254 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.746235 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63407fab-4c85-429d-b7d4-fb31207f5750-istio-podinfo\") pod \"e2e-derive-0aa3397f-openshift-default-c76498d59-glx24\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.751627 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.751605 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63407fab-4c85-429d-b7d4-fb31207f5750-istio-token\") pod \"e2e-derive-0aa3397f-openshift-default-c76498d59-glx24\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.751716 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.751685 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fhts\" (UniqueName: \"kubernetes.io/projected/63407fab-4c85-429d-b7d4-fb31207f5750-kube-api-access-4fhts\") pod \"e2e-derive-0aa3397f-openshift-default-c76498d59-glx24\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.820965 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.820910 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:44.963359 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.962807 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24"] Jul 12 00:26:44.969671 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.969632 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:26:44.969806 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.969710 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:26:44.969806 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:44.969753 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:26:45.070544 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:45.070505 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" event={"ID":"63407fab-4c85-429d-b7d4-fb31207f5750","Type":"ContainerStarted","Data":"3b70f5c9c5cd61d0d5074f70fa7c42a1a1872bc1544f45558df1d4e6cccead30"} Jul 12 00:26:45.070726 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:45.070564 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" event={"ID":"63407fab-4c85-429d-b7d4-fb31207f5750","Type":"ContainerStarted","Data":"93625cba1b13092bbbe1d9363858d8cccfb845d671acb2eb1210a781f1eb836e"} Jul 12 00:26:45.092441 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:45.092336 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" podStartSLOduration=1.0923161 podStartE2EDuration="1.0923161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:26:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:26:45.090426616 +0000 UTC m=+1768.266223253" watchObservedRunningTime="2026-07-12 00:26:45.0923161 +0000 UTC m=+1768.268112740" Jul 12 00:26:45.821979 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:45.821944 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:46.826632 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:46.826598 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:47.081439 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:47.081356 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:47.082334 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:47.082315 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:56.137171 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:56.137068 2564 generic.go:356] "Generic (PLEG): container finished" podID="63407fab-4c85-429d-b7d4-fb31207f5750" containerID="3b70f5c9c5cd61d0d5074f70fa7c42a1a1872bc1544f45558df1d4e6cccead30" exitCode=0 Jul 12 00:26:56.137171 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:56.137142 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" event={"ID":"63407fab-4c85-429d-b7d4-fb31207f5750","Type":"ContainerDied","Data":"3b70f5c9c5cd61d0d5074f70fa7c42a1a1872bc1544f45558df1d4e6cccead30"} Jul 12 00:26:56.137760 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:56.137661 2564 scope.go:117] "RemoveContainer" containerID="3b70f5c9c5cd61d0d5074f70fa7c42a1a1872bc1544f45558df1d4e6cccead30" Jul 12 00:26:56.138792 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:56.138761 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:26:56.138871 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:56.138847 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:26:56.138922 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:56.138895 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:26:57.144152 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:57.144096 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" event={"ID":"63407fab-4c85-429d-b7d4-fb31207f5750","Type":"ContainerStarted","Data":"31190c195c98415049d8f9ba2f85dfdf1a539a68569bd33dbece48f4447a3b86"} Jul 12 00:26:57.821198 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:57.821162 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:26:57.822143 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:57.822121 2564 patch_prober.go:28] interesting pod/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 12 00:26:57.822273 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:57.822162 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" podUID="63407fab-4c85-429d-b7d4-fb31207f5750" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 12 00:26:58.821409 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:58.821375 2564 patch_prober.go:28] interesting pod/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 12 00:26:58.821858 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:58.821446 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" podUID="63407fab-4c85-429d-b7d4-fb31207f5750" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 12 00:26:59.821697 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:59.821660 2564 patch_prober.go:28] interesting pod/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 12 00:26:59.822207 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:26:59.821742 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" podUID="63407fab-4c85-429d-b7d4-fb31207f5750" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 12 00:27:00.821680 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:27:00.821642 2564 patch_prober.go:28] interesting pod/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 12 00:27:00.821858 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:27:00.821705 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" podUID="63407fab-4c85-429d-b7d4-fb31207f5750" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 12 00:27:01.825432 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:27:01.825404 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:27:01.825883 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:27:01.825675 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:27:01.826332 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:27:01.826317 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:27:17.446651 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:27:17.446615 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcdr8_8bdecd8b-9853-4a8f-8441-68bad8a709c2/ovn-acl-logging/0.log" Jul 12 00:27:17.456854 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:27:17.456833 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcdr8_8bdecd8b-9853-4a8f-8441-68bad8a709c2/ovn-acl-logging/0.log" Jul 12 00:28:15.375394 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:15.375365 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24"] Jul 12 00:28:15.375946 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:15.375538 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" podUID="63407fab-4c85-429d-b7d4-fb31207f5750" containerName="istio-proxy" containerID="cri-o://31190c195c98415049d8f9ba2f85dfdf1a539a68569bd33dbece48f4447a3b86" gracePeriod=30 Jul 12 00:28:16.827904 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:16.827868 2564 patch_prober.go:28] interesting pod/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 12 00:28:16.828274 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:16.827919 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" podUID="63407fab-4c85-429d-b7d4-fb31207f5750" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 12 00:28:20.568544 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.568509 2564 generic.go:356] "Generic (PLEG): container finished" podID="63407fab-4c85-429d-b7d4-fb31207f5750" containerID="31190c195c98415049d8f9ba2f85dfdf1a539a68569bd33dbece48f4447a3b86" exitCode=0 Jul 12 00:28:20.568946 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.568578 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" event={"ID":"63407fab-4c85-429d-b7d4-fb31207f5750","Type":"ContainerDied","Data":"31190c195c98415049d8f9ba2f85dfdf1a539a68569bd33dbece48f4447a3b86"} Jul 12 00:28:20.568946 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.568640 2564 scope.go:117] "RemoveContainer" containerID="3b70f5c9c5cd61d0d5074f70fa7c42a1a1872bc1544f45558df1d4e6cccead30" Jul 12 00:28:20.633213 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.633192 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:28:20.674031 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.673950 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fhts\" (UniqueName: \"kubernetes.io/projected/63407fab-4c85-429d-b7d4-fb31207f5750-kube-api-access-4fhts\") pod \"63407fab-4c85-429d-b7d4-fb31207f5750\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " Jul 12 00:28:20.674031 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.674006 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-workload-certs\") pod \"63407fab-4c85-429d-b7d4-fb31207f5750\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " Jul 12 00:28:20.674268 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.674050 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-workload-socket\") pod \"63407fab-4c85-429d-b7d4-fb31207f5750\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " Jul 12 00:28:20.674268 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.674133 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63407fab-4c85-429d-b7d4-fb31207f5750-istiod-ca-cert\") pod \"63407fab-4c85-429d-b7d4-fb31207f5750\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " Jul 12 00:28:20.674268 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.674177 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-istio-data\") pod \"63407fab-4c85-429d-b7d4-fb31207f5750\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " Jul 12 00:28:20.674268 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.674230 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63407fab-4c85-429d-b7d4-fb31207f5750-istio-podinfo\") pod \"63407fab-4c85-429d-b7d4-fb31207f5750\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " Jul 12 00:28:20.674494 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.674275 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-credential-socket\") pod \"63407fab-4c85-429d-b7d4-fb31207f5750\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " Jul 12 00:28:20.674494 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.674301 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63407fab-4c85-429d-b7d4-fb31207f5750-istio-token\") pod \"63407fab-4c85-429d-b7d4-fb31207f5750\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " Jul 12 00:28:20.674494 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.674359 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-istio-envoy\") pod \"63407fab-4c85-429d-b7d4-fb31207f5750\" (UID: \"63407fab-4c85-429d-b7d4-fb31207f5750\") " Jul 12 00:28:20.674494 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.674404 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "63407fab-4c85-429d-b7d4-fb31207f5750" (UID: "63407fab-4c85-429d-b7d4-fb31207f5750"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 00:28:20.674919 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.674884 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-workload-certs\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:28:20.675320 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.675289 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-istio-data" (OuterVolumeSpecName: "istio-data") pod "63407fab-4c85-429d-b7d4-fb31207f5750" (UID: "63407fab-4c85-429d-b7d4-fb31207f5750"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 00:28:20.675566 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.675542 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "63407fab-4c85-429d-b7d4-fb31207f5750" (UID: "63407fab-4c85-429d-b7d4-fb31207f5750"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 00:28:20.675788 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.675744 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "63407fab-4c85-429d-b7d4-fb31207f5750" (UID: "63407fab-4c85-429d-b7d4-fb31207f5750"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 00:28:20.675941 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.675905 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63407fab-4c85-429d-b7d4-fb31207f5750-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "63407fab-4c85-429d-b7d4-fb31207f5750" (UID: "63407fab-4c85-429d-b7d4-fb31207f5750"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 00:28:20.677287 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.677257 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "63407fab-4c85-429d-b7d4-fb31207f5750" (UID: "63407fab-4c85-429d-b7d4-fb31207f5750"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 00:28:20.677389 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.677337 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63407fab-4c85-429d-b7d4-fb31207f5750-kube-api-access-4fhts" (OuterVolumeSpecName: "kube-api-access-4fhts") pod "63407fab-4c85-429d-b7d4-fb31207f5750" (UID: "63407fab-4c85-429d-b7d4-fb31207f5750"). InnerVolumeSpecName "kube-api-access-4fhts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 00:28:20.677907 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.677879 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/63407fab-4c85-429d-b7d4-fb31207f5750-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "63407fab-4c85-429d-b7d4-fb31207f5750" (UID: "63407fab-4c85-429d-b7d4-fb31207f5750"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 12 00:28:20.678002 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.677915 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63407fab-4c85-429d-b7d4-fb31207f5750-istio-token" (OuterVolumeSpecName: "istio-token") pod "63407fab-4c85-429d-b7d4-fb31207f5750" (UID: "63407fab-4c85-429d-b7d4-fb31207f5750"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 00:28:20.775599 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.775573 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fhts\" (UniqueName: \"kubernetes.io/projected/63407fab-4c85-429d-b7d4-fb31207f5750-kube-api-access-4fhts\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:28:20.775599 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.775596 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-workload-socket\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:28:20.775748 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.775606 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63407fab-4c85-429d-b7d4-fb31207f5750-istiod-ca-cert\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:28:20.775748 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.775614 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-istio-data\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:28:20.775748 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.775621 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63407fab-4c85-429d-b7d4-fb31207f5750-istio-podinfo\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:28:20.775748 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.775628 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-credential-socket\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:28:20.775748 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.775637 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63407fab-4c85-429d-b7d4-fb31207f5750-istio-token\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:28:20.775748 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:20.775645 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63407fab-4c85-429d-b7d4-fb31207f5750-istio-envoy\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:28:21.574515 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:21.574481 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" Jul 12 00:28:21.574515 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:21.574495 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24" event={"ID":"63407fab-4c85-429d-b7d4-fb31207f5750","Type":"ContainerDied","Data":"93625cba1b13092bbbe1d9363858d8cccfb845d671acb2eb1210a781f1eb836e"} Jul 12 00:28:21.574974 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:21.574578 2564 scope.go:117] "RemoveContainer" containerID="31190c195c98415049d8f9ba2f85dfdf1a539a68569bd33dbece48f4447a3b86" Jul 12 00:28:21.594161 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:21.594077 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24"] Jul 12 00:28:21.600382 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:21.600358 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-0aa3397f-openshift-default-c76498d59-glx24"] Jul 12 00:28:23.337869 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:28:23.337840 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63407fab-4c85-429d-b7d4-fb31207f5750" path="/var/lib/kubelet/pods/63407fab-4c85-429d-b7d4-fb31207f5750/volumes" Jul 12 00:30:55.357231 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:30:55.357199 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-68596461-866c77c6c-7cwvp"] Jul 12 00:30:55.357669 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:30:55.357655 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63407fab-4c85-429d-b7d4-fb31207f5750" containerName="istio-proxy" Jul 12 00:30:55.357714 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:30:55.357671 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="63407fab-4c85-429d-b7d4-fb31207f5750" containerName="istio-proxy" Jul 12 00:30:55.357714 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:30:55.357689 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63407fab-4c85-429d-b7d4-fb31207f5750" containerName="istio-proxy" Jul 12 00:30:55.357714 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:30:55.357696 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="63407fab-4c85-429d-b7d4-fb31207f5750" containerName="istio-proxy" Jul 12 00:30:55.357808 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:30:55.357776 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="63407fab-4c85-429d-b7d4-fb31207f5750" containerName="istio-proxy" Jul 12 00:30:55.360666 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:30:55.360651 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-68596461-866c77c6c-7cwvp" Jul 12 00:30:55.363788 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:30:55.363770 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-68596461-serving-cert\"" Jul 12 00:30:55.374668 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:30:55.374649 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-68596461-866c77c6c-7cwvp"] Jul 12 00:30:55.534720 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:30:55.534686 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f-openshift-service-ca\") pod \"maas-api-e2e-mt-68596461-866c77c6c-7cwvp\" (UID: \"a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-68596461-866c77c6c-7cwvp" Jul 12 00:30:55.534720 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:30:55.534718 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f-maas-api-tls\") pod \"maas-api-e2e-mt-68596461-866c77c6c-7cwvp\" (UID: \"a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-68596461-866c77c6c-7cwvp" Jul 12 00:30:55.534923 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:30:55.534778 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxlw8\" (UniqueName: \"kubernetes.io/projected/a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f-kube-api-access-gxlw8\") pod \"maas-api-e2e-mt-68596461-866c77c6c-7cwvp\" (UID: \"a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-68596461-866c77c6c-7cwvp" Jul 12 00:30:55.636196 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:30:55.636124 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f-openshift-service-ca\") pod \"maas-api-e2e-mt-68596461-866c77c6c-7cwvp\" (UID: \"a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-68596461-866c77c6c-7cwvp" Jul 12 00:30:55.636196 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:30:55.636164 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f-maas-api-tls\") pod \"maas-api-e2e-mt-68596461-866c77c6c-7cwvp\" (UID: \"a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-68596461-866c77c6c-7cwvp" Jul 12 00:30:55.636377 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:30:55.636241 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxlw8\" (UniqueName: \"kubernetes.io/projected/a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f-kube-api-access-gxlw8\") pod \"maas-api-e2e-mt-68596461-866c77c6c-7cwvp\" (UID: \"a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-68596461-866c77c6c-7cwvp" Jul 12 00:30:55.636736 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:30:55.636716 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f-openshift-service-ca\") pod \"maas-api-e2e-mt-68596461-866c77c6c-7cwvp\" (UID: \"a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-68596461-866c77c6c-7cwvp" Jul 12 00:30:55.638492 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:30:55.638470 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f-maas-api-tls\") pod \"maas-api-e2e-mt-68596461-866c77c6c-7cwvp\" (UID: \"a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-68596461-866c77c6c-7cwvp" Jul 12 00:30:55.643947 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:30:55.643927 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxlw8\" (UniqueName: \"kubernetes.io/projected/a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f-kube-api-access-gxlw8\") pod \"maas-api-e2e-mt-68596461-866c77c6c-7cwvp\" (UID: \"a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-68596461-866c77c6c-7cwvp" Jul 12 00:30:55.670866 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:30:55.670842 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-68596461-866c77c6c-7cwvp" Jul 12 00:30:55.807322 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:30:55.807283 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-68596461-866c77c6c-7cwvp"] Jul 12 00:30:55.809363 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:30:55.809333 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b19c9b_2ed6_4cec_8b2a_f2d6abd50c7f.slice/crio-dde0edc2002eafad79945f0aa844bf44bb2540bb740f4f972de00e5654c351bb WatchSource:0}: Error finding container dde0edc2002eafad79945f0aa844bf44bb2540bb740f4f972de00e5654c351bb: Status 404 returned error can't find the container with id dde0edc2002eafad79945f0aa844bf44bb2540bb740f4f972de00e5654c351bb Jul 12 00:30:55.810672 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:30:55.810651 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 12 00:30:56.358295 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:30:56.358262 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-68596461-866c77c6c-7cwvp" event={"ID":"a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f","Type":"ContainerStarted","Data":"42979a34077a8d3e99545fa16f19b536016df1d6fe94fb903f69de7b9e18b7b4"} Jul 12 00:30:56.358607 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:30:56.358308 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-68596461-866c77c6c-7cwvp" event={"ID":"a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f","Type":"ContainerStarted","Data":"dde0edc2002eafad79945f0aa844bf44bb2540bb740f4f972de00e5654c351bb"} Jul 12 00:30:56.358607 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:30:56.358376 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-68596461-866c77c6c-7cwvp" Jul 12 00:30:56.376835 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:30:56.376794 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-68596461-866c77c6c-7cwvp" podStartSLOduration=1.04576537 podStartE2EDuration="1.376775587s" totalImagesPullingTime="331.010217ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:30:56.374964801 +0000 UTC m=+2019.550761439" watchObservedRunningTime="2026-07-12 00:30:56.376775587 +0000 UTC m=+2019.552572224" Jul 12 00:31:02.367094 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:31:02.367065 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-68596461-866c77c6c-7cwvp" Jul 12 00:31:33.190728 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:31:33.190699 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-68596461-866c77c6c-7cwvp"] Jul 12 00:31:33.191286 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:31:33.190901 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-68596461-866c77c6c-7cwvp" podUID="a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f" containerName="maas-api" containerID="cri-o://42979a34077a8d3e99545fa16f19b536016df1d6fe94fb903f69de7b9e18b7b4" gracePeriod=30 Jul 12 00:31:33.440834 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:31:33.440779 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-68596461-866c77c6c-7cwvp" Jul 12 00:31:33.546752 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:31:33.546720 2564 generic.go:356] "Generic (PLEG): container finished" podID="a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f" containerID="42979a34077a8d3e99545fa16f19b536016df1d6fe94fb903f69de7b9e18b7b4" exitCode=0 Jul 12 00:31:33.546855 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:31:33.546765 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-68596461-866c77c6c-7cwvp" Jul 12 00:31:33.546855 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:31:33.546806 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-68596461-866c77c6c-7cwvp" event={"ID":"a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f","Type":"ContainerDied","Data":"42979a34077a8d3e99545fa16f19b536016df1d6fe94fb903f69de7b9e18b7b4"} Jul 12 00:31:33.546934 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:31:33.546857 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-68596461-866c77c6c-7cwvp" event={"ID":"a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f","Type":"ContainerDied","Data":"dde0edc2002eafad79945f0aa844bf44bb2540bb740f4f972de00e5654c351bb"} Jul 12 00:31:33.546934 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:31:33.546880 2564 scope.go:117] "RemoveContainer" containerID="42979a34077a8d3e99545fa16f19b536016df1d6fe94fb903f69de7b9e18b7b4" Jul 12 00:31:33.553155 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:31:33.553138 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f-maas-api-tls\") pod \"a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f\" (UID: \"a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f\") " Jul 12 00:31:33.553240 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:31:33.553193 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxlw8\" (UniqueName: \"kubernetes.io/projected/a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f-kube-api-access-gxlw8\") pod \"a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f\" (UID: \"a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f\") " Jul 12 00:31:33.553297 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:31:33.553287 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f-openshift-service-ca\") pod \"a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f\" (UID: \"a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f\") " Jul 12 00:31:33.553670 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:31:33.553650 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f" (UID: "a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 00:31:33.555053 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:31:33.555027 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f" (UID: "a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 00:31:33.555347 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:31:33.555276 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f-kube-api-access-gxlw8" (OuterVolumeSpecName: "kube-api-access-gxlw8") pod "a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f" (UID: "a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f"). InnerVolumeSpecName "kube-api-access-gxlw8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 00:31:33.555412 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:31:33.555367 2564 scope.go:117] "RemoveContainer" containerID="42979a34077a8d3e99545fa16f19b536016df1d6fe94fb903f69de7b9e18b7b4" Jul 12 00:31:33.555647 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:31:33.555624 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42979a34077a8d3e99545fa16f19b536016df1d6fe94fb903f69de7b9e18b7b4\": container with ID starting with 42979a34077a8d3e99545fa16f19b536016df1d6fe94fb903f69de7b9e18b7b4 not found: ID does not exist" containerID="42979a34077a8d3e99545fa16f19b536016df1d6fe94fb903f69de7b9e18b7b4" Jul 12 00:31:33.555703 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:31:33.555657 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42979a34077a8d3e99545fa16f19b536016df1d6fe94fb903f69de7b9e18b7b4"} err="failed to get container status \"42979a34077a8d3e99545fa16f19b536016df1d6fe94fb903f69de7b9e18b7b4\": rpc error: code = NotFound desc = could not find container \"42979a34077a8d3e99545fa16f19b536016df1d6fe94fb903f69de7b9e18b7b4\": container with ID starting with 42979a34077a8d3e99545fa16f19b536016df1d6fe94fb903f69de7b9e18b7b4 not found: ID does not exist" Jul 12 00:31:33.654770 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:31:33.654750 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxlw8\" (UniqueName: \"kubernetes.io/projected/a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f-kube-api-access-gxlw8\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:31:33.654770 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:31:33.654771 2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f-openshift-service-ca\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:31:33.654884 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:31:33.654780 2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f-maas-api-tls\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:31:33.867635 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:31:33.867596 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-68596461-866c77c6c-7cwvp"] Jul 12 00:31:33.871578 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:31:33.871558 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-68596461-866c77c6c-7cwvp"] Jul 12 00:31:35.336946 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:31:35.336916 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f" path="/var/lib/kubelet/pods/a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f/volumes" Jul 12 00:32:17.484016 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:32:17.483985 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcdr8_8bdecd8b-9853-4a8f-8441-68bad8a709c2/ovn-acl-logging/0.log" Jul 12 00:32:17.492097 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:32:17.492077 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcdr8_8bdecd8b-9853-4a8f-8441-68bad8a709c2/ovn-acl-logging/0.log" Jul 12 00:33:32.049762 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.049727 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww"] Jul 12 00:33:32.050560 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.050539 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f" containerName="maas-api" Jul 12 00:33:32.050560 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.050562 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f" containerName="maas-api" Jul 12 00:33:32.050714 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.050635 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1b19c9b-2ed6-4cec-8b2a-f2d6abd50c7f" containerName="maas-api" Jul 12 00:33:32.050714 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.050646 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="63407fab-4c85-429d-b7d4-fb31207f5750" containerName="istio-proxy" Jul 12 00:33:32.054051 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.054026 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.056368 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.056342 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-25afa8-openshift-default-dockercfg-l8g22\"" Jul 12 00:33:32.065677 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.065658 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww"] Jul 12 00:33:32.135187 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.135155 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99k6n\" (UniqueName: \"kubernetes.io/projected/924319c2-0598-4d18-8a56-5a4a58d1c4b2-kube-api-access-99k6n\") pod \"e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.135303 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.135201 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istio-podinfo\") pod \"e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.135347 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.135303 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istio-token\") pod \"e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.135347 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.135336 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-credential-socket\") pod \"e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.135428 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.135416 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-workload-socket\") pod \"e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.135465 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.135436 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istio-data\") pod \"e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.135500 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.135474 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-workload-certs\") pod \"e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.135534 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.135497 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istiod-ca-cert\") pod \"e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.135568 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.135535 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istio-envoy\") pod \"e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.236215 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.236185 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istio-token\") pod \"e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.236349 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.236222 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-credential-socket\") pod \"e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.236349 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.236271 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-workload-socket\") pod \"e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.236349 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.236289 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istio-data\") pod \"e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.236349 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.236306 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-workload-certs\") pod \"e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.236349 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.236320 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istiod-ca-cert\") pod \"e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.236349 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.236342 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istio-envoy\") pod \"e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.236656 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.236384 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99k6n\" (UniqueName: \"kubernetes.io/projected/924319c2-0598-4d18-8a56-5a4a58d1c4b2-kube-api-access-99k6n\") pod \"e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.236656 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.236415 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istio-podinfo\") pod \"e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.236765 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.236726 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-workload-socket\") pod \"e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.236765 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.236755 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istio-data\") pod \"e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.236920 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.236892 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-credential-socket\") pod \"e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.236985 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.236941 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-workload-certs\") pod \"e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.237214 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.237190 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istiod-ca-cert\") pod \"e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.238605 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.238582 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istio-envoy\") pod \"e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.238875 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.238855 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istio-podinfo\") pod \"e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.254028 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.254008 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99k6n\" (UniqueName: \"kubernetes.io/projected/924319c2-0598-4d18-8a56-5a4a58d1c4b2-kube-api-access-99k6n\") pod \"e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.256677 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.256656 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istio-token\") pod \"e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.365246 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.365183 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:32.502956 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.502929 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww"] Jul 12 00:33:32.505244 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:33:32.505221 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod924319c2_0598_4d18_8a56_5a4a58d1c4b2.slice/crio-66b5fb0f19766ff031901bd5566844ea240776fa0cc744512a22f53b14cfab81 WatchSource:0}: Error finding container 66b5fb0f19766ff031901bd5566844ea240776fa0cc744512a22f53b14cfab81: Status 404 returned error can't find the container with id 66b5fb0f19766ff031901bd5566844ea240776fa0cc744512a22f53b14cfab81 Jul 12 00:33:32.507450 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.507418 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:33:32.507538 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.507482 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:33:32.507538 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:32.507510 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:33:33.160194 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:33.160156 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" event={"ID":"924319c2-0598-4d18-8a56-5a4a58d1c4b2","Type":"ContainerStarted","Data":"54abf8a356ff7f76818ca9d6e4b30ec616e4f1eaad5609d1a79f830ca2565f43"} Jul 12 00:33:33.160558 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:33.160216 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" event={"ID":"924319c2-0598-4d18-8a56-5a4a58d1c4b2","Type":"ContainerStarted","Data":"66b5fb0f19766ff031901bd5566844ea240776fa0cc744512a22f53b14cfab81"} Jul 12 00:33:33.181922 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:33.181880 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" podStartSLOduration=1.181865744 podStartE2EDuration="1.181865744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:33:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:33:33.180761911 +0000 UTC m=+2176.356558548" watchObservedRunningTime="2026-07-12 00:33:33.181865744 +0000 UTC m=+2176.357662381" Jul 12 00:33:33.365351 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:33.365314 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:33.371170 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:33.371150 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:34.165269 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:34.165244 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:34.166188 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:34.166172 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:50.207250 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:50.207216 2564 patch_prober.go:28] interesting pod/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 12 00:33:50.207671 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:50.207282 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" podUID="924319c2-0598-4d18-8a56-5a4a58d1c4b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 12 00:33:51.254920 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:51.254883 2564 generic.go:356] "Generic (PLEG): container finished" podID="924319c2-0598-4d18-8a56-5a4a58d1c4b2" containerID="54abf8a356ff7f76818ca9d6e4b30ec616e4f1eaad5609d1a79f830ca2565f43" exitCode=0 Jul 12 00:33:51.255513 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:51.254964 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" event={"ID":"924319c2-0598-4d18-8a56-5a4a58d1c4b2","Type":"ContainerDied","Data":"54abf8a356ff7f76818ca9d6e4b30ec616e4f1eaad5609d1a79f830ca2565f43"} Jul 12 00:33:51.255513 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:51.255448 2564 scope.go:117] "RemoveContainer" containerID="54abf8a356ff7f76818ca9d6e4b30ec616e4f1eaad5609d1a79f830ca2565f43" Jul 12 00:33:51.256460 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:51.256431 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:33:51.256541 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:51.256500 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:33:51.256541 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:51.256531 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:33:52.261364 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:52.261328 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" event={"ID":"924319c2-0598-4d18-8a56-5a4a58d1c4b2","Type":"ContainerStarted","Data":"9a061cfb99184e125a0f00fbe9356d8fb4782cbb466d76ddf6c6fef0c21876cd"} Jul 12 00:33:52.365476 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:52.365448 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:52.365634 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:52.365603 2564 patch_prober.go:28] interesting pod/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 12 00:33:52.365678 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:52.365646 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" podUID="924319c2-0598-4d18-8a56-5a4a58d1c4b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 12 00:33:53.365789 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:53.365754 2564 patch_prober.go:28] interesting pod/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 12 00:33:53.366222 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:53.365807 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" podUID="924319c2-0598-4d18-8a56-5a4a58d1c4b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 12 00:33:54.366062 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:54.366029 2564 patch_prober.go:28] interesting pod/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 12 00:33:54.366442 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:54.366079 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" podUID="924319c2-0598-4d18-8a56-5a4a58d1c4b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 12 00:33:55.365813 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:55.365778 2564 patch_prober.go:28] interesting pod/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 12 00:33:55.365992 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:55.365835 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" podUID="924319c2-0598-4d18-8a56-5a4a58d1c4b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 12 00:33:56.369384 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:56.369355 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:56.369770 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:56.369581 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:33:56.370279 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:33:56.370265 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:35:26.029560 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:26.029525 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww"] Jul 12 00:35:26.030160 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:26.029791 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" podUID="924319c2-0598-4d18-8a56-5a4a58d1c4b2" containerName="istio-proxy" containerID="cri-o://9a061cfb99184e125a0f00fbe9356d8fb4782cbb466d76ddf6c6fef0c21876cd" gracePeriod=30 Jul 12 00:35:26.371600 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:26.371523 2564 patch_prober.go:28] interesting pod/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 12 00:35:26.371600 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:26.371584 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" podUID="924319c2-0598-4d18-8a56-5a4a58d1c4b2" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 12 00:35:31.287289 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.287264 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:35:31.385402 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.385331 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istio-envoy\") pod \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " Jul 12 00:35:31.385402 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.385373 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istiod-ca-cert\") pod \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " Jul 12 00:35:31.385570 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.385419 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-workload-certs\") pod \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " Jul 12 00:35:31.385570 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.385467 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istio-podinfo\") pod \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " Jul 12 00:35:31.385570 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.385495 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99k6n\" (UniqueName: \"kubernetes.io/projected/924319c2-0598-4d18-8a56-5a4a58d1c4b2-kube-api-access-99k6n\") pod \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " Jul 12 00:35:31.385570 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.385557 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istio-token\") pod \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " Jul 12 00:35:31.385748 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.385590 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istio-data\") pod \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " Jul 12 00:35:31.385748 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.385622 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-credential-socket\") pod \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " Jul 12 00:35:31.385748 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.385652 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-workload-socket\") pod \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\" (UID: \"924319c2-0598-4d18-8a56-5a4a58d1c4b2\") " Jul 12 00:35:31.385748 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.385721 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "924319c2-0598-4d18-8a56-5a4a58d1c4b2" (UID: "924319c2-0598-4d18-8a56-5a4a58d1c4b2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 00:35:31.385944 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.385827 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "924319c2-0598-4d18-8a56-5a4a58d1c4b2" (UID: "924319c2-0598-4d18-8a56-5a4a58d1c4b2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 00:35:31.385944 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.385933 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "924319c2-0598-4d18-8a56-5a4a58d1c4b2" (UID: "924319c2-0598-4d18-8a56-5a4a58d1c4b2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 00:35:31.386049 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.386029 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "924319c2-0598-4d18-8a56-5a4a58d1c4b2" (UID: "924319c2-0598-4d18-8a56-5a4a58d1c4b2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 00:35:31.386183 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.386164 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-credential-socket\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:35:31.386280 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.386186 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-workload-socket\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:35:31.386280 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.386198 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istiod-ca-cert\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:35:31.386280 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.386213 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-workload-certs\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:35:31.386594 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.386569 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istio-data" (OuterVolumeSpecName: "istio-data") pod "924319c2-0598-4d18-8a56-5a4a58d1c4b2" (UID: "924319c2-0598-4d18-8a56-5a4a58d1c4b2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 00:35:31.387609 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.387581 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "924319c2-0598-4d18-8a56-5a4a58d1c4b2" (UID: "924319c2-0598-4d18-8a56-5a4a58d1c4b2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 00:35:31.387683 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.387643 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "924319c2-0598-4d18-8a56-5a4a58d1c4b2" (UID: "924319c2-0598-4d18-8a56-5a4a58d1c4b2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 12 00:35:31.388155 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.388136 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/924319c2-0598-4d18-8a56-5a4a58d1c4b2-kube-api-access-99k6n" (OuterVolumeSpecName: "kube-api-access-99k6n") pod "924319c2-0598-4d18-8a56-5a4a58d1c4b2" (UID: "924319c2-0598-4d18-8a56-5a4a58d1c4b2"). InnerVolumeSpecName "kube-api-access-99k6n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 00:35:31.388234 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.388173 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istio-token" (OuterVolumeSpecName: "istio-token") pod "924319c2-0598-4d18-8a56-5a4a58d1c4b2" (UID: "924319c2-0598-4d18-8a56-5a4a58d1c4b2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 00:35:31.487493 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.487473 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istio-envoy\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:35:31.487493 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.487493 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istio-podinfo\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:35:31.487628 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.487502 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99k6n\" (UniqueName: \"kubernetes.io/projected/924319c2-0598-4d18-8a56-5a4a58d1c4b2-kube-api-access-99k6n\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:35:31.487628 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.487513 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istio-token\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:35:31.487628 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.487525 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/924319c2-0598-4d18-8a56-5a4a58d1c4b2-istio-data\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:35:31.758361 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.758329 2564 generic.go:356] "Generic (PLEG): container finished" podID="924319c2-0598-4d18-8a56-5a4a58d1c4b2" containerID="9a061cfb99184e125a0f00fbe9356d8fb4782cbb466d76ddf6c6fef0c21876cd" exitCode=0 Jul 12 00:35:31.758509 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.758372 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" Jul 12 00:35:31.758509 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.758375 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" event={"ID":"924319c2-0598-4d18-8a56-5a4a58d1c4b2","Type":"ContainerDied","Data":"9a061cfb99184e125a0f00fbe9356d8fb4782cbb466d76ddf6c6fef0c21876cd"} Jul 12 00:35:31.758509 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.758496 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww" event={"ID":"924319c2-0598-4d18-8a56-5a4a58d1c4b2","Type":"ContainerDied","Data":"66b5fb0f19766ff031901bd5566844ea240776fa0cc744512a22f53b14cfab81"} Jul 12 00:35:31.758635 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.758521 2564 scope.go:117] "RemoveContainer" containerID="9a061cfb99184e125a0f00fbe9356d8fb4782cbb466d76ddf6c6fef0c21876cd" Jul 12 00:35:31.767809 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.767793 2564 scope.go:117] "RemoveContainer" containerID="54abf8a356ff7f76818ca9d6e4b30ec616e4f1eaad5609d1a79f830ca2565f43" Jul 12 00:35:31.775713 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.775698 2564 scope.go:117] "RemoveContainer" containerID="9a061cfb99184e125a0f00fbe9356d8fb4782cbb466d76ddf6c6fef0c21876cd" Jul 12 00:35:31.775957 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:35:31.775939 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a061cfb99184e125a0f00fbe9356d8fb4782cbb466d76ddf6c6fef0c21876cd\": container with ID starting with 9a061cfb99184e125a0f00fbe9356d8fb4782cbb466d76ddf6c6fef0c21876cd not found: ID does not exist" containerID="9a061cfb99184e125a0f00fbe9356d8fb4782cbb466d76ddf6c6fef0c21876cd" Jul 12 00:35:31.776010 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.775965 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a061cfb99184e125a0f00fbe9356d8fb4782cbb466d76ddf6c6fef0c21876cd"} err="failed to get container status \"9a061cfb99184e125a0f00fbe9356d8fb4782cbb466d76ddf6c6fef0c21876cd\": rpc error: code = NotFound desc = could not find container \"9a061cfb99184e125a0f00fbe9356d8fb4782cbb466d76ddf6c6fef0c21876cd\": container with ID starting with 9a061cfb99184e125a0f00fbe9356d8fb4782cbb466d76ddf6c6fef0c21876cd not found: ID does not exist" Jul 12 00:35:31.776010 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.775982 2564 scope.go:117] "RemoveContainer" containerID="54abf8a356ff7f76818ca9d6e4b30ec616e4f1eaad5609d1a79f830ca2565f43" Jul 12 00:35:31.776198 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:35:31.776178 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54abf8a356ff7f76818ca9d6e4b30ec616e4f1eaad5609d1a79f830ca2565f43\": container with ID starting with 54abf8a356ff7f76818ca9d6e4b30ec616e4f1eaad5609d1a79f830ca2565f43 not found: ID does not exist" containerID="54abf8a356ff7f76818ca9d6e4b30ec616e4f1eaad5609d1a79f830ca2565f43" Jul 12 00:35:31.776248 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.776205 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54abf8a356ff7f76818ca9d6e4b30ec616e4f1eaad5609d1a79f830ca2565f43"} err="failed to get container status \"54abf8a356ff7f76818ca9d6e4b30ec616e4f1eaad5609d1a79f830ca2565f43\": rpc error: code = NotFound desc = could not find container \"54abf8a356ff7f76818ca9d6e4b30ec616e4f1eaad5609d1a79f830ca2565f43\": container with ID starting with 54abf8a356ff7f76818ca9d6e4b30ec616e4f1eaad5609d1a79f830ca2565f43 not found: ID does not exist" Jul 12 00:35:31.781606 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.781584 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww"] Jul 12 00:35:31.785112 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:31.785076 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-25afa8-openshift-default-bbf94b8f7-pxcww"] Jul 12 00:35:33.336616 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:33.336587 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="924319c2-0598-4d18-8a56-5a4a58d1c4b2" path="/var/lib/kubelet/pods/924319c2-0598-4d18-8a56-5a4a58d1c4b2/volumes" Jul 12 00:35:34.859810 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:34.859781 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk"] Jul 12 00:35:34.860316 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:34.860302 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="924319c2-0598-4d18-8a56-5a4a58d1c4b2" containerName="istio-proxy" Jul 12 00:35:34.860316 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:34.860317 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="924319c2-0598-4d18-8a56-5a4a58d1c4b2" containerName="istio-proxy" Jul 12 00:35:34.860422 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:34.860406 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="924319c2-0598-4d18-8a56-5a4a58d1c4b2" containerName="istio-proxy" Jul 12 00:35:34.860422 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:34.860415 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="924319c2-0598-4d18-8a56-5a4a58d1c4b2" containerName="istio-proxy" Jul 12 00:35:34.865011 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:34.864990 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:34.867309 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:34.867291 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-fa215e-openshift-default-dockercfg-dvbqf\"" Jul 12 00:35:34.875066 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:34.875041 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk"] Jul 12 00:35:35.013956 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.013923 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-credential-socket\") pod \"e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:35.014131 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.013972 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istio-envoy\") pod \"e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:35.014131 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.014034 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istio-token\") pod \"e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:35.014131 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.014085 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istio-podinfo\") pod \"e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:35.014242 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.014143 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-workload-socket\") pod \"e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:35.014242 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.014168 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-workload-certs\") pod \"e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:35.014242 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.014182 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istio-data\") pod \"e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:35.014242 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.014202 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istiod-ca-cert\") pod \"e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:35.014242 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.014236 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m92x6\" (UniqueName: \"kubernetes.io/projected/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-kube-api-access-m92x6\") pod \"e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:35.115226 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.115138 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istio-podinfo\") pod \"e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:35.115226 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.115204 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-workload-socket\") pod \"e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:35.115396 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.115232 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-workload-certs\") pod \"e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:35.115396 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.115256 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istio-data\") pod \"e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:35.115396 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.115379 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istiod-ca-cert\") pod \"e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:35.115521 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.115410 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m92x6\" (UniqueName: \"kubernetes.io/projected/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-kube-api-access-m92x6\") pod \"e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:35.115577 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.115522 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-credential-socket\") pod \"e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:35.115623 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.115572 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istio-envoy\") pod \"e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:35.115623 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.115617 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istio-token\") pod \"e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:35.115719 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.115642 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-workload-socket\") pod \"e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:35.115719 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.115663 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istio-data\") pod \"e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:35.115835 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.115721 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-workload-certs\") pod \"e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:35.116034 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.116010 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-credential-socket\") pod \"e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:35.116198 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.116055 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istiod-ca-cert\") pod \"e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:35.117686 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.117661 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istio-podinfo\") pod \"e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:35.117686 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.117678 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istio-envoy\") pod \"e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:35.123432 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.123409 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istio-token\") pod \"e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:35.123563 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.123547 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m92x6\" (UniqueName: \"kubernetes.io/projected/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-kube-api-access-m92x6\") pod \"e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:35.176574 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.176551 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:35.309559 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.309535 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk"] Jul 12 00:35:35.311438 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:35:35.311405 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bfb3f01_61e6_4aa1_a0f0_ae70fc1b78b5.slice/crio-4bacd9dbb37a4da54cbe7323f6a2d5af79f086051c26148b6823eca8ff841922 WatchSource:0}: Error finding container 4bacd9dbb37a4da54cbe7323f6a2d5af79f086051c26148b6823eca8ff841922: Status 404 returned error can't find the container with id 4bacd9dbb37a4da54cbe7323f6a2d5af79f086051c26148b6823eca8ff841922 Jul 12 00:35:35.313617 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.313586 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:35:35.313681 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.313649 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:35:35.313715 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.313678 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:35:35.780779 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.780737 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" event={"ID":"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5","Type":"ContainerStarted","Data":"1bd2f40a5289b03654e624f18a15f0f7287e6050f8cc0c9811969412f6432120"} Jul 12 00:35:35.780941 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.780821 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" event={"ID":"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5","Type":"ContainerStarted","Data":"4bacd9dbb37a4da54cbe7323f6a2d5af79f086051c26148b6823eca8ff841922"} Jul 12 00:35:35.801230 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:35.801187 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" podStartSLOduration=1.801171418 podStartE2EDuration="1.801171418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:35:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:35:35.798959405 +0000 UTC m=+2298.974756052" watchObservedRunningTime="2026-07-12 00:35:35.801171418 +0000 UTC m=+2298.976968054" Jul 12 00:35:36.177341 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:36.177314 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:36.181902 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:36.181882 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:36.785847 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:36.785817 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:36.786559 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:36.786540 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:50.858357 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:50.858324 2564 generic.go:356] "Generic (PLEG): container finished" podID="0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5" containerID="1bd2f40a5289b03654e624f18a15f0f7287e6050f8cc0c9811969412f6432120" exitCode=0 Jul 12 00:35:50.858880 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:50.858404 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" event={"ID":"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5","Type":"ContainerDied","Data":"1bd2f40a5289b03654e624f18a15f0f7287e6050f8cc0c9811969412f6432120"} Jul 12 00:35:50.858948 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:50.858931 2564 scope.go:117] "RemoveContainer" containerID="1bd2f40a5289b03654e624f18a15f0f7287e6050f8cc0c9811969412f6432120" Jul 12 00:35:50.859997 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:50.859971 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:35:50.860115 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:50.860035 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:35:50.860115 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:50.860064 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:35:51.785941 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:51.785899 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:51.864939 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:51.864904 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" event={"ID":"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5","Type":"ContainerStarted","Data":"51ba40dff5366b9afc1f91df52a4d5465e22fa09be89a83ebfb7b1c8d80fbc1f"} Jul 12 00:35:52.178304 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:52.178270 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:52.178509 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:52.178416 2564 patch_prober.go:28] interesting pod/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 12 00:35:52.178509 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:52.178463 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" podUID="0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 12 00:35:53.177927 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:53.177888 2564 patch_prober.go:28] interesting pod/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 12 00:35:53.178420 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:53.177954 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" podUID="0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 12 00:35:54.177218 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:54.177182 2564 patch_prober.go:28] interesting pod/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 12 00:35:54.177521 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:54.177494 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" podUID="0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 12 00:35:55.177712 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:55.177649 2564 patch_prober.go:28] interesting pod/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 12 00:35:55.178231 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:55.177772 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" podUID="0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 12 00:35:56.181080 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:56.181051 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:56.181572 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:56.181440 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:35:56.182065 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:35:56.182049 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:36:42.562192 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:42.562159 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk"] Jul 12 00:36:42.562649 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:42.562424 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" podUID="0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5" containerName="istio-proxy" containerID="cri-o://51ba40dff5366b9afc1f91df52a4d5465e22fa09be89a83ebfb7b1c8d80fbc1f" gracePeriod=30 Jul 12 00:36:47.822756 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:47.822699 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:36:47.908664 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:47.908637 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istiod-ca-cert\") pod \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " Jul 12 00:36:47.908664 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:47.908666 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istio-data\") pod \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " Jul 12 00:36:47.908872 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:47.908693 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-workload-certs\") pod \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " Jul 12 00:36:47.908872 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:47.908719 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istio-envoy\") pod \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " Jul 12 00:36:47.908872 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:47.908749 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m92x6\" (UniqueName: \"kubernetes.io/projected/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-kube-api-access-m92x6\") pod \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " Jul 12 00:36:47.908872 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:47.908783 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-workload-socket\") pod \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " Jul 12 00:36:47.908872 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:47.908821 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istio-token\") pod \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " Jul 12 00:36:47.908872 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:47.908860 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-credential-socket\") pod \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " Jul 12 00:36:47.909210 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:47.908900 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istio-podinfo\") pod \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\" (UID: \"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5\") " Jul 12 00:36:47.909270 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:47.909044 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5" (UID: "0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 00:36:47.909270 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:47.909156 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5" (UID: "0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 00:36:47.909270 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:47.909152 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5" (UID: "0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 00:36:47.909467 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:47.909336 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5" (UID: "0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 00:36:47.909685 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:47.909661 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istio-data" (OuterVolumeSpecName: "istio-data") pod "0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5" (UID: "0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 00:36:47.911042 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:47.911021 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5" (UID: "0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 00:36:47.911141 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:47.911052 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istio-token" (OuterVolumeSpecName: "istio-token") pod "0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5" (UID: "0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 00:36:47.911448 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:47.911429 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5" (UID: "0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 12 00:36:47.911448 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:47.911434 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-kube-api-access-m92x6" (OuterVolumeSpecName: "kube-api-access-m92x6") pod "0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5" (UID: "0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5"). InnerVolumeSpecName "kube-api-access-m92x6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 00:36:48.009949 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:48.009918 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-workload-socket\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:36:48.009949 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:48.009945 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istio-token\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:36:48.009949 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:48.009955 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-credential-socket\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:36:48.010178 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:48.009964 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istio-podinfo\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:36:48.010178 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:48.009973 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istiod-ca-cert\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:36:48.010178 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:48.009981 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istio-data\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:36:48.010178 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:48.009988 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-workload-certs\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:36:48.010178 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:48.009997 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-istio-envoy\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:36:48.010178 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:48.010004 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m92x6\" (UniqueName: \"kubernetes.io/projected/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5-kube-api-access-m92x6\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:36:48.156033 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:48.155961 2564 generic.go:356] "Generic (PLEG): container finished" podID="0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5" containerID="51ba40dff5366b9afc1f91df52a4d5465e22fa09be89a83ebfb7b1c8d80fbc1f" exitCode=0 Jul 12 00:36:48.156033 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:48.156014 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" Jul 12 00:36:48.156219 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:48.156042 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" event={"ID":"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5","Type":"ContainerDied","Data":"51ba40dff5366b9afc1f91df52a4d5465e22fa09be89a83ebfb7b1c8d80fbc1f"} Jul 12 00:36:48.156219 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:48.156119 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk" event={"ID":"0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5","Type":"ContainerDied","Data":"4bacd9dbb37a4da54cbe7323f6a2d5af79f086051c26148b6823eca8ff841922"} Jul 12 00:36:48.156219 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:48.156124 2564 scope.go:117] "RemoveContainer" containerID="51ba40dff5366b9afc1f91df52a4d5465e22fa09be89a83ebfb7b1c8d80fbc1f" Jul 12 00:36:48.166078 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:48.166059 2564 scope.go:117] "RemoveContainer" containerID="1bd2f40a5289b03654e624f18a15f0f7287e6050f8cc0c9811969412f6432120" Jul 12 00:36:48.176283 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:48.176259 2564 scope.go:117] "RemoveContainer" containerID="51ba40dff5366b9afc1f91df52a4d5465e22fa09be89a83ebfb7b1c8d80fbc1f" Jul 12 00:36:48.176605 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:36:48.176579 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51ba40dff5366b9afc1f91df52a4d5465e22fa09be89a83ebfb7b1c8d80fbc1f\": container with ID starting with 51ba40dff5366b9afc1f91df52a4d5465e22fa09be89a83ebfb7b1c8d80fbc1f not found: ID does not exist" containerID="51ba40dff5366b9afc1f91df52a4d5465e22fa09be89a83ebfb7b1c8d80fbc1f" Jul 12 00:36:48.176712 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:48.176617 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51ba40dff5366b9afc1f91df52a4d5465e22fa09be89a83ebfb7b1c8d80fbc1f"} err="failed to get container status \"51ba40dff5366b9afc1f91df52a4d5465e22fa09be89a83ebfb7b1c8d80fbc1f\": rpc error: code = NotFound desc = could not find container \"51ba40dff5366b9afc1f91df52a4d5465e22fa09be89a83ebfb7b1c8d80fbc1f\": container with ID starting with 51ba40dff5366b9afc1f91df52a4d5465e22fa09be89a83ebfb7b1c8d80fbc1f not found: ID does not exist" Jul 12 00:36:48.176712 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:48.176639 2564 scope.go:117] "RemoveContainer" containerID="1bd2f40a5289b03654e624f18a15f0f7287e6050f8cc0c9811969412f6432120" Jul 12 00:36:48.177264 ip-10-0-132-227 kubenswrapper[2564]: E0712 00:36:48.177236 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bd2f40a5289b03654e624f18a15f0f7287e6050f8cc0c9811969412f6432120\": container with ID starting with 1bd2f40a5289b03654e624f18a15f0f7287e6050f8cc0c9811969412f6432120 not found: ID does not exist" containerID="1bd2f40a5289b03654e624f18a15f0f7287e6050f8cc0c9811969412f6432120" Jul 12 00:36:48.177367 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:48.177271 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bd2f40a5289b03654e624f18a15f0f7287e6050f8cc0c9811969412f6432120"} err="failed to get container status \"1bd2f40a5289b03654e624f18a15f0f7287e6050f8cc0c9811969412f6432120\": rpc error: code = NotFound desc = could not find container \"1bd2f40a5289b03654e624f18a15f0f7287e6050f8cc0c9811969412f6432120\": container with ID starting with 1bd2f40a5289b03654e624f18a15f0f7287e6050f8cc0c9811969412f6432120 not found: ID does not exist" Jul 12 00:36:48.179643 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:48.179621 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk"] Jul 12 00:36:48.181692 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:48.181671 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-fa215e-openshift-default-78546bbcd5-hc2dk"] Jul 12 00:36:49.336333 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:49.336301 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5" path="/var/lib/kubelet/pods/0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5/volumes" Jul 12 00:36:52.135777 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.135746 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb"] Jul 12 00:36:52.137508 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.137483 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="924319c2-0598-4d18-8a56-5a4a58d1c4b2" containerName="istio-proxy" Jul 12 00:36:52.137670 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.137659 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="924319c2-0598-4d18-8a56-5a4a58d1c4b2" containerName="istio-proxy" Jul 12 00:36:52.137774 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.137764 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5" containerName="istio-proxy" Jul 12 00:36:52.137851 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.137842 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5" containerName="istio-proxy" Jul 12 00:36:52.137923 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.137914 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5" containerName="istio-proxy" Jul 12 00:36:52.138004 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.137995 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5" containerName="istio-proxy" Jul 12 00:36:52.138654 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.138637 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5" containerName="istio-proxy" Jul 12 00:36:52.138836 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.138822 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bfb3f01-61e6-4aa1-a0f0-ae70fc1b78b5" containerName="istio-proxy" Jul 12 00:36:52.146730 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.146701 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.148182 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.148162 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb"] Jul 12 00:36:52.149207 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.149187 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-39949b-openshift-default-dockercfg-gbqgs\"" Jul 12 00:36:52.248325 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.248290 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48dc35ae-b894-436d-a22f-57076b87cdae-istio-podinfo\") pod \"e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.248499 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.248331 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-credential-socket\") pod \"e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.248499 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.248361 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48dc35ae-b894-436d-a22f-57076b87cdae-istiod-ca-cert\") pod \"e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.248499 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.248408 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48dc35ae-b894-436d-a22f-57076b87cdae-istio-token\") pod \"e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.248499 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.248426 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-workload-socket\") pod \"e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.248499 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.248464 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgrlx\" (UniqueName: \"kubernetes.io/projected/48dc35ae-b894-436d-a22f-57076b87cdae-kube-api-access-qgrlx\") pod \"e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.248862 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.248508 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-workload-certs\") pod \"e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.248862 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.248565 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-istio-data\") pod \"e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.248862 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.248586 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-istio-envoy\") pod \"e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.349701 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.349669 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgrlx\" (UniqueName: \"kubernetes.io/projected/48dc35ae-b894-436d-a22f-57076b87cdae-kube-api-access-qgrlx\") pod \"e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.349836 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.349716 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-workload-certs\") pod \"e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.349836 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.349755 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-istio-data\") pod \"e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.349836 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.349772 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-istio-envoy\") pod \"e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.349836 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.349813 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48dc35ae-b894-436d-a22f-57076b87cdae-istio-podinfo\") pod \"e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.350046 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.349929 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-credential-socket\") pod \"e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.350046 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.349972 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48dc35ae-b894-436d-a22f-57076b87cdae-istiod-ca-cert\") pod \"e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.350046 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.350032 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48dc35ae-b894-436d-a22f-57076b87cdae-istio-token\") pod \"e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.350231 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.350058 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-workload-socket\") pod \"e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.350231 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.350204 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-workload-certs\") pod \"e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.350356 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.350297 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-istio-data\") pod \"e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.350356 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.350338 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-credential-socket\") pod \"e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.350432 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.350378 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-workload-socket\") pod \"e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.350647 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.350629 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48dc35ae-b894-436d-a22f-57076b87cdae-istiod-ca-cert\") pod \"e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.351991 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.351967 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-istio-envoy\") pod \"e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.352234 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.352216 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48dc35ae-b894-436d-a22f-57076b87cdae-istio-podinfo\") pod \"e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.358429 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.358407 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48dc35ae-b894-436d-a22f-57076b87cdae-istio-token\") pod \"e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.358517 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.358502 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgrlx\" (UniqueName: \"kubernetes.io/projected/48dc35ae-b894-436d-a22f-57076b87cdae-kube-api-access-qgrlx\") pod \"e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.458402 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.458365 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:52.595294 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.595273 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb"] Jul 12 00:36:52.597622 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:36:52.597586 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48dc35ae_b894_436d_a22f_57076b87cdae.slice/crio-1c5b5d6b2190db6510e30dc5dd4f907751a04fc20688930f3e233a16545961ce WatchSource:0}: Error finding container 1c5b5d6b2190db6510e30dc5dd4f907751a04fc20688930f3e233a16545961ce: Status 404 returned error can't find the container with id 1c5b5d6b2190db6510e30dc5dd4f907751a04fc20688930f3e233a16545961ce Jul 12 00:36:52.599779 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.599745 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:36:52.599864 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.599815 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:36:52.599864 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:52.599842 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:36:53.183889 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:53.183852 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" event={"ID":"48dc35ae-b894-436d-a22f-57076b87cdae","Type":"ContainerStarted","Data":"4ee331a2dd073448ec30066ce23fca9cc5c68ef6366dd991ea7f2752d043cc53"} Jul 12 00:36:53.184385 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:53.183917 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" event={"ID":"48dc35ae-b894-436d-a22f-57076b87cdae","Type":"ContainerStarted","Data":"1c5b5d6b2190db6510e30dc5dd4f907751a04fc20688930f3e233a16545961ce"} Jul 12 00:36:53.204442 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:53.204395 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" podStartSLOduration=1.204380355 podStartE2EDuration="1.204380355s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 00:36:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:36:53.202096098 +0000 UTC m=+2376.377892738" watchObservedRunningTime="2026-07-12 00:36:53.204380355 +0000 UTC m=+2376.380177054" Jul 12 00:36:53.458827 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:53.458761 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:53.463422 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:53.463401 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:54.189400 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:54.189370 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:36:54.190162 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:36:54.190145 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:37:07.269274 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:37:07.269240 2564 generic.go:356] "Generic (PLEG): container finished" podID="48dc35ae-b894-436d-a22f-57076b87cdae" containerID="4ee331a2dd073448ec30066ce23fca9cc5c68ef6366dd991ea7f2752d043cc53" exitCode=0 Jul 12 00:37:07.269657 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:37:07.269287 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" event={"ID":"48dc35ae-b894-436d-a22f-57076b87cdae","Type":"ContainerDied","Data":"4ee331a2dd073448ec30066ce23fca9cc5c68ef6366dd991ea7f2752d043cc53"} Jul 12 00:37:07.269657 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:37:07.269653 2564 scope.go:117] "RemoveContainer" containerID="4ee331a2dd073448ec30066ce23fca9cc5c68ef6366dd991ea7f2752d043cc53" Jul 12 00:37:07.270702 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:37:07.270672 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:37:07.270762 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:37:07.270741 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:37:07.270798 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:37:07.270774 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 12 00:37:08.278740 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:37:08.278680 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" event={"ID":"48dc35ae-b894-436d-a22f-57076b87cdae","Type":"ContainerStarted","Data":"fcada71f43616c7c92d6658ed8ccfee50e419b4d292e81e27f9ccdc3fc22378f"} Jul 12 00:37:08.459550 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:37:08.459520 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:37:08.460427 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:37:08.460404 2564 patch_prober.go:28] interesting pod/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 12 00:37:08.460485 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:37:08.460456 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" podUID="48dc35ae-b894-436d-a22f-57076b87cdae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 12 00:37:09.189490 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:37:09.189457 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:37:09.458874 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:37:09.458797 2564 patch_prober.go:28] interesting pod/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 12 00:37:09.459254 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:37:09.458871 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" podUID="48dc35ae-b894-436d-a22f-57076b87cdae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 12 00:37:10.459117 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:37:10.459080 2564 patch_prober.go:28] interesting pod/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 12 00:37:10.459479 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:37:10.459167 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" podUID="48dc35ae-b894-436d-a22f-57076b87cdae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 12 00:37:11.459721 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:37:11.459688 2564 patch_prober.go:28] interesting pod/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 12 00:37:11.460126 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:37:11.459740 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" podUID="48dc35ae-b894-436d-a22f-57076b87cdae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 12 00:37:12.463006 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:37:12.462978 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:37:12.463970 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:37:12.463949 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:37:17.529617 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:37:17.529590 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcdr8_8bdecd8b-9853-4a8f-8441-68bad8a709c2/ovn-acl-logging/0.log" Jul 12 00:37:17.536299 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:37:17.536278 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcdr8_8bdecd8b-9853-4a8f-8441-68bad8a709c2/ovn-acl-logging/0.log" Jul 12 00:42:17.563806 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:42:17.563777 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcdr8_8bdecd8b-9853-4a8f-8441-68bad8a709c2/ovn-acl-logging/0.log" Jul 12 00:42:17.571834 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:42:17.571814 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xcdr8_8bdecd8b-9853-4a8f-8441-68bad8a709c2/ovn-acl-logging/0.log" Jul 12 00:44:50.481541 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:50.481509 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb"] Jul 12 00:44:50.482095 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:50.481716 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" podUID="48dc35ae-b894-436d-a22f-57076b87cdae" containerName="istio-proxy" containerID="cri-o://fcada71f43616c7c92d6658ed8ccfee50e419b4d292e81e27f9ccdc3fc22378f" gracePeriod=30 Jul 12 00:44:55.653873 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.653835 2564 generic.go:356] "Generic (PLEG): container finished" podID="48dc35ae-b894-436d-a22f-57076b87cdae" containerID="fcada71f43616c7c92d6658ed8ccfee50e419b4d292e81e27f9ccdc3fc22378f" exitCode=0 Jul 12 00:44:55.654298 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.653900 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" event={"ID":"48dc35ae-b894-436d-a22f-57076b87cdae","Type":"ContainerDied","Data":"fcada71f43616c7c92d6658ed8ccfee50e419b4d292e81e27f9ccdc3fc22378f"} Jul 12 00:44:55.654298 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.653961 2564 scope.go:117] "RemoveContainer" containerID="4ee331a2dd073448ec30066ce23fca9cc5c68ef6366dd991ea7f2752d043cc53" Jul 12 00:44:55.740064 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.740042 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:44:55.887186 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.887096 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-istio-data\") pod \"48dc35ae-b894-436d-a22f-57076b87cdae\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " Jul 12 00:44:55.887413 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.887193 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-credential-socket\") pod \"48dc35ae-b894-436d-a22f-57076b87cdae\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " Jul 12 00:44:55.887413 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.887225 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48dc35ae-b894-436d-a22f-57076b87cdae-istiod-ca-cert\") pod \"48dc35ae-b894-436d-a22f-57076b87cdae\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " Jul 12 00:44:55.887413 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.887270 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48dc35ae-b894-436d-a22f-57076b87cdae-istio-podinfo\") pod \"48dc35ae-b894-436d-a22f-57076b87cdae\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " Jul 12 00:44:55.887413 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.887310 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-workload-socket\") pod \"48dc35ae-b894-436d-a22f-57076b87cdae\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " Jul 12 00:44:55.887413 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.887360 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-istio-envoy\") pod \"48dc35ae-b894-436d-a22f-57076b87cdae\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " Jul 12 00:44:55.887413 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.887402 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-workload-certs\") pod \"48dc35ae-b894-436d-a22f-57076b87cdae\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " Jul 12 00:44:55.887730 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.887431 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48dc35ae-b894-436d-a22f-57076b87cdae-istio-token\") pod \"48dc35ae-b894-436d-a22f-57076b87cdae\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " Jul 12 00:44:55.887787 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.887467 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "48dc35ae-b894-436d-a22f-57076b87cdae" (UID: "48dc35ae-b894-436d-a22f-57076b87cdae"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 00:44:55.887787 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.887653 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "48dc35ae-b894-436d-a22f-57076b87cdae" (UID: "48dc35ae-b894-436d-a22f-57076b87cdae"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 00:44:55.887787 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.887726 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48dc35ae-b894-436d-a22f-57076b87cdae-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "48dc35ae-b894-436d-a22f-57076b87cdae" (UID: "48dc35ae-b894-436d-a22f-57076b87cdae"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 00:44:55.887943 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.887725 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "48dc35ae-b894-436d-a22f-57076b87cdae" (UID: "48dc35ae-b894-436d-a22f-57076b87cdae"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 00:44:55.887943 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.887517 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgrlx\" (UniqueName: \"kubernetes.io/projected/48dc35ae-b894-436d-a22f-57076b87cdae-kube-api-access-qgrlx\") pod \"48dc35ae-b894-436d-a22f-57076b87cdae\" (UID: \"48dc35ae-b894-436d-a22f-57076b87cdae\") " Jul 12 00:44:55.888037 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.887972 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-istio-data" (OuterVolumeSpecName: "istio-data") pod "48dc35ae-b894-436d-a22f-57076b87cdae" (UID: "48dc35ae-b894-436d-a22f-57076b87cdae"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 00:44:55.888236 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.888218 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-istio-data\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:44:55.888313 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.888241 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-credential-socket\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:44:55.888313 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.888255 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48dc35ae-b894-436d-a22f-57076b87cdae-istiod-ca-cert\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:44:55.888313 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.888269 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-workload-socket\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:44:55.888313 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.888281 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-workload-certs\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:44:55.889620 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.889596 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "48dc35ae-b894-436d-a22f-57076b87cdae" (UID: "48dc35ae-b894-436d-a22f-57076b87cdae"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 00:44:55.889704 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.889619 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48dc35ae-b894-436d-a22f-57076b87cdae-istio-token" (OuterVolumeSpecName: "istio-token") pod "48dc35ae-b894-436d-a22f-57076b87cdae" (UID: "48dc35ae-b894-436d-a22f-57076b87cdae"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 00:44:55.889879 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.889850 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/48dc35ae-b894-436d-a22f-57076b87cdae-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "48dc35ae-b894-436d-a22f-57076b87cdae" (UID: "48dc35ae-b894-436d-a22f-57076b87cdae"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 12 00:44:55.889923 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.889882 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48dc35ae-b894-436d-a22f-57076b87cdae-kube-api-access-qgrlx" (OuterVolumeSpecName: "kube-api-access-qgrlx") pod "48dc35ae-b894-436d-a22f-57076b87cdae" (UID: "48dc35ae-b894-436d-a22f-57076b87cdae"). InnerVolumeSpecName "kube-api-access-qgrlx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 00:44:55.981545 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.981522 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zg554_600c047f-a7bf-4474-9522-c30b342af2cd/manager/0.log" Jul 12 00:44:55.989420 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.989402 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgrlx\" (UniqueName: \"kubernetes.io/projected/48dc35ae-b894-436d-a22f-57076b87cdae-kube-api-access-qgrlx\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:44:55.989420 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.989420 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48dc35ae-b894-436d-a22f-57076b87cdae-istio-podinfo\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:44:55.989530 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.989429 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48dc35ae-b894-436d-a22f-57076b87cdae-istio-envoy\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:44:55.989530 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:55.989437 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48dc35ae-b894-436d-a22f-57076b87cdae-istio-token\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 12 00:44:56.095604 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:56.095578 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zh9fb_a4df588d-b35e-40fb-aef6-b0e12128e5cd/manager/0.log" Jul 12 00:44:56.661305 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:56.661274 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" Jul 12 00:44:56.661768 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:56.661321 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb" event={"ID":"48dc35ae-b894-436d-a22f-57076b87cdae","Type":"ContainerDied","Data":"1c5b5d6b2190db6510e30dc5dd4f907751a04fc20688930f3e233a16545961ce"} Jul 12 00:44:56.661768 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:56.661375 2564 scope.go:117] "RemoveContainer" containerID="fcada71f43616c7c92d6658ed8ccfee50e419b4d292e81e27f9ccdc3fc22378f" Jul 12 00:44:56.682396 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:56.682373 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb"] Jul 12 00:44:56.686153 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:56.686122 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-39949b-openshift-default-5c5b9f46dc-h58zb"] Jul 12 00:44:56.831367 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:56.831345 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c8b78dfc9-nvp94_9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755/manager/0.log" Jul 12 00:44:56.843067 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:56.843049 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c8b78dfc9-nvp94_9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755/copy-manifests/0.log" Jul 12 00:44:57.214255 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:57.214226 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7d7cb7bff4-wnp69_1e3d83f0-73e7-4ea9-bcc1-cb8be3753893/maas-api/0.log" Jul 12 00:44:57.336835 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:57.336808 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48dc35ae-b894-436d-a22f-57076b87cdae" path="/var/lib/kubelet/pods/48dc35ae-b894-436d-a22f-57076b87cdae/volumes" Jul 12 00:44:58.874203 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:44:58.874167 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-zx7z5_a3b2bc3d-8984-47c5-a7af-11fa608ec9f1/postgres/0.log" Jul 12 00:45:00.420881 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:00.420854 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9fb8q_64b01c35-6e22-4df6-8c25-62f8cafe3951/manager/0.log" Jul 12 00:45:00.647757 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:00.647728 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vfl9d_01216096-1bc9-4da3-bb6c-d61955349722/registry-server/0.log" Jul 12 00:45:01.014188 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:01.014140 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-d5gh2_8511cf9e-87d4-4a85-bad0-8466f18486cf/manager/0.log" Jul 12 00:45:01.366872 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:01.366801 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4lhxvp_5d64989d-f5c2-4029-a088-7531e9d1cf8f/istio-proxy/0.log" Jul 12 00:45:01.837624 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:01.837593 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9rkm7_23091102-0999-42cd-8673-1e4809b9451d/istio-proxy/1.log" Jul 12 00:45:01.958288 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:01.958264 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-tg9lj_649b2b12-1d9b-4ad5-a87c-2b4de8ca86f9/payload-pre-processing/0.log" Jul 12 00:45:02.540978 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:02.540955 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-wlh8s_5f21b231-43fe-4db9-ab03-8ea3d385ff27/main/0.log" Jul 12 00:45:02.884264 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:02.884187 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2mkmq_e021d6e6-445f-4802-8202-c8f4f3985b3a/main/0.log" Jul 12 00:45:02.998654 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:02.998631 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-lw4r2_0c53b85d-26b5-4a76-80a8-3359628dcd5b/main/0.log" Jul 12 00:45:10.158340 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:10.158271 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2dpdn_a15f85da-2145-459f-8445-82ec38f243b7/global-pull-secret-syncer/0.log" Jul 12 00:45:10.351311 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:10.351287 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-q72jw_46db6233-0f23-4f52-9648-f6b265d0df9d/konnectivity-agent/0.log" Jul 12 00:45:10.367838 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:10.367810 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-227.ec2.internal_128e18488d42fbf8ffd3f878224f2cb5/haproxy/0.log" Jul 12 00:45:16.000569 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:16.000543 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9fb8q_64b01c35-6e22-4df6-8c25-62f8cafe3951/manager/0.log" Jul 12 00:45:16.083325 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:16.083298 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vfl9d_01216096-1bc9-4da3-bb6c-d61955349722/registry-server/0.log" Jul 12 00:45:16.290561 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:16.290533 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-d5gh2_8511cf9e-87d4-4a85-bad0-8466f18486cf/manager/0.log" Jul 12 00:45:17.857291 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:17.857267 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25/alertmanager/0.log" Jul 12 00:45:17.875226 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:17.875201 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25/config-reloader/0.log" Jul 12 00:45:17.894834 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:17.894810 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25/kube-rbac-proxy-web/0.log" Jul 12 00:45:17.912513 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:17.912495 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25/kube-rbac-proxy/0.log" Jul 12 00:45:17.930721 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:17.930704 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25/kube-rbac-proxy-metric/0.log" Jul 12 00:45:17.949298 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:17.949279 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25/prom-label-proxy/0.log" Jul 12 00:45:17.966839 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:17.966821 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8aee3fe4-8fd5-4eb4-b9d5-425aa7eefd25/init-config-reloader/0.log" Jul 12 00:45:18.030717 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.030694 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-v2lbx_2cb8a669-b3fa-4c26-a706-5dea8a445f17/kube-state-metrics/0.log" Jul 12 00:45:18.046151 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.046098 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-v2lbx_2cb8a669-b3fa-4c26-a706-5dea8a445f17/kube-rbac-proxy-main/0.log" Jul 12 00:45:18.066378 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.066346 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-v2lbx_2cb8a669-b3fa-4c26-a706-5dea8a445f17/kube-rbac-proxy-self/0.log" Jul 12 00:45:18.090882 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.090805 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-658cdbb5d4-2kqgl_6f531380-b19e-45a3-95a2-11d13132a3b5/metrics-server/0.log" Jul 12 00:45:18.113851 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.113830 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-qp4b9_eafcd884-1232-4901-ba5b-69950705d701/monitoring-plugin/0.log" Jul 12 00:45:18.239863 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.239843 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-984m4_5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc/node-exporter/0.log" Jul 12 00:45:18.261228 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.261210 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-984m4_5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc/kube-rbac-proxy/0.log" Jul 12 00:45:18.280852 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.280834 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-984m4_5e5cc3f1-b0cf-4116-9970-87e5a8eb92cc/init-textfile/0.log" Jul 12 00:45:18.382738 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.382671 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-xsgt9_f91c62dd-4916-4142-b0df-68e7e49c9bd1/kube-rbac-proxy-main/0.log" Jul 12 00:45:18.403743 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.403724 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-xsgt9_f91c62dd-4916-4142-b0df-68e7e49c9bd1/kube-rbac-proxy-self/0.log" Jul 12 00:45:18.421878 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.421862 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-xsgt9_f91c62dd-4916-4142-b0df-68e7e49c9bd1/openshift-state-metrics/0.log" Jul 12 00:45:18.454296 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.454275 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c17fd92b-7812-4cf6-a66f-f290c4daae0d/prometheus/0.log" Jul 12 00:45:18.470452 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.470436 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c17fd92b-7812-4cf6-a66f-f290c4daae0d/config-reloader/0.log" Jul 12 00:45:18.488823 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.488804 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c17fd92b-7812-4cf6-a66f-f290c4daae0d/thanos-sidecar/0.log" Jul 12 00:45:18.516245 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.516230 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c17fd92b-7812-4cf6-a66f-f290c4daae0d/kube-rbac-proxy-web/0.log" Jul 12 00:45:18.530323 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.530308 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c17fd92b-7812-4cf6-a66f-f290c4daae0d/kube-rbac-proxy/0.log" Jul 12 00:45:18.547356 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.547341 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c17fd92b-7812-4cf6-a66f-f290c4daae0d/kube-rbac-proxy-thanos/0.log" Jul 12 00:45:18.565070 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.565053 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c17fd92b-7812-4cf6-a66f-f290c4daae0d/init-config-reloader/0.log" Jul 12 00:45:18.592446 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.592431 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-dqq4k_1ffe969c-2596-410b-a64a-b5228a50c7d8/prometheus-operator/0.log" Jul 12 00:45:18.610466 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.610452 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-dqq4k_1ffe969c-2596-410b-a64a-b5228a50c7d8/kube-rbac-proxy/0.log" Jul 12 00:45:18.632798 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.632753 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-rmgt9_861636f5-b3e5-499d-802e-2d956e9c6f46/prometheus-operator-admission-webhook/0.log" Jul 12 00:45:18.669349 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.669328 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-58c4d6d95b-9jjmv_a2ed8305-c0cd-4376-9437-40a53257ec41/telemeter-client/0.log" Jul 12 00:45:18.685498 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.685483 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-58c4d6d95b-9jjmv_a2ed8305-c0cd-4376-9437-40a53257ec41/reload/0.log" Jul 12 00:45:18.703650 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.703633 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-58c4d6d95b-9jjmv_a2ed8305-c0cd-4376-9437-40a53257ec41/kube-rbac-proxy/0.log" Jul 12 00:45:18.734256 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.734235 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-557df4ff8b-fc8gh_5afc1c2b-a166-4afb-8aa6-bf80156a012f/thanos-query/0.log" Jul 12 00:45:18.751345 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.751318 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-557df4ff8b-fc8gh_5afc1c2b-a166-4afb-8aa6-bf80156a012f/kube-rbac-proxy-web/0.log" Jul 12 00:45:18.769514 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.769493 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-557df4ff8b-fc8gh_5afc1c2b-a166-4afb-8aa6-bf80156a012f/kube-rbac-proxy/0.log" Jul 12 00:45:18.790644 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.790612 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-557df4ff8b-fc8gh_5afc1c2b-a166-4afb-8aa6-bf80156a012f/prom-label-proxy/0.log" Jul 12 00:45:18.811030 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.811009 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-557df4ff8b-fc8gh_5afc1c2b-a166-4afb-8aa6-bf80156a012f/kube-rbac-proxy-rules/0.log" Jul 12 00:45:18.831117 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:18.831087 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-557df4ff8b-fc8gh_5afc1c2b-a166-4afb-8aa6-bf80156a012f/kube-rbac-proxy-metrics/0.log" Jul 12 00:45:21.838481 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:21.838448 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kpjgh/perf-node-gather-daemonset-pk6ct"] Jul 12 00:45:21.839087 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:21.839068 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48dc35ae-b894-436d-a22f-57076b87cdae" containerName="istio-proxy" Jul 12 00:45:21.839231 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:21.839089 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="48dc35ae-b894-436d-a22f-57076b87cdae" containerName="istio-proxy" Jul 12 00:45:21.839231 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:21.839115 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48dc35ae-b894-436d-a22f-57076b87cdae" containerName="istio-proxy" Jul 12 00:45:21.839231 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:21.839131 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="48dc35ae-b894-436d-a22f-57076b87cdae" containerName="istio-proxy" Jul 12 00:45:21.839377 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:21.839262 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="48dc35ae-b894-436d-a22f-57076b87cdae" containerName="istio-proxy" Jul 12 00:45:21.839377 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:21.839277 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="48dc35ae-b894-436d-a22f-57076b87cdae" containerName="istio-proxy" Jul 12 00:45:21.843901 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:21.843881 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-pk6ct" Jul 12 00:45:21.846366 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:21.846346 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kpjgh\"/\"openshift-service-ca.crt\"" Jul 12 00:45:21.846496 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:21.846476 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kpjgh\"/\"default-dockercfg-dbv4n\"" Jul 12 00:45:21.847369 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:21.847352 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kpjgh\"/\"kube-root-ca.crt\"" Jul 12 00:45:21.850913 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:21.850894 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kpjgh/perf-node-gather-daemonset-pk6ct"] Jul 12 00:45:21.905016 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:21.904990 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/313d4200-a7e6-4532-9fc0-739af2bdde86-podres\") pod \"perf-node-gather-daemonset-pk6ct\" (UID: \"313d4200-a7e6-4532-9fc0-739af2bdde86\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-pk6ct" Jul 12 00:45:21.905138 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:21.905022 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/313d4200-a7e6-4532-9fc0-739af2bdde86-sys\") pod \"perf-node-gather-daemonset-pk6ct\" (UID: \"313d4200-a7e6-4532-9fc0-739af2bdde86\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-pk6ct" Jul 12 00:45:21.905138 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:21.905039 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/313d4200-a7e6-4532-9fc0-739af2bdde86-proc\") pod \"perf-node-gather-daemonset-pk6ct\" (UID: \"313d4200-a7e6-4532-9fc0-739af2bdde86\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-pk6ct" Jul 12 00:45:21.905228 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:21.905173 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/313d4200-a7e6-4532-9fc0-739af2bdde86-lib-modules\") pod \"perf-node-gather-daemonset-pk6ct\" (UID: \"313d4200-a7e6-4532-9fc0-739af2bdde86\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-pk6ct" Jul 12 00:45:21.905228 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:21.905223 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w9z5\" (UniqueName: \"kubernetes.io/projected/313d4200-a7e6-4532-9fc0-739af2bdde86-kube-api-access-5w9z5\") pod \"perf-node-gather-daemonset-pk6ct\" (UID: \"313d4200-a7e6-4532-9fc0-739af2bdde86\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-pk6ct" Jul 12 00:45:22.006431 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:22.006400 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w9z5\" (UniqueName: \"kubernetes.io/projected/313d4200-a7e6-4532-9fc0-739af2bdde86-kube-api-access-5w9z5\") pod \"perf-node-gather-daemonset-pk6ct\" (UID: \"313d4200-a7e6-4532-9fc0-739af2bdde86\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-pk6ct" Jul 12 00:45:22.006578 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:22.006435 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/313d4200-a7e6-4532-9fc0-739af2bdde86-podres\") pod \"perf-node-gather-daemonset-pk6ct\" (UID: \"313d4200-a7e6-4532-9fc0-739af2bdde86\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-pk6ct" Jul 12 00:45:22.006578 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:22.006461 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/313d4200-a7e6-4532-9fc0-739af2bdde86-sys\") pod \"perf-node-gather-daemonset-pk6ct\" (UID: \"313d4200-a7e6-4532-9fc0-739af2bdde86\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-pk6ct" Jul 12 00:45:22.006578 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:22.006475 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/313d4200-a7e6-4532-9fc0-739af2bdde86-proc\") pod \"perf-node-gather-daemonset-pk6ct\" (UID: \"313d4200-a7e6-4532-9fc0-739af2bdde86\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-pk6ct" Jul 12 00:45:22.006578 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:22.006551 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/313d4200-a7e6-4532-9fc0-739af2bdde86-sys\") pod \"perf-node-gather-daemonset-pk6ct\" (UID: \"313d4200-a7e6-4532-9fc0-739af2bdde86\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-pk6ct" Jul 12 00:45:22.006578 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:22.006569 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/313d4200-a7e6-4532-9fc0-739af2bdde86-podres\") pod \"perf-node-gather-daemonset-pk6ct\" (UID: \"313d4200-a7e6-4532-9fc0-739af2bdde86\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-pk6ct" Jul 12 00:45:22.006784 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:22.006572 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/313d4200-a7e6-4532-9fc0-739af2bdde86-lib-modules\") pod \"perf-node-gather-daemonset-pk6ct\" (UID: \"313d4200-a7e6-4532-9fc0-739af2bdde86\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-pk6ct" Jul 12 00:45:22.006784 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:22.006636 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/313d4200-a7e6-4532-9fc0-739af2bdde86-proc\") pod \"perf-node-gather-daemonset-pk6ct\" (UID: \"313d4200-a7e6-4532-9fc0-739af2bdde86\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-pk6ct" Jul 12 00:45:22.006784 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:22.006655 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/313d4200-a7e6-4532-9fc0-739af2bdde86-lib-modules\") pod \"perf-node-gather-daemonset-pk6ct\" (UID: \"313d4200-a7e6-4532-9fc0-739af2bdde86\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-pk6ct" Jul 12 00:45:22.013468 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:22.013445 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w9z5\" (UniqueName: \"kubernetes.io/projected/313d4200-a7e6-4532-9fc0-739af2bdde86-kube-api-access-5w9z5\") pod \"perf-node-gather-daemonset-pk6ct\" (UID: \"313d4200-a7e6-4532-9fc0-739af2bdde86\") " pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-pk6ct" Jul 12 00:45:22.155347 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:22.155282 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-pk6ct" Jul 12 00:45:22.287070 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:22.287047 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kpjgh/perf-node-gather-daemonset-pk6ct"] Jul 12 00:45:22.289379 ip-10-0-132-227 kubenswrapper[2564]: W0712 00:45:22.289356 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod313d4200_a7e6_4532_9fc0_739af2bdde86.slice/crio-7812097be861354b1c35c189bb8706865464cc70684d9ec0357197bfc677c7c2 WatchSource:0}: Error finding container 7812097be861354b1c35c189bb8706865464cc70684d9ec0357197bfc677c7c2: Status 404 returned error can't find the container with id 7812097be861354b1c35c189bb8706865464cc70684d9ec0357197bfc677c7c2 Jul 12 00:45:22.792705 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:22.792672 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-pk6ct" event={"ID":"313d4200-a7e6-4532-9fc0-739af2bdde86","Type":"ContainerStarted","Data":"af3312a8a4d9af2ba746f75e5aeaeca51db2ac888b6c0009da76fdf91fce1169"} Jul 12 00:45:22.792893 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:22.792757 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-pk6ct" event={"ID":"313d4200-a7e6-4532-9fc0-739af2bdde86","Type":"ContainerStarted","Data":"7812097be861354b1c35c189bb8706865464cc70684d9ec0357197bfc677c7c2"} Jul 12 00:45:22.792893 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:22.792825 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-pk6ct" Jul 12 00:45:22.808287 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:22.808243 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-pk6ct" podStartSLOduration=1.808231609 podStartE2EDuration="1.808231609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 00:45:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 00:45:22.806827218 +0000 UTC m=+2885.982623856" watchObservedRunningTime="2026-07-12 00:45:22.808231609 +0000 UTC m=+2885.984028245" Jul 12 00:45:23.328633 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:23.328603 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tmx6h_c572ec5d-e507-4720-bc4c-13308d59b739/dns/0.log" Jul 12 00:45:23.346649 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:23.346620 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tmx6h_c572ec5d-e507-4720-bc4c-13308d59b739/kube-rbac-proxy/0.log" Jul 12 00:45:23.428539 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:23.428514 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-whhnk_fc60340a-59c1-4e60-b020-bf384ce4d9b6/dns-node-resolver/0.log" Jul 12 00:45:24.029049 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:24.029027 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jw46q_6ae6d9b4-ded1-4cc5-8110-668501906a6d/node-ca/0.log" Jul 12 00:45:24.956053 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:24.956024 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4lhxvp_5d64989d-f5c2-4029-a088-7531e9d1cf8f/istio-proxy/0.log" Jul 12 00:45:25.133758 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:25.133716 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9rkm7_23091102-0999-42cd-8673-1e4809b9451d/istio-proxy/0.log" Jul 12 00:45:25.161555 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:25.161528 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9rkm7_23091102-0999-42cd-8673-1e4809b9451d/istio-proxy/1.log" Jul 12 00:45:25.188187 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:25.188166 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-tg9lj_649b2b12-1d9b-4ad5-a87c-2b4de8ca86f9/payload-pre-processing/0.log" Jul 12 00:45:25.958655 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:25.958625 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f8z6q_bbc60d51-642d-40a2-bb34-b6617178b718/serve-healthcheck-canary/0.log" Jul 12 00:45:26.575431 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:26.575399 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s4jhn_38b3a226-3fad-4685-9361-ab9ea0688ac2/kube-rbac-proxy/0.log" Jul 12 00:45:26.591615 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:26.591592 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s4jhn_38b3a226-3fad-4685-9361-ab9ea0688ac2/exporter/0.log" Jul 12 00:45:26.608423 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:26.608404 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s4jhn_38b3a226-3fad-4685-9361-ab9ea0688ac2/extractor/0.log" Jul 12 00:45:28.760216 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:28.760186 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zg554_600c047f-a7bf-4474-9522-c30b342af2cd/manager/0.log" Jul 12 00:45:28.808525 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:28.808489 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kpjgh/perf-node-gather-daemonset-pk6ct" Jul 12 00:45:28.888120 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:28.888070 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zh9fb_a4df588d-b35e-40fb-aef6-b0e12128e5cd/manager/0.log" Jul 12 00:45:29.375690 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:29.375660 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c8b78dfc9-nvp94_9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755/manager/0.log" Jul 12 00:45:29.390079 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:29.390056 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c8b78dfc9-nvp94_9ff5d957-8ccb-4c9e-9ac5-1cf340ba1755/copy-manifests/0.log" Jul 12 00:45:30.848442 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:30.848365 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6bf7bdd7c5-fggvj_3c9d0e65-98ef-4a91-bc29-c96315d0c612/manager/0.log" Jul 12 00:45:33.012591 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:33.012562 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4lhxvp_5d64989d-f5c2-4029-a088-7531e9d1cf8f/istio-proxy/0.log" Jul 12 00:45:33.168523 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:33.168489 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9rkm7_23091102-0999-42cd-8673-1e4809b9451d/istio-proxy/0.log" Jul 12 00:45:33.197813 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:33.197790 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9rkm7_23091102-0999-42cd-8673-1e4809b9451d/istio-proxy/1.log" Jul 12 00:45:33.220317 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:33.220296 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-tg9lj_649b2b12-1d9b-4ad5-a87c-2b4de8ca86f9/payload-pre-processing/0.log" Jul 12 00:45:34.534746 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:34.534716 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4lhxvp_5d64989d-f5c2-4029-a088-7531e9d1cf8f/istio-proxy/0.log" Jul 12 00:45:34.698259 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:34.698234 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9rkm7_23091102-0999-42cd-8673-1e4809b9451d/istio-proxy/0.log" Jul 12 00:45:34.726456 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:34.726429 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9rkm7_23091102-0999-42cd-8673-1e4809b9451d/istio-proxy/1.log" Jul 12 00:45:34.745464 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:34.745436 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-tg9lj_649b2b12-1d9b-4ad5-a87c-2b4de8ca86f9/payload-pre-processing/0.log" Jul 12 00:45:37.736516 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:37.736491 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-phxwk_7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525/kube-multus-additional-cni-plugins/0.log" Jul 12 00:45:37.765257 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:37.765235 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-phxwk_7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525/egress-router-binary-copy/0.log" Jul 12 00:45:37.783879 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:37.783859 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-phxwk_7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525/cni-plugins/0.log" Jul 12 00:45:37.801155 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:37.801130 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-phxwk_7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525/bond-cni-plugin/0.log" Jul 12 00:45:37.817461 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:37.817445 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-phxwk_7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525/routeoverride-cni/0.log" Jul 12 00:45:37.833230 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:37.833209 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-phxwk_7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525/whereabouts-cni-bincopy/0.log" Jul 12 00:45:37.851522 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:37.851494 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-phxwk_7fe0a2f0-0bed-40b5-bbb1-f4acaa7aa525/whereabouts-cni/0.log" Jul 12 00:45:38.016576 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:38.016488 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-chlwj_a8441f59-adc8-4e06-939d-7ed374002b1d/kube-multus/0.log" Jul 12 00:45:38.136712 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:38.136681 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cjtrj_7759c22b-76ac-44de-a812-a82cf40941eb/network-metrics-daemon/0.log" Jul 12 00:45:38.151973 ip-10-0-132-227 kubenswrapper[2564]: I0712 00:45:38.151949 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cjtrj_7759c22b-76ac-44de-a812-a82cf40941eb/kube-rbac-proxy/0.log"