Jul 07 17:22:42.365783 ip-10-0-136-69 systemd[1]: Starting Kubernetes Kubelet... Jul 07 17:22:42.753541 ip-10-0-136-69 kubenswrapper[2549]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 17:22:42.753541 ip-10-0-136-69 kubenswrapper[2549]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 17:22:42.753541 ip-10-0-136-69 kubenswrapper[2549]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 17:22:42.753541 ip-10-0-136-69 kubenswrapper[2549]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 17:22:42.753541 ip-10-0-136-69 kubenswrapper[2549]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 17:22:42.754574 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.754450 2549 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 17:22:42.758800 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758783 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 17:22:42.758800 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758799 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 17:22:42.758872 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758805 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 17:22:42.758872 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758810 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 17:22:42.758872 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758813 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 17:22:42.758872 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758815 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 17:22:42.758872 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758818 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 17:22:42.758872 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758821 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 17:22:42.758872 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758824 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 17:22:42.758872 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758827 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 17:22:42.758872 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758830 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 17:22:42.758872 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758833 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 17:22:42.758872 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758835 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 17:22:42.758872 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758838 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 07 17:22:42.758872 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758842 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 17:22:42.758872 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758845 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 17:22:42.758872 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758847 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 17:22:42.758872 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758850 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 17:22:42.758872 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758852 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 17:22:42.758872 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758855 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 17:22:42.758872 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758857 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 17:22:42.759349 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758859 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 17:22:42.759349 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758862 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 17:22:42.759349 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758864 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 17:22:42.759349 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758866 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 17:22:42.759349 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758869 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 17:22:42.759349 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758871 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 17:22:42.759349 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758874 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 17:22:42.759349 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758876 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 17:22:42.759349 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758879 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 17:22:42.759349 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758882 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 17:22:42.759349 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758885 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 17:22:42.759349 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758889 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 17:22:42.759349 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758892 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 17:22:42.759349 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758895 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 17:22:42.759349 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758898 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 17:22:42.759349 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758900 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 17:22:42.759349 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758903 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 17:22:42.759349 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758905 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 17:22:42.759349 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758907 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 17:22:42.759349 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758910 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 17:22:42.759859 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758913 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 17:22:42.759859 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758915 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 17:22:42.759859 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758917 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 17:22:42.759859 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758920 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 17:22:42.759859 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758923 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 17:22:42.759859 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758926 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 17:22:42.759859 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758928 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 17:22:42.759859 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758930 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 17:22:42.759859 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758933 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 17:22:42.759859 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758935 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 17:22:42.759859 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758938 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 17:22:42.759859 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758940 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 17:22:42.759859 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758942 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 17:22:42.759859 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758946 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 17:22:42.759859 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758950 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 17:22:42.759859 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758953 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 17:22:42.759859 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758955 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 17:22:42.759859 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758958 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 17:22:42.759859 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758960 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 17:22:42.759859 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758962 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 17:22:42.760382 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758965 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 17:22:42.760382 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758967 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 17:22:42.760382 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758969 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 17:22:42.760382 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758972 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 17:22:42.760382 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758975 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 17:22:42.760382 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758977 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 17:22:42.760382 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758980 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 17:22:42.760382 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758982 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 17:22:42.760382 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758984 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 17:22:42.760382 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758987 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 17:22:42.760382 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758990 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 17:22:42.760382 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758992 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 17:22:42.760382 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758994 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 17:22:42.760382 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.758998 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 17:22:42.760382 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759001 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 17:22:42.760382 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759004 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 17:22:42.760382 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759007 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 17:22:42.760382 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759009 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 17:22:42.760382 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759012 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 17:22:42.760382 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759014 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 17:22:42.760961 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759016 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 17:22:42.760961 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759019 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 17:22:42.760961 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759021 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 17:22:42.760961 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759024 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 17:22:42.760961 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759026 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 17:22:42.760961 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759029 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 17:22:42.760961 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759032 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 17:22:42.760961 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759034 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 17:22:42.760961 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759037 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 17:22:42.760961 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759039 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 17:22:42.760961 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759041 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 17:22:42.760961 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759044 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 17:22:42.760961 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759046 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 17:22:42.760961 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759048 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 17:22:42.760961 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759051 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 17:22:42.760961 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759053 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 17:22:42.760961 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759055 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 17:22:42.760961 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759058 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 17:22:42.760961 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759765 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 17:22:42.760961 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759772 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 17:22:42.761433 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759775 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 17:22:42.761433 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759779 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 17:22:42.761433 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759781 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 17:22:42.761433 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759785 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 17:22:42.761433 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759787 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 17:22:42.761433 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759790 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 17:22:42.761433 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759792 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 17:22:42.761433 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759795 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 17:22:42.761433 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759797 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 17:22:42.761433 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759800 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 17:22:42.761433 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759802 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 17:22:42.761433 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759804 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 17:22:42.761433 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759807 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 17:22:42.761433 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759811 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 17:22:42.761433 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759815 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 17:22:42.761433 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759818 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 17:22:42.761433 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759821 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 17:22:42.761433 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759825 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 17:22:42.761433 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759828 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 17:22:42.762011 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759831 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 17:22:42.762011 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759834 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 17:22:42.762011 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759837 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 17:22:42.762011 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759839 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 17:22:42.762011 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759842 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 17:22:42.762011 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759845 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 17:22:42.762011 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759847 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 17:22:42.762011 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759850 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 17:22:42.762011 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759852 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 17:22:42.762011 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759856 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 17:22:42.762011 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759859 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 17:22:42.762011 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759861 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 17:22:42.762011 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759864 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 17:22:42.762011 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759868 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 07 17:22:42.762011 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759870 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 17:22:42.762011 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759873 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 17:22:42.762011 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759875 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 17:22:42.762011 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759878 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 17:22:42.762011 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759881 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 17:22:42.762011 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759883 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 17:22:42.762517 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759886 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 17:22:42.762517 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759888 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 17:22:42.762517 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759891 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 17:22:42.762517 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759893 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 17:22:42.762517 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759896 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 17:22:42.762517 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759898 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 17:22:42.762517 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759901 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 17:22:42.762517 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759903 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 17:22:42.762517 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759906 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 17:22:42.762517 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759908 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 17:22:42.762517 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759911 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 17:22:42.762517 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759913 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 17:22:42.762517 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759917 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 17:22:42.762517 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759920 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 17:22:42.762517 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759924 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 17:22:42.762517 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759926 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 17:22:42.762517 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759929 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 17:22:42.762517 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759932 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 17:22:42.762517 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759934 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 17:22:42.763002 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759937 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 17:22:42.763002 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759940 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 17:22:42.763002 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759943 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 17:22:42.763002 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759945 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 17:22:42.763002 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759947 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 17:22:42.763002 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759950 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 17:22:42.763002 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759952 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 17:22:42.763002 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759954 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 17:22:42.763002 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759957 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 17:22:42.763002 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759959 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 17:22:42.763002 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759961 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 17:22:42.763002 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759965 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 17:22:42.763002 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759967 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 17:22:42.763002 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759970 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 17:22:42.763002 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759972 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 17:22:42.763002 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759974 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 17:22:42.763002 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759977 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 17:22:42.763002 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759980 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 17:22:42.763002 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759982 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 17:22:42.763473 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759985 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 17:22:42.763473 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759987 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 17:22:42.763473 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759990 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 17:22:42.763473 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759992 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 17:22:42.763473 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759995 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 17:22:42.763473 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.759998 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 17:22:42.763473 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760001 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 17:22:42.763473 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760003 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 17:22:42.763473 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760015 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 17:22:42.763473 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760017 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 17:22:42.763473 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760020 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 17:22:42.763473 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760022 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 17:22:42.763473 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760025 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 17:22:42.763473 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760028 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 17:22:42.763473 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760030 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 17:22:42.763473 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760033 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 17:22:42.763473 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760035 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 17:22:42.763473 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760037 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 17:22:42.763473 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760040 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 17:22:42.763473 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760042 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 17:22:42.763969 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760419 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 17:22:42.763969 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760425 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 17:22:42.763969 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760428 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 17:22:42.763969 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760430 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 17:22:42.763969 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760434 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 17:22:42.763969 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760436 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 17:22:42.763969 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760439 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 17:22:42.763969 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760442 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 17:22:42.763969 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760444 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 17:22:42.763969 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760447 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 17:22:42.763969 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760450 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 17:22:42.763969 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760452 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 17:22:42.763969 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760455 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 17:22:42.763969 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760457 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 17:22:42.763969 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760460 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 17:22:42.763969 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760462 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 17:22:42.763969 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760466 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 17:22:42.763969 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760468 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 17:22:42.763969 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760471 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 17:22:42.764445 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760473 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 17:22:42.764445 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760476 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 17:22:42.764445 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760479 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 17:22:42.764445 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760496 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 17:22:42.764445 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760500 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 17:22:42.764445 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760503 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 17:22:42.764445 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760506 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 17:22:42.764445 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760509 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 17:22:42.764445 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760512 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 17:22:42.764445 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760514 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 17:22:42.764445 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760517 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 17:22:42.764445 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760520 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 17:22:42.764445 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760523 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 17:22:42.764445 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760525 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 17:22:42.764445 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760529 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 17:22:42.764445 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760532 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 17:22:42.764445 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760535 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 17:22:42.764445 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760537 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 17:22:42.764445 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760540 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 17:22:42.764924 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760543 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 17:22:42.764924 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760545 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 17:22:42.764924 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760549 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 17:22:42.764924 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760552 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 17:22:42.764924 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760554 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 17:22:42.764924 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760557 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 17:22:42.764924 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760560 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 17:22:42.764924 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760562 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 17:22:42.764924 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760565 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 17:22:42.764924 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760568 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 17:22:42.764924 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760571 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 17:22:42.764924 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760573 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 17:22:42.764924 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760576 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 17:22:42.764924 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760579 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 17:22:42.764924 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760581 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 17:22:42.764924 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760584 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 17:22:42.764924 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760586 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 17:22:42.764924 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760588 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 17:22:42.764924 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760591 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 17:22:42.764924 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760593 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 17:22:42.765398 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760596 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 17:22:42.765398 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760599 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 17:22:42.765398 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760601 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 17:22:42.765398 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760604 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 17:22:42.765398 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760606 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 17:22:42.765398 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760608 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 17:22:42.765398 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760611 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 07 17:22:42.765398 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760613 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 17:22:42.765398 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760616 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 17:22:42.765398 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760618 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 17:22:42.765398 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760620 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 17:22:42.765398 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760623 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 17:22:42.765398 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760626 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 17:22:42.765398 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760631 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 17:22:42.765398 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760634 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 17:22:42.765398 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760636 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 17:22:42.765398 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760639 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 17:22:42.765398 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760641 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 17:22:42.765398 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760644 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 17:22:42.765398 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760646 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 17:22:42.765886 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760648 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 17:22:42.765886 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760652 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 17:22:42.765886 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760655 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 17:22:42.765886 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760657 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 17:22:42.765886 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760659 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 17:22:42.765886 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760662 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 17:22:42.765886 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760664 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 17:22:42.765886 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760667 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 17:22:42.765886 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760670 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 17:22:42.765886 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760672 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 17:22:42.765886 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760674 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 17:22:42.765886 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760677 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 17:22:42.765886 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760679 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 17:22:42.765886 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760681 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 17:22:42.765886 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760683 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 17:22:42.765886 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760686 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 17:22:42.765886 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760690 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 17:22:42.765886 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760693 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 17:22:42.765886 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760695 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 17:22:42.766322 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760698 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 17:22:42.766322 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.760700 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 17:22:42.766322 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760764 2549 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 17:22:42.766322 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760775 2549 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 17:22:42.766322 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760785 2549 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 17:22:42.766322 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760799 2549 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 17:22:42.766322 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760806 2549 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 17:22:42.766322 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760809 2549 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 17:22:42.766322 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760813 2549 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 17:22:42.766322 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760816 2549 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 17:22:42.766322 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760819 2549 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 17:22:42.766322 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760822 2549 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 17:22:42.766322 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760825 2549 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 17:22:42.766322 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760828 2549 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 17:22:42.766322 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760832 2549 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 17:22:42.766322 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760835 2549 flags.go:64] FLAG: --cgroup-root="" Jul 07 17:22:42.766322 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760838 2549 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 17:22:42.766322 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760841 2549 flags.go:64] FLAG: --client-ca-file="" Jul 07 17:22:42.766322 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760844 2549 flags.go:64] FLAG: --cloud-provider="external" Jul 07 17:22:42.766322 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760847 2549 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 17:22:42.766322 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760851 2549 flags.go:64] FLAG: --cluster-domain="" Jul 07 17:22:42.766322 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760854 2549 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 17:22:42.766322 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760856 2549 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 17:22:42.766322 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760859 2549 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 17:22:42.766918 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760863 2549 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 17:22:42.766918 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760866 2549 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 17:22:42.766918 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760869 2549 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 17:22:42.766918 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760872 2549 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 17:22:42.766918 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760875 2549 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 17:22:42.766918 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760878 2549 flags.go:64] FLAG: --contention-profiling="false" Jul 07 17:22:42.766918 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760881 2549 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 17:22:42.766918 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760884 2549 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 17:22:42.766918 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760887 2549 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 17:22:42.766918 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760889 2549 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 17:22:42.766918 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760893 2549 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 17:22:42.766918 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760896 2549 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 17:22:42.766918 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760899 2549 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 17:22:42.766918 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760902 2549 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 17:22:42.766918 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760906 2549 flags.go:64] FLAG: --enable-server="true" Jul 07 17:22:42.766918 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760909 2549 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 17:22:42.766918 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760913 2549 flags.go:64] FLAG: --event-burst="100" Jul 07 17:22:42.766918 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760916 2549 flags.go:64] FLAG: --event-qps="50" Jul 07 17:22:42.766918 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760919 2549 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 17:22:42.766918 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760922 2549 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 17:22:42.766918 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760924 2549 flags.go:64] FLAG: --eviction-hard="" Jul 07 17:22:42.766918 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760928 2549 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 17:22:42.766918 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760932 2549 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 17:22:42.766918 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760935 2549 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 17:22:42.766918 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760938 2549 flags.go:64] FLAG: --eviction-soft="" Jul 07 17:22:42.767599 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760941 2549 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 17:22:42.767599 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760943 2549 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 17:22:42.767599 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760946 2549 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 17:22:42.767599 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760949 2549 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 17:22:42.767599 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760951 2549 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 17:22:42.767599 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760954 2549 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 17:22:42.767599 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760956 2549 flags.go:64] FLAG: --feature-gates="" Jul 07 17:22:42.767599 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760960 2549 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 17:22:42.767599 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760963 2549 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 17:22:42.767599 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760966 2549 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 17:22:42.767599 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760969 2549 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 17:22:42.767599 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760972 2549 flags.go:64] FLAG: --healthz-port="10248" Jul 07 17:22:42.767599 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760975 2549 flags.go:64] FLAG: --help="false" Jul 07 17:22:42.767599 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760978 2549 flags.go:64] FLAG: --hostname-override="ip-10-0-136-69.ec2.internal" Jul 07 17:22:42.767599 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760981 2549 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 17:22:42.767599 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760983 2549 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 17:22:42.767599 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760986 2549 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 17:22:42.767599 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760989 2549 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 17:22:42.767599 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760992 2549 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 17:22:42.767599 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760995 2549 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 17:22:42.767599 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.760997 2549 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 17:22:42.767599 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761001 2549 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 17:22:42.767599 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761004 2549 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 17:22:42.768215 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761007 2549 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 17:22:42.768215 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761010 2549 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 17:22:42.768215 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761013 2549 flags.go:64] FLAG: --kube-reserved="" Jul 07 17:22:42.768215 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761016 2549 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 17:22:42.768215 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761019 2549 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 17:22:42.768215 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761021 2549 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 17:22:42.768215 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761025 2549 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 17:22:42.768215 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761028 2549 flags.go:64] FLAG: --lock-file="" Jul 07 17:22:42.768215 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761031 2549 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 17:22:42.768215 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761033 2549 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 17:22:42.768215 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761036 2549 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 17:22:42.768215 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761041 2549 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 17:22:42.768215 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761043 2549 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 17:22:42.768215 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761046 2549 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 17:22:42.768215 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761049 2549 flags.go:64] FLAG: --logging-format="text" Jul 07 17:22:42.768215 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761051 2549 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 17:22:42.768215 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761054 2549 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 17:22:42.768215 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761057 2549 flags.go:64] FLAG: --manifest-url="" Jul 07 17:22:42.768215 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761060 2549 flags.go:64] FLAG: --manifest-url-header="" Jul 07 17:22:42.768215 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761064 2549 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 17:22:42.768215 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761066 2549 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 17:22:42.768215 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761070 2549 flags.go:64] FLAG: --max-pods="110" Jul 07 17:22:42.768215 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761073 2549 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 17:22:42.768215 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761076 2549 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 17:22:42.768215 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761078 2549 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 17:22:42.768849 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761081 2549 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 17:22:42.768849 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761084 2549 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 17:22:42.768849 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761086 2549 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 17:22:42.768849 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761089 2549 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 17:22:42.768849 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761097 2549 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 17:22:42.768849 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761100 2549 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 17:22:42.768849 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761103 2549 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 17:22:42.768849 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761106 2549 flags.go:64] FLAG: --pod-cidr="" Jul 07 17:22:42.768849 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761111 2549 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 17:22:42.768849 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761117 2549 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 17:22:42.768849 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761120 2549 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 17:22:42.768849 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761123 2549 flags.go:64] FLAG: --pods-per-core="0" Jul 07 17:22:42.768849 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761125 2549 flags.go:64] FLAG: --port="10250" Jul 07 17:22:42.768849 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761129 2549 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 17:22:42.768849 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761133 2549 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0378063e0183cc464" Jul 07 17:22:42.768849 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761135 2549 flags.go:64] FLAG: --qos-reserved="" Jul 07 17:22:42.768849 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761138 2549 flags.go:64] FLAG: --read-only-port="10255" Jul 07 17:22:42.768849 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761141 2549 flags.go:64] FLAG: --register-node="true" Jul 07 17:22:42.768849 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761144 2549 flags.go:64] FLAG: --register-with-taints="" Jul 07 17:22:42.768849 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761147 2549 flags.go:64] FLAG: --registry-burst="10" Jul 07 17:22:42.768849 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761150 2549 flags.go:64] FLAG: --registry-qps="5" Jul 07 17:22:42.768849 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761152 2549 flags.go:64] FLAG: --reserved-cpus="" Jul 07 17:22:42.768849 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761155 2549 flags.go:64] FLAG: --reserved-memory="" Jul 07 17:22:42.768849 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761158 2549 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 17:22:42.768849 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761161 2549 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 17:22:42.769449 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761164 2549 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 17:22:42.769449 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761167 2549 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 17:22:42.769449 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761169 2549 flags.go:64] FLAG: --runonce="false" Jul 07 17:22:42.769449 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761172 2549 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 17:22:42.769449 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761175 2549 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 17:22:42.769449 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761177 2549 flags.go:64] FLAG: --seccomp-default="false" Jul 07 17:22:42.769449 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761180 2549 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 17:22:42.769449 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761183 2549 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 17:22:42.769449 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761186 2549 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 17:22:42.769449 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761188 2549 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 17:22:42.769449 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761191 2549 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 17:22:42.769449 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761194 2549 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 17:22:42.769449 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761197 2549 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 17:22:42.769449 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761199 2549 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 17:22:42.769449 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761203 2549 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 17:22:42.769449 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761205 2549 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 17:22:42.769449 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761209 2549 flags.go:64] FLAG: --system-cgroups="" Jul 07 17:22:42.769449 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761211 2549 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 17:22:42.769449 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761216 2549 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 17:22:42.769449 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761218 2549 flags.go:64] FLAG: --tls-cert-file="" Jul 07 17:22:42.769449 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761221 2549 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 17:22:42.769449 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761226 2549 flags.go:64] FLAG: --tls-min-version="" Jul 07 17:22:42.769449 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761228 2549 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 17:22:42.769449 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761231 2549 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 17:22:42.769449 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761234 2549 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 17:22:42.770064 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761237 2549 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 17:22:42.770064 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761239 2549 flags.go:64] FLAG: --v="2" Jul 07 17:22:42.770064 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761243 2549 flags.go:64] FLAG: --version="false" Jul 07 17:22:42.770064 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761246 2549 flags.go:64] FLAG: --vmodule="" Jul 07 17:22:42.770064 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761250 2549 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 17:22:42.770064 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.761253 2549 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 17:22:42.770064 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761369 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 17:22:42.770064 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761373 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 17:22:42.770064 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761376 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 17:22:42.770064 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761379 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 17:22:42.770064 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761382 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 17:22:42.770064 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761384 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 17:22:42.770064 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761386 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 17:22:42.770064 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761389 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 17:22:42.770064 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761391 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 17:22:42.770064 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761394 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 17:22:42.770064 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761396 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 17:22:42.770064 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761398 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 17:22:42.770064 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761401 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 17:22:42.770064 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761403 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 17:22:42.770064 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761406 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 17:22:42.770592 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761409 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 17:22:42.770592 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761411 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 17:22:42.770592 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761414 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 17:22:42.770592 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761417 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 17:22:42.770592 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761420 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 17:22:42.770592 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761422 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 17:22:42.770592 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761425 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 17:22:42.770592 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761428 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 17:22:42.770592 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761431 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 17:22:42.770592 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761433 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 17:22:42.770592 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761436 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 17:22:42.770592 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761438 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 17:22:42.770592 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761441 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 17:22:42.770592 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761444 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 17:22:42.770592 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761446 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 17:22:42.770592 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761449 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 17:22:42.770592 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761451 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 17:22:42.770592 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761454 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 17:22:42.770592 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761456 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 17:22:42.771061 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761458 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 17:22:42.771061 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761461 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 17:22:42.771061 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761463 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 17:22:42.771061 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761466 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 17:22:42.771061 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761468 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 17:22:42.771061 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761470 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 17:22:42.771061 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761473 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 17:22:42.771061 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761475 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 17:22:42.771061 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761477 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 17:22:42.771061 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761493 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 17:22:42.771061 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761496 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 17:22:42.771061 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761500 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 17:22:42.771061 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761502 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 17:22:42.771061 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761505 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 17:22:42.771061 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761508 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 17:22:42.771061 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761510 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 17:22:42.771061 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761513 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 17:22:42.771061 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761515 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 17:22:42.771061 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761518 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 17:22:42.771061 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761521 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 17:22:42.771560 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761524 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 17:22:42.771560 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761527 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 17:22:42.771560 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761529 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 17:22:42.771560 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761532 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 17:22:42.771560 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761534 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 17:22:42.771560 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761537 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 17:22:42.771560 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761539 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 17:22:42.771560 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761542 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 17:22:42.771560 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761544 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 17:22:42.771560 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761546 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 07 17:22:42.771560 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761548 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 17:22:42.771560 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761551 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 17:22:42.771560 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761553 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 17:22:42.771560 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761557 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 17:22:42.771560 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761560 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 17:22:42.771560 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761563 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 17:22:42.771560 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761566 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 17:22:42.771560 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761569 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 17:22:42.771560 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761572 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 17:22:42.771560 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761574 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 17:22:42.772085 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761577 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 17:22:42.772085 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761579 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 17:22:42.772085 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761582 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 17:22:42.772085 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761585 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 17:22:42.772085 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761587 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 17:22:42.772085 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761590 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 17:22:42.772085 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761594 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 17:22:42.772085 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761597 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 17:22:42.772085 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761599 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 17:22:42.772085 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761602 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 17:22:42.772085 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761605 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 17:22:42.772085 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761608 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 17:22:42.772085 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761611 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 17:22:42.772085 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761613 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 17:22:42.772085 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761616 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 17:22:42.772085 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761618 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 17:22:42.772085 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761621 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 17:22:42.772085 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761623 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 17:22:42.772085 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761626 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 17:22:42.772085 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761628 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 17:22:42.772644 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761631 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 17:22:42.772644 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761633 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 17:22:42.772644 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761635 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 17:22:42.772644 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761638 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 17:22:42.772644 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.761640 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 17:22:42.772644 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.762263 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 17:22:42.772644 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.768833 2549 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 17:22:42.772644 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.768848 2549 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 17:22:42.772644 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.769503 2549 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 17:22:42.772644 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.769510 2549 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 17:22:42.772644 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769579 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 17:22:42.772644 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769584 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 17:22:42.772644 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769587 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 17:22:42.772644 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769590 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 17:22:42.772644 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769593 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 17:22:42.773009 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769596 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 17:22:42.773009 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769599 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 17:22:42.773009 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769602 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 17:22:42.773009 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769605 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 17:22:42.773009 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769608 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 17:22:42.773009 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769610 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 17:22:42.773009 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769613 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 17:22:42.773009 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769615 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 17:22:42.773009 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769618 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 17:22:42.773009 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769620 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 17:22:42.773009 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769623 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 17:22:42.773009 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769625 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 17:22:42.773009 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769627 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 17:22:42.773009 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769630 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 17:22:42.773009 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769632 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 17:22:42.773009 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769635 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 17:22:42.773009 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769637 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 17:22:42.773009 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769640 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 17:22:42.773009 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769642 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 17:22:42.773009 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769645 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 17:22:42.773503 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769649 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 17:22:42.773503 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769653 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 17:22:42.773503 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769656 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 17:22:42.773503 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769658 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 17:22:42.773503 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769661 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 17:22:42.773503 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769664 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 17:22:42.773503 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769666 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 17:22:42.773503 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769669 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 17:22:42.773503 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769671 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 17:22:42.773503 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769674 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 17:22:42.773503 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769676 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 17:22:42.773503 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769679 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 17:22:42.773503 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769681 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 17:22:42.773503 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769685 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 17:22:42.773503 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769689 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 17:22:42.773503 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769692 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 17:22:42.773503 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769694 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 17:22:42.773503 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769697 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 17:22:42.773503 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769699 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 17:22:42.773965 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769702 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 17:22:42.773965 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769704 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 17:22:42.773965 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769707 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 17:22:42.773965 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769709 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 17:22:42.773965 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769712 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 17:22:42.773965 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769715 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 17:22:42.773965 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769717 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 17:22:42.773965 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769720 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 17:22:42.773965 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769722 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 17:22:42.773965 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769725 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 17:22:42.773965 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769727 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 07 17:22:42.773965 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769730 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 17:22:42.773965 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769732 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 17:22:42.773965 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769734 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 17:22:42.773965 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769737 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 17:22:42.773965 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769740 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 17:22:42.773965 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769744 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 17:22:42.773965 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769747 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 17:22:42.773965 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769750 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 17:22:42.774420 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769753 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 17:22:42.774420 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769756 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 17:22:42.774420 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769759 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 17:22:42.774420 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769761 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 17:22:42.774420 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769764 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 17:22:42.774420 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769767 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 17:22:42.774420 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769769 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 17:22:42.774420 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769771 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 17:22:42.774420 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769774 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 17:22:42.774420 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769776 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 17:22:42.774420 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769779 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 17:22:42.774420 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769781 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 17:22:42.774420 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769783 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 17:22:42.774420 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769786 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 17:22:42.774420 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769788 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 17:22:42.774420 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769791 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 17:22:42.774420 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769793 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 17:22:42.774420 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769796 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 17:22:42.774420 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769798 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 17:22:42.774876 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769801 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 17:22:42.774876 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769803 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 17:22:42.774876 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769806 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 17:22:42.774876 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769809 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 17:22:42.774876 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769811 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 17:22:42.774876 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769813 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 17:22:42.774876 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769816 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 17:22:42.774876 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769818 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 17:22:42.774876 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769821 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 17:22:42.774876 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769823 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 17:22:42.774876 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769825 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 17:22:42.774876 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769828 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 17:22:42.774876 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769830 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 17:22:42.774876 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769833 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 17:22:42.774876 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769835 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 17:22:42.774876 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769838 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 17:22:42.774876 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769840 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 17:22:42.775277 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.769844 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 17:22:42.775277 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769970 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 17:22:42.775277 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769975 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 17:22:42.775277 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769979 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 17:22:42.775277 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769981 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 17:22:42.775277 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769984 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 17:22:42.775277 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769987 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 17:22:42.775277 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769990 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 17:22:42.775277 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769992 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 17:22:42.775277 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769995 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 17:22:42.775277 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769997 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 17:22:42.775277 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.769999 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 17:22:42.775277 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770002 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 17:22:42.775277 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770004 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 17:22:42.775277 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770007 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 17:22:42.775700 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770009 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 17:22:42.775700 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770012 2549 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 17:22:42.775700 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770014 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 17:22:42.775700 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770016 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 17:22:42.775700 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770019 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 17:22:42.775700 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770021 2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 17:22:42.775700 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770024 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 17:22:42.775700 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770026 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 17:22:42.775700 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770028 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 17:22:42.775700 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770031 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 17:22:42.775700 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770033 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 17:22:42.775700 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770035 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 17:22:42.775700 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770038 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 17:22:42.775700 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770040 2549 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 17:22:42.775700 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770043 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 17:22:42.775700 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770045 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 17:22:42.775700 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770048 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 17:22:42.775700 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770050 2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 17:22:42.775700 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770052 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 17:22:42.775700 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770055 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 17:22:42.776221 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770057 2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 17:22:42.776221 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770059 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 17:22:42.776221 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770062 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 17:22:42.776221 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770064 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 17:22:42.776221 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770067 2549 feature_gate.go:328] unrecognized feature gate: Example Jul 07 17:22:42.776221 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770069 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 17:22:42.776221 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770072 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 17:22:42.776221 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770074 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 17:22:42.776221 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770077 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 17:22:42.776221 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770080 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 17:22:42.776221 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770082 2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 17:22:42.776221 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770085 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 17:22:42.776221 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770087 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 17:22:42.776221 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770090 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 17:22:42.776221 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770092 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 17:22:42.776221 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770095 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 17:22:42.776221 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770097 2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 17:22:42.776221 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770099 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 17:22:42.776221 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770102 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 17:22:42.776221 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770104 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 17:22:42.776716 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770107 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 17:22:42.776716 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770109 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 17:22:42.776716 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770111 2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 17:22:42.776716 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770114 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 17:22:42.776716 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770116 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 17:22:42.776716 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770118 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 17:22:42.776716 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770121 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 17:22:42.776716 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770124 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 17:22:42.776716 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770126 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 17:22:42.776716 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770128 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 17:22:42.776716 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770131 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 17:22:42.776716 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770133 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 17:22:42.776716 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770135 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 17:22:42.776716 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770138 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 17:22:42.776716 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770140 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 17:22:42.776716 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770142 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 17:22:42.776716 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770145 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 17:22:42.776716 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770148 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 17:22:42.776716 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770150 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 17:22:42.777157 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770154 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 17:22:42.777157 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770157 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 17:22:42.777157 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770160 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 17:22:42.777157 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770164 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 17:22:42.777157 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770167 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 17:22:42.777157 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770170 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 17:22:42.777157 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770173 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 17:22:42.777157 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770175 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 17:22:42.777157 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770178 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 17:22:42.777157 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770180 2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 17:22:42.777157 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770182 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 17:22:42.777157 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770184 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 17:22:42.777157 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770187 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 17:22:42.777157 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770189 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 17:22:42.777157 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770191 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 17:22:42.777157 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770195 2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 17:22:42.777157 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770199 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 17:22:42.777157 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770201 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 17:22:42.777611 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770204 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 17:22:42.777611 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770206 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 17:22:42.777611 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770209 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 17:22:42.777611 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770212 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 17:22:42.777611 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770214 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 17:22:42.777611 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770216 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 17:22:42.777611 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770219 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 17:22:42.777611 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:42.770221 2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 17:22:42.777611 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.770226 2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 17:22:42.777611 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.770312 2549 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 17:22:42.777611 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.772275 2549 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 17:22:42.777611 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.773649 2549 server.go:1019] "Starting client certificate rotation" Jul 07 17:22:42.777611 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.773748 2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 17:22:42.777611 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.774498 2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 17:22:42.778077 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.776609 2549 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 17:22:42.779223 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.779202 2549 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 17:22:42.797564 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.797544 2549 log.go:25] "Validated CRI v1 runtime API" Jul 07 17:22:42.799687 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.799673 2549 log.go:25] "Validated CRI v1 image API" Jul 07 17:22:42.800495 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.800470 2549 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 17:22:42.805319 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.805297 2549 fs.go:135] Filesystem UUIDs: map[37035094-7bdc-4f9c-8d2e-8164f36ac9e5:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 90bdf774-c701-47f1-8dfa-0bdc0c78c9be:/dev/nvme0n1p4] Jul 07 17:22:42.805397 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.805316 2549 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 17:22:42.810471 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.810364 2549 manager.go:216] Machine: {Timestamp:2026-07-07 17:22:42.809077836 +0000 UTC m=+0.331703176 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3112400 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fc6ced73e0899516b79b1e038f744 SystemUUID:ec2fc6ce-d73e-0899-516b-79b1e038f744 BootID:8ffa1fa3-68a9-4921-ab0a-2893f4d2779c Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4a:cb:2c:b9:4d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4a:cb:2c:b9:4d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:ed:20:6d:2c:4e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 17:22:42.810471 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.810465 2549 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 17:22:42.810591 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.810562 2549 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 17:22:42.813600 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.813582 2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 17:22:42.813768 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.813740 2549 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 17:22:42.813906 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.813771 2549 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-69.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 17:22:42.815178 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.815168 2549 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 17:22:42.815222 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.815181 2549 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 17:22:42.815222 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.815189 2549 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 17:22:42.815808 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.815797 2549 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 17:22:42.818956 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.818945 2549 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 17:22:42.821912 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.821901 2549 state_mem.go:36] "Initialized new in-memory state store" Jul 07 17:22:42.822029 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.822020 2549 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 17:22:42.822061 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.822051 2549 kubelet.go:486] "Attempting to sync node with API server" Jul 07 17:22:42.822089 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.822067 2549 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 17:22:42.822118 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.822090 2549 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 17:22:42.822118 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.822105 2549 kubelet.go:398] "Adding apiserver pod source" Jul 07 17:22:42.822118 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.822117 2549 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 17:22:42.822536 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.822523 2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 17:22:42.822576 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.822548 2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 17:22:42.824536 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.824518 2549 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 17:22:42.825830 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.825817 2549 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 17:22:42.825886 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.825847 2549 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 17:22:42.826915 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.826905 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 17:22:42.826952 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.826921 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 17:22:42.826952 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.826928 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 17:22:42.826952 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.826934 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 17:22:42.826952 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.826942 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 17:22:42.826952 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.826948 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 17:22:42.827072 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.826959 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 17:22:42.827072 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.826968 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 17:22:42.827072 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.826983 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 17:22:42.827072 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.826990 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 17:22:42.827072 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.827011 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 17:22:42.827072 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.827020 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 17:22:42.828722 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.828710 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 17:22:42.828722 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.828722 2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 17:22:42.831808 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.831795 2549 server.go:1268] "Started kubelet" Jul 07 17:22:42.831895 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.831872 2549 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 17:22:42.831951 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.831884 2549 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 17:22:42.831951 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.831945 2549 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 17:22:42.836583 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.836563 2549 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 17:22:42.836867 ip-10-0-136-69 systemd[1]: Started Kubernetes Kubelet. Jul 07 17:22:42.838008 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.837986 2549 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-69.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 17:22:42.838169 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:42.838138 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-69.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 17:22:42.838268 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:42.838233 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 17:22:42.838915 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.838898 2549 server.go:310] "Adding debug handlers to kubelet server" Jul 07 17:22:42.842370 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.842348 2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vf9nz" Jul 07 17:22:42.843371 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:42.842536 2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-69.ec2.internal.18c011be9e0bfe04 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-69.ec2.internal,UID:ip-10-0-136-69.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-69.ec2.internal,},FirstTimestamp:2026-07-07 17:22:42.8317609 +0000 UTC m=+0.354386240,LastTimestamp:2026-07-07 17:22:42.8317609 +0000 UTC m=+0.354386240,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-69.ec2.internal,}" Jul 07 17:22:42.844041 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:42.844022 2549 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 17:22:42.844829 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.844815 2549 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 17:22:42.844899 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.844827 2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 17:22:42.844950 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:42.844907 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-69.ec2.internal\" not found" Jul 07 17:22:42.845561 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.845544 2549 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 17:22:42.845561 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.845546 2549 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 17:22:42.845677 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.845572 2549 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 17:22:42.845677 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.845662 2549 reconstruct.go:97] "Volume reconstruction finished" Jul 07 17:22:42.845677 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.845673 2549 reconciler.go:29] "Reconciler: start to sync state" Jul 07 17:22:42.845808 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.845783 2549 factory.go:55] Registering systemd factory Jul 07 17:22:42.845808 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.845800 2549 factory.go:223] Registration of the systemd container factory successfully Jul 07 17:22:42.846086 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.846027 2549 factory.go:153] Registering CRI-O factory Jul 07 17:22:42.846086 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.846037 2549 factory.go:223] Registration of the crio container factory successfully Jul 07 17:22:42.846086 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.846077 2549 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 17:22:42.846203 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.846094 2549 factory.go:103] Registering Raw factory Jul 07 17:22:42.846203 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.846104 2549 manager.go:1196] Started watching for new ooms in manager Jul 07 17:22:42.846526 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.846511 2549 manager.go:349] Starting recovery of all containers Jul 07 17:22:42.851153 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.851133 2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vf9nz" Jul 07 17:22:42.855133 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.855118 2549 manager.go:354] Recovery completed Jul 07 17:22:42.858029 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:42.857874 2549 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-69.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 17:22:42.858090 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:42.857918 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 17:22:42.859307 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.859294 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 17:22:42.861640 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.861623 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientMemory" Jul 07 17:22:42.861711 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.861658 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 17:22:42.861711 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.861674 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientPID" Jul 07 17:22:42.862244 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.862200 2549 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 17:22:42.862244 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.862211 2549 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 17:22:42.862244 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.862225 2549 state_mem.go:36] "Initialized new in-memory state store" Jul 07 17:22:42.862359 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.862254 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 17:22:42.862961 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.862949 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientMemory" Jul 07 17:22:42.863013 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.862971 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 17:22:42.863013 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.862981 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientPID" Jul 07 17:22:42.863441 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.863428 2549 policy_none.go:49] "None policy: Start" Jul 07 17:22:42.863509 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.863447 2549 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 17:22:42.863509 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.863465 2549 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 17:22:42.864410 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.864400 2549 policy_none.go:47] "Start" Jul 07 17:22:42.902599 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.902586 2549 manager.go:337] "Starting Device Plugin manager" Jul 07 17:22:42.902667 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:42.902617 2549 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 17:22:42.902667 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.902628 2549 server.go:87] "Starting device plugin registration server" Jul 07 17:22:42.902851 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.902839 2549 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 17:22:42.902911 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.902854 2549 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 17:22:42.902993 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.902978 2549 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 17:22:42.903068 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.903053 2549 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 17:22:42.903068 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.903065 2549 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 17:22:42.903479 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:42.903458 2549 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 17:22:42.903577 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:42.903528 2549 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-69.ec2.internal\" not found" Jul 07 17:22:42.976325 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.976299 2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 17:22:42.977597 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.977584 2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 17:22:42.977659 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.977616 2549 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 17:22:42.977659 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.977636 2549 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 17:22:42.977719 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:42.977668 2549 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 17:22:42.980251 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:42.980234 2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 17:22:43.003253 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.003233 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 17:22:43.004070 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.004028 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientMemory" Jul 07 17:22:43.004070 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.004058 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 17:22:43.004177 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.004073 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientPID" Jul 07 17:22:43.004177 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.004096 2549 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-69.ec2.internal" Jul 07 17:22:43.010784 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.010770 2549 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-69.ec2.internal" Jul 07 17:22:43.010835 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:43.010791 2549 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-69.ec2.internal\": node \"ip-10-0-136-69.ec2.internal\" not found" Jul 07 17:22:43.033357 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:43.033330 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-69.ec2.internal\" not found" Jul 07 17:22:43.078123 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.078087 2549 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-69.ec2.internal"] Jul 07 17:22:43.078227 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.078162 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 17:22:43.079013 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.078999 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientMemory" Jul 07 17:22:43.079088 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.079032 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 17:22:43.079088 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.079047 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientPID" Jul 07 17:22:43.080417 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.080402 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 17:22:43.080600 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.080586 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal" Jul 07 17:22:43.080651 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.080616 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 17:22:43.081099 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.081082 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientMemory" Jul 07 17:22:43.081183 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.081114 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 17:22:43.081183 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.081130 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientPID" Jul 07 17:22:43.081183 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.081085 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientMemory" Jul 07 17:22:43.081297 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.081185 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 17:22:43.081297 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.081195 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientPID" Jul 07 17:22:43.082119 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.082102 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-69.ec2.internal" Jul 07 17:22:43.082201 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.082136 2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 17:22:43.082860 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.082847 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientMemory" Jul 07 17:22:43.082919 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.082875 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 17:22:43.082919 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.082886 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeHasSufficientPID" Jul 07 17:22:43.108023 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:43.107993 2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-69.ec2.internal\" not found" node="ip-10-0-136-69.ec2.internal" Jul 07 17:22:43.112436 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:43.112420 2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-69.ec2.internal\" not found" node="ip-10-0-136-69.ec2.internal" Jul 07 17:22:43.134313 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:43.134294 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-69.ec2.internal\" not found" Jul 07 17:22:43.147317 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.147303 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a35f195a56c286aa22094586167aa68-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal\" (UID: \"9a35f195a56c286aa22094586167aa68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal" Jul 07 17:22:43.147383 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.147324 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/151e2e5ee0d5207030555e86076a8303-config\") pod \"kube-apiserver-proxy-ip-10-0-136-69.ec2.internal\" (UID: \"151e2e5ee0d5207030555e86076a8303\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-69.ec2.internal" Jul 07 17:22:43.147383 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.147338 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9a35f195a56c286aa22094586167aa68-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal\" (UID: \"9a35f195a56c286aa22094586167aa68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal" Jul 07 17:22:43.234608 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:43.234585 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-69.ec2.internal\" not found" Jul 07 17:22:43.247912 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.247897 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9a35f195a56c286aa22094586167aa68-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal\" (UID: \"9a35f195a56c286aa22094586167aa68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal" Jul 07 17:22:43.247986 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.247922 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a35f195a56c286aa22094586167aa68-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal\" (UID: \"9a35f195a56c286aa22094586167aa68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal" Jul 07 17:22:43.247986 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.247939 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/151e2e5ee0d5207030555e86076a8303-config\") pod \"kube-apiserver-proxy-ip-10-0-136-69.ec2.internal\" (UID: \"151e2e5ee0d5207030555e86076a8303\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-69.ec2.internal" Jul 07 17:22:43.248066 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.247986 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/151e2e5ee0d5207030555e86076a8303-config\") pod \"kube-apiserver-proxy-ip-10-0-136-69.ec2.internal\" (UID: \"151e2e5ee0d5207030555e86076a8303\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-69.ec2.internal" Jul 07 17:22:43.248066 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.247996 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9a35f195a56c286aa22094586167aa68-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal\" (UID: \"9a35f195a56c286aa22094586167aa68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal" Jul 07 17:22:43.248066 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.248032 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a35f195a56c286aa22094586167aa68-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal\" (UID: \"9a35f195a56c286aa22094586167aa68\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal" Jul 07 17:22:43.335303 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:43.335238 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-69.ec2.internal\" not found" Jul 07 17:22:43.410777 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.410752 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal" Jul 07 17:22:43.415535 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.415515 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-69.ec2.internal" Jul 07 17:22:43.435667 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:43.435647 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-69.ec2.internal\" not found" Jul 07 17:22:43.536146 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:43.536115 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-69.ec2.internal\" not found" Jul 07 17:22:43.636703 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:43.636647 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-69.ec2.internal\" not found" Jul 07 17:22:43.672985 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.672967 2549 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 17:22:43.737327 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:43.737307 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-69.ec2.internal\" not found" Jul 07 17:22:43.772822 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.772807 2549 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 17:22:43.773291 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.772914 2549 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 17:22:43.773291 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.772970 2549 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 17:22:43.838295 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:43.838269 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-69.ec2.internal\" not found" Jul 07 17:22:43.856523 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.856477 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 17:17:44 +0000 UTC" deadline="2028-03-04 09:47:48.698416412 +0000 UTC" Jul 07 17:22:43.856523 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.856521 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14536h25m4.841899364s" Jul 07 17:22:43.918961 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.918897 2549 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 17:22:43.939200 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:43.939176 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-69.ec2.internal\" not found" Jul 07 17:22:43.972399 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:43.972368 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod151e2e5ee0d5207030555e86076a8303.slice/crio-2469547b181db720ddfe5ba3606b22f789444d3ea9ae59a4261be78948bbbeaf WatchSource:0}: Error finding container 2469547b181db720ddfe5ba3606b22f789444d3ea9ae59a4261be78948bbbeaf: Status 404 returned error can't find the container with id 2469547b181db720ddfe5ba3606b22f789444d3ea9ae59a4261be78948bbbeaf Jul 07 17:22:43.972864 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:43.972836 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a35f195a56c286aa22094586167aa68.slice/crio-91c4c6307a97ad95828e984ea1f0130d40727aab154b9331e6b8161cef8bd110 WatchSource:0}: Error finding container 91c4c6307a97ad95828e984ea1f0130d40727aab154b9331e6b8161cef8bd110: Status 404 returned error can't find the container with id 91c4c6307a97ad95828e984ea1f0130d40727aab154b9331e6b8161cef8bd110 Jul 07 17:22:43.977856 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.977838 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 17:22:43.981385 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.981348 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-69.ec2.internal" event={"ID":"151e2e5ee0d5207030555e86076a8303","Type":"ContainerStarted","Data":"2469547b181db720ddfe5ba3606b22f789444d3ea9ae59a4261be78948bbbeaf"} Jul 07 17:22:43.982452 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:43.982429 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal" event={"ID":"9a35f195a56c286aa22094586167aa68","Type":"ContainerStarted","Data":"91c4c6307a97ad95828e984ea1f0130d40727aab154b9331e6b8161cef8bd110"} Jul 07 17:22:44.039409 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:44.039380 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-69.ec2.internal\" not found" Jul 07 17:22:45.375978 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:45.375949 2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-69.ec2.internal\" not found" Jul 07 17:22:45.387576 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:45.387552 2549 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 17:22:45.481371 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:45.481313 2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-69.ec2.internal" Jul 07 17:22:45.492454 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:45.492438 2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 17:22:45.493407 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:45.493396 2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal" Jul 07 17:22:45.505611 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:45.505594 2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 17:22:46.059682 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.059658 2549 apiserver.go:52] "Watching apiserver" Jul 07 17:22:46.070884 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.070859 2549 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 17:22:46.072139 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.072104 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-136-69.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh","openshift-image-registry/node-ca-6qsgn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal","openshift-multus/multus-additional-cni-plugins-n6cwg","openshift-network-diagnostics/network-check-target-bmz4p","openshift-network-operator/iptables-alerter-nh8n2","kube-system/konnectivity-agent-rs7tq","openshift-cluster-node-tuning-operator/tuned-mjvth","openshift-dns/node-resolver-jk577","openshift-multus/multus-zrjhw","openshift-multus/network-metrics-daemon-csjmz","openshift-ovn-kubernetes/ovnkube-node-mhztd","kube-system/global-pull-secret-syncer-45k9q"] Jul 07 17:22:46.073624 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.073604 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jk577" Jul 07 17:22:46.075430 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.075109 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.076262 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.076242 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6qsgn" Jul 07 17:22:46.076747 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.076728 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 17:22:46.076953 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.076936 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 17:22:46.077205 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.077185 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gww52\"" Jul 07 17:22:46.077816 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.077797 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 17:22:46.078497 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.078478 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hx5rw\"" Jul 07 17:22:46.078698 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.078680 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 17:22:46.081349 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.081286 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 17:22:46.081626 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.081597 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:22:46.081726 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.081664 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 17:22:46.081726 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.081698 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 17:22:46.081854 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.081791 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n6cwg" Jul 07 17:22:46.081854 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:46.081657 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45k9q" podUID="77800761-9499-4c79-b3b7-f9f39131c8f9" Jul 07 17:22:46.081854 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.081815 2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 17:22:46.082930 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.082137 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:22:46.082930 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:46.082200 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmz4p" podUID="f8abb2d6-e485-457c-8fa7-96617b6362b1" Jul 07 17:22:46.082930 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.082845 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 17:22:46.082930 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.082873 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.083195 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.083177 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 17:22:46.083254 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.083229 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 17:22:46.083254 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.083246 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8bl4t\"" Jul 07 17:22:46.083548 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.083528 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 17:22:46.084691 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.084675 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 17:22:46.085254 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.085235 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 17:22:46.085434 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.085419 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 17:22:46.085680 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.085665 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 17:22:46.085835 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.085812 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 17:22:46.085916 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.085879 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pkmrd\"" Jul 07 17:22:46.085971 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.085931 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 17:22:46.086160 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.086143 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8mkqb\"" Jul 07 17:22:46.086290 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.086270 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 17:22:46.086556 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.086539 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nh8n2" Jul 07 17:22:46.087814 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.087797 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh" Jul 07 17:22:46.089031 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.089017 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rs7tq" Jul 07 17:22:46.089751 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.089737 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 17:22:46.090026 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.090011 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 17:22:46.090125 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.090109 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 17:22:46.092009 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.090817 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 17:22:46.093777 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.092292 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.093777 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.092766 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8777cc86-acf1-4454-80d0-9f96c88bb693-etc-tuned\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.093777 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.092795 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcmps\" (UniqueName: \"kubernetes.io/projected/8777cc86-acf1-4454-80d0-9f96c88bb693-kube-api-access-fcmps\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.093777 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.092821 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-run-systemd\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.093777 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.092847 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.093777 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.092870 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc3322ee-9711-4997-b100-02824e125414-host\") pod \"node-ca-6qsgn\" (UID: \"dc3322ee-9711-4997-b100-02824e125414\") " pod="openshift-image-registry/node-ca-6qsgn" Jul 07 17:22:46.093777 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.092892 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-etc-sysctl-conf\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.093777 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.092913 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-etc-systemd\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.093777 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.092933 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-lib-modules\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.093777 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.092957 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8777cc86-acf1-4454-80d0-9f96c88bb693-tmp\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.093777 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.092979 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-var-lib-openvswitch\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.093777 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093001 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8880047-1dd1-462e-9fed-24e401d49df0-cnibin\") pod \"multus-additional-cni-plugins-n6cwg\" (UID: \"f8880047-1dd1-462e-9fed-24e401d49df0\") " pod="openshift-multus/multus-additional-cni-plugins-n6cwg" Jul 07 17:22:46.093777 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093024 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kblqm\" (UniqueName: \"kubernetes.io/projected/f8abb2d6-e485-457c-8fa7-96617b6362b1-kube-api-access-kblqm\") pod \"network-check-target-bmz4p\" (UID: \"f8abb2d6-e485-457c-8fa7-96617b6362b1\") " pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:22:46.093777 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093052 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-host-kubelet\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.093777 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093074 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-systemd-units\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.093777 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093094 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-host-slash\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.093777 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093116 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/00383bc5-6090-486b-892b-5be74f96c497-env-overrides\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.094617 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093139 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77800761-9499-4c79-b3b7-f9f39131c8f9-original-pull-secret\") pod \"global-pull-secret-syncer-45k9q\" (UID: \"77800761-9499-4c79-b3b7-f9f39131c8f9\") " pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:22:46.094617 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093170 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8880047-1dd1-462e-9fed-24e401d49df0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n6cwg\" (UID: \"f8880047-1dd1-462e-9fed-24e401d49df0\") " pod="openshift-multus/multus-additional-cni-plugins-n6cwg" Jul 07 17:22:46.094617 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093192 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-run\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.094617 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093213 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-var-lib-kubelet\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.094617 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093241 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-host-run-netns\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.094617 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093271 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-run-ovn\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.094617 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093305 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-etc-modprobe-d\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.094617 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093326 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-sys\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.094617 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093350 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-host\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.094617 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093371 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/85e73679-afa9-417c-a7d5-8d8e795965b1-hosts-file\") pod \"node-resolver-jk577\" (UID: \"85e73679-afa9-417c-a7d5-8d8e795965b1\") " pod="openshift-dns/node-resolver-jk577" Jul 07 17:22:46.094617 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093392 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85e73679-afa9-417c-a7d5-8d8e795965b1-tmp-dir\") pod \"node-resolver-jk577\" (UID: \"85e73679-afa9-417c-a7d5-8d8e795965b1\") " pod="openshift-dns/node-resolver-jk577" Jul 07 17:22:46.094617 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093413 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-node-log\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.094617 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093442 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:22:46.094617 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:46.093560 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csjmz" podUID="da36f22f-e43c-4114-994d-b0bd9fae9555" Jul 07 17:22:46.094617 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093446 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrt9z\" (UniqueName: \"kubernetes.io/projected/00383bc5-6090-486b-892b-5be74f96c497-kube-api-access-rrt9z\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.094617 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093690 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dc3322ee-9711-4997-b100-02824e125414-serviceca\") pod \"node-ca-6qsgn\" (UID: \"dc3322ee-9711-4997-b100-02824e125414\") " pod="openshift-image-registry/node-ca-6qsgn" Jul 07 17:22:46.094617 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093717 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f8880047-1dd1-462e-9fed-24e401d49df0-os-release\") pod \"multus-additional-cni-plugins-n6cwg\" (UID: \"f8880047-1dd1-462e-9fed-24e401d49df0\") " pod="openshift-multus/multus-additional-cni-plugins-n6cwg" Jul 07 17:22:46.095368 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093740 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8880047-1dd1-462e-9fed-24e401d49df0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n6cwg\" (UID: \"f8880047-1dd1-462e-9fed-24e401d49df0\") " pod="openshift-multus/multus-additional-cni-plugins-n6cwg" Jul 07 17:22:46.095368 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093779 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mvm8\" (UniqueName: \"kubernetes.io/projected/f8880047-1dd1-462e-9fed-24e401d49df0-kube-api-access-6mvm8\") pod \"multus-additional-cni-plugins-n6cwg\" (UID: \"f8880047-1dd1-462e-9fed-24e401d49df0\") " pod="openshift-multus/multus-additional-cni-plugins-n6cwg" Jul 07 17:22:46.095368 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093821 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-etc-sysctl-d\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.095368 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093860 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-host-cni-bin\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.095368 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093880 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-host-cni-netd\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.095368 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093902 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8880047-1dd1-462e-9fed-24e401d49df0-system-cni-dir\") pod \"multus-additional-cni-plugins-n6cwg\" (UID: \"f8880047-1dd1-462e-9fed-24e401d49df0\") " pod="openshift-multus/multus-additional-cni-plugins-n6cwg" Jul 07 17:22:46.095368 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093935 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-etc-kubernetes\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.095368 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.093979 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlnzh\" (UniqueName: \"kubernetes.io/projected/85e73679-afa9-417c-a7d5-8d8e795965b1-kube-api-access-xlnzh\") pod \"node-resolver-jk577\" (UID: \"85e73679-afa9-417c-a7d5-8d8e795965b1\") " pod="openshift-dns/node-resolver-jk577" Jul 07 17:22:46.095368 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.094002 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxwpq\" (UniqueName: \"kubernetes.io/projected/dc3322ee-9711-4997-b100-02824e125414-kube-api-access-hxwpq\") pod \"node-ca-6qsgn\" (UID: \"dc3322ee-9711-4997-b100-02824e125414\") " pod="openshift-image-registry/node-ca-6qsgn" Jul 07 17:22:46.095368 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.094022 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/77800761-9499-4c79-b3b7-f9f39131c8f9-dbus\") pod \"global-pull-secret-syncer-45k9q\" (UID: \"77800761-9499-4c79-b3b7-f9f39131c8f9\") " pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:22:46.095368 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.094062 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-etc-openvswitch\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.095368 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.094097 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-run-openvswitch\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.095368 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.094120 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/00383bc5-6090-486b-892b-5be74f96c497-ovnkube-config\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.095368 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.094139 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/00383bc5-6090-486b-892b-5be74f96c497-ovn-node-metrics-cert\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.095368 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.094159 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8880047-1dd1-462e-9fed-24e401d49df0-cni-binary-copy\") pod \"multus-additional-cni-plugins-n6cwg\" (UID: \"f8880047-1dd1-462e-9fed-24e401d49df0\") " pod="openshift-multus/multus-additional-cni-plugins-n6cwg" Jul 07 17:22:46.095368 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.094174 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8880047-1dd1-462e-9fed-24e401d49df0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n6cwg\" (UID: \"f8880047-1dd1-462e-9fed-24e401d49df0\") " pod="openshift-multus/multus-additional-cni-plugins-n6cwg" Jul 07 17:22:46.096124 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.094188 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-log-socket\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.096124 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.094201 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-host-run-ovn-kubernetes\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.096124 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.094244 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/00383bc5-6090-486b-892b-5be74f96c497-ovnkube-script-lib\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.096124 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.094270 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/77800761-9499-4c79-b3b7-f9f39131c8f9-kubelet-config\") pod \"global-pull-secret-syncer-45k9q\" (UID: \"77800761-9499-4c79-b3b7-f9f39131c8f9\") " pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:22:46.096124 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.094786 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-etc-sysconfig\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.099184 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.097244 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tvd89\"" Jul 07 17:22:46.099184 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.097500 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 17:22:46.099184 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.097735 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-b2zj8\"" Jul 07 17:22:46.099184 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.097907 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 17:22:46.099184 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.098315 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5n7xp\"" Jul 07 17:22:46.099184 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.098481 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 17:22:46.099184 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.098690 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 17:22:46.104744 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.101056 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kzfxc\"" Jul 07 17:22:46.104744 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.101433 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 17:22:46.109226 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.109024 2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 17:22:46.135469 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.135443 2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-68wg5" Jul 07 17:22:46.142208 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.142187 2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-68wg5" Jul 07 17:22:46.182157 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.182139 2549 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 17:22:46.195129 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195086 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxwpq\" (UniqueName: \"kubernetes.io/projected/dc3322ee-9711-4997-b100-02824e125414-kube-api-access-hxwpq\") pod \"node-ca-6qsgn\" (UID: \"dc3322ee-9711-4997-b100-02824e125414\") " pod="openshift-image-registry/node-ca-6qsgn" Jul 07 17:22:46.195129 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195112 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-etc-openvswitch\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.195129 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195129 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-run-openvswitch\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.195381 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195143 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/00383bc5-6090-486b-892b-5be74f96c497-ovnkube-config\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.195381 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195162 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/00383bc5-6090-486b-892b-5be74f96c497-ovn-node-metrics-cert\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.195381 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195186 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8777cc86-acf1-4454-80d0-9f96c88bb693-etc-tuned\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.195381 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195207 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-etc-openvswitch\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.195381 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195211 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-cni-binary-copy\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.195381 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195237 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-log-socket\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.195381 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195249 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-run-openvswitch\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.195381 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195260 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/00383bc5-6090-486b-892b-5be74f96c497-ovnkube-script-lib\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.195381 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195307 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-etc-sysconfig\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.195381 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195328 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-host-run-netns\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.195381 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195349 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-hostroot\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.195381 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195364 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4b116fae-395d-4aac-ad81-c14945b2a706-konnectivity-ca\") pod \"konnectivity-agent-rs7tq\" (UID: \"4b116fae-395d-4aac-ad81-c14945b2a706\") " pod="kube-system/konnectivity-agent-rs7tq" Jul 07 17:22:46.196104 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195389 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.196104 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195437 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc3322ee-9711-4997-b100-02824e125414-host\") pod \"node-ca-6qsgn\" (UID: \"dc3322ee-9711-4997-b100-02824e125414\") " pod="openshift-image-registry/node-ca-6qsgn" Jul 07 17:22:46.196104 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195454 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-lib-modules\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.196104 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195474 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8777cc86-acf1-4454-80d0-9f96c88bb693-tmp\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.196104 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195478 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-etc-sysconfig\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.196104 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195492 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxchg\" (UniqueName: \"kubernetes.io/projected/31a335ef-84f6-4214-8495-88ba5e13d840-kube-api-access-kxchg\") pod \"iptables-alerter-nh8n2\" (UID: \"31a335ef-84f6-4214-8495-88ba5e13d840\") " pod="openshift-network-operator/iptables-alerter-nh8n2" Jul 07 17:22:46.196104 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195532 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/184531fd-f251-4571-af57-6d53c61c316e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x5xdh\" (UID: \"184531fd-f251-4571-af57-6d53c61c316e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh" Jul 07 17:22:46.196104 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195542 2549 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 17:22:46.196104 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195653 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-lib-modules\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.196104 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195697 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dc3322ee-9711-4997-b100-02824e125414-host\") pod \"node-ca-6qsgn\" (UID: \"dc3322ee-9711-4997-b100-02824e125414\") " pod="openshift-image-registry/node-ca-6qsgn" Jul 07 17:22:46.196104 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195740 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-log-socket\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.196104 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195549 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmjjn\" (UniqueName: \"kubernetes.io/projected/184531fd-f251-4571-af57-6d53c61c316e-kube-api-access-kmjjn\") pod \"aws-ebs-csi-driver-node-x5xdh\" (UID: \"184531fd-f251-4571-af57-6d53c61c316e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh" Jul 07 17:22:46.196104 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195789 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-host-run-k8s-cni-cncf-io\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.196104 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195818 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-host-kubelet\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.196104 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195842 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-systemd-units\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.196104 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195857 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/00383bc5-6090-486b-892b-5be74f96c497-ovnkube-script-lib\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.196104 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195864 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-host-slash\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.196913 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195883 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.196913 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195886 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/00383bc5-6090-486b-892b-5be74f96c497-env-overrides\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.196913 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195933 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-host-kubelet\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.196913 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195938 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77800761-9499-4c79-b3b7-f9f39131c8f9-original-pull-secret\") pod \"global-pull-secret-syncer-45k9q\" (UID: \"77800761-9499-4c79-b3b7-f9f39131c8f9\") " pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:22:46.196913 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195979 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8880047-1dd1-462e-9fed-24e401d49df0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n6cwg\" (UID: \"f8880047-1dd1-462e-9fed-24e401d49df0\") " pod="openshift-multus/multus-additional-cni-plugins-n6cwg" Jul 07 17:22:46.196913 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196007 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-run\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.196913 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:46.196055 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 17:22:46.196913 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196068 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-systemd-units\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.196913 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196080 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-var-lib-kubelet\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.196913 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:46.196112 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77800761-9499-4c79-b3b7-f9f39131c8f9-original-pull-secret podName:77800761-9499-4c79-b3b7-f9f39131c8f9 nodeName:}" failed. No retries permitted until 2026-07-07 17:22:46.696093932 +0000 UTC m=+2.982697040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/77800761-9499-4c79-b3b7-f9f39131c8f9-original-pull-secret") pod "global-pull-secret-syncer-45k9q" (UID: "77800761-9499-4c79-b3b7-f9f39131c8f9") : object "kube-system"/"original-pull-secret" not registered Jul 07 17:22:46.196913 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196120 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-var-lib-kubelet\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.196913 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196128 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-host-run-netns\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.196913 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196169 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-host-run-netns\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.196913 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196207 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-run\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.196913 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196226 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-sys\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.196913 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196230 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/00383bc5-6090-486b-892b-5be74f96c497-env-overrides\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.196913 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196241 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8880047-1dd1-462e-9fed-24e401d49df0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n6cwg\" (UID: \"f8880047-1dd1-462e-9fed-24e401d49df0\") " pod="openshift-multus/multus-additional-cni-plugins-n6cwg" Jul 07 17:22:46.197735 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.195984 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-host-slash\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.197735 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196245 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/85e73679-afa9-417c-a7d5-8d8e795965b1-hosts-file\") pod \"node-resolver-jk577\" (UID: \"85e73679-afa9-417c-a7d5-8d8e795965b1\") " pod="openshift-dns/node-resolver-jk577" Jul 07 17:22:46.197735 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196305 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-sys\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.197735 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196307 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-host-var-lib-cni-bin\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.197735 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196342 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/85e73679-afa9-417c-a7d5-8d8e795965b1-hosts-file\") pod \"node-resolver-jk577\" (UID: \"85e73679-afa9-417c-a7d5-8d8e795965b1\") " pod="openshift-dns/node-resolver-jk577" Jul 07 17:22:46.197735 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196348 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-multus-conf-dir\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.197735 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196374 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-node-log\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.197735 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196401 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f8880047-1dd1-462e-9fed-24e401d49df0-os-release\") pod \"multus-additional-cni-plugins-n6cwg\" (UID: \"f8880047-1dd1-462e-9fed-24e401d49df0\") " pod="openshift-multus/multus-additional-cni-plugins-n6cwg" Jul 07 17:22:46.197735 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196428 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8880047-1dd1-462e-9fed-24e401d49df0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n6cwg\" (UID: \"f8880047-1dd1-462e-9fed-24e401d49df0\") " pod="openshift-multus/multus-additional-cni-plugins-n6cwg" Jul 07 17:22:46.197735 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196453 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mvm8\" (UniqueName: \"kubernetes.io/projected/f8880047-1dd1-462e-9fed-24e401d49df0-kube-api-access-6mvm8\") pod \"multus-additional-cni-plugins-n6cwg\" (UID: \"f8880047-1dd1-462e-9fed-24e401d49df0\") " pod="openshift-multus/multus-additional-cni-plugins-n6cwg" Jul 07 17:22:46.197735 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196462 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-node-log\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.197735 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196499 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/00383bc5-6090-486b-892b-5be74f96c497-ovnkube-config\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.197735 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196585 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f8880047-1dd1-462e-9fed-24e401d49df0-os-release\") pod \"multus-additional-cni-plugins-n6cwg\" (UID: \"f8880047-1dd1-462e-9fed-24e401d49df0\") " pod="openshift-multus/multus-additional-cni-plugins-n6cwg" Jul 07 17:22:46.197735 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196479 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlnzh\" (UniqueName: \"kubernetes.io/projected/85e73679-afa9-417c-a7d5-8d8e795965b1-kube-api-access-xlnzh\") pod \"node-resolver-jk577\" (UID: \"85e73679-afa9-417c-a7d5-8d8e795965b1\") " pod="openshift-dns/node-resolver-jk577" Jul 07 17:22:46.197735 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196629 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-host-var-lib-kubelet\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.197735 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196654 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-host-run-multus-certs\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.197735 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196679 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/31a335ef-84f6-4214-8495-88ba5e13d840-iptables-alerter-script\") pod \"iptables-alerter-nh8n2\" (UID: \"31a335ef-84f6-4214-8495-88ba5e13d840\") " pod="openshift-network-operator/iptables-alerter-nh8n2" Jul 07 17:22:46.198591 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196719 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-host-cni-netd\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.198591 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196746 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-etc-kubernetes\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.198591 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196769 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/184531fd-f251-4571-af57-6d53c61c316e-device-dir\") pod \"aws-ebs-csi-driver-node-x5xdh\" (UID: \"184531fd-f251-4571-af57-6d53c61c316e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh" Jul 07 17:22:46.198591 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196793 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da36f22f-e43c-4114-994d-b0bd9fae9555-metrics-certs\") pod \"network-metrics-daemon-csjmz\" (UID: \"da36f22f-e43c-4114-994d-b0bd9fae9555\") " pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:22:46.198591 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196817 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/77800761-9499-4c79-b3b7-f9f39131c8f9-dbus\") pod \"global-pull-secret-syncer-45k9q\" (UID: \"77800761-9499-4c79-b3b7-f9f39131c8f9\") " pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:22:46.198591 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196855 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8880047-1dd1-462e-9fed-24e401d49df0-cni-binary-copy\") pod \"multus-additional-cni-plugins-n6cwg\" (UID: \"f8880047-1dd1-462e-9fed-24e401d49df0\") " pod="openshift-multus/multus-additional-cni-plugins-n6cwg" Jul 07 17:22:46.198591 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196879 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8880047-1dd1-462e-9fed-24e401d49df0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n6cwg\" (UID: \"f8880047-1dd1-462e-9fed-24e401d49df0\") " pod="openshift-multus/multus-additional-cni-plugins-n6cwg" Jul 07 17:22:46.198591 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196879 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-host-cni-netd\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.198591 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196915 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-system-cni-dir\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.198591 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.196972 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-etc-kubernetes\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.198591 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197016 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8880047-1dd1-462e-9fed-24e401d49df0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n6cwg\" (UID: \"f8880047-1dd1-462e-9fed-24e401d49df0\") " pod="openshift-multus/multus-additional-cni-plugins-n6cwg" Jul 07 17:22:46.198591 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197076 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/77800761-9499-4c79-b3b7-f9f39131c8f9-dbus\") pod \"global-pull-secret-syncer-45k9q\" (UID: \"77800761-9499-4c79-b3b7-f9f39131c8f9\") " pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:22:46.198591 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197108 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh7xw\" (UniqueName: \"kubernetes.io/projected/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-kube-api-access-kh7xw\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.198591 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197142 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-host-run-ovn-kubernetes\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.198591 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197181 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/77800761-9499-4c79-b3b7-f9f39131c8f9-kubelet-config\") pod \"global-pull-secret-syncer-45k9q\" (UID: \"77800761-9499-4c79-b3b7-f9f39131c8f9\") " pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:22:46.198591 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197212 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcmps\" (UniqueName: \"kubernetes.io/projected/8777cc86-acf1-4454-80d0-9f96c88bb693-kube-api-access-fcmps\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.198591 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197251 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/184531fd-f251-4571-af57-6d53c61c316e-registration-dir\") pod \"aws-ebs-csi-driver-node-x5xdh\" (UID: \"184531fd-f251-4571-af57-6d53c61c316e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh" Jul 07 17:22:46.199595 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197280 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm864\" (UniqueName: \"kubernetes.io/projected/da36f22f-e43c-4114-994d-b0bd9fae9555-kube-api-access-sm864\") pod \"network-metrics-daemon-csjmz\" (UID: \"da36f22f-e43c-4114-994d-b0bd9fae9555\") " pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:22:46.199595 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197291 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/77800761-9499-4c79-b3b7-f9f39131c8f9-kubelet-config\") pod \"global-pull-secret-syncer-45k9q\" (UID: \"77800761-9499-4c79-b3b7-f9f39131c8f9\") " pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:22:46.199595 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197334 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-host-run-ovn-kubernetes\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.199595 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197357 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-run-systemd\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.199595 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197384 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-etc-sysctl-conf\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.199595 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197404 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8880047-1dd1-462e-9fed-24e401d49df0-cni-binary-copy\") pod \"multus-additional-cni-plugins-n6cwg\" (UID: \"f8880047-1dd1-462e-9fed-24e401d49df0\") " pod="openshift-multus/multus-additional-cni-plugins-n6cwg" Jul 07 17:22:46.199595 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197410 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-etc-systemd\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.199595 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197461 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-host-var-lib-cni-multus\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.199595 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197488 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-multus-daemon-config\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.199595 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197532 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-var-lib-openvswitch\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.199595 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197557 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8880047-1dd1-462e-9fed-24e401d49df0-cnibin\") pod \"multus-additional-cni-plugins-n6cwg\" (UID: \"f8880047-1dd1-462e-9fed-24e401d49df0\") " pod="openshift-multus/multus-additional-cni-plugins-n6cwg" Jul 07 17:22:46.199595 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197617 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-etc-sysctl-conf\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.199595 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197661 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-var-lib-openvswitch\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.199595 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197693 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kblqm\" (UniqueName: \"kubernetes.io/projected/f8abb2d6-e485-457c-8fa7-96617b6362b1-kube-api-access-kblqm\") pod \"network-check-target-bmz4p\" (UID: \"f8abb2d6-e485-457c-8fa7-96617b6362b1\") " pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:22:46.199595 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197722 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-multus-cni-dir\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.199595 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197748 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-multus-socket-dir-parent\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.199595 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197771 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-etc-kubernetes\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.200574 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197795 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/184531fd-f251-4571-af57-6d53c61c316e-etc-selinux\") pod \"aws-ebs-csi-driver-node-x5xdh\" (UID: \"184531fd-f251-4571-af57-6d53c61c316e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh" Jul 07 17:22:46.200574 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197815 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8880047-1dd1-462e-9fed-24e401d49df0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n6cwg\" (UID: \"f8880047-1dd1-462e-9fed-24e401d49df0\") " pod="openshift-multus/multus-additional-cni-plugins-n6cwg" Jul 07 17:22:46.200574 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197820 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/184531fd-f251-4571-af57-6d53c61c316e-sys-fs\") pod \"aws-ebs-csi-driver-node-x5xdh\" (UID: \"184531fd-f251-4571-af57-6d53c61c316e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh" Jul 07 17:22:46.200574 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197860 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/184531fd-f251-4571-af57-6d53c61c316e-socket-dir\") pod \"aws-ebs-csi-driver-node-x5xdh\" (UID: \"184531fd-f251-4571-af57-6d53c61c316e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh" Jul 07 17:22:46.200574 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197863 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8880047-1dd1-462e-9fed-24e401d49df0-cnibin\") pod \"multus-additional-cni-plugins-n6cwg\" (UID: \"f8880047-1dd1-462e-9fed-24e401d49df0\") " pod="openshift-multus/multus-additional-cni-plugins-n6cwg" Jul 07 17:22:46.200574 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197896 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-run-ovn\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.200574 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197917 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-run-systemd\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.200574 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197918 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-etc-modprobe-d\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.200574 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.197968 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-run-ovn\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.200574 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.198015 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-etc-modprobe-d\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.200574 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.198010 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-etc-systemd\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.200574 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.198065 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-host\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.200574 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.198126 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85e73679-afa9-417c-a7d5-8d8e795965b1-tmp-dir\") pod \"node-resolver-jk577\" (UID: \"85e73679-afa9-417c-a7d5-8d8e795965b1\") " pod="openshift-dns/node-resolver-jk577" Jul 07 17:22:46.200574 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.198188 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-host\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.200574 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.198223 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-os-release\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.200574 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.198254 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrt9z\" (UniqueName: \"kubernetes.io/projected/00383bc5-6090-486b-892b-5be74f96c497-kube-api-access-rrt9z\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.200574 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.198279 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dc3322ee-9711-4997-b100-02824e125414-serviceca\") pod \"node-ca-6qsgn\" (UID: \"dc3322ee-9711-4997-b100-02824e125414\") " pod="openshift-image-registry/node-ca-6qsgn" Jul 07 17:22:46.201285 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.198303 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-etc-sysctl-d\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.201285 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.198325 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31a335ef-84f6-4214-8495-88ba5e13d840-host-slash\") pod \"iptables-alerter-nh8n2\" (UID: \"31a335ef-84f6-4214-8495-88ba5e13d840\") " pod="openshift-network-operator/iptables-alerter-nh8n2" Jul 07 17:22:46.201285 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.198349 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4b116fae-395d-4aac-ad81-c14945b2a706-agent-certs\") pod \"konnectivity-agent-rs7tq\" (UID: \"4b116fae-395d-4aac-ad81-c14945b2a706\") " pod="kube-system/konnectivity-agent-rs7tq" Jul 07 17:22:46.201285 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.198381 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-host-cni-bin\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.201285 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.198382 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85e73679-afa9-417c-a7d5-8d8e795965b1-tmp-dir\") pod \"node-resolver-jk577\" (UID: \"85e73679-afa9-417c-a7d5-8d8e795965b1\") " pod="openshift-dns/node-resolver-jk577" Jul 07 17:22:46.201285 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.198404 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8880047-1dd1-462e-9fed-24e401d49df0-system-cni-dir\") pod \"multus-additional-cni-plugins-n6cwg\" (UID: \"f8880047-1dd1-462e-9fed-24e401d49df0\") " pod="openshift-multus/multus-additional-cni-plugins-n6cwg" Jul 07 17:22:46.201285 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.198427 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-cnibin\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.201285 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.198532 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/00383bc5-6090-486b-892b-5be74f96c497-host-cni-bin\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.201285 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.198550 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8880047-1dd1-462e-9fed-24e401d49df0-system-cni-dir\") pod \"multus-additional-cni-plugins-n6cwg\" (UID: \"f8880047-1dd1-462e-9fed-24e401d49df0\") " pod="openshift-multus/multus-additional-cni-plugins-n6cwg" Jul 07 17:22:46.201285 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.198632 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8777cc86-acf1-4454-80d0-9f96c88bb693-etc-sysctl-d\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.201285 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.198814 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dc3322ee-9711-4997-b100-02824e125414-serviceca\") pod \"node-ca-6qsgn\" (UID: \"dc3322ee-9711-4997-b100-02824e125414\") " pod="openshift-image-registry/node-ca-6qsgn" Jul 07 17:22:46.201285 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.199500 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8777cc86-acf1-4454-80d0-9f96c88bb693-tmp\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.201285 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.200935 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8777cc86-acf1-4454-80d0-9f96c88bb693-etc-tuned\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.201701 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.201344 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/00383bc5-6090-486b-892b-5be74f96c497-ovn-node-metrics-cert\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.204795 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.204774 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxwpq\" (UniqueName: \"kubernetes.io/projected/dc3322ee-9711-4997-b100-02824e125414-kube-api-access-hxwpq\") pod \"node-ca-6qsgn\" (UID: \"dc3322ee-9711-4997-b100-02824e125414\") " pod="openshift-image-registry/node-ca-6qsgn" Jul 07 17:22:46.204886 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:46.204845 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 17:22:46.204886 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:46.204865 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 17:22:46.204886 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:46.204876 2549 projected.go:196] Error preparing data for projected volume kube-api-access-kblqm for pod openshift-network-diagnostics/network-check-target-bmz4p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:22:46.205005 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:46.204936 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8abb2d6-e485-457c-8fa7-96617b6362b1-kube-api-access-kblqm podName:f8abb2d6-e485-457c-8fa7-96617b6362b1 nodeName:}" failed. No retries permitted until 2026-07-07 17:22:46.70492009 +0000 UTC m=+2.991523213 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kblqm" (UniqueName: "kubernetes.io/projected/f8abb2d6-e485-457c-8fa7-96617b6362b1-kube-api-access-kblqm") pod "network-check-target-bmz4p" (UID: "f8abb2d6-e485-457c-8fa7-96617b6362b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:22:46.207136 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.207112 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcmps\" (UniqueName: \"kubernetes.io/projected/8777cc86-acf1-4454-80d0-9f96c88bb693-kube-api-access-fcmps\") pod \"tuned-mjvth\" (UID: \"8777cc86-acf1-4454-80d0-9f96c88bb693\") " pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.207661 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.207641 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mvm8\" (UniqueName: \"kubernetes.io/projected/f8880047-1dd1-462e-9fed-24e401d49df0-kube-api-access-6mvm8\") pod \"multus-additional-cni-plugins-n6cwg\" (UID: \"f8880047-1dd1-462e-9fed-24e401d49df0\") " pod="openshift-multus/multus-additional-cni-plugins-n6cwg" Jul 07 17:22:46.207989 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.207972 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrt9z\" (UniqueName: \"kubernetes.io/projected/00383bc5-6090-486b-892b-5be74f96c497-kube-api-access-rrt9z\") pod \"ovnkube-node-mhztd\" (UID: \"00383bc5-6090-486b-892b-5be74f96c497\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.208631 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.208615 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlnzh\" (UniqueName: \"kubernetes.io/projected/85e73679-afa9-417c-a7d5-8d8e795965b1-kube-api-access-xlnzh\") pod \"node-resolver-jk577\" (UID: \"85e73679-afa9-417c-a7d5-8d8e795965b1\") " pod="openshift-dns/node-resolver-jk577" Jul 07 17:22:46.299090 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.299063 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmjjn\" (UniqueName: \"kubernetes.io/projected/184531fd-f251-4571-af57-6d53c61c316e-kube-api-access-kmjjn\") pod \"aws-ebs-csi-driver-node-x5xdh\" (UID: \"184531fd-f251-4571-af57-6d53c61c316e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh" Jul 07 17:22:46.299090 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.299102 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-host-run-k8s-cni-cncf-io\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.299284 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.299140 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-host-var-lib-cni-bin\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.299284 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.299162 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-multus-conf-dir\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.299284 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.299186 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-host-var-lib-kubelet\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.299284 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.299188 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-host-run-k8s-cni-cncf-io\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.299284 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.299206 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-host-run-multus-certs\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.299284 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.299230 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/31a335ef-84f6-4214-8495-88ba5e13d840-iptables-alerter-script\") pod \"iptables-alerter-nh8n2\" (UID: \"31a335ef-84f6-4214-8495-88ba5e13d840\") " pod="openshift-network-operator/iptables-alerter-nh8n2" Jul 07 17:22:46.299284 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.299256 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/184531fd-f251-4571-af57-6d53c61c316e-device-dir\") pod \"aws-ebs-csi-driver-node-x5xdh\" (UID: \"184531fd-f251-4571-af57-6d53c61c316e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh" Jul 07 17:22:46.299284 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.299270 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-host-var-lib-cni-bin\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.299284 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.299272 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-multus-conf-dir\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.299284 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.299272 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-host-var-lib-kubelet\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.299654 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.299281 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da36f22f-e43c-4114-994d-b0bd9fae9555-metrics-certs\") pod \"network-metrics-daemon-csjmz\" (UID: \"da36f22f-e43c-4114-994d-b0bd9fae9555\") " pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:22:46.299654 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.299582 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-host-run-multus-certs\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.299729 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.299652 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/184531fd-f251-4571-af57-6d53c61c316e-device-dir\") pod \"aws-ebs-csi-driver-node-x5xdh\" (UID: \"184531fd-f251-4571-af57-6d53c61c316e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh" Jul 07 17:22:46.299773 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:46.299730 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:22:46.299806 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:46.299777 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da36f22f-e43c-4114-994d-b0bd9fae9555-metrics-certs podName:da36f22f-e43c-4114-994d-b0bd9fae9555 nodeName:}" failed. No retries permitted until 2026-07-07 17:22:46.799759454 +0000 UTC m=+3.086362566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da36f22f-e43c-4114-994d-b0bd9fae9555-metrics-certs") pod "network-metrics-daemon-csjmz" (UID: "da36f22f-e43c-4114-994d-b0bd9fae9555") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:22:46.299933 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.299906 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-system-cni-dir\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.300090 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.299948 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh7xw\" (UniqueName: \"kubernetes.io/projected/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-kube-api-access-kh7xw\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.300090 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.299976 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/184531fd-f251-4571-af57-6d53c61c316e-registration-dir\") pod \"aws-ebs-csi-driver-node-x5xdh\" (UID: \"184531fd-f251-4571-af57-6d53c61c316e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh" Jul 07 17:22:46.300090 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.299991 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm864\" (UniqueName: \"kubernetes.io/projected/da36f22f-e43c-4114-994d-b0bd9fae9555-kube-api-access-sm864\") pod \"network-metrics-daemon-csjmz\" (UID: \"da36f22f-e43c-4114-994d-b0bd9fae9555\") " pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:22:46.300090 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.300008 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-host-var-lib-cni-multus\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.300090 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.300025 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-multus-daemon-config\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.300090 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.300070 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-multus-cni-dir\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.300384 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.300093 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-multus-socket-dir-parent\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.300384 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.300115 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-etc-kubernetes\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.300384 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.300138 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/184531fd-f251-4571-af57-6d53c61c316e-etc-selinux\") pod \"aws-ebs-csi-driver-node-x5xdh\" (UID: \"184531fd-f251-4571-af57-6d53c61c316e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh" Jul 07 17:22:46.300384 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.300160 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/184531fd-f251-4571-af57-6d53c61c316e-sys-fs\") pod \"aws-ebs-csi-driver-node-x5xdh\" (UID: \"184531fd-f251-4571-af57-6d53c61c316e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh" Jul 07 17:22:46.300384 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.300182 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/184531fd-f251-4571-af57-6d53c61c316e-socket-dir\") pod \"aws-ebs-csi-driver-node-x5xdh\" (UID: \"184531fd-f251-4571-af57-6d53c61c316e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh" Jul 07 17:22:46.300384 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.300207 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-os-release\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.300384 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.300219 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-system-cni-dir\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.300384 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.300234 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31a335ef-84f6-4214-8495-88ba5e13d840-host-slash\") pod \"iptables-alerter-nh8n2\" (UID: \"31a335ef-84f6-4214-8495-88ba5e13d840\") " pod="openshift-network-operator/iptables-alerter-nh8n2" Jul 07 17:22:46.300384 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.300260 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4b116fae-395d-4aac-ad81-c14945b2a706-agent-certs\") pod \"konnectivity-agent-rs7tq\" (UID: \"4b116fae-395d-4aac-ad81-c14945b2a706\") " pod="kube-system/konnectivity-agent-rs7tq" Jul 07 17:22:46.300384 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.300266 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-multus-socket-dir-parent\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.300384 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.300287 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-cnibin\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.300384 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.300316 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-cni-binary-copy\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.300384 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.300341 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-host-run-netns\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.300384 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.300362 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-hostroot\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.300384 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.300383 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4b116fae-395d-4aac-ad81-c14945b2a706-konnectivity-ca\") pod \"konnectivity-agent-rs7tq\" (UID: \"4b116fae-395d-4aac-ad81-c14945b2a706\") " pod="kube-system/konnectivity-agent-rs7tq" Jul 07 17:22:46.301086 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.300413 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-host-var-lib-cni-multus\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.301086 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.300412 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxchg\" (UniqueName: \"kubernetes.io/projected/31a335ef-84f6-4214-8495-88ba5e13d840-kube-api-access-kxchg\") pod \"iptables-alerter-nh8n2\" (UID: \"31a335ef-84f6-4214-8495-88ba5e13d840\") " pod="openshift-network-operator/iptables-alerter-nh8n2" Jul 07 17:22:46.301086 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.300449 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/184531fd-f251-4571-af57-6d53c61c316e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x5xdh\" (UID: \"184531fd-f251-4571-af57-6d53c61c316e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh" Jul 07 17:22:46.301086 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.300480 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/31a335ef-84f6-4214-8495-88ba5e13d840-iptables-alerter-script\") pod \"iptables-alerter-nh8n2\" (UID: \"31a335ef-84f6-4214-8495-88ba5e13d840\") " pod="openshift-network-operator/iptables-alerter-nh8n2" Jul 07 17:22:46.301086 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.300547 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/184531fd-f251-4571-af57-6d53c61c316e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x5xdh\" (UID: \"184531fd-f251-4571-af57-6d53c61c316e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh" Jul 07 17:22:46.301086 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.300605 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-cnibin\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.301086 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.300868 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/184531fd-f251-4571-af57-6d53c61c316e-sys-fs\") pod \"aws-ebs-csi-driver-node-x5xdh\" (UID: \"184531fd-f251-4571-af57-6d53c61c316e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh" Jul 07 17:22:46.301086 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.300925 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-etc-kubernetes\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.301086 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.300936 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-multus-daemon-config\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.301086 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.301016 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-multus-cni-dir\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.301086 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.301021 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/184531fd-f251-4571-af57-6d53c61c316e-etc-selinux\") pod \"aws-ebs-csi-driver-node-x5xdh\" (UID: \"184531fd-f251-4571-af57-6d53c61c316e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh" Jul 07 17:22:46.301086 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.301041 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-cni-binary-copy\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.301086 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.301080 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-os-release\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.302086 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.301101 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-host-run-netns\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.302086 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.301112 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/184531fd-f251-4571-af57-6d53c61c316e-socket-dir\") pod \"aws-ebs-csi-driver-node-x5xdh\" (UID: \"184531fd-f251-4571-af57-6d53c61c316e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh" Jul 07 17:22:46.302086 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.301146 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31a335ef-84f6-4214-8495-88ba5e13d840-host-slash\") pod \"iptables-alerter-nh8n2\" (UID: \"31a335ef-84f6-4214-8495-88ba5e13d840\") " pod="openshift-network-operator/iptables-alerter-nh8n2" Jul 07 17:22:46.302086 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.301176 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-hostroot\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.302086 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.301205 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/184531fd-f251-4571-af57-6d53c61c316e-registration-dir\") pod \"aws-ebs-csi-driver-node-x5xdh\" (UID: \"184531fd-f251-4571-af57-6d53c61c316e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh" Jul 07 17:22:46.302086 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.301581 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4b116fae-395d-4aac-ad81-c14945b2a706-konnectivity-ca\") pod \"konnectivity-agent-rs7tq\" (UID: \"4b116fae-395d-4aac-ad81-c14945b2a706\") " pod="kube-system/konnectivity-agent-rs7tq" Jul 07 17:22:46.303446 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.303418 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4b116fae-395d-4aac-ad81-c14945b2a706-agent-certs\") pod \"konnectivity-agent-rs7tq\" (UID: \"4b116fae-395d-4aac-ad81-c14945b2a706\") " pod="kube-system/konnectivity-agent-rs7tq" Jul 07 17:22:46.311217 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.311090 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmjjn\" (UniqueName: \"kubernetes.io/projected/184531fd-f251-4571-af57-6d53c61c316e-kube-api-access-kmjjn\") pod \"aws-ebs-csi-driver-node-x5xdh\" (UID: \"184531fd-f251-4571-af57-6d53c61c316e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh" Jul 07 17:22:46.311294 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.311146 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxchg\" (UniqueName: \"kubernetes.io/projected/31a335ef-84f6-4214-8495-88ba5e13d840-kube-api-access-kxchg\") pod \"iptables-alerter-nh8n2\" (UID: \"31a335ef-84f6-4214-8495-88ba5e13d840\") " pod="openshift-network-operator/iptables-alerter-nh8n2" Jul 07 17:22:46.313124 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.313102 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm864\" (UniqueName: \"kubernetes.io/projected/da36f22f-e43c-4114-994d-b0bd9fae9555-kube-api-access-sm864\") pod \"network-metrics-daemon-csjmz\" (UID: \"da36f22f-e43c-4114-994d-b0bd9fae9555\") " pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:22:46.313573 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.313550 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh7xw\" (UniqueName: \"kubernetes.io/projected/d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef-kube-api-access-kh7xw\") pod \"multus-zrjhw\" (UID: \"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef\") " pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.386156 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.386129 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jk577" Jul 07 17:22:46.401163 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.401137 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:22:46.412902 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.412874 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6qsgn" Jul 07 17:22:46.420462 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.420441 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n6cwg" Jul 07 17:22:46.428215 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.428193 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mjvth" Jul 07 17:22:46.435802 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.435786 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nh8n2" Jul 07 17:22:46.444543 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.444524 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh" Jul 07 17:22:46.451239 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.451220 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rs7tq" Jul 07 17:22:46.457160 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.457038 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zrjhw" Jul 07 17:22:46.517444 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.517419 2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 17:22:46.702357 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.702295 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77800761-9499-4c79-b3b7-f9f39131c8f9-original-pull-secret\") pod \"global-pull-secret-syncer-45k9q\" (UID: \"77800761-9499-4c79-b3b7-f9f39131c8f9\") " pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:22:46.702471 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:46.702393 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 17:22:46.702471 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:46.702455 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77800761-9499-4c79-b3b7-f9f39131c8f9-original-pull-secret podName:77800761-9499-4c79-b3b7-f9f39131c8f9 nodeName:}" failed. No retries permitted until 2026-07-07 17:22:47.702436391 +0000 UTC m=+3.989039501 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/77800761-9499-4c79-b3b7-f9f39131c8f9-original-pull-secret") pod "global-pull-secret-syncer-45k9q" (UID: "77800761-9499-4c79-b3b7-f9f39131c8f9") : object "kube-system"/"original-pull-secret" not registered Jul 07 17:22:46.803285 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.803255 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da36f22f-e43c-4114-994d-b0bd9fae9555-metrics-certs\") pod \"network-metrics-daemon-csjmz\" (UID: \"da36f22f-e43c-4114-994d-b0bd9fae9555\") " pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:22:46.803426 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:46.803304 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kblqm\" (UniqueName: \"kubernetes.io/projected/f8abb2d6-e485-457c-8fa7-96617b6362b1-kube-api-access-kblqm\") pod \"network-check-target-bmz4p\" (UID: \"f8abb2d6-e485-457c-8fa7-96617b6362b1\") " pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:22:46.803426 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:46.803403 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:22:46.803426 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:46.803413 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 17:22:46.803569 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:46.803431 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 17:22:46.803569 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:46.803443 2549 projected.go:196] Error preparing data for projected volume kube-api-access-kblqm for pod openshift-network-diagnostics/network-check-target-bmz4p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:22:46.803569 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:46.803472 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da36f22f-e43c-4114-994d-b0bd9fae9555-metrics-certs podName:da36f22f-e43c-4114-994d-b0bd9fae9555 nodeName:}" failed. No retries permitted until 2026-07-07 17:22:47.803447359 +0000 UTC m=+4.090050485 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da36f22f-e43c-4114-994d-b0bd9fae9555-metrics-certs") pod "network-metrics-daemon-csjmz" (UID: "da36f22f-e43c-4114-994d-b0bd9fae9555") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:22:46.803569 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:46.803496 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8abb2d6-e485-457c-8fa7-96617b6362b1-kube-api-access-kblqm podName:f8abb2d6-e485-457c-8fa7-96617b6362b1 nodeName:}" failed. No retries permitted until 2026-07-07 17:22:47.803481325 +0000 UTC m=+4.090084455 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kblqm" (UniqueName: "kubernetes.io/projected/f8abb2d6-e485-457c-8fa7-96617b6362b1-kube-api-access-kblqm") pod "network-check-target-bmz4p" (UID: "f8abb2d6-e485-457c-8fa7-96617b6362b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:22:47.144921 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:47.144881 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 17:17:46 +0000 UTC" deadline="2028-01-15 06:58:10.247057874 +0000 UTC" Jul 07 17:22:47.144921 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:47.144916 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13357h35m23.102145076s" Jul 07 17:22:47.329674 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:47.329645 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8777cc86_acf1_4454_80d0_9f96c88bb693.slice/crio-df73d7ba2b0c88cc7baf8f70d01a799cb3795dad78dfcf8e94dd3face80eb097 WatchSource:0}: Error finding container df73d7ba2b0c88cc7baf8f70d01a799cb3795dad78dfcf8e94dd3face80eb097: Status 404 returned error can't find the container with id df73d7ba2b0c88cc7baf8f70d01a799cb3795dad78dfcf8e94dd3face80eb097 Jul 07 17:22:47.334034 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:47.334006 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8880047_1dd1_462e_9fed_24e401d49df0.slice/crio-6c70afe9ecba7e22cf38f7dd120c752bd594a863c38de7326a0902b4b7e9d96d WatchSource:0}: Error finding container 6c70afe9ecba7e22cf38f7dd120c752bd594a863c38de7326a0902b4b7e9d96d: Status 404 returned error can't find the container with id 6c70afe9ecba7e22cf38f7dd120c752bd594a863c38de7326a0902b4b7e9d96d Jul 07 17:22:47.336219 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:47.336092 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod184531fd_f251_4571_af57_6d53c61c316e.slice/crio-ad21a44871e67b88ae6ce5e3ec3f1d591d7dab70ca102ec1196449b181c2f139 WatchSource:0}: Error finding container ad21a44871e67b88ae6ce5e3ec3f1d591d7dab70ca102ec1196449b181c2f139: Status 404 returned error can't find the container with id ad21a44871e67b88ae6ce5e3ec3f1d591d7dab70ca102ec1196449b181c2f139 Jul 07 17:22:47.343026 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:47.343008 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc3322ee_9711_4997_b100_02824e125414.slice/crio-888811e6785ec0f382ffef962fda05bdf181b6b287a838f59bad0140ad68872d WatchSource:0}: Error finding container 888811e6785ec0f382ffef962fda05bdf181b6b287a838f59bad0140ad68872d: Status 404 returned error can't find the container with id 888811e6785ec0f382ffef962fda05bdf181b6b287a838f59bad0140ad68872d Jul 07 17:22:47.343788 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:47.343764 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00383bc5_6090_486b_892b_5be74f96c497.slice/crio-04e345ad7af29872c2fe212de0116d687ca6427d4bbe74a1665694331dee09f0 WatchSource:0}: Error finding container 04e345ad7af29872c2fe212de0116d687ca6427d4bbe74a1665694331dee09f0: Status 404 returned error can't find the container with id 04e345ad7af29872c2fe212de0116d687ca6427d4bbe74a1665694331dee09f0 Jul 07 17:22:47.344145 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:22:47.344124 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8b3a8e9_c4a1_47a6_bfb4_8c366e6d70ef.slice/crio-2d817340470a0e0973ad75e22b2ecf1c19272125a9becea308ea3e4e63488861 WatchSource:0}: Error finding container 2d817340470a0e0973ad75e22b2ecf1c19272125a9becea308ea3e4e63488861: Status 404 returned error can't find the container with id 2d817340470a0e0973ad75e22b2ecf1c19272125a9becea308ea3e4e63488861 Jul 07 17:22:47.719959 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:47.719724 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77800761-9499-4c79-b3b7-f9f39131c8f9-original-pull-secret\") pod \"global-pull-secret-syncer-45k9q\" (UID: \"77800761-9499-4c79-b3b7-f9f39131c8f9\") " pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:22:47.719959 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:47.719861 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 17:22:47.720122 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:47.719982 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77800761-9499-4c79-b3b7-f9f39131c8f9-original-pull-secret podName:77800761-9499-4c79-b3b7-f9f39131c8f9 nodeName:}" failed. No retries permitted until 2026-07-07 17:22:49.719963129 +0000 UTC m=+6.006566238 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/77800761-9499-4c79-b3b7-f9f39131c8f9-original-pull-secret") pod "global-pull-secret-syncer-45k9q" (UID: "77800761-9499-4c79-b3b7-f9f39131c8f9") : object "kube-system"/"original-pull-secret" not registered Jul 07 17:22:47.783969 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:47.783944 2549 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 17:22:47.820575 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:47.820554 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da36f22f-e43c-4114-994d-b0bd9fae9555-metrics-certs\") pod \"network-metrics-daemon-csjmz\" (UID: \"da36f22f-e43c-4114-994d-b0bd9fae9555\") " pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:22:47.820664 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:47.820598 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kblqm\" (UniqueName: \"kubernetes.io/projected/f8abb2d6-e485-457c-8fa7-96617b6362b1-kube-api-access-kblqm\") pod \"network-check-target-bmz4p\" (UID: \"f8abb2d6-e485-457c-8fa7-96617b6362b1\") " pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:22:47.820718 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:47.820705 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:22:47.820750 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:47.820720 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 17:22:47.820750 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:47.820735 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 17:22:47.820750 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:47.820746 2549 projected.go:196] Error preparing data for projected volume kube-api-access-kblqm for pod openshift-network-diagnostics/network-check-target-bmz4p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:22:47.820833 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:47.820766 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da36f22f-e43c-4114-994d-b0bd9fae9555-metrics-certs podName:da36f22f-e43c-4114-994d-b0bd9fae9555 nodeName:}" failed. No retries permitted until 2026-07-07 17:22:49.820747736 +0000 UTC m=+6.107350862 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da36f22f-e43c-4114-994d-b0bd9fae9555-metrics-certs") pod "network-metrics-daemon-csjmz" (UID: "da36f22f-e43c-4114-994d-b0bd9fae9555") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:22:47.820833 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:47.820784 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8abb2d6-e485-457c-8fa7-96617b6362b1-kube-api-access-kblqm podName:f8abb2d6-e485-457c-8fa7-96617b6362b1 nodeName:}" failed. No retries permitted until 2026-07-07 17:22:49.820772557 +0000 UTC m=+6.107375665 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kblqm" (UniqueName: "kubernetes.io/projected/f8abb2d6-e485-457c-8fa7-96617b6362b1-kube-api-access-kblqm") pod "network-check-target-bmz4p" (UID: "f8abb2d6-e485-457c-8fa7-96617b6362b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:22:48.145575 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:48.145461 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 17:17:46 +0000 UTC" deadline="2028-03-09 16:39:25.783050592 +0000 UTC" Jul 07 17:22:48.145575 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:48.145534 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14663h16m37.637521299s" Jul 07 17:22:48.214694 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:48.214664 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:22:48.214848 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:48.214664 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:22:48.214848 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:48.214797 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45k9q" podUID="77800761-9499-4c79-b3b7-f9f39131c8f9" Jul 07 17:22:48.214848 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:48.214838 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmz4p" podUID="f8abb2d6-e485-457c-8fa7-96617b6362b1" Jul 07 17:22:48.215008 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:48.214677 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:22:48.215008 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:48.214937 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csjmz" podUID="da36f22f-e43c-4114-994d-b0bd9fae9555" Jul 07 17:22:48.228122 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:48.228023 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nh8n2" event={"ID":"31a335ef-84f6-4214-8495-88ba5e13d840","Type":"ContainerStarted","Data":"22ab9b5c870ecd9148cac7678d0330b7e4eb6c17dc96bcc2e49338283f48c3e6"} Jul 07 17:22:48.230067 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:48.229976 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh" event={"ID":"184531fd-f251-4571-af57-6d53c61c316e","Type":"ContainerStarted","Data":"ad21a44871e67b88ae6ce5e3ec3f1d591d7dab70ca102ec1196449b181c2f139"} Jul 07 17:22:48.233080 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:48.233047 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6cwg" event={"ID":"f8880047-1dd1-462e-9fed-24e401d49df0","Type":"ContainerStarted","Data":"6c70afe9ecba7e22cf38f7dd120c752bd594a863c38de7326a0902b4b7e9d96d"} Jul 07 17:22:48.238091 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:48.238065 2549 generic.go:356] "Generic (PLEG): container finished" podID="9a35f195a56c286aa22094586167aa68" containerID="810776caff8fb9de348e1282a8892ad8e317032d376af105fe122747971781a0" exitCode=0 Jul 07 17:22:48.238203 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:48.238148 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal" event={"ID":"9a35f195a56c286aa22094586167aa68","Type":"ContainerDied","Data":"810776caff8fb9de348e1282a8892ad8e317032d376af105fe122747971781a0"} Jul 07 17:22:48.251385 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:48.251335 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zrjhw" event={"ID":"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef","Type":"ContainerStarted","Data":"2d817340470a0e0973ad75e22b2ecf1c19272125a9becea308ea3e4e63488861"} Jul 07 17:22:48.256936 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:48.256912 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6qsgn" event={"ID":"dc3322ee-9711-4997-b100-02824e125414","Type":"ContainerStarted","Data":"888811e6785ec0f382ffef962fda05bdf181b6b287a838f59bad0140ad68872d"} Jul 07 17:22:48.265285 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:48.265263 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jk577" event={"ID":"85e73679-afa9-417c-a7d5-8d8e795965b1","Type":"ContainerStarted","Data":"9e163390bc79014eec14219bc31d12824d10cfb51e79bc140e27ba5a92940f26"} Jul 07 17:22:48.283483 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:48.283317 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mjvth" event={"ID":"8777cc86-acf1-4454-80d0-9f96c88bb693","Type":"ContainerStarted","Data":"df73d7ba2b0c88cc7baf8f70d01a799cb3795dad78dfcf8e94dd3face80eb097"} Jul 07 17:22:48.293111 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:48.293084 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-69.ec2.internal" event={"ID":"151e2e5ee0d5207030555e86076a8303","Type":"ContainerStarted","Data":"50e81b73f438f95fe72fb0589770fa14ecf1c3cdcf6e8d748309d71b66831861"} Jul 07 17:22:48.314546 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:48.312153 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" event={"ID":"00383bc5-6090-486b-892b-5be74f96c497","Type":"ContainerStarted","Data":"04e345ad7af29872c2fe212de0116d687ca6427d4bbe74a1665694331dee09f0"} Jul 07 17:22:48.323326 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:48.323223 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rs7tq" event={"ID":"4b116fae-395d-4aac-ad81-c14945b2a706","Type":"ContainerStarted","Data":"c8e98feafcc9f9a710e80e3720d7c9b64ad19fa04315976e9c91b2ebcd721bc7"} Jul 07 17:22:49.348263 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:49.348228 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal" event={"ID":"9a35f195a56c286aa22094586167aa68","Type":"ContainerStarted","Data":"2f173d22aba6ba8577b1f032ac527fa88acff94deb8eea0070d08a3022c3bc7e"} Jul 07 17:22:49.368486 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:49.368427 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-69.ec2.internal" podStartSLOduration=4.368407602 podStartE2EDuration="4.368407602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:22:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:22:48.31553955 +0000 UTC m=+4.602142682" watchObservedRunningTime="2026-07-07 17:22:49.368407602 +0000 UTC m=+5.655010735" Jul 07 17:22:49.369213 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:49.369178 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-69.ec2.internal" podStartSLOduration=4.369164981 podStartE2EDuration="4.369164981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:22:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:22:49.369045032 +0000 UTC m=+5.655648146" watchObservedRunningTime="2026-07-07 17:22:49.369164981 +0000 UTC m=+5.655768116" Jul 07 17:22:49.737110 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:49.736453 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77800761-9499-4c79-b3b7-f9f39131c8f9-original-pull-secret\") pod \"global-pull-secret-syncer-45k9q\" (UID: \"77800761-9499-4c79-b3b7-f9f39131c8f9\") " pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:22:49.737110 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:49.736652 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 17:22:49.737110 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:49.736716 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77800761-9499-4c79-b3b7-f9f39131c8f9-original-pull-secret podName:77800761-9499-4c79-b3b7-f9f39131c8f9 nodeName:}" failed. No retries permitted until 2026-07-07 17:22:53.736697142 +0000 UTC m=+10.023300274 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/77800761-9499-4c79-b3b7-f9f39131c8f9-original-pull-secret") pod "global-pull-secret-syncer-45k9q" (UID: "77800761-9499-4c79-b3b7-f9f39131c8f9") : object "kube-system"/"original-pull-secret" not registered Jul 07 17:22:49.837947 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:49.837913 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da36f22f-e43c-4114-994d-b0bd9fae9555-metrics-certs\") pod \"network-metrics-daemon-csjmz\" (UID: \"da36f22f-e43c-4114-994d-b0bd9fae9555\") " pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:22:49.838112 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:49.837970 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kblqm\" (UniqueName: \"kubernetes.io/projected/f8abb2d6-e485-457c-8fa7-96617b6362b1-kube-api-access-kblqm\") pod \"network-check-target-bmz4p\" (UID: \"f8abb2d6-e485-457c-8fa7-96617b6362b1\") " pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:22:49.838178 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:49.838140 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 17:22:49.838178 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:49.838162 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 17:22:49.838178 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:49.838176 2549 projected.go:196] Error preparing data for projected volume kube-api-access-kblqm for pod openshift-network-diagnostics/network-check-target-bmz4p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:22:49.838320 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:49.838230 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8abb2d6-e485-457c-8fa7-96617b6362b1-kube-api-access-kblqm podName:f8abb2d6-e485-457c-8fa7-96617b6362b1 nodeName:}" failed. No retries permitted until 2026-07-07 17:22:53.838212045 +0000 UTC m=+10.124815174 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kblqm" (UniqueName: "kubernetes.io/projected/f8abb2d6-e485-457c-8fa7-96617b6362b1-kube-api-access-kblqm") pod "network-check-target-bmz4p" (UID: "f8abb2d6-e485-457c-8fa7-96617b6362b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:22:49.838740 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:49.838715 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:22:49.838846 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:49.838775 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da36f22f-e43c-4114-994d-b0bd9fae9555-metrics-certs podName:da36f22f-e43c-4114-994d-b0bd9fae9555 nodeName:}" failed. No retries permitted until 2026-07-07 17:22:53.838759321 +0000 UTC m=+10.125362431 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da36f22f-e43c-4114-994d-b0bd9fae9555-metrics-certs") pod "network-metrics-daemon-csjmz" (UID: "da36f22f-e43c-4114-994d-b0bd9fae9555") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:22:50.214827 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:50.214754 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:22:50.214969 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:50.214949 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csjmz" podUID="da36f22f-e43c-4114-994d-b0bd9fae9555" Jul 07 17:22:50.215363 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:50.215343 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:22:50.215559 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:50.215536 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45k9q" podUID="77800761-9499-4c79-b3b7-f9f39131c8f9" Jul 07 17:22:50.215640 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:50.215602 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:22:50.215692 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:50.215676 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmz4p" podUID="f8abb2d6-e485-457c-8fa7-96617b6362b1" Jul 07 17:22:52.217397 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:52.216641 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:22:52.217397 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:52.216759 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmz4p" podUID="f8abb2d6-e485-457c-8fa7-96617b6362b1" Jul 07 17:22:52.217397 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:52.217123 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:22:52.217397 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:52.217222 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csjmz" podUID="da36f22f-e43c-4114-994d-b0bd9fae9555" Jul 07 17:22:52.217397 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:52.217275 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:22:52.217397 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:52.217344 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45k9q" podUID="77800761-9499-4c79-b3b7-f9f39131c8f9" Jul 07 17:22:53.766722 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:53.766183 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77800761-9499-4c79-b3b7-f9f39131c8f9-original-pull-secret\") pod \"global-pull-secret-syncer-45k9q\" (UID: \"77800761-9499-4c79-b3b7-f9f39131c8f9\") " pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:22:53.766722 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:53.766317 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 17:22:53.766722 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:53.766386 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77800761-9499-4c79-b3b7-f9f39131c8f9-original-pull-secret podName:77800761-9499-4c79-b3b7-f9f39131c8f9 nodeName:}" failed. No retries permitted until 2026-07-07 17:23:01.766365163 +0000 UTC m=+18.052968286 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/77800761-9499-4c79-b3b7-f9f39131c8f9-original-pull-secret") pod "global-pull-secret-syncer-45k9q" (UID: "77800761-9499-4c79-b3b7-f9f39131c8f9") : object "kube-system"/"original-pull-secret" not registered Jul 07 17:22:53.867012 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:53.866978 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da36f22f-e43c-4114-994d-b0bd9fae9555-metrics-certs\") pod \"network-metrics-daemon-csjmz\" (UID: \"da36f22f-e43c-4114-994d-b0bd9fae9555\") " pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:22:53.867190 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:53.867029 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kblqm\" (UniqueName: \"kubernetes.io/projected/f8abb2d6-e485-457c-8fa7-96617b6362b1-kube-api-access-kblqm\") pod \"network-check-target-bmz4p\" (UID: \"f8abb2d6-e485-457c-8fa7-96617b6362b1\") " pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:22:53.867190 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:53.867136 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:22:53.867190 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:53.867152 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 17:22:53.867190 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:53.867167 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 17:22:53.867190 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:53.867181 2549 projected.go:196] Error preparing data for projected volume kube-api-access-kblqm for pod openshift-network-diagnostics/network-check-target-bmz4p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:22:53.867380 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:53.867203 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da36f22f-e43c-4114-994d-b0bd9fae9555-metrics-certs podName:da36f22f-e43c-4114-994d-b0bd9fae9555 nodeName:}" failed. No retries permitted until 2026-07-07 17:23:01.86718284 +0000 UTC m=+18.153785966 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da36f22f-e43c-4114-994d-b0bd9fae9555-metrics-certs") pod "network-metrics-daemon-csjmz" (UID: "da36f22f-e43c-4114-994d-b0bd9fae9555") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:22:53.867380 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:53.867231 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8abb2d6-e485-457c-8fa7-96617b6362b1-kube-api-access-kblqm podName:f8abb2d6-e485-457c-8fa7-96617b6362b1 nodeName:}" failed. No retries permitted until 2026-07-07 17:23:01.867213679 +0000 UTC m=+18.153816801 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kblqm" (UniqueName: "kubernetes.io/projected/f8abb2d6-e485-457c-8fa7-96617b6362b1-kube-api-access-kblqm") pod "network-check-target-bmz4p" (UID: "f8abb2d6-e485-457c-8fa7-96617b6362b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:22:54.217345 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:54.217270 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:22:54.217487 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:54.217376 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45k9q" podUID="77800761-9499-4c79-b3b7-f9f39131c8f9" Jul 07 17:22:54.217763 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:54.217739 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:22:54.217891 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:54.217830 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmz4p" podUID="f8abb2d6-e485-457c-8fa7-96617b6362b1" Jul 07 17:22:54.217891 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:54.217879 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:22:54.218002 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:54.217959 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csjmz" podUID="da36f22f-e43c-4114-994d-b0bd9fae9555" Jul 07 17:22:56.217017 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:56.216603 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:22:56.217017 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:56.216649 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:22:56.217017 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:56.216714 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45k9q" podUID="77800761-9499-4c79-b3b7-f9f39131c8f9" Jul 07 17:22:56.217017 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:56.216746 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:22:56.217017 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:56.216858 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csjmz" podUID="da36f22f-e43c-4114-994d-b0bd9fae9555" Jul 07 17:22:56.217017 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:56.216968 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmz4p" podUID="f8abb2d6-e485-457c-8fa7-96617b6362b1" Jul 07 17:22:58.218529 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:58.217406 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:22:58.218529 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:58.217681 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45k9q" podUID="77800761-9499-4c79-b3b7-f9f39131c8f9" Jul 07 17:22:58.218529 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:58.218059 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:22:58.218529 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:58.218177 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmz4p" podUID="f8abb2d6-e485-457c-8fa7-96617b6362b1" Jul 07 17:22:58.218529 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:58.218238 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:22:58.218529 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:22:58.218347 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csjmz" podUID="da36f22f-e43c-4114-994d-b0bd9fae9555" Jul 07 17:22:58.369149 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:58.369062 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mjvth" event={"ID":"8777cc86-acf1-4454-80d0-9f96c88bb693","Type":"ContainerStarted","Data":"c7becc1b235b48d6b3ca0495cd572308465fb0d246c55eb6b12cf23f7f89055d"} Jul 07 17:22:58.371151 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:58.371121 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rs7tq" event={"ID":"4b116fae-395d-4aac-ad81-c14945b2a706","Type":"ContainerStarted","Data":"fb3e2d3d834a5f43ebb7b75c5e0ec9dbdf7f0020369ca5eabfb5bd7d8f46c414"} Jul 07 17:22:58.373084 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:58.373061 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh" event={"ID":"184531fd-f251-4571-af57-6d53c61c316e","Type":"ContainerStarted","Data":"950b91f1d4096cb18ff46febacab26bbb65e6675646278b3a6921cd26464625e"} Jul 07 17:22:58.375195 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:58.375172 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6cwg" event={"ID":"f8880047-1dd1-462e-9fed-24e401d49df0","Type":"ContainerStarted","Data":"2c03c75916f2b193089645e773880e45333ec3624b05e7bac6bff2af0f5b4a2b"} Jul 07 17:22:58.378301 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:58.378278 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6qsgn" event={"ID":"dc3322ee-9711-4997-b100-02824e125414","Type":"ContainerStarted","Data":"df01b9f988aa3273839c13a2c8a6df9aa566a9f8226d2b0e22d1959a3501e714"} Jul 07 17:22:58.379870 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:58.379846 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jk577" event={"ID":"85e73679-afa9-417c-a7d5-8d8e795965b1","Type":"ContainerStarted","Data":"268e757b4b60a967211a15f74bb7bb6147789d08eb9d5ab69815adc30c8b689f"} Jul 07 17:22:58.392323 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:58.392269 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mjvth" podStartSLOduration=3.798543911 podStartE2EDuration="14.392251719s" totalImagesPullingTime="10.593707808s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:22:58.391673437 +0000 UTC m=+14.678276569" watchObservedRunningTime="2026-07-07 17:22:58.392251719 +0000 UTC m=+14.678854854" Jul 07 17:22:58.414976 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:58.414932 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jk577" podStartSLOduration=4.056836602 podStartE2EDuration="14.414915938s" totalImagesPullingTime="10.358079336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:22:58.414340414 +0000 UTC m=+14.700943547" watchObservedRunningTime="2026-07-07 17:22:58.414915938 +0000 UTC m=+14.701519073" Jul 07 17:22:58.437453 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:58.437372 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6qsgn" podStartSLOduration=4.083856132 podStartE2EDuration="14.437359339s" totalImagesPullingTime="10.353503207s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:22:58.436834869 +0000 UTC m=+14.723438006" watchObservedRunningTime="2026-07-07 17:22:58.437359339 +0000 UTC m=+14.723962472" Jul 07 17:22:58.485158 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:58.485109 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rs7tq" podStartSLOduration=4.128529881 podStartE2EDuration="14.48509019s" totalImagesPullingTime="10.356560309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:22:58.484754197 +0000 UTC m=+14.771357328" watchObservedRunningTime="2026-07-07 17:22:58.48509019 +0000 UTC m=+14.771693322" Jul 07 17:22:59.384005 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:59.383792 2549 generic.go:356] "Generic (PLEG): container finished" podID="f8880047-1dd1-462e-9fed-24e401d49df0" containerID="2c03c75916f2b193089645e773880e45333ec3624b05e7bac6bff2af0f5b4a2b" exitCode=0 Jul 07 17:22:59.384448 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:22:59.383877 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6cwg" event={"ID":"f8880047-1dd1-462e-9fed-24e401d49df0","Type":"ContainerDied","Data":"2c03c75916f2b193089645e773880e45333ec3624b05e7bac6bff2af0f5b4a2b"} Jul 07 17:23:00.214864 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:00.214834 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:23:00.214864 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:00.214848 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:23:00.215073 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:00.214833 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:23:00.215073 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:00.214937 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45k9q" podUID="77800761-9499-4c79-b3b7-f9f39131c8f9" Jul 07 17:23:00.215073 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:00.215042 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csjmz" podUID="da36f22f-e43c-4114-994d-b0bd9fae9555" Jul 07 17:23:00.215228 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:00.215154 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmz4p" podUID="f8abb2d6-e485-457c-8fa7-96617b6362b1" Jul 07 17:23:00.387914 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:00.387885 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nh8n2" event={"ID":"31a335ef-84f6-4214-8495-88ba5e13d840","Type":"ContainerStarted","Data":"d49437c2f67491eb861d3950da01a496bbe1e89ffbc4592b32bf7514403bb00f"} Jul 07 17:23:00.406273 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:00.406231 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nh8n2" podStartSLOduration=6.041798295 podStartE2EDuration="16.406218348s" totalImagesPullingTime="10.364420053s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:23:00.405691788 +0000 UTC m=+16.692294921" watchObservedRunningTime="2026-07-07 17:23:00.406218348 +0000 UTC m=+16.692821479" Jul 07 17:23:01.832879 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:01.832846 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77800761-9499-4c79-b3b7-f9f39131c8f9-original-pull-secret\") pod \"global-pull-secret-syncer-45k9q\" (UID: \"77800761-9499-4c79-b3b7-f9f39131c8f9\") " pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:23:01.833458 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:01.832983 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 17:23:01.833458 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:01.833050 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77800761-9499-4c79-b3b7-f9f39131c8f9-original-pull-secret podName:77800761-9499-4c79-b3b7-f9f39131c8f9 nodeName:}" failed. No retries permitted until 2026-07-07 17:23:17.833032311 +0000 UTC m=+34.119635426 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/77800761-9499-4c79-b3b7-f9f39131c8f9-original-pull-secret") pod "global-pull-secret-syncer-45k9q" (UID: "77800761-9499-4c79-b3b7-f9f39131c8f9") : object "kube-system"/"original-pull-secret" not registered Jul 07 17:23:01.933454 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:01.933425 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kblqm\" (UniqueName: \"kubernetes.io/projected/f8abb2d6-e485-457c-8fa7-96617b6362b1-kube-api-access-kblqm\") pod \"network-check-target-bmz4p\" (UID: \"f8abb2d6-e485-457c-8fa7-96617b6362b1\") " pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:23:01.933648 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:01.933522 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da36f22f-e43c-4114-994d-b0bd9fae9555-metrics-certs\") pod \"network-metrics-daemon-csjmz\" (UID: \"da36f22f-e43c-4114-994d-b0bd9fae9555\") " pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:23:01.933648 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:01.933606 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 17:23:01.933648 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:01.933614 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:23:01.933648 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:01.933623 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 17:23:01.933648 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:01.933636 2549 projected.go:196] Error preparing data for projected volume kube-api-access-kblqm for pod openshift-network-diagnostics/network-check-target-bmz4p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:23:01.933856 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:01.933670 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da36f22f-e43c-4114-994d-b0bd9fae9555-metrics-certs podName:da36f22f-e43c-4114-994d-b0bd9fae9555 nodeName:}" failed. No retries permitted until 2026-07-07 17:23:17.933651318 +0000 UTC m=+34.220254427 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da36f22f-e43c-4114-994d-b0bd9fae9555-metrics-certs") pod "network-metrics-daemon-csjmz" (UID: "da36f22f-e43c-4114-994d-b0bd9fae9555") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:23:01.933856 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:01.933688 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8abb2d6-e485-457c-8fa7-96617b6362b1-kube-api-access-kblqm podName:f8abb2d6-e485-457c-8fa7-96617b6362b1 nodeName:}" failed. No retries permitted until 2026-07-07 17:23:17.933679462 +0000 UTC m=+34.220282571 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kblqm" (UniqueName: "kubernetes.io/projected/f8abb2d6-e485-457c-8fa7-96617b6362b1-kube-api-access-kblqm") pod "network-check-target-bmz4p" (UID: "f8abb2d6-e485-457c-8fa7-96617b6362b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:23:02.214112 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:02.214043 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:23:02.214268 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:02.214150 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:23:02.214268 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:02.214169 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:23:02.214268 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:02.214255 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csjmz" podUID="da36f22f-e43c-4114-994d-b0bd9fae9555" Jul 07 17:23:02.214664 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:02.214638 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmz4p" podUID="f8abb2d6-e485-457c-8fa7-96617b6362b1" Jul 07 17:23:02.214766 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:02.214685 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45k9q" podUID="77800761-9499-4c79-b3b7-f9f39131c8f9" Jul 07 17:23:02.327897 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:02.327865 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rs7tq" Jul 07 17:23:02.328865 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:02.328847 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rs7tq" Jul 07 17:23:04.214585 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:04.214551 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:23:04.215232 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:04.214647 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45k9q" podUID="77800761-9499-4c79-b3b7-f9f39131c8f9" Jul 07 17:23:04.215232 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:04.214654 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:23:04.215232 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:04.214678 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:23:04.215232 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:04.214729 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmz4p" podUID="f8abb2d6-e485-457c-8fa7-96617b6362b1" Jul 07 17:23:04.215232 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:04.214799 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csjmz" podUID="da36f22f-e43c-4114-994d-b0bd9fae9555" Jul 07 17:23:06.214497 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:06.214464 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:23:06.215152 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:06.214469 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:23:06.215152 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:06.214723 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csjmz" podUID="da36f22f-e43c-4114-994d-b0bd9fae9555" Jul 07 17:23:06.215152 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:06.214595 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmz4p" podUID="f8abb2d6-e485-457c-8fa7-96617b6362b1" Jul 07 17:23:06.215152 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:06.214779 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:23:06.215152 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:06.214852 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45k9q" podUID="77800761-9499-4c79-b3b7-f9f39131c8f9" Jul 07 17:23:07.160431 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:07.160357 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jk577_85e73679-afa9-417c-a7d5-8d8e795965b1/dns-node-resolver/0.log" Jul 07 17:23:07.402517 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:07.402320 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" event={"ID":"00383bc5-6090-486b-892b-5be74f96c497","Type":"ContainerStarted","Data":"ec33b2d7455255dc4dbf2d0acddd6b94bb8c94a983904d0442bf635b837efbd9"} Jul 07 17:23:07.403845 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:07.403818 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zrjhw" event={"ID":"d8b3a8e9-c4a1-47a6-bfb4-8c366e6d70ef","Type":"ContainerStarted","Data":"23bbbd8a6a8075af9b70d1ae5eb0b2ec8209f03da27e41b6b45576f3250f2a2f"} Jul 07 17:23:07.501135 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:07.501108 2549 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 17:23:08.138613 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:08.138359 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6qsgn_dc3322ee-9711-4997-b100-02824e125414/node-ca/0.log" Jul 07 17:23:08.151605 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:08.151477 2549 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T17:23:07.501131613Z","UUID":"6a465d7e-5d0e-4531-ad58-f32d8b2b816d","Handler":null,"Name":"","Endpoint":""} Jul 07 17:23:08.152989 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:08.152968 2549 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 17:23:08.153109 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:08.153012 2549 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 17:23:08.214443 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:08.214420 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:23:08.214585 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:08.214555 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45k9q" podUID="77800761-9499-4c79-b3b7-f9f39131c8f9" Jul 07 17:23:08.214893 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:08.214877 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:23:08.214989 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:08.214971 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmz4p" podUID="f8abb2d6-e485-457c-8fa7-96617b6362b1" Jul 07 17:23:08.215087 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:08.215070 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:23:08.215206 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:08.215138 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csjmz" podUID="da36f22f-e43c-4114-994d-b0bd9fae9555" Jul 07 17:23:08.409159 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:08.409135 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhztd_00383bc5-6090-486b-892b-5be74f96c497/ovn-acl-logging/0.log" Jul 07 17:23:08.409621 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:08.409528 2549 generic.go:356] "Generic (PLEG): container finished" podID="00383bc5-6090-486b-892b-5be74f96c497" containerID="dfc9a4cb72b06a356e29e847112ca078cf14a38b107ae9414c9287c8ee535955" exitCode=1 Jul 07 17:23:08.409621 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:08.409604 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" event={"ID":"00383bc5-6090-486b-892b-5be74f96c497","Type":"ContainerStarted","Data":"4b63e68f61ef3fa50124e3d7b02ab3afbc6b566697031f785d00c515ce797443"} Jul 07 17:23:08.409735 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:08.409689 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" event={"ID":"00383bc5-6090-486b-892b-5be74f96c497","Type":"ContainerStarted","Data":"962e3d33184c3de271901a2da34857f1add60e4d671c914be536df0d5a00301e"} Jul 07 17:23:08.409789 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:08.409741 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" event={"ID":"00383bc5-6090-486b-892b-5be74f96c497","Type":"ContainerStarted","Data":"e049a773429f165078988e458c7cb549d4510d432f0094a152e9658345231352"} Jul 07 17:23:08.409836 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:08.409789 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" event={"ID":"00383bc5-6090-486b-892b-5be74f96c497","Type":"ContainerStarted","Data":"5ab2e346cbbffd32335a741de8e843c466cc6b344d4be01f4bc3616b5c5b54fb"} Jul 07 17:23:08.409836 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:08.409828 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" event={"ID":"00383bc5-6090-486b-892b-5be74f96c497","Type":"ContainerDied","Data":"dfc9a4cb72b06a356e29e847112ca078cf14a38b107ae9414c9287c8ee535955"} Jul 07 17:23:08.411434 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:08.411409 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh" event={"ID":"184531fd-f251-4571-af57-6d53c61c316e","Type":"ContainerStarted","Data":"e2040a8299a59ea9c42ec065d8a5a322610e3e6c8ffb83066593ea4ea48f0dc8"} Jul 07 17:23:10.214416 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:10.214348 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:23:10.214416 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:10.214378 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:23:10.214923 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:10.214348 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:23:10.214923 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:10.214502 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csjmz" podUID="da36f22f-e43c-4114-994d-b0bd9fae9555" Jul 07 17:23:10.214923 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:10.214621 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmz4p" podUID="f8abb2d6-e485-457c-8fa7-96617b6362b1" Jul 07 17:23:10.214923 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:10.214712 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45k9q" podUID="77800761-9499-4c79-b3b7-f9f39131c8f9" Jul 07 17:23:10.417954 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:10.417929 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhztd_00383bc5-6090-486b-892b-5be74f96c497/ovn-acl-logging/0.log" Jul 07 17:23:10.418297 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:10.418276 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" event={"ID":"00383bc5-6090-486b-892b-5be74f96c497","Type":"ContainerStarted","Data":"3f5c5f1cb33cc1f88efb9eee1dfaa50469be8c102f5aea6edd8e5d32406f043a"} Jul 07 17:23:10.419877 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:10.419852 2549 generic.go:356] "Generic (PLEG): container finished" podID="f8880047-1dd1-462e-9fed-24e401d49df0" containerID="598c74b290543ce7fac83906c0727b1301d4913a9b487a9e249778f39e7e38df" exitCode=0 Jul 07 17:23:10.419970 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:10.419883 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6cwg" event={"ID":"f8880047-1dd1-462e-9fed-24e401d49df0","Type":"ContainerDied","Data":"598c74b290543ce7fac83906c0727b1301d4913a9b487a9e249778f39e7e38df"} Jul 07 17:23:10.457364 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:10.457329 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zrjhw" podStartSLOduration=6.564437988 podStartE2EDuration="26.457318393s" totalImagesPullingTime="19.892880405s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:23:07.449534544 +0000 UTC m=+23.736137667" watchObservedRunningTime="2026-07-07 17:23:10.457318393 +0000 UTC m=+26.743921523" Jul 07 17:23:11.424045 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:11.424008 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh" event={"ID":"184531fd-f251-4571-af57-6d53c61c316e","Type":"ContainerStarted","Data":"3a0a624dcbe81399d80bb3d9f314eb2230626805085f48653212dbeff61456ad"} Jul 07 17:23:11.444608 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:11.444566 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x5xdh" podStartSLOduration=4.603979462 podStartE2EDuration="27.444550894s" totalImagesPullingTime="22.840571432s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:22:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:23:11.443942973 +0000 UTC m=+27.730546105" watchObservedRunningTime="2026-07-07 17:23:11.444550894 +0000 UTC m=+27.731154019" Jul 07 17:23:12.214636 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:12.214618 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:23:12.214732 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:12.214617 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:23:12.214732 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:12.214711 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csjmz" podUID="da36f22f-e43c-4114-994d-b0bd9fae9555" Jul 07 17:23:12.214816 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:12.214737 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:23:12.214867 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:12.214813 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmz4p" podUID="f8abb2d6-e485-457c-8fa7-96617b6362b1" Jul 07 17:23:12.214921 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:12.214897 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45k9q" podUID="77800761-9499-4c79-b3b7-f9f39131c8f9" Jul 07 17:23:12.428349 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:12.428164 2549 generic.go:356] "Generic (PLEG): container finished" podID="f8880047-1dd1-462e-9fed-24e401d49df0" containerID="dfa4cb1cd3ebc23b153dbc8f2274916224c9a21d5af4acb1379b0a14f8a9d08c" exitCode=0 Jul 07 17:23:12.429029 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:12.428238 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6cwg" event={"ID":"f8880047-1dd1-462e-9fed-24e401d49df0","Type":"ContainerDied","Data":"dfa4cb1cd3ebc23b153dbc8f2274916224c9a21d5af4acb1379b0a14f8a9d08c"} Jul 07 17:23:12.432114 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:12.432098 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhztd_00383bc5-6090-486b-892b-5be74f96c497/ovn-acl-logging/0.log" Jul 07 17:23:12.432487 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:12.432467 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" event={"ID":"00383bc5-6090-486b-892b-5be74f96c497","Type":"ContainerStarted","Data":"6e259df317d9f87c6d02464a1359255742d0b723634c0361f1cd36dda484df7e"} Jul 07 17:23:12.432945 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:12.432924 2549 scope.go:117] "RemoveContainer" containerID="dfc9a4cb72b06a356e29e847112ca078cf14a38b107ae9414c9287c8ee535955" Jul 07 17:23:13.438137 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:13.438109 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhztd_00383bc5-6090-486b-892b-5be74f96c497/ovn-acl-logging/0.log" Jul 07 17:23:13.438524 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:13.438442 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" event={"ID":"00383bc5-6090-486b-892b-5be74f96c497","Type":"ContainerStarted","Data":"dedf17c06fa10bc7f198c3ae05c19433a6cce50cd96bd2a12f55eebad42432a4"} Jul 07 17:23:13.438746 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:13.438724 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:23:13.438868 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:13.438827 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:23:13.438924 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:13.438901 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:23:13.453748 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:13.453728 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:23:13.453948 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:13.453933 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:23:13.487473 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:13.487432 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" podStartSLOduration=9.547816878999999 podStartE2EDuration="29.487418803s" totalImagesPullingTime="19.939601924s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:23:13.486975912 +0000 UTC m=+29.773579044" watchObservedRunningTime="2026-07-07 17:23:13.487418803 +0000 UTC m=+29.774021934" Jul 07 17:23:14.115184 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:14.115123 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rs7tq" Jul 07 17:23:14.115290 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:14.115252 2549 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 17:23:14.115842 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:14.115822 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rs7tq" Jul 07 17:23:14.214631 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:14.214605 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:23:14.214707 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:14.214691 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmz4p" podUID="f8abb2d6-e485-457c-8fa7-96617b6362b1" Jul 07 17:23:14.214790 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:14.214774 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:23:14.214881 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:14.214861 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45k9q" podUID="77800761-9499-4c79-b3b7-f9f39131c8f9" Jul 07 17:23:14.214930 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:14.214918 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:23:14.215046 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:14.215029 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csjmz" podUID="da36f22f-e43c-4114-994d-b0bd9fae9555" Jul 07 17:23:14.442621 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:14.442597 2549 generic.go:356] "Generic (PLEG): container finished" podID="f8880047-1dd1-462e-9fed-24e401d49df0" containerID="81e554659315237bc578d2095b741fa26b7ccb57a2c202424ac073bb6c1f299d" exitCode=0 Jul 07 17:23:14.443031 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:14.442673 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6cwg" event={"ID":"f8880047-1dd1-462e-9fed-24e401d49df0","Type":"ContainerDied","Data":"81e554659315237bc578d2095b741fa26b7ccb57a2c202424ac073bb6c1f299d"} Jul 07 17:23:16.214148 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:16.214121 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:23:16.214148 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:16.214146 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:23:16.214778 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:16.214270 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmz4p" podUID="f8abb2d6-e485-457c-8fa7-96617b6362b1" Jul 07 17:23:16.214778 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:16.214335 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csjmz" podUID="da36f22f-e43c-4114-994d-b0bd9fae9555" Jul 07 17:23:16.214778 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:16.214358 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:23:16.214778 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:16.214468 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45k9q" podUID="77800761-9499-4c79-b3b7-f9f39131c8f9" Jul 07 17:23:17.861582 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:17.861546 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77800761-9499-4c79-b3b7-f9f39131c8f9-original-pull-secret\") pod \"global-pull-secret-syncer-45k9q\" (UID: \"77800761-9499-4c79-b3b7-f9f39131c8f9\") " pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:23:17.862136 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:17.861677 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 17:23:17.862136 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:17.861738 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77800761-9499-4c79-b3b7-f9f39131c8f9-original-pull-secret podName:77800761-9499-4c79-b3b7-f9f39131c8f9 nodeName:}" failed. No retries permitted until 2026-07-07 17:23:49.861719381 +0000 UTC m=+66.148322493 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/77800761-9499-4c79-b3b7-f9f39131c8f9-original-pull-secret") pod "global-pull-secret-syncer-45k9q" (UID: "77800761-9499-4c79-b3b7-f9f39131c8f9") : object "kube-system"/"original-pull-secret" not registered Jul 07 17:23:17.961826 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:17.961797 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kblqm\" (UniqueName: \"kubernetes.io/projected/f8abb2d6-e485-457c-8fa7-96617b6362b1-kube-api-access-kblqm\") pod \"network-check-target-bmz4p\" (UID: \"f8abb2d6-e485-457c-8fa7-96617b6362b1\") " pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:23:17.961959 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:17.961850 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da36f22f-e43c-4114-994d-b0bd9fae9555-metrics-certs\") pod \"network-metrics-daemon-csjmz\" (UID: \"da36f22f-e43c-4114-994d-b0bd9fae9555\") " pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:23:17.961959 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:17.961928 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:23:17.961959 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:17.961944 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 17:23:17.962058 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:17.961961 2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 17:23:17.962058 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:17.961971 2549 projected.go:196] Error preparing data for projected volume kube-api-access-kblqm for pod openshift-network-diagnostics/network-check-target-bmz4p: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:23:17.962058 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:17.961972 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da36f22f-e43c-4114-994d-b0bd9fae9555-metrics-certs podName:da36f22f-e43c-4114-994d-b0bd9fae9555 nodeName:}" failed. No retries permitted until 2026-07-07 17:23:49.961959046 +0000 UTC m=+66.248562155 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da36f22f-e43c-4114-994d-b0bd9fae9555-metrics-certs") pod "network-metrics-daemon-csjmz" (UID: "da36f22f-e43c-4114-994d-b0bd9fae9555") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 17:23:17.962058 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:17.962014 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8abb2d6-e485-457c-8fa7-96617b6362b1-kube-api-access-kblqm podName:f8abb2d6-e485-457c-8fa7-96617b6362b1 nodeName:}" failed. No retries permitted until 2026-07-07 17:23:49.962002569 +0000 UTC m=+66.248605678 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kblqm" (UniqueName: "kubernetes.io/projected/f8abb2d6-e485-457c-8fa7-96617b6362b1-kube-api-access-kblqm") pod "network-check-target-bmz4p" (UID: "f8abb2d6-e485-457c-8fa7-96617b6362b1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 17:23:18.214428 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:18.214397 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:23:18.214428 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:18.214408 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:23:18.214661 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:18.214487 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45k9q" podUID="77800761-9499-4c79-b3b7-f9f39131c8f9" Jul 07 17:23:18.214661 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:18.214550 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmz4p" podUID="f8abb2d6-e485-457c-8fa7-96617b6362b1" Jul 07 17:23:18.214661 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:18.214590 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:23:18.214839 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:18.214665 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csjmz" podUID="da36f22f-e43c-4114-994d-b0bd9fae9555" Jul 07 17:23:20.214613 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:20.214579 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:23:20.215047 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:20.214584 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:23:20.215047 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:20.214711 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45k9q" podUID="77800761-9499-4c79-b3b7-f9f39131c8f9" Jul 07 17:23:20.215047 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:20.214583 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:23:20.215047 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:20.214767 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csjmz" podUID="da36f22f-e43c-4114-994d-b0bd9fae9555" Jul 07 17:23:20.215047 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:20.214862 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmz4p" podUID="f8abb2d6-e485-457c-8fa7-96617b6362b1" Jul 07 17:23:21.462381 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:21.462339 2549 generic.go:356] "Generic (PLEG): container finished" podID="f8880047-1dd1-462e-9fed-24e401d49df0" containerID="84e2a9bd1ea2a6cae7a20485859e56f6e2c62945dcb4649789dced83c6f117e0" exitCode=0 Jul 07 17:23:21.462760 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:21.462385 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6cwg" event={"ID":"f8880047-1dd1-462e-9fed-24e401d49df0","Type":"ContainerDied","Data":"84e2a9bd1ea2a6cae7a20485859e56f6e2c62945dcb4649789dced83c6f117e0"} Jul 07 17:23:22.214384 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:22.214357 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:23:22.214384 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:22.214377 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:23:22.214589 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:22.214377 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:23:22.214589 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:22.214464 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csjmz" podUID="da36f22f-e43c-4114-994d-b0bd9fae9555" Jul 07 17:23:22.214676 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:22.214584 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmz4p" podUID="f8abb2d6-e485-457c-8fa7-96617b6362b1" Jul 07 17:23:22.214718 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:22.214683 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45k9q" podUID="77800761-9499-4c79-b3b7-f9f39131c8f9" Jul 07 17:23:22.467794 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:22.467736 2549 generic.go:356] "Generic (PLEG): container finished" podID="f8880047-1dd1-462e-9fed-24e401d49df0" containerID="5ae7c489b2256debd1e315b3111901161ac495cf4d07955cd5bb8038002225cf" exitCode=0 Jul 07 17:23:22.468158 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:22.467791 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6cwg" event={"ID":"f8880047-1dd1-462e-9fed-24e401d49df0","Type":"ContainerDied","Data":"5ae7c489b2256debd1e315b3111901161ac495cf4d07955cd5bb8038002225cf"} Jul 07 17:23:23.473753 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:23.473720 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n6cwg" event={"ID":"f8880047-1dd1-462e-9fed-24e401d49df0","Type":"ContainerStarted","Data":"80efd31e191b2c090d02785d12226f8639bc81ed2442de221f3c3c9c835e3f0d"} Jul 07 17:23:23.503086 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:23.503036 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-n6cwg" podStartSLOduration=10.159336366 podStartE2EDuration="39.503020965s" totalImagesPullingTime="29.343684599s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:22:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:23:23.502391378 +0000 UTC m=+39.788994509" watchObservedRunningTime="2026-07-07 17:23:23.503020965 +0000 UTC m=+39.789624095" Jul 07 17:23:24.217341 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:24.217315 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:23:24.217527 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:24.217420 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:23:24.217527 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:24.217421 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csjmz" podUID="da36f22f-e43c-4114-994d-b0bd9fae9555" Jul 07 17:23:24.217620 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:24.217526 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45k9q" podUID="77800761-9499-4c79-b3b7-f9f39131c8f9" Jul 07 17:23:24.217620 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:24.217427 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:23:24.217620 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:24.217599 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmz4p" podUID="f8abb2d6-e485-457c-8fa7-96617b6362b1" Jul 07 17:23:26.214652 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:26.214617 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:23:26.215075 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:26.214754 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:23:26.215075 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:26.214762 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csjmz" podUID="da36f22f-e43c-4114-994d-b0bd9fae9555" Jul 07 17:23:26.215075 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:26.214859 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45k9q" podUID="77800761-9499-4c79-b3b7-f9f39131c8f9" Jul 07 17:23:26.215075 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:26.214904 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:23:26.215075 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:26.214958 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmz4p" podUID="f8abb2d6-e485-457c-8fa7-96617b6362b1" Jul 07 17:23:28.214186 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:28.214136 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:23:28.214696 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:28.214137 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:23:28.214696 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:28.214260 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45k9q" podUID="77800761-9499-4c79-b3b7-f9f39131c8f9" Jul 07 17:23:28.214696 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:28.214150 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:23:28.214696 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:28.214322 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmz4p" podUID="f8abb2d6-e485-457c-8fa7-96617b6362b1" Jul 07 17:23:28.214696 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:28.214434 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csjmz" podUID="da36f22f-e43c-4114-994d-b0bd9fae9555" Jul 07 17:23:30.214719 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:30.214489 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:23:30.215167 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:30.214490 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:23:30.215167 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:30.214490 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:23:30.215167 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:30.214825 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmz4p" podUID="f8abb2d6-e485-457c-8fa7-96617b6362b1" Jul 07 17:23:30.215167 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:30.214930 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csjmz" podUID="da36f22f-e43c-4114-994d-b0bd9fae9555" Jul 07 17:23:30.215167 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:30.215036 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45k9q" podUID="77800761-9499-4c79-b3b7-f9f39131c8f9" Jul 07 17:23:32.214804 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:32.214770 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:23:32.214804 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:32.214791 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:23:32.215281 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:32.214880 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csjmz" podUID="da36f22f-e43c-4114-994d-b0bd9fae9555" Jul 07 17:23:32.215281 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:32.214968 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45k9q" podUID="77800761-9499-4c79-b3b7-f9f39131c8f9" Jul 07 17:23:32.215281 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:32.215012 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:23:32.215281 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:32.215094 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmz4p" podUID="f8abb2d6-e485-457c-8fa7-96617b6362b1" Jul 07 17:23:33.286695 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:33.286669 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-45k9q"] Jul 07 17:23:33.287143 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:33.286779 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:23:33.287143 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:33.286858 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45k9q" podUID="77800761-9499-4c79-b3b7-f9f39131c8f9" Jul 07 17:23:33.290912 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:33.290882 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bmz4p"] Jul 07 17:23:33.291018 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:33.290979 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:23:33.291096 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:33.291073 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmz4p" podUID="f8abb2d6-e485-457c-8fa7-96617b6362b1" Jul 07 17:23:33.291477 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:33.291459 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-csjmz"] Jul 07 17:23:33.291608 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:33.291563 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:23:33.291676 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:33.291645 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csjmz" podUID="da36f22f-e43c-4114-994d-b0bd9fae9555" Jul 07 17:23:35.214247 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:35.214199 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:23:35.214247 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:35.214236 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:23:35.214998 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:35.214200 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:23:35.214998 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:35.214300 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bmz4p" podUID="f8abb2d6-e485-457c-8fa7-96617b6362b1" Jul 07 17:23:35.214998 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:35.214406 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-csjmz" podUID="da36f22f-e43c-4114-994d-b0bd9fae9555" Jul 07 17:23:35.214998 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:35.214482 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45k9q" podUID="77800761-9499-4c79-b3b7-f9f39131c8f9" Jul 07 17:23:37.090074 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.090015 2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-69.ec2.internal" event="NodeReady" Jul 07 17:23:37.090380 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.090105 2549 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 17:23:37.131683 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.131657 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64b6745578-krn5m"] Jul 07 17:23:37.135133 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.135116 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b6745578-krn5m" Jul 07 17:23:37.138759 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.138736 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 17:23:37.138865 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.138773 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 17:23:37.139040 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.139024 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-m5jqz\"" Jul 07 17:23:37.139118 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.139062 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 17:23:37.144426 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.144390 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 17:23:37.145066 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.145050 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fbql5"] Jul 07 17:23:37.150154 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.150140 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fbql5" Jul 07 17:23:37.151540 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.151522 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-t88qh"] Jul 07 17:23:37.152757 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.152726 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 17:23:37.152757 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.152737 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 17:23:37.152895 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.152768 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 17:23:37.152895 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.152822 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pcwpt\"" Jul 07 17:23:37.156733 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.156713 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64b6745578-krn5m"] Jul 07 17:23:37.156849 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.156809 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t88qh" Jul 07 17:23:37.157453 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.157434 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fbql5"] Jul 07 17:23:37.159716 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.159698 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 17:23:37.159816 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.159698 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 17:23:37.159816 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.159697 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pgv6p\"" Jul 07 17:23:37.167159 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.167137 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t88qh"] Jul 07 17:23:37.208698 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.206891 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a66202a-7bf0-4977-87cd-6c477367e249-registry-tls\") pod \"image-registry-64b6745578-krn5m\" (UID: \"6a66202a-7bf0-4977-87cd-6c477367e249\") " pod="openshift-image-registry/image-registry-64b6745578-krn5m" Jul 07 17:23:37.208698 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.206934 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6a66202a-7bf0-4977-87cd-6c477367e249-installation-pull-secrets\") pod \"image-registry-64b6745578-krn5m\" (UID: \"6a66202a-7bf0-4977-87cd-6c477367e249\") " pod="openshift-image-registry/image-registry-64b6745578-krn5m" Jul 07 17:23:37.208698 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.206971 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a66202a-7bf0-4977-87cd-6c477367e249-bound-sa-token\") pod \"image-registry-64b6745578-krn5m\" (UID: \"6a66202a-7bf0-4977-87cd-6c477367e249\") " pod="openshift-image-registry/image-registry-64b6745578-krn5m" Jul 07 17:23:37.208698 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.207000 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af4ab4e6-36fa-4d42-877d-e0d9a0262cbe-tmp-dir\") pod \"dns-default-t88qh\" (UID: \"af4ab4e6-36fa-4d42-877d-e0d9a0262cbe\") " pod="openshift-dns/dns-default-t88qh" Jul 07 17:23:37.208698 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.207033 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f35b592d-681c-46b0-985a-07ffe8ad432b-cert\") pod \"ingress-canary-fbql5\" (UID: \"f35b592d-681c-46b0-985a-07ffe8ad432b\") " pod="openshift-ingress-canary/ingress-canary-fbql5" Jul 07 17:23:37.208698 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.207090 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhmbd\" (UniqueName: \"kubernetes.io/projected/af4ab4e6-36fa-4d42-877d-e0d9a0262cbe-kube-api-access-rhmbd\") pod \"dns-default-t88qh\" (UID: \"af4ab4e6-36fa-4d42-877d-e0d9a0262cbe\") " pod="openshift-dns/dns-default-t88qh" Jul 07 17:23:37.208698 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.207168 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af4ab4e6-36fa-4d42-877d-e0d9a0262cbe-metrics-tls\") pod \"dns-default-t88qh\" (UID: \"af4ab4e6-36fa-4d42-877d-e0d9a0262cbe\") " pod="openshift-dns/dns-default-t88qh" Jul 07 17:23:37.208698 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.207219 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtmxx\" (UniqueName: \"kubernetes.io/projected/f35b592d-681c-46b0-985a-07ffe8ad432b-kube-api-access-gtmxx\") pod \"ingress-canary-fbql5\" (UID: \"f35b592d-681c-46b0-985a-07ffe8ad432b\") " pod="openshift-ingress-canary/ingress-canary-fbql5" Jul 07 17:23:37.208698 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.207248 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7db4f\" (UniqueName: \"kubernetes.io/projected/6a66202a-7bf0-4977-87cd-6c477367e249-kube-api-access-7db4f\") pod \"image-registry-64b6745578-krn5m\" (UID: \"6a66202a-7bf0-4977-87cd-6c477367e249\") " pod="openshift-image-registry/image-registry-64b6745578-krn5m" Jul 07 17:23:37.208698 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.207271 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/af4ab4e6-36fa-4d42-877d-e0d9a0262cbe-config-volume\") pod \"dns-default-t88qh\" (UID: \"af4ab4e6-36fa-4d42-877d-e0d9a0262cbe\") " pod="openshift-dns/dns-default-t88qh" Jul 07 17:23:37.208698 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.207305 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6a66202a-7bf0-4977-87cd-6c477367e249-ca-trust-extracted\") pod \"image-registry-64b6745578-krn5m\" (UID: \"6a66202a-7bf0-4977-87cd-6c477367e249\") " pod="openshift-image-registry/image-registry-64b6745578-krn5m" Jul 07 17:23:37.208698 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.207333 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6a66202a-7bf0-4977-87cd-6c477367e249-registry-certificates\") pod \"image-registry-64b6745578-krn5m\" (UID: \"6a66202a-7bf0-4977-87cd-6c477367e249\") " pod="openshift-image-registry/image-registry-64b6745578-krn5m" Jul 07 17:23:37.208698 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.207367 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6a66202a-7bf0-4977-87cd-6c477367e249-image-registry-private-configuration\") pod \"image-registry-64b6745578-krn5m\" (UID: \"6a66202a-7bf0-4977-87cd-6c477367e249\") " pod="openshift-image-registry/image-registry-64b6745578-krn5m" Jul 07 17:23:37.208698 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.207418 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6a66202a-7bf0-4977-87cd-6c477367e249-trusted-ca\") pod \"image-registry-64b6745578-krn5m\" (UID: \"6a66202a-7bf0-4977-87cd-6c477367e249\") " pod="openshift-image-registry/image-registry-64b6745578-krn5m" Jul 07 17:23:37.213862 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.213843 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:23:37.213941 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.213867 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:23:37.214022 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.214011 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:23:37.216877 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.216860 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 17:23:37.217137 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.217120 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 17:23:37.217274 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.217257 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 17:23:37.217372 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.217359 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7rcfs\"" Jul 07 17:23:37.217426 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.217390 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vmhtn\"" Jul 07 17:23:37.217426 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.217361 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 17:23:37.251987 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.251966 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-csgq8"] Jul 07 17:23:37.269631 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.269603 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-csgq8"] Jul 07 17:23:37.269705 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.269673 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-csgq8" Jul 07 17:23:37.272863 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.272847 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 17:23:37.273223 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.273207 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 17:23:37.273306 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.273280 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 17:23:37.273371 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.273302 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 17:23:37.273588 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.273575 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-k2gj6\"" Jul 07 17:23:37.308119 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.308097 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6a66202a-7bf0-4977-87cd-6c477367e249-trusted-ca\") pod \"image-registry-64b6745578-krn5m\" (UID: \"6a66202a-7bf0-4977-87cd-6c477367e249\") " pod="openshift-image-registry/image-registry-64b6745578-krn5m" Jul 07 17:23:37.308201 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.308125 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a66202a-7bf0-4977-87cd-6c477367e249-registry-tls\") pod \"image-registry-64b6745578-krn5m\" (UID: \"6a66202a-7bf0-4977-87cd-6c477367e249\") " pod="openshift-image-registry/image-registry-64b6745578-krn5m" Jul 07 17:23:37.308201 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.308141 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6a66202a-7bf0-4977-87cd-6c477367e249-installation-pull-secrets\") pod \"image-registry-64b6745578-krn5m\" (UID: \"6a66202a-7bf0-4977-87cd-6c477367e249\") " pod="openshift-image-registry/image-registry-64b6745578-krn5m" Jul 07 17:23:37.308201 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.308158 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a66202a-7bf0-4977-87cd-6c477367e249-bound-sa-token\") pod \"image-registry-64b6745578-krn5m\" (UID: \"6a66202a-7bf0-4977-87cd-6c477367e249\") " pod="openshift-image-registry/image-registry-64b6745578-krn5m" Jul 07 17:23:37.308201 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.308181 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/347b071e-f42e-4c03-8320-65185889aa7a-crio-socket\") pod \"insights-runtime-extractor-csgq8\" (UID: \"347b071e-f42e-4c03-8320-65185889aa7a\") " pod="openshift-insights/insights-runtime-extractor-csgq8" Jul 07 17:23:37.308393 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.308243 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/347b071e-f42e-4c03-8320-65185889aa7a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-csgq8\" (UID: \"347b071e-f42e-4c03-8320-65185889aa7a\") " pod="openshift-insights/insights-runtime-extractor-csgq8" Jul 07 17:23:37.308393 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.308294 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af4ab4e6-36fa-4d42-877d-e0d9a0262cbe-tmp-dir\") pod \"dns-default-t88qh\" (UID: \"af4ab4e6-36fa-4d42-877d-e0d9a0262cbe\") " pod="openshift-dns/dns-default-t88qh" Jul 07 17:23:37.308393 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.308321 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f35b592d-681c-46b0-985a-07ffe8ad432b-cert\") pod \"ingress-canary-fbql5\" (UID: \"f35b592d-681c-46b0-985a-07ffe8ad432b\") " pod="openshift-ingress-canary/ingress-canary-fbql5" Jul 07 17:23:37.308393 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.308345 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhmbd\" (UniqueName: \"kubernetes.io/projected/af4ab4e6-36fa-4d42-877d-e0d9a0262cbe-kube-api-access-rhmbd\") pod \"dns-default-t88qh\" (UID: \"af4ab4e6-36fa-4d42-877d-e0d9a0262cbe\") " pod="openshift-dns/dns-default-t88qh" Jul 07 17:23:37.308393 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.308378 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/347b071e-f42e-4c03-8320-65185889aa7a-data-volume\") pod \"insights-runtime-extractor-csgq8\" (UID: \"347b071e-f42e-4c03-8320-65185889aa7a\") " pod="openshift-insights/insights-runtime-extractor-csgq8" Jul 07 17:23:37.308654 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.308405 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/347b071e-f42e-4c03-8320-65185889aa7a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-csgq8\" (UID: \"347b071e-f42e-4c03-8320-65185889aa7a\") " pod="openshift-insights/insights-runtime-extractor-csgq8" Jul 07 17:23:37.308654 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.308446 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af4ab4e6-36fa-4d42-877d-e0d9a0262cbe-metrics-tls\") pod \"dns-default-t88qh\" (UID: \"af4ab4e6-36fa-4d42-877d-e0d9a0262cbe\") " pod="openshift-dns/dns-default-t88qh" Jul 07 17:23:37.308654 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.308485 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtmxx\" (UniqueName: \"kubernetes.io/projected/f35b592d-681c-46b0-985a-07ffe8ad432b-kube-api-access-gtmxx\") pod \"ingress-canary-fbql5\" (UID: \"f35b592d-681c-46b0-985a-07ffe8ad432b\") " pod="openshift-ingress-canary/ingress-canary-fbql5" Jul 07 17:23:37.308654 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.308529 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7db4f\" (UniqueName: \"kubernetes.io/projected/6a66202a-7bf0-4977-87cd-6c477367e249-kube-api-access-7db4f\") pod \"image-registry-64b6745578-krn5m\" (UID: \"6a66202a-7bf0-4977-87cd-6c477367e249\") " pod="openshift-image-registry/image-registry-64b6745578-krn5m" Jul 07 17:23:37.308654 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.308549 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/af4ab4e6-36fa-4d42-877d-e0d9a0262cbe-config-volume\") pod \"dns-default-t88qh\" (UID: \"af4ab4e6-36fa-4d42-877d-e0d9a0262cbe\") " pod="openshift-dns/dns-default-t88qh" Jul 07 17:23:37.308654 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.308572 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tpbs\" (UniqueName: \"kubernetes.io/projected/347b071e-f42e-4c03-8320-65185889aa7a-kube-api-access-8tpbs\") pod \"insights-runtime-extractor-csgq8\" (UID: \"347b071e-f42e-4c03-8320-65185889aa7a\") " pod="openshift-insights/insights-runtime-extractor-csgq8" Jul 07 17:23:37.308654 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.308597 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6a66202a-7bf0-4977-87cd-6c477367e249-ca-trust-extracted\") pod \"image-registry-64b6745578-krn5m\" (UID: \"6a66202a-7bf0-4977-87cd-6c477367e249\") " pod="openshift-image-registry/image-registry-64b6745578-krn5m" Jul 07 17:23:37.308654 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.308617 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6a66202a-7bf0-4977-87cd-6c477367e249-registry-certificates\") pod \"image-registry-64b6745578-krn5m\" (UID: \"6a66202a-7bf0-4977-87cd-6c477367e249\") " pod="openshift-image-registry/image-registry-64b6745578-krn5m" Jul 07 17:23:37.308654 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.308644 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af4ab4e6-36fa-4d42-877d-e0d9a0262cbe-tmp-dir\") pod \"dns-default-t88qh\" (UID: \"af4ab4e6-36fa-4d42-877d-e0d9a0262cbe\") " pod="openshift-dns/dns-default-t88qh" Jul 07 17:23:37.308654 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.308656 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6a66202a-7bf0-4977-87cd-6c477367e249-image-registry-private-configuration\") pod \"image-registry-64b6745578-krn5m\" (UID: \"6a66202a-7bf0-4977-87cd-6c477367e249\") " pod="openshift-image-registry/image-registry-64b6745578-krn5m" Jul 07 17:23:37.309120 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.308991 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6a66202a-7bf0-4977-87cd-6c477367e249-ca-trust-extracted\") pod \"image-registry-64b6745578-krn5m\" (UID: \"6a66202a-7bf0-4977-87cd-6c477367e249\") " pod="openshift-image-registry/image-registry-64b6745578-krn5m" Jul 07 17:23:37.309768 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.309325 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6a66202a-7bf0-4977-87cd-6c477367e249-trusted-ca\") pod \"image-registry-64b6745578-krn5m\" (UID: \"6a66202a-7bf0-4977-87cd-6c477367e249\") " pod="openshift-image-registry/image-registry-64b6745578-krn5m" Jul 07 17:23:37.309768 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.309452 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/af4ab4e6-36fa-4d42-877d-e0d9a0262cbe-config-volume\") pod \"dns-default-t88qh\" (UID: \"af4ab4e6-36fa-4d42-877d-e0d9a0262cbe\") " pod="openshift-dns/dns-default-t88qh" Jul 07 17:23:37.310000 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.309977 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6a66202a-7bf0-4977-87cd-6c477367e249-registry-certificates\") pod \"image-registry-64b6745578-krn5m\" (UID: \"6a66202a-7bf0-4977-87cd-6c477367e249\") " pod="openshift-image-registry/image-registry-64b6745578-krn5m" Jul 07 17:23:37.312616 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.312591 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af4ab4e6-36fa-4d42-877d-e0d9a0262cbe-metrics-tls\") pod \"dns-default-t88qh\" (UID: \"af4ab4e6-36fa-4d42-877d-e0d9a0262cbe\") " pod="openshift-dns/dns-default-t88qh" Jul 07 17:23:37.312854 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.312833 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6a66202a-7bf0-4977-87cd-6c477367e249-installation-pull-secrets\") pod \"image-registry-64b6745578-krn5m\" (UID: \"6a66202a-7bf0-4977-87cd-6c477367e249\") " pod="openshift-image-registry/image-registry-64b6745578-krn5m" Jul 07 17:23:37.312929 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.312861 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6a66202a-7bf0-4977-87cd-6c477367e249-image-registry-private-configuration\") pod \"image-registry-64b6745578-krn5m\" (UID: \"6a66202a-7bf0-4977-87cd-6c477367e249\") " pod="openshift-image-registry/image-registry-64b6745578-krn5m" Jul 07 17:23:37.312929 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.312865 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f35b592d-681c-46b0-985a-07ffe8ad432b-cert\") pod \"ingress-canary-fbql5\" (UID: \"f35b592d-681c-46b0-985a-07ffe8ad432b\") " pod="openshift-ingress-canary/ingress-canary-fbql5" Jul 07 17:23:37.313064 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.313046 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6a66202a-7bf0-4977-87cd-6c477367e249-registry-tls\") pod \"image-registry-64b6745578-krn5m\" (UID: \"6a66202a-7bf0-4977-87cd-6c477367e249\") " pod="openshift-image-registry/image-registry-64b6745578-krn5m" Jul 07 17:23:37.317760 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.317732 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a66202a-7bf0-4977-87cd-6c477367e249-bound-sa-token\") pod \"image-registry-64b6745578-krn5m\" (UID: \"6a66202a-7bf0-4977-87cd-6c477367e249\") " pod="openshift-image-registry/image-registry-64b6745578-krn5m" Jul 07 17:23:37.317830 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.317801 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7db4f\" (UniqueName: \"kubernetes.io/projected/6a66202a-7bf0-4977-87cd-6c477367e249-kube-api-access-7db4f\") pod \"image-registry-64b6745578-krn5m\" (UID: \"6a66202a-7bf0-4977-87cd-6c477367e249\") " pod="openshift-image-registry/image-registry-64b6745578-krn5m" Jul 07 17:23:37.318169 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.318150 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhmbd\" (UniqueName: \"kubernetes.io/projected/af4ab4e6-36fa-4d42-877d-e0d9a0262cbe-kube-api-access-rhmbd\") pod \"dns-default-t88qh\" (UID: \"af4ab4e6-36fa-4d42-877d-e0d9a0262cbe\") " pod="openshift-dns/dns-default-t88qh" Jul 07 17:23:37.318814 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.318798 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtmxx\" (UniqueName: \"kubernetes.io/projected/f35b592d-681c-46b0-985a-07ffe8ad432b-kube-api-access-gtmxx\") pod \"ingress-canary-fbql5\" (UID: \"f35b592d-681c-46b0-985a-07ffe8ad432b\") " pod="openshift-ingress-canary/ingress-canary-fbql5" Jul 07 17:23:37.409678 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.409657 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/347b071e-f42e-4c03-8320-65185889aa7a-crio-socket\") pod \"insights-runtime-extractor-csgq8\" (UID: \"347b071e-f42e-4c03-8320-65185889aa7a\") " pod="openshift-insights/insights-runtime-extractor-csgq8" Jul 07 17:23:37.409771 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.409682 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/347b071e-f42e-4c03-8320-65185889aa7a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-csgq8\" (UID: \"347b071e-f42e-4c03-8320-65185889aa7a\") " pod="openshift-insights/insights-runtime-extractor-csgq8" Jul 07 17:23:37.409771 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.409705 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/347b071e-f42e-4c03-8320-65185889aa7a-data-volume\") pod \"insights-runtime-extractor-csgq8\" (UID: \"347b071e-f42e-4c03-8320-65185889aa7a\") " pod="openshift-insights/insights-runtime-extractor-csgq8" Jul 07 17:23:37.409771 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.409719 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/347b071e-f42e-4c03-8320-65185889aa7a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-csgq8\" (UID: \"347b071e-f42e-4c03-8320-65185889aa7a\") " pod="openshift-insights/insights-runtime-extractor-csgq8" Jul 07 17:23:37.409903 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.409860 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/347b071e-f42e-4c03-8320-65185889aa7a-crio-socket\") pod \"insights-runtime-extractor-csgq8\" (UID: \"347b071e-f42e-4c03-8320-65185889aa7a\") " pod="openshift-insights/insights-runtime-extractor-csgq8" Jul 07 17:23:37.409903 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.409881 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tpbs\" (UniqueName: \"kubernetes.io/projected/347b071e-f42e-4c03-8320-65185889aa7a-kube-api-access-8tpbs\") pod \"insights-runtime-extractor-csgq8\" (UID: \"347b071e-f42e-4c03-8320-65185889aa7a\") " pod="openshift-insights/insights-runtime-extractor-csgq8" Jul 07 17:23:37.410062 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.410043 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/347b071e-f42e-4c03-8320-65185889aa7a-data-volume\") pod \"insights-runtime-extractor-csgq8\" (UID: \"347b071e-f42e-4c03-8320-65185889aa7a\") " pod="openshift-insights/insights-runtime-extractor-csgq8" Jul 07 17:23:37.410190 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.410174 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/347b071e-f42e-4c03-8320-65185889aa7a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-csgq8\" (UID: \"347b071e-f42e-4c03-8320-65185889aa7a\") " pod="openshift-insights/insights-runtime-extractor-csgq8" Jul 07 17:23:37.411923 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.411905 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/347b071e-f42e-4c03-8320-65185889aa7a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-csgq8\" (UID: \"347b071e-f42e-4c03-8320-65185889aa7a\") " pod="openshift-insights/insights-runtime-extractor-csgq8" Jul 07 17:23:37.419269 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.419254 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tpbs\" (UniqueName: \"kubernetes.io/projected/347b071e-f42e-4c03-8320-65185889aa7a-kube-api-access-8tpbs\") pod \"insights-runtime-extractor-csgq8\" (UID: \"347b071e-f42e-4c03-8320-65185889aa7a\") " pod="openshift-insights/insights-runtime-extractor-csgq8" Jul 07 17:23:37.446256 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.446238 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b6745578-krn5m" Jul 07 17:23:37.459363 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.459344 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fbql5" Jul 07 17:23:37.466246 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.466232 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t88qh" Jul 07 17:23:37.578160 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.577929 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-csgq8" Jul 07 17:23:37.640893 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.640744 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t88qh"] Jul 07 17:23:37.643630 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.643566 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fbql5"] Jul 07 17:23:37.644782 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:23:37.644759 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf4ab4e6_36fa_4d42_877d_e0d9a0262cbe.slice/crio-4a0abbdf4b9de67bd5cd9931139093a0f67c5a31ff957144b0b9e5e763264607 WatchSource:0}: Error finding container 4a0abbdf4b9de67bd5cd9931139093a0f67c5a31ff957144b0b9e5e763264607: Status 404 returned error can't find the container with id 4a0abbdf4b9de67bd5cd9931139093a0f67c5a31ff957144b0b9e5e763264607 Jul 07 17:23:37.649008 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:23:37.647647 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf35b592d_681c_46b0_985a_07ffe8ad432b.slice/crio-43b35bca832c911977d5522daee70b67137e35440d7df6c5a1e9e85d32e2e1dd WatchSource:0}: Error finding container 43b35bca832c911977d5522daee70b67137e35440d7df6c5a1e9e85d32e2e1dd: Status 404 returned error can't find the container with id 43b35bca832c911977d5522daee70b67137e35440d7df6c5a1e9e85d32e2e1dd Jul 07 17:23:37.651158 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.651138 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64b6745578-krn5m"] Jul 07 17:23:37.654168 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:23:37.654147 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a66202a_7bf0_4977_87cd_6c477367e249.slice/crio-3de78d98d9dd2a8a80ef446271649341c73a3319cd195f9e31fd75a23b20d426 WatchSource:0}: Error finding container 3de78d98d9dd2a8a80ef446271649341c73a3319cd195f9e31fd75a23b20d426: Status 404 returned error can't find the container with id 3de78d98d9dd2a8a80ef446271649341c73a3319cd195f9e31fd75a23b20d426 Jul 07 17:23:37.738317 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:37.738288 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-csgq8"] Jul 07 17:23:37.742154 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:23:37.742122 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod347b071e_f42e_4c03_8320_65185889aa7a.slice/crio-72d4e5fac415983158e9904c16720ad4f3c70ddb5043a4bce19840c3dd733bc4 WatchSource:0}: Error finding container 72d4e5fac415983158e9904c16720ad4f3c70ddb5043a4bce19840c3dd733bc4: Status 404 returned error can't find the container with id 72d4e5fac415983158e9904c16720ad4f3c70ddb5043a4bce19840c3dd733bc4 Jul 07 17:23:38.512688 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:38.512418 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fbql5" event={"ID":"f35b592d-681c-46b0-985a-07ffe8ad432b","Type":"ContainerStarted","Data":"43b35bca832c911977d5522daee70b67137e35440d7df6c5a1e9e85d32e2e1dd"} Jul 07 17:23:38.514462 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:38.514318 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-csgq8" event={"ID":"347b071e-f42e-4c03-8320-65185889aa7a","Type":"ContainerStarted","Data":"72d4e5fac415983158e9904c16720ad4f3c70ddb5043a4bce19840c3dd733bc4"} Jul 07 17:23:38.519671 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:38.519499 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64b6745578-krn5m" event={"ID":"6a66202a-7bf0-4977-87cd-6c477367e249","Type":"ContainerStarted","Data":"6e482e7621c0262d32e724800def07df30d458b29f6a505f4b98f67ddc31e2c7"} Jul 07 17:23:38.519671 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:38.519648 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64b6745578-krn5m" event={"ID":"6a66202a-7bf0-4977-87cd-6c477367e249","Type":"ContainerStarted","Data":"3de78d98d9dd2a8a80ef446271649341c73a3319cd195f9e31fd75a23b20d426"} Jul 07 17:23:38.519840 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:38.519726 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64b6745578-krn5m" Jul 07 17:23:38.523070 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:38.523047 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t88qh" event={"ID":"af4ab4e6-36fa-4d42-877d-e0d9a0262cbe","Type":"ContainerStarted","Data":"4a0abbdf4b9de67bd5cd9931139093a0f67c5a31ff957144b0b9e5e763264607"} Jul 07 17:23:38.552735 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:38.552192 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64b6745578-krn5m" podStartSLOduration=7.552172351 podStartE2EDuration="7.552172351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:23:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:23:38.546886679 +0000 UTC m=+54.833489810" watchObservedRunningTime="2026-07-07 17:23:38.552172351 +0000 UTC m=+54.838775483" Jul 07 17:23:42.411950 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:42.411918 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-92gws"] Jul 07 17:23:42.418903 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:42.418881 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-92gws" Jul 07 17:23:42.422209 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:42.422185 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 07 17:23:42.422531 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:42.422479 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-l57s5\"" Jul 07 17:23:42.423636 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:42.423613 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 17:23:42.423846 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:42.423676 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 07 17:23:42.423846 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:42.423686 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 17:23:42.423846 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:42.423722 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 17:23:42.426328 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:42.426269 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-92gws"] Jul 07 17:23:42.451701 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:42.451674 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ed05cf1-7704-4308-a8db-08cb0b9d6ec4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-92gws\" (UID: \"4ed05cf1-7704-4308-a8db-08cb0b9d6ec4\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-92gws" Jul 07 17:23:42.451813 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:42.451716 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6845\" (UniqueName: \"kubernetes.io/projected/4ed05cf1-7704-4308-a8db-08cb0b9d6ec4-kube-api-access-j6845\") pod \"prometheus-operator-567f7b8b7c-92gws\" (UID: \"4ed05cf1-7704-4308-a8db-08cb0b9d6ec4\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-92gws" Jul 07 17:23:42.451813 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:42.451792 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ed05cf1-7704-4308-a8db-08cb0b9d6ec4-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-92gws\" (UID: \"4ed05cf1-7704-4308-a8db-08cb0b9d6ec4\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-92gws" Jul 07 17:23:42.451926 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:42.451834 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ed05cf1-7704-4308-a8db-08cb0b9d6ec4-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-92gws\" (UID: \"4ed05cf1-7704-4308-a8db-08cb0b9d6ec4\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-92gws" Jul 07 17:23:42.552916 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:42.552882 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ed05cf1-7704-4308-a8db-08cb0b9d6ec4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-92gws\" (UID: \"4ed05cf1-7704-4308-a8db-08cb0b9d6ec4\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-92gws" Jul 07 17:23:42.553040 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:42.552926 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6845\" (UniqueName: \"kubernetes.io/projected/4ed05cf1-7704-4308-a8db-08cb0b9d6ec4-kube-api-access-j6845\") pod \"prometheus-operator-567f7b8b7c-92gws\" (UID: \"4ed05cf1-7704-4308-a8db-08cb0b9d6ec4\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-92gws" Jul 07 17:23:42.553040 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:42.552991 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ed05cf1-7704-4308-a8db-08cb0b9d6ec4-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-92gws\" (UID: \"4ed05cf1-7704-4308-a8db-08cb0b9d6ec4\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-92gws" Jul 07 17:23:42.553147 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:42.553048 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ed05cf1-7704-4308-a8db-08cb0b9d6ec4-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-92gws\" (UID: \"4ed05cf1-7704-4308-a8db-08cb0b9d6ec4\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-92gws" Jul 07 17:23:42.554307 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:42.554273 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ed05cf1-7704-4308-a8db-08cb0b9d6ec4-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-92gws\" (UID: \"4ed05cf1-7704-4308-a8db-08cb0b9d6ec4\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-92gws" Jul 07 17:23:42.557341 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:42.557320 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4ed05cf1-7704-4308-a8db-08cb0b9d6ec4-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-92gws\" (UID: \"4ed05cf1-7704-4308-a8db-08cb0b9d6ec4\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-92gws" Jul 07 17:23:42.557432 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:42.557340 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ed05cf1-7704-4308-a8db-08cb0b9d6ec4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-92gws\" (UID: \"4ed05cf1-7704-4308-a8db-08cb0b9d6ec4\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-92gws" Jul 07 17:23:42.563569 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:42.563542 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6845\" (UniqueName: \"kubernetes.io/projected/4ed05cf1-7704-4308-a8db-08cb0b9d6ec4-kube-api-access-j6845\") pod \"prometheus-operator-567f7b8b7c-92gws\" (UID: \"4ed05cf1-7704-4308-a8db-08cb0b9d6ec4\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-92gws" Jul 07 17:23:42.731010 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:42.730939 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-92gws" Jul 07 17:23:43.134402 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:43.134372 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-92gws"] Jul 07 17:23:43.538126 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:43.538041 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-csgq8" event={"ID":"347b071e-f42e-4c03-8320-65185889aa7a","Type":"ContainerStarted","Data":"c19c93abb36787ef165e2b7709723369e107de9568122fc8810473efc623be1c"} Jul 07 17:23:43.539833 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:43.539807 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t88qh" event={"ID":"af4ab4e6-36fa-4d42-877d-e0d9a0262cbe","Type":"ContainerStarted","Data":"e049347c8eb65c1ff7dd64c02c2e4008ea356f31f8eb15069a45d04e3ddf5b5a"} Jul 07 17:23:43.539961 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:43.539855 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t88qh" event={"ID":"af4ab4e6-36fa-4d42-877d-e0d9a0262cbe","Type":"ContainerStarted","Data":"75268abf5fd8d582fcf03ec3e8a426caf43385298d2fa50441998bb19564f61d"} Jul 07 17:23:43.539961 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:43.539949 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-t88qh" Jul 07 17:23:43.541290 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:43.541269 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fbql5" event={"ID":"f35b592d-681c-46b0-985a-07ffe8ad432b","Type":"ContainerStarted","Data":"0653e68c326627f869a7a602329869cfae49c5e9cff35112f9e15970f5454d29"} Jul 07 17:23:43.542486 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:43.542467 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-92gws" event={"ID":"4ed05cf1-7704-4308-a8db-08cb0b9d6ec4","Type":"ContainerStarted","Data":"c1c4e2b1d84a3ac31c564ca10a26575d36d85f658da39381d3b1a8b3a7025d64"} Jul 07 17:23:43.563900 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:43.563851 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-t88qh" podStartSLOduration=1.236903508 podStartE2EDuration="6.563833742s" totalImagesPullingTime="5.326930234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:23:43.563267909 +0000 UTC m=+59.849871041" watchObservedRunningTime="2026-07-07 17:23:43.563833742 +0000 UTC m=+59.850436875" Jul 07 17:23:43.582757 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:43.582713 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fbql5" podStartSLOduration=1.25942254 podStartE2EDuration="6.582696773s" totalImagesPullingTime="5.323274233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:23:43.581739931 +0000 UTC m=+59.868343063" watchObservedRunningTime="2026-07-07 17:23:43.582696773 +0000 UTC m=+59.869299905" Jul 07 17:23:44.549705 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:44.549668 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-csgq8" event={"ID":"347b071e-f42e-4c03-8320-65185889aa7a","Type":"ContainerStarted","Data":"e16648f935f83d88b27ce646e6d8738bb551389259d7a3e9e676291da9e35c62"} Jul 07 17:23:45.456867 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:45.456839 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhztd" Jul 07 17:23:45.559380 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:45.558830 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-92gws" event={"ID":"4ed05cf1-7704-4308-a8db-08cb0b9d6ec4","Type":"ContainerStarted","Data":"d1cce36a1f787e6327256ee5c6e9dc8f854f16eada0ae69424837d4e770ecafb"} Jul 07 17:23:45.559380 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:45.558935 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-92gws" event={"ID":"4ed05cf1-7704-4308-a8db-08cb0b9d6ec4","Type":"ContainerStarted","Data":"e74796df02f6861f8ed57cf6c085e7cec72970fff5503c7bcea43421b155b91c"} Jul 07 17:23:45.585743 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:45.585691 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-92gws" podStartSLOduration=1.7481843700000002 podStartE2EDuration="3.585671154s" totalImagesPullingTime="1.837486784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:23:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:23:45.584713589 +0000 UTC m=+61.871316720" watchObservedRunningTime="2026-07-07 17:23:45.585671154 +0000 UTC m=+61.872274289" Jul 07 17:23:46.564422 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:46.564346 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-csgq8" event={"ID":"347b071e-f42e-4c03-8320-65185889aa7a","Type":"ContainerStarted","Data":"715d6f8f3949e764498ef81fee3dcc925058c283531691a978fa928c71ef47ab"} Jul 07 17:23:46.589654 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:46.589607 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-csgq8" podStartSLOduration=1.20230734 podStartE2EDuration="9.589589412s" totalImagesPullingTime="8.387282072s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:23:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:23:46.589172488 +0000 UTC m=+62.875775620" watchObservedRunningTime="2026-07-07 17:23:46.589589412 +0000 UTC m=+62.876192542" Jul 07 17:23:47.825958 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.825930 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hwdfn"] Jul 07 17:23:47.827982 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.827966 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:47.830762 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.830740 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 17:23:47.830913 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.830767 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 17:23:47.831028 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.830997 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 17:23:47.831277 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.831261 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-chml4\"" Jul 07 17:23:47.894287 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.894262 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc268fef-45f8-4525-b0c5-6c68da072c13-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hwdfn\" (UID: \"fc268fef-45f8-4525-b0c5-6c68da072c13\") " pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:47.894377 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.894301 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fc268fef-45f8-4525-b0c5-6c68da072c13-node-exporter-accelerators-collector-config\") pod \"node-exporter-hwdfn\" (UID: \"fc268fef-45f8-4525-b0c5-6c68da072c13\") " pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:47.894377 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.894347 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbw7k\" (UniqueName: \"kubernetes.io/projected/fc268fef-45f8-4525-b0c5-6c68da072c13-kube-api-access-tbw7k\") pod \"node-exporter-hwdfn\" (UID: \"fc268fef-45f8-4525-b0c5-6c68da072c13\") " pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:47.894377 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.894373 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fc268fef-45f8-4525-b0c5-6c68da072c13-root\") pod \"node-exporter-hwdfn\" (UID: \"fc268fef-45f8-4525-b0c5-6c68da072c13\") " pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:47.894478 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.894397 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fc268fef-45f8-4525-b0c5-6c68da072c13-node-exporter-textfile\") pod \"node-exporter-hwdfn\" (UID: \"fc268fef-45f8-4525-b0c5-6c68da072c13\") " pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:47.894478 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.894412 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc268fef-45f8-4525-b0c5-6c68da072c13-metrics-client-ca\") pod \"node-exporter-hwdfn\" (UID: \"fc268fef-45f8-4525-b0c5-6c68da072c13\") " pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:47.894603 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.894500 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc268fef-45f8-4525-b0c5-6c68da072c13-node-exporter-tls\") pod \"node-exporter-hwdfn\" (UID: \"fc268fef-45f8-4525-b0c5-6c68da072c13\") " pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:47.894603 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.894546 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fc268fef-45f8-4525-b0c5-6c68da072c13-node-exporter-wtmp\") pod \"node-exporter-hwdfn\" (UID: \"fc268fef-45f8-4525-b0c5-6c68da072c13\") " pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:47.894603 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.894568 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc268fef-45f8-4525-b0c5-6c68da072c13-sys\") pod \"node-exporter-hwdfn\" (UID: \"fc268fef-45f8-4525-b0c5-6c68da072c13\") " pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:47.995678 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.995657 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc268fef-45f8-4525-b0c5-6c68da072c13-node-exporter-tls\") pod \"node-exporter-hwdfn\" (UID: \"fc268fef-45f8-4525-b0c5-6c68da072c13\") " pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:47.995775 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.995681 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fc268fef-45f8-4525-b0c5-6c68da072c13-node-exporter-wtmp\") pod \"node-exporter-hwdfn\" (UID: \"fc268fef-45f8-4525-b0c5-6c68da072c13\") " pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:47.995775 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.995701 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc268fef-45f8-4525-b0c5-6c68da072c13-sys\") pod \"node-exporter-hwdfn\" (UID: \"fc268fef-45f8-4525-b0c5-6c68da072c13\") " pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:47.995775 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.995737 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc268fef-45f8-4525-b0c5-6c68da072c13-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hwdfn\" (UID: \"fc268fef-45f8-4525-b0c5-6c68da072c13\") " pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:47.995908 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.995771 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fc268fef-45f8-4525-b0c5-6c68da072c13-node-exporter-accelerators-collector-config\") pod \"node-exporter-hwdfn\" (UID: \"fc268fef-45f8-4525-b0c5-6c68da072c13\") " pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:47.995908 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.995785 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc268fef-45f8-4525-b0c5-6c68da072c13-sys\") pod \"node-exporter-hwdfn\" (UID: \"fc268fef-45f8-4525-b0c5-6c68da072c13\") " pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:47.995908 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.995825 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbw7k\" (UniqueName: \"kubernetes.io/projected/fc268fef-45f8-4525-b0c5-6c68da072c13-kube-api-access-tbw7k\") pod \"node-exporter-hwdfn\" (UID: \"fc268fef-45f8-4525-b0c5-6c68da072c13\") " pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:47.995908 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.995840 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fc268fef-45f8-4525-b0c5-6c68da072c13-node-exporter-wtmp\") pod \"node-exporter-hwdfn\" (UID: \"fc268fef-45f8-4525-b0c5-6c68da072c13\") " pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:47.995908 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.995848 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fc268fef-45f8-4525-b0c5-6c68da072c13-root\") pod \"node-exporter-hwdfn\" (UID: \"fc268fef-45f8-4525-b0c5-6c68da072c13\") " pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:47.995908 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.995878 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fc268fef-45f8-4525-b0c5-6c68da072c13-node-exporter-textfile\") pod \"node-exporter-hwdfn\" (UID: \"fc268fef-45f8-4525-b0c5-6c68da072c13\") " pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:47.995908 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.995893 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc268fef-45f8-4525-b0c5-6c68da072c13-metrics-client-ca\") pod \"node-exporter-hwdfn\" (UID: \"fc268fef-45f8-4525-b0c5-6c68da072c13\") " pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:47.996239 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.995974 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fc268fef-45f8-4525-b0c5-6c68da072c13-root\") pod \"node-exporter-hwdfn\" (UID: \"fc268fef-45f8-4525-b0c5-6c68da072c13\") " pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:47.996300 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.996279 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fc268fef-45f8-4525-b0c5-6c68da072c13-node-exporter-textfile\") pod \"node-exporter-hwdfn\" (UID: \"fc268fef-45f8-4525-b0c5-6c68da072c13\") " pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:47.996431 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.996410 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc268fef-45f8-4525-b0c5-6c68da072c13-metrics-client-ca\") pod \"node-exporter-hwdfn\" (UID: \"fc268fef-45f8-4525-b0c5-6c68da072c13\") " pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:47.996682 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.996413 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fc268fef-45f8-4525-b0c5-6c68da072c13-node-exporter-accelerators-collector-config\") pod \"node-exporter-hwdfn\" (UID: \"fc268fef-45f8-4525-b0c5-6c68da072c13\") " pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:47.998179 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.998157 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc268fef-45f8-4525-b0c5-6c68da072c13-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hwdfn\" (UID: \"fc268fef-45f8-4525-b0c5-6c68da072c13\") " pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:47.998429 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:47.998410 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fc268fef-45f8-4525-b0c5-6c68da072c13-node-exporter-tls\") pod \"node-exporter-hwdfn\" (UID: \"fc268fef-45f8-4525-b0c5-6c68da072c13\") " pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:48.008938 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:48.008918 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbw7k\" (UniqueName: \"kubernetes.io/projected/fc268fef-45f8-4525-b0c5-6c68da072c13-kube-api-access-tbw7k\") pod \"node-exporter-hwdfn\" (UID: \"fc268fef-45f8-4525-b0c5-6c68da072c13\") " pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:48.136489 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:48.136438 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hwdfn" Jul 07 17:23:48.146349 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:23:48.146312 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc268fef_45f8_4525_b0c5_6c68da072c13.slice/crio-1b5872e5ea27ecafa1bf624e51833d29885b04f10c8949cf441cd01490917c3f WatchSource:0}: Error finding container 1b5872e5ea27ecafa1bf624e51833d29885b04f10c8949cf441cd01490917c3f: Status 404 returned error can't find the container with id 1b5872e5ea27ecafa1bf624e51833d29885b04f10c8949cf441cd01490917c3f Jul 07 17:23:48.575259 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:48.575224 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hwdfn" event={"ID":"fc268fef-45f8-4525-b0c5-6c68da072c13","Type":"ContainerStarted","Data":"1b5872e5ea27ecafa1bf624e51833d29885b04f10c8949cf441cd01490917c3f"} Jul 07 17:23:48.931636 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:48.930188 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 17:23:48.935047 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:48.935023 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:48.939554 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:48.939537 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 17:23:48.939889 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:48.939869 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 17:23:48.939889 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:48.939880 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 17:23:48.940033 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:48.939916 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 17:23:48.940033 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:48.939880 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 17:23:48.940574 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:48.940553 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 17:23:48.941449 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:48.941426 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 17:23:48.941572 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:48.941449 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 17:23:48.941572 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:48.941490 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 17:23:48.941572 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:48.941524 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-l8wv5\"" Jul 07 17:23:48.961924 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:48.961900 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 17:23:49.002339 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.002304 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.002464 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.002352 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.002464 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.002385 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spbp7\" (UniqueName: \"kubernetes.io/projected/4512f419-ceed-415c-b02e-c61116bbeac9-kube-api-access-spbp7\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.002464 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.002423 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4512f419-ceed-415c-b02e-c61116bbeac9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.002660 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.002549 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.002660 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.002576 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.002660 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.002601 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4512f419-ceed-415c-b02e-c61116bbeac9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.002660 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.002624 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4512f419-ceed-415c-b02e-c61116bbeac9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.002825 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.002666 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-web-config\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.002825 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.002709 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4512f419-ceed-415c-b02e-c61116bbeac9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.002825 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.002738 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-config-volume\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.002825 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.002752 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4512f419-ceed-415c-b02e-c61116bbeac9-config-out\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.002978 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.002830 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.103561 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.103532 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.103716 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.103569 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.103716 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.103594 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4512f419-ceed-415c-b02e-c61116bbeac9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.103716 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.103614 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4512f419-ceed-415c-b02e-c61116bbeac9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.103716 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.103652 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-web-config\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.103716 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.103681 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4512f419-ceed-415c-b02e-c61116bbeac9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.103716 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.103712 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-config-volume\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.103993 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.103734 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4512f419-ceed-415c-b02e-c61116bbeac9-config-out\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.103993 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.103778 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.103993 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.103815 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.103993 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.103853 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.103993 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.103880 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spbp7\" (UniqueName: \"kubernetes.io/projected/4512f419-ceed-415c-b02e-c61116bbeac9-kube-api-access-spbp7\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.103993 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.103924 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4512f419-ceed-415c-b02e-c61116bbeac9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.104278 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.104022 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4512f419-ceed-415c-b02e-c61116bbeac9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.106740 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:23:49.105410 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4512f419-ceed-415c-b02e-c61116bbeac9-alertmanager-trusted-ca-bundle podName:4512f419-ceed-415c-b02e-c61116bbeac9 nodeName:}" failed. No retries permitted until 2026-07-07 17:23:49.605309602 +0000 UTC m=+65.891912714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/4512f419-ceed-415c-b02e-c61116bbeac9-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "4512f419-ceed-415c-b02e-c61116bbeac9") : configmap references non-existent config key: ca-bundle.crt Jul 07 17:23:49.106740 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.106391 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4512f419-ceed-415c-b02e-c61116bbeac9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.106740 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.106604 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.107343 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.107317 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4512f419-ceed-415c-b02e-c61116bbeac9-config-out\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.107529 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.107486 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.107904 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.107879 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.108883 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.108859 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.108983 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.108862 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-config-volume\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.109080 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.109061 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4512f419-ceed-415c-b02e-c61116bbeac9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.109278 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.109261 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.110063 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.110043 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-web-config\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.118567 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.118538 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spbp7\" (UniqueName: \"kubernetes.io/projected/4512f419-ceed-415c-b02e-c61116bbeac9-kube-api-access-spbp7\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.580107 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.580040 2549 generic.go:356] "Generic (PLEG): container finished" podID="fc268fef-45f8-4525-b0c5-6c68da072c13" containerID="574dd1cd4eaafdf4a2456971853d7c02c60f75d5ed6ca61351044bea9d88ecf2" exitCode=0 Jul 07 17:23:49.580222 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.580129 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hwdfn" event={"ID":"fc268fef-45f8-4525-b0c5-6c68da072c13","Type":"ContainerDied","Data":"574dd1cd4eaafdf4a2456971853d7c02c60f75d5ed6ca61351044bea9d88ecf2"} Jul 07 17:23:49.608028 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.607997 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4512f419-ceed-415c-b02e-c61116bbeac9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.608804 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.608780 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4512f419-ceed-415c-b02e-c61116bbeac9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.844959 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.844893 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:23:49.909917 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.909888 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77800761-9499-4c79-b3b7-f9f39131c8f9-original-pull-secret\") pod \"global-pull-secret-syncer-45k9q\" (UID: \"77800761-9499-4c79-b3b7-f9f39131c8f9\") " pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:23:49.913668 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.913650 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 17:23:49.922727 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.922707 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77800761-9499-4c79-b3b7-f9f39131c8f9-original-pull-secret\") pod \"global-pull-secret-syncer-45k9q\" (UID: \"77800761-9499-4c79-b3b7-f9f39131c8f9\") " pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:23:49.993088 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:49.993058 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 17:23:49.997158 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:23:49.997134 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4512f419_ceed_415c_b02e_c61116bbeac9.slice/crio-83f73e0e60d8c9fd6cbff79b04f5ed56539f9ce5b9a37b7713c848cda24de81e WatchSource:0}: Error finding container 83f73e0e60d8c9fd6cbff79b04f5ed56539f9ce5b9a37b7713c848cda24de81e: Status 404 returned error can't find the container with id 83f73e0e60d8c9fd6cbff79b04f5ed56539f9ce5b9a37b7713c848cda24de81e Jul 07 17:23:50.011290 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:50.011265 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da36f22f-e43c-4114-994d-b0bd9fae9555-metrics-certs\") pod \"network-metrics-daemon-csjmz\" (UID: \"da36f22f-e43c-4114-994d-b0bd9fae9555\") " pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:23:50.011366 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:50.011325 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kblqm\" (UniqueName: \"kubernetes.io/projected/f8abb2d6-e485-457c-8fa7-96617b6362b1-kube-api-access-kblqm\") pod \"network-check-target-bmz4p\" (UID: \"f8abb2d6-e485-457c-8fa7-96617b6362b1\") " pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:23:50.014341 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:50.014322 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 17:23:50.014430 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:50.014353 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 17:23:50.023917 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:50.023896 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da36f22f-e43c-4114-994d-b0bd9fae9555-metrics-certs\") pod \"network-metrics-daemon-csjmz\" (UID: \"da36f22f-e43c-4114-994d-b0bd9fae9555\") " pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:23:50.026213 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:50.026193 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 17:23:50.034783 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:50.034763 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kblqm\" (UniqueName: \"kubernetes.io/projected/f8abb2d6-e485-457c-8fa7-96617b6362b1-kube-api-access-kblqm\") pod \"network-check-target-bmz4p\" (UID: \"f8abb2d6-e485-457c-8fa7-96617b6362b1\") " pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:23:50.122700 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:50.122651 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45k9q" Jul 07 17:23:50.131701 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:50.131681 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vmhtn\"" Jul 07 17:23:50.135273 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:50.135257 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7rcfs\"" Jul 07 17:23:50.139678 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:50.139647 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:23:50.142952 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:50.142937 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-csjmz" Jul 07 17:23:50.267367 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:50.267338 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-45k9q"] Jul 07 17:23:50.271396 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:23:50.271362 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77800761_9499_4c79_b3b7_f9f39131c8f9.slice/crio-025c4e331b861cba074db94a70c98825a120149ec7ab37c1d6b20d5adb71f9d2 WatchSource:0}: Error finding container 025c4e331b861cba074db94a70c98825a120149ec7ab37c1d6b20d5adb71f9d2: Status 404 returned error can't find the container with id 025c4e331b861cba074db94a70c98825a120149ec7ab37c1d6b20d5adb71f9d2 Jul 07 17:23:50.288314 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:50.288269 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-csjmz"] Jul 07 17:23:50.290862 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:23:50.290841 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda36f22f_e43c_4114_994d_b0bd9fae9555.slice/crio-789e01c8183568d69927612fc5733b803ac4d8074d6a319b222fdcfc1de27ea6 WatchSource:0}: Error finding container 789e01c8183568d69927612fc5733b803ac4d8074d6a319b222fdcfc1de27ea6: Status 404 returned error can't find the container with id 789e01c8183568d69927612fc5733b803ac4d8074d6a319b222fdcfc1de27ea6 Jul 07 17:23:50.306972 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:50.306954 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bmz4p"] Jul 07 17:23:50.309592 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:23:50.309573 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8abb2d6_e485_457c_8fa7_96617b6362b1.slice/crio-af351eff9c2d41db150f645e5f36e62504d1e56903f4119d17df6cb0dccf38fe WatchSource:0}: Error finding container af351eff9c2d41db150f645e5f36e62504d1e56903f4119d17df6cb0dccf38fe: Status 404 returned error can't find the container with id af351eff9c2d41db150f645e5f36e62504d1e56903f4119d17df6cb0dccf38fe Jul 07 17:23:50.584700 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:50.584664 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-45k9q" event={"ID":"77800761-9499-4c79-b3b7-f9f39131c8f9","Type":"ContainerStarted","Data":"025c4e331b861cba074db94a70c98825a120149ec7ab37c1d6b20d5adb71f9d2"} Jul 07 17:23:50.585978 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:50.585944 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4512f419-ceed-415c-b02e-c61116bbeac9","Type":"ContainerStarted","Data":"83f73e0e60d8c9fd6cbff79b04f5ed56539f9ce5b9a37b7713c848cda24de81e"} Jul 07 17:23:50.588315 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:50.588283 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hwdfn" event={"ID":"fc268fef-45f8-4525-b0c5-6c68da072c13","Type":"ContainerStarted","Data":"ec208a6a5af43bbea7b64d5867492624f4d296d6f4b6c53c9f6fb6195ccbc137"} Jul 07 17:23:50.588430 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:50.588338 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hwdfn" event={"ID":"fc268fef-45f8-4525-b0c5-6c68da072c13","Type":"ContainerStarted","Data":"9b6ed8c006667892ade4b885def81191612f66bc55e237c19adb1751153ba098"} Jul 07 17:23:50.589523 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:50.589479 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-csjmz" event={"ID":"da36f22f-e43c-4114-994d-b0bd9fae9555","Type":"ContainerStarted","Data":"789e01c8183568d69927612fc5733b803ac4d8074d6a319b222fdcfc1de27ea6"} Jul 07 17:23:50.590629 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:50.590606 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bmz4p" event={"ID":"f8abb2d6-e485-457c-8fa7-96617b6362b1","Type":"ContainerStarted","Data":"af351eff9c2d41db150f645e5f36e62504d1e56903f4119d17df6cb0dccf38fe"} Jul 07 17:23:50.609926 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:50.609886 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hwdfn" podStartSLOduration=2.392090803 podStartE2EDuration="3.609872065s" totalImagesPullingTime="1.148434539s" totalInitContainerRuntime="69.346723ms" isStatefulPod=true podCreationTimestamp="2026-07-07 17:23:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:23:50.608691017 +0000 UTC m=+66.895294147" watchObservedRunningTime="2026-07-07 17:23:50.609872065 +0000 UTC m=+66.896475195" Jul 07 17:23:52.224403 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.224366 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-b7568f448-hblx2"] Jul 07 17:23:52.258864 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.258487 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-b7568f448-hblx2" Jul 07 17:23:52.258864 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.258493 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-b7568f448-hblx2"] Jul 07 17:23:52.263103 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.263080 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 07 17:23:52.263237 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.263098 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 07 17:23:52.263366 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.263341 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8ujhdpsm1em7u\"" Jul 07 17:23:52.263552 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.263535 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 17:23:52.263829 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.263813 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 07 17:23:52.264181 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.264126 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-7qkrh\"" Jul 07 17:23:52.330949 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.330927 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64b9916c-a200-4090-8c47-9171b42c6bd9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-b7568f448-hblx2\" (UID: \"64b9916c-a200-4090-8c47-9171b42c6bd9\") " pod="openshift-monitoring/metrics-server-b7568f448-hblx2" Jul 07 17:23:52.331058 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.330961 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbj2g\" (UniqueName: \"kubernetes.io/projected/64b9916c-a200-4090-8c47-9171b42c6bd9-kube-api-access-nbj2g\") pod \"metrics-server-b7568f448-hblx2\" (UID: \"64b9916c-a200-4090-8c47-9171b42c6bd9\") " pod="openshift-monitoring/metrics-server-b7568f448-hblx2" Jul 07 17:23:52.331058 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.331000 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/64b9916c-a200-4090-8c47-9171b42c6bd9-audit-log\") pod \"metrics-server-b7568f448-hblx2\" (UID: \"64b9916c-a200-4090-8c47-9171b42c6bd9\") " pod="openshift-monitoring/metrics-server-b7568f448-hblx2" Jul 07 17:23:52.331179 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.331060 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/64b9916c-a200-4090-8c47-9171b42c6bd9-secret-metrics-server-tls\") pod \"metrics-server-b7568f448-hblx2\" (UID: \"64b9916c-a200-4090-8c47-9171b42c6bd9\") " pod="openshift-monitoring/metrics-server-b7568f448-hblx2" Jul 07 17:23:52.331179 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.331109 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/64b9916c-a200-4090-8c47-9171b42c6bd9-secret-metrics-server-client-certs\") pod \"metrics-server-b7568f448-hblx2\" (UID: \"64b9916c-a200-4090-8c47-9171b42c6bd9\") " pod="openshift-monitoring/metrics-server-b7568f448-hblx2" Jul 07 17:23:52.331179 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.331167 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/64b9916c-a200-4090-8c47-9171b42c6bd9-client-ca-bundle\") pod \"metrics-server-b7568f448-hblx2\" (UID: \"64b9916c-a200-4090-8c47-9171b42c6bd9\") " pod="openshift-monitoring/metrics-server-b7568f448-hblx2" Jul 07 17:23:52.331310 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.331208 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/64b9916c-a200-4090-8c47-9171b42c6bd9-metrics-server-audit-profiles\") pod \"metrics-server-b7568f448-hblx2\" (UID: \"64b9916c-a200-4090-8c47-9171b42c6bd9\") " pod="openshift-monitoring/metrics-server-b7568f448-hblx2" Jul 07 17:23:52.432612 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.432583 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/64b9916c-a200-4090-8c47-9171b42c6bd9-secret-metrics-server-client-certs\") pod \"metrics-server-b7568f448-hblx2\" (UID: \"64b9916c-a200-4090-8c47-9171b42c6bd9\") " pod="openshift-monitoring/metrics-server-b7568f448-hblx2" Jul 07 17:23:52.432712 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.432634 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/64b9916c-a200-4090-8c47-9171b42c6bd9-client-ca-bundle\") pod \"metrics-server-b7568f448-hblx2\" (UID: \"64b9916c-a200-4090-8c47-9171b42c6bd9\") " pod="openshift-monitoring/metrics-server-b7568f448-hblx2" Jul 07 17:23:52.432712 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.432664 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/64b9916c-a200-4090-8c47-9171b42c6bd9-metrics-server-audit-profiles\") pod \"metrics-server-b7568f448-hblx2\" (UID: \"64b9916c-a200-4090-8c47-9171b42c6bd9\") " pod="openshift-monitoring/metrics-server-b7568f448-hblx2" Jul 07 17:23:52.432810 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.432710 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64b9916c-a200-4090-8c47-9171b42c6bd9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-b7568f448-hblx2\" (UID: \"64b9916c-a200-4090-8c47-9171b42c6bd9\") " pod="openshift-monitoring/metrics-server-b7568f448-hblx2" Jul 07 17:23:52.432810 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.432732 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbj2g\" (UniqueName: \"kubernetes.io/projected/64b9916c-a200-4090-8c47-9171b42c6bd9-kube-api-access-nbj2g\") pod \"metrics-server-b7568f448-hblx2\" (UID: \"64b9916c-a200-4090-8c47-9171b42c6bd9\") " pod="openshift-monitoring/metrics-server-b7568f448-hblx2" Jul 07 17:23:52.432810 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.432792 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/64b9916c-a200-4090-8c47-9171b42c6bd9-audit-log\") pod \"metrics-server-b7568f448-hblx2\" (UID: \"64b9916c-a200-4090-8c47-9171b42c6bd9\") " pod="openshift-monitoring/metrics-server-b7568f448-hblx2" Jul 07 17:23:52.432951 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.432823 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/64b9916c-a200-4090-8c47-9171b42c6bd9-secret-metrics-server-tls\") pod \"metrics-server-b7568f448-hblx2\" (UID: \"64b9916c-a200-4090-8c47-9171b42c6bd9\") " pod="openshift-monitoring/metrics-server-b7568f448-hblx2" Jul 07 17:23:52.433736 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.433712 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/64b9916c-a200-4090-8c47-9171b42c6bd9-metrics-server-audit-profiles\") pod \"metrics-server-b7568f448-hblx2\" (UID: \"64b9916c-a200-4090-8c47-9171b42c6bd9\") " pod="openshift-monitoring/metrics-server-b7568f448-hblx2" Jul 07 17:23:52.433858 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.433795 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64b9916c-a200-4090-8c47-9171b42c6bd9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-b7568f448-hblx2\" (UID: \"64b9916c-a200-4090-8c47-9171b42c6bd9\") " pod="openshift-monitoring/metrics-server-b7568f448-hblx2" Jul 07 17:23:52.433858 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.433843 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/64b9916c-a200-4090-8c47-9171b42c6bd9-audit-log\") pod \"metrics-server-b7568f448-hblx2\" (UID: \"64b9916c-a200-4090-8c47-9171b42c6bd9\") " pod="openshift-monitoring/metrics-server-b7568f448-hblx2" Jul 07 17:23:52.435285 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.435262 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/64b9916c-a200-4090-8c47-9171b42c6bd9-secret-metrics-server-tls\") pod \"metrics-server-b7568f448-hblx2\" (UID: \"64b9916c-a200-4090-8c47-9171b42c6bd9\") " pod="openshift-monitoring/metrics-server-b7568f448-hblx2" Jul 07 17:23:52.435616 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.435600 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/64b9916c-a200-4090-8c47-9171b42c6bd9-secret-metrics-server-client-certs\") pod \"metrics-server-b7568f448-hblx2\" (UID: \"64b9916c-a200-4090-8c47-9171b42c6bd9\") " pod="openshift-monitoring/metrics-server-b7568f448-hblx2" Jul 07 17:23:52.436533 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.436496 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/64b9916c-a200-4090-8c47-9171b42c6bd9-client-ca-bundle\") pod \"metrics-server-b7568f448-hblx2\" (UID: \"64b9916c-a200-4090-8c47-9171b42c6bd9\") " pod="openshift-monitoring/metrics-server-b7568f448-hblx2" Jul 07 17:23:52.451114 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.450293 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbj2g\" (UniqueName: \"kubernetes.io/projected/64b9916c-a200-4090-8c47-9171b42c6bd9-kube-api-access-nbj2g\") pod \"metrics-server-b7568f448-hblx2\" (UID: \"64b9916c-a200-4090-8c47-9171b42c6bd9\") " pod="openshift-monitoring/metrics-server-b7568f448-hblx2" Jul 07 17:23:52.570725 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.570695 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-b7568f448-hblx2" Jul 07 17:23:52.602201 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.602170 2549 generic.go:356] "Generic (PLEG): container finished" podID="4512f419-ceed-415c-b02e-c61116bbeac9" containerID="09569ad9b462f60999c4cf67ea3d57456ffaf48ebb55d2aaae476ee1b4baa017" exitCode=0 Jul 07 17:23:52.602312 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.602271 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4512f419-ceed-415c-b02e-c61116bbeac9","Type":"ContainerDied","Data":"09569ad9b462f60999c4cf67ea3d57456ffaf48ebb55d2aaae476ee1b4baa017"} Jul 07 17:23:52.605748 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.605721 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-csjmz" event={"ID":"da36f22f-e43c-4114-994d-b0bd9fae9555","Type":"ContainerStarted","Data":"8603b15eaa99ced2284a31f7e91dcc14300166f969e7d722329347fd74c93bfe"} Jul 07 17:23:52.743943 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:52.743864 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-b7568f448-hblx2"] Jul 07 17:23:52.747482 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:23:52.747455 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64b9916c_a200_4090_8c47_9171b42c6bd9.slice/crio-78d1d2956a730ec0647bd1fdd488713f39627dea12a809e3494083a9e1087278 WatchSource:0}: Error finding container 78d1d2956a730ec0647bd1fdd488713f39627dea12a809e3494083a9e1087278: Status 404 returned error can't find the container with id 78d1d2956a730ec0647bd1fdd488713f39627dea12a809e3494083a9e1087278 Jul 07 17:23:53.551799 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:53.551765 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-t88qh" Jul 07 17:23:53.616951 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:53.616853 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-b7568f448-hblx2" event={"ID":"64b9916c-a200-4090-8c47-9171b42c6bd9","Type":"ContainerStarted","Data":"78d1d2956a730ec0647bd1fdd488713f39627dea12a809e3494083a9e1087278"} Jul 07 17:23:53.620998 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:53.620527 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-csjmz" event={"ID":"da36f22f-e43c-4114-994d-b0bd9fae9555","Type":"ContainerStarted","Data":"66ce790bd51824314ba02c63f16b77bd94d769749ac923840fd88adbe4447e54"} Jul 07 17:23:53.663620 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:53.663573 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-csjmz" podStartSLOduration=67.647848382 podStartE2EDuration="1m9.663554343s" totalImagesPullingTime="2.015705961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:23:53.661259171 +0000 UTC m=+69.947862301" watchObservedRunningTime="2026-07-07 17:23:53.663554343 +0000 UTC m=+69.950157476" Jul 07 17:23:57.637614 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:57.637572 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bmz4p" event={"ID":"f8abb2d6-e485-457c-8fa7-96617b6362b1","Type":"ContainerStarted","Data":"21127650db02673606dc3a7772c6f0e5abcf25f418bf759c2d34b65c3cfa8d27"} Jul 07 17:23:57.638057 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:57.637664 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:23:57.639065 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:57.639040 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-45k9q" event={"ID":"77800761-9499-4c79-b3b7-f9f39131c8f9","Type":"ContainerStarted","Data":"e77904a60f69e79a7c54a70e9aba203448d27e4082ac2edc69aedd563ca26776"} Jul 07 17:23:57.640577 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:57.640558 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-b7568f448-hblx2" event={"ID":"64b9916c-a200-4090-8c47-9171b42c6bd9","Type":"ContainerStarted","Data":"8eb6446904d67e680cd8f24c9ce0585df53da2a0ac1890ab0fb66f10ed298260"} Jul 07 17:23:57.643767 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:57.643745 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4512f419-ceed-415c-b02e-c61116bbeac9","Type":"ContainerStarted","Data":"690f7d1bfa2cd6223a719277f263ed8d7c9d1ad04c7da95cf2c975f668704dc3"} Jul 07 17:23:57.643857 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:57.643801 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4512f419-ceed-415c-b02e-c61116bbeac9","Type":"ContainerStarted","Data":"459155931f0fd05bf217c5563afd23352bc95194905db506cb92347e29aa7453"} Jul 07 17:23:57.643857 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:57.643830 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4512f419-ceed-415c-b02e-c61116bbeac9","Type":"ContainerStarted","Data":"a8050489cd27ba10430e4a896c9867355c9ef8462224c4ab36d477c6bb7b496e"} Jul 07 17:23:57.643857 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:57.643854 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4512f419-ceed-415c-b02e-c61116bbeac9","Type":"ContainerStarted","Data":"876ad4d7c3fda9dde0ace870b3ef71b65b90ab0efbd1d24ca068e6f1144afbce"} Jul 07 17:23:57.643952 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:57.643878 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4512f419-ceed-415c-b02e-c61116bbeac9","Type":"ContainerStarted","Data":"24afcb63b47d2fcec3a4a96ec9a29d153f7d7256d01a0fcd9d5e184d34a98a43"} Jul 07 17:23:57.661080 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:57.661044 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bmz4p" podStartSLOduration=67.183512359 podStartE2EDuration="1m13.661033033s" totalImagesPullingTime="6.477520674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:23:57.65965754 +0000 UTC m=+73.946260671" watchObservedRunningTime="2026-07-07 17:23:57.661033033 +0000 UTC m=+73.947636164" Jul 07 17:23:57.689070 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:57.689036 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-b7568f448-hblx2" podStartSLOduration=1.64353639 podStartE2EDuration="5.689024901s" totalImagesPullingTime="4.045488511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:23:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:23:57.68829594 +0000 UTC m=+73.974899072" watchObservedRunningTime="2026-07-07 17:23:57.689024901 +0000 UTC m=+73.975628032" Jul 07 17:23:57.710259 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:57.710221 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-45k9q" podStartSLOduration=67.179251563 podStartE2EDuration="1m13.710212085s" totalImagesPullingTime="6.530960522s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:23:57.708878803 +0000 UTC m=+73.995481927" watchObservedRunningTime="2026-07-07 17:23:57.710212085 +0000 UTC m=+73.996815216" Jul 07 17:23:58.650948 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:58.650913 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4512f419-ceed-415c-b02e-c61116bbeac9","Type":"ContainerStarted","Data":"ec0cdf04ae0ae5042272c747208ce0d4b227e451ad64e4cedac665a30697262e"} Jul 07 17:23:58.693107 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:58.693058 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.027460826 podStartE2EDuration="10.693040576s" totalImagesPullingTime="7.64885959s" totalInitContainerRuntime="16.72016ms" isStatefulPod=false podCreationTimestamp="2026-07-07 17:23:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:23:58.687166053 +0000 UTC m=+74.973769184" watchObservedRunningTime="2026-07-07 17:23:58.693040576 +0000 UTC m=+74.979643707" Jul 07 17:23:59.530583 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:23:59.530554 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64b6745578-krn5m" Jul 07 17:24:01.203915 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.203884 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59f774ffff-jx94x"] Jul 07 17:24:01.206116 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.206095 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:24:01.211724 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.211705 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 17:24:01.211724 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.211714 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 17:24:01.212254 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.212235 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zm2j4\"" Jul 07 17:24:01.213106 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.213088 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 17:24:01.213192 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.213128 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 17:24:01.213192 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.213174 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 17:24:01.213419 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.213404 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 17:24:01.213487 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.213405 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 17:24:01.221779 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.221762 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 17:24:01.236208 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.236185 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59f774ffff-jx94x"] Jul 07 17:24:01.309199 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.309175 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8216170-c3b4-4cc2-98f3-db82011a895c-console-serving-cert\") pod \"console-59f774ffff-jx94x\" (UID: \"f8216170-c3b4-4cc2-98f3-db82011a895c\") " pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:24:01.309299 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.309214 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8216170-c3b4-4cc2-98f3-db82011a895c-oauth-serving-cert\") pod \"console-59f774ffff-jx94x\" (UID: \"f8216170-c3b4-4cc2-98f3-db82011a895c\") " pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:24:01.309299 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.309234 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8216170-c3b4-4cc2-98f3-db82011a895c-console-oauth-config\") pod \"console-59f774ffff-jx94x\" (UID: \"f8216170-c3b4-4cc2-98f3-db82011a895c\") " pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:24:01.309299 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.309254 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8216170-c3b4-4cc2-98f3-db82011a895c-trusted-ca-bundle\") pod \"console-59f774ffff-jx94x\" (UID: \"f8216170-c3b4-4cc2-98f3-db82011a895c\") " pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:24:01.309463 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.309294 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcdz8\" (UniqueName: \"kubernetes.io/projected/f8216170-c3b4-4cc2-98f3-db82011a895c-kube-api-access-lcdz8\") pod \"console-59f774ffff-jx94x\" (UID: \"f8216170-c3b4-4cc2-98f3-db82011a895c\") " pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:24:01.309463 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.309343 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8216170-c3b4-4cc2-98f3-db82011a895c-service-ca\") pod \"console-59f774ffff-jx94x\" (UID: \"f8216170-c3b4-4cc2-98f3-db82011a895c\") " pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:24:01.309463 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.309378 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8216170-c3b4-4cc2-98f3-db82011a895c-console-config\") pod \"console-59f774ffff-jx94x\" (UID: \"f8216170-c3b4-4cc2-98f3-db82011a895c\") " pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:24:01.410593 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.410560 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8216170-c3b4-4cc2-98f3-db82011a895c-oauth-serving-cert\") pod \"console-59f774ffff-jx94x\" (UID: \"f8216170-c3b4-4cc2-98f3-db82011a895c\") " pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:24:01.411271 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.411244 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8216170-c3b4-4cc2-98f3-db82011a895c-oauth-serving-cert\") pod \"console-59f774ffff-jx94x\" (UID: \"f8216170-c3b4-4cc2-98f3-db82011a895c\") " pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:24:01.411345 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.411301 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8216170-c3b4-4cc2-98f3-db82011a895c-console-oauth-config\") pod \"console-59f774ffff-jx94x\" (UID: \"f8216170-c3b4-4cc2-98f3-db82011a895c\") " pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:24:01.411345 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.411328 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8216170-c3b4-4cc2-98f3-db82011a895c-trusted-ca-bundle\") pod \"console-59f774ffff-jx94x\" (UID: \"f8216170-c3b4-4cc2-98f3-db82011a895c\") " pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:24:01.411439 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.411349 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcdz8\" (UniqueName: \"kubernetes.io/projected/f8216170-c3b4-4cc2-98f3-db82011a895c-kube-api-access-lcdz8\") pod \"console-59f774ffff-jx94x\" (UID: \"f8216170-c3b4-4cc2-98f3-db82011a895c\") " pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:24:01.411439 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.411377 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8216170-c3b4-4cc2-98f3-db82011a895c-service-ca\") pod \"console-59f774ffff-jx94x\" (UID: \"f8216170-c3b4-4cc2-98f3-db82011a895c\") " pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:24:01.411439 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.411404 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8216170-c3b4-4cc2-98f3-db82011a895c-console-config\") pod \"console-59f774ffff-jx94x\" (UID: \"f8216170-c3b4-4cc2-98f3-db82011a895c\") " pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:24:01.411600 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.411473 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8216170-c3b4-4cc2-98f3-db82011a895c-console-serving-cert\") pod \"console-59f774ffff-jx94x\" (UID: \"f8216170-c3b4-4cc2-98f3-db82011a895c\") " pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:24:01.412516 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.412484 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8216170-c3b4-4cc2-98f3-db82011a895c-service-ca\") pod \"console-59f774ffff-jx94x\" (UID: \"f8216170-c3b4-4cc2-98f3-db82011a895c\") " pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:24:01.412661 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.412607 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8216170-c3b4-4cc2-98f3-db82011a895c-console-config\") pod \"console-59f774ffff-jx94x\" (UID: \"f8216170-c3b4-4cc2-98f3-db82011a895c\") " pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:24:01.412888 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.412864 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8216170-c3b4-4cc2-98f3-db82011a895c-trusted-ca-bundle\") pod \"console-59f774ffff-jx94x\" (UID: \"f8216170-c3b4-4cc2-98f3-db82011a895c\") " pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:24:01.414138 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.414119 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8216170-c3b4-4cc2-98f3-db82011a895c-console-serving-cert\") pod \"console-59f774ffff-jx94x\" (UID: \"f8216170-c3b4-4cc2-98f3-db82011a895c\") " pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:24:01.414306 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.414286 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8216170-c3b4-4cc2-98f3-db82011a895c-console-oauth-config\") pod \"console-59f774ffff-jx94x\" (UID: \"f8216170-c3b4-4cc2-98f3-db82011a895c\") " pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:24:01.428144 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.428116 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcdz8\" (UniqueName: \"kubernetes.io/projected/f8216170-c3b4-4cc2-98f3-db82011a895c-kube-api-access-lcdz8\") pod \"console-59f774ffff-jx94x\" (UID: \"f8216170-c3b4-4cc2-98f3-db82011a895c\") " pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:24:01.515344 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.515280 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:24:01.670351 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:01.669733 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59f774ffff-jx94x"] Jul 07 17:24:01.672466 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:24:01.672439 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8216170_c3b4_4cc2_98f3_db82011a895c.slice/crio-05de1b953ac789508339fab1467bd06e5c73d274c7a325fdcf57fcaf1e113e9b WatchSource:0}: Error finding container 05de1b953ac789508339fab1467bd06e5c73d274c7a325fdcf57fcaf1e113e9b: Status 404 returned error can't find the container with id 05de1b953ac789508339fab1467bd06e5c73d274c7a325fdcf57fcaf1e113e9b Jul 07 17:24:02.668992 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:02.668952 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f774ffff-jx94x" event={"ID":"f8216170-c3b4-4cc2-98f3-db82011a895c","Type":"ContainerStarted","Data":"05de1b953ac789508339fab1467bd06e5c73d274c7a325fdcf57fcaf1e113e9b"} Jul 07 17:24:05.683620 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:05.683580 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f774ffff-jx94x" event={"ID":"f8216170-c3b4-4cc2-98f3-db82011a895c","Type":"ContainerStarted","Data":"8aa5fc49361e0df35b6d307406a60772279ec4190141e50102ef3e603cd7c379"} Jul 07 17:24:05.708992 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:05.708933 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59f774ffff-jx94x" podStartSLOduration=1.3142072790000001 podStartE2EDuration="4.708917118s" totalImagesPullingTime="3.394709839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:24:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:24:05.708309257 +0000 UTC m=+81.994912387" watchObservedRunningTime="2026-07-07 17:24:05.708917118 +0000 UTC m=+81.995520248" Jul 07 17:24:11.516179 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:11.516136 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:24:11.516777 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:11.516223 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:24:11.521368 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:11.521343 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:24:11.708980 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:11.708950 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:24:12.571784 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:12.571752 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-b7568f448-hblx2" Jul 07 17:24:12.572171 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:12.571808 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-b7568f448-hblx2" Jul 07 17:24:28.653352 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:28.653317 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bmz4p" Jul 07 17:24:32.576866 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:32.576830 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-b7568f448-hblx2" Jul 07 17:24:32.580859 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:32.580837 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-b7568f448-hblx2" Jul 07 17:24:41.578242 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:41.578217 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4512f419-ceed-415c-b02e-c61116bbeac9/init-config-reloader/0.log" Jul 07 17:24:41.759495 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:41.759463 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4512f419-ceed-415c-b02e-c61116bbeac9/alertmanager/0.log" Jul 07 17:24:41.970753 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:41.970725 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4512f419-ceed-415c-b02e-c61116bbeac9/config-reloader/0.log" Jul 07 17:24:42.160332 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:42.160305 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4512f419-ceed-415c-b02e-c61116bbeac9/kube-rbac-proxy-web/0.log" Jul 07 17:24:42.362429 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:42.362366 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4512f419-ceed-415c-b02e-c61116bbeac9/kube-rbac-proxy/0.log" Jul 07 17:24:42.559212 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:42.559190 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4512f419-ceed-415c-b02e-c61116bbeac9/kube-rbac-proxy-metric/0.log" Jul 07 17:24:42.764678 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:42.764650 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4512f419-ceed-415c-b02e-c61116bbeac9/prom-label-proxy/0.log" Jul 07 17:24:43.760800 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:43.760765 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-b7568f448-hblx2_64b9916c-a200-4090-8c47-9171b42c6bd9/metrics-server/0.log" Jul 07 17:24:44.761855 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:44.761825 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hwdfn_fc268fef-45f8-4525-b0c5-6c68da072c13/init-textfile/0.log" Jul 07 17:24:44.960852 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:44.960824 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hwdfn_fc268fef-45f8-4525-b0c5-6c68da072c13/node-exporter/0.log" Jul 07 17:24:45.159797 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:45.159772 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hwdfn_fc268fef-45f8-4525-b0c5-6c68da072c13/kube-rbac-proxy/0.log" Jul 07 17:24:47.967323 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:47.967286 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-92gws_4ed05cf1-7704-4308-a8db-08cb0b9d6ec4/prometheus-operator/0.log" Jul 07 17:24:48.160074 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:48.160042 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-92gws_4ed05cf1-7704-4308-a8db-08cb0b9d6ec4/kube-rbac-proxy/0.log" Jul 07 17:24:50.961586 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:50.961539 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59f774ffff-jx94x_f8216170-c3b4-4cc2-98f3-db82011a895c/console/0.log" Jul 07 17:24:51.759992 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:24:51.759965 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fbql5_f35b592d-681c-46b0-985a-07ffe8ad432b/serve-healthcheck-canary/0.log" Jul 07 17:25:08.037388 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.037336 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8b778bf9d-zb28c"] Jul 07 17:25:08.039750 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.039723 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:25:08.054188 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.054159 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8b778bf9d-zb28c"] Jul 07 17:25:08.179257 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.179225 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f7a044a4-fd75-476f-8958-aa43183aecb7-console-config\") pod \"console-8b778bf9d-zb28c\" (UID: \"f7a044a4-fd75-476f-8958-aa43183aecb7\") " pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:25:08.179380 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.179269 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f7a044a4-fd75-476f-8958-aa43183aecb7-console-serving-cert\") pod \"console-8b778bf9d-zb28c\" (UID: \"f7a044a4-fd75-476f-8958-aa43183aecb7\") " pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:25:08.179380 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.179305 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f7a044a4-fd75-476f-8958-aa43183aecb7-service-ca\") pod \"console-8b778bf9d-zb28c\" (UID: \"f7a044a4-fd75-476f-8958-aa43183aecb7\") " pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:25:08.179380 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.179331 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f7a044a4-fd75-476f-8958-aa43183aecb7-console-oauth-config\") pod \"console-8b778bf9d-zb28c\" (UID: \"f7a044a4-fd75-476f-8958-aa43183aecb7\") " pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:25:08.179380 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.179358 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f7a044a4-fd75-476f-8958-aa43183aecb7-oauth-serving-cert\") pod \"console-8b778bf9d-zb28c\" (UID: \"f7a044a4-fd75-476f-8958-aa43183aecb7\") " pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:25:08.179627 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.179399 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7a044a4-fd75-476f-8958-aa43183aecb7-trusted-ca-bundle\") pod \"console-8b778bf9d-zb28c\" (UID: \"f7a044a4-fd75-476f-8958-aa43183aecb7\") " pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:25:08.179627 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.179488 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffbt4\" (UniqueName: \"kubernetes.io/projected/f7a044a4-fd75-476f-8958-aa43183aecb7-kube-api-access-ffbt4\") pod \"console-8b778bf9d-zb28c\" (UID: \"f7a044a4-fd75-476f-8958-aa43183aecb7\") " pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:25:08.280791 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.280760 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f7a044a4-fd75-476f-8958-aa43183aecb7-console-config\") pod \"console-8b778bf9d-zb28c\" (UID: \"f7a044a4-fd75-476f-8958-aa43183aecb7\") " pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:25:08.280911 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.280799 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f7a044a4-fd75-476f-8958-aa43183aecb7-console-serving-cert\") pod \"console-8b778bf9d-zb28c\" (UID: \"f7a044a4-fd75-476f-8958-aa43183aecb7\") " pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:25:08.280911 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.280821 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f7a044a4-fd75-476f-8958-aa43183aecb7-service-ca\") pod \"console-8b778bf9d-zb28c\" (UID: \"f7a044a4-fd75-476f-8958-aa43183aecb7\") " pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:25:08.280911 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.280842 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f7a044a4-fd75-476f-8958-aa43183aecb7-console-oauth-config\") pod \"console-8b778bf9d-zb28c\" (UID: \"f7a044a4-fd75-476f-8958-aa43183aecb7\") " pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:25:08.280911 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.280867 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f7a044a4-fd75-476f-8958-aa43183aecb7-oauth-serving-cert\") pod \"console-8b778bf9d-zb28c\" (UID: \"f7a044a4-fd75-476f-8958-aa43183aecb7\") " pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:25:08.280911 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.280892 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7a044a4-fd75-476f-8958-aa43183aecb7-trusted-ca-bundle\") pod \"console-8b778bf9d-zb28c\" (UID: \"f7a044a4-fd75-476f-8958-aa43183aecb7\") " pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:25:08.281231 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.281122 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffbt4\" (UniqueName: \"kubernetes.io/projected/f7a044a4-fd75-476f-8958-aa43183aecb7-kube-api-access-ffbt4\") pod \"console-8b778bf9d-zb28c\" (UID: \"f7a044a4-fd75-476f-8958-aa43183aecb7\") " pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:25:08.281748 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.281719 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f7a044a4-fd75-476f-8958-aa43183aecb7-service-ca\") pod \"console-8b778bf9d-zb28c\" (UID: \"f7a044a4-fd75-476f-8958-aa43183aecb7\") " pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:25:08.281850 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.281745 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f7a044a4-fd75-476f-8958-aa43183aecb7-console-config\") pod \"console-8b778bf9d-zb28c\" (UID: \"f7a044a4-fd75-476f-8958-aa43183aecb7\") " pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:25:08.281955 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.281932 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f7a044a4-fd75-476f-8958-aa43183aecb7-oauth-serving-cert\") pod \"console-8b778bf9d-zb28c\" (UID: \"f7a044a4-fd75-476f-8958-aa43183aecb7\") " pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:25:08.282153 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.282129 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7a044a4-fd75-476f-8958-aa43183aecb7-trusted-ca-bundle\") pod \"console-8b778bf9d-zb28c\" (UID: \"f7a044a4-fd75-476f-8958-aa43183aecb7\") " pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:25:08.283818 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.283794 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f7a044a4-fd75-476f-8958-aa43183aecb7-console-serving-cert\") pod \"console-8b778bf9d-zb28c\" (UID: \"f7a044a4-fd75-476f-8958-aa43183aecb7\") " pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:25:08.283912 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.283898 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f7a044a4-fd75-476f-8958-aa43183aecb7-console-oauth-config\") pod \"console-8b778bf9d-zb28c\" (UID: \"f7a044a4-fd75-476f-8958-aa43183aecb7\") " pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:25:08.300387 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.300326 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffbt4\" (UniqueName: \"kubernetes.io/projected/f7a044a4-fd75-476f-8958-aa43183aecb7-kube-api-access-ffbt4\") pod \"console-8b778bf9d-zb28c\" (UID: \"f7a044a4-fd75-476f-8958-aa43183aecb7\") " pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:25:08.349315 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.349280 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:25:08.481085 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.481057 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8b778bf9d-zb28c"] Jul 07 17:25:08.483856 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:25:08.483824 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7a044a4_fd75_476f_8958_aa43183aecb7.slice/crio-0a9c4b36f78b6e70cde00d9683ddc68cddb981cfdcaf2690ca2feebcf75e099d WatchSource:0}: Error finding container 0a9c4b36f78b6e70cde00d9683ddc68cddb981cfdcaf2690ca2feebcf75e099d: Status 404 returned error can't find the container with id 0a9c4b36f78b6e70cde00d9683ddc68cddb981cfdcaf2690ca2feebcf75e099d Jul 07 17:25:08.487941 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.487884 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 17:25:08.489298 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.489250 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4512f419-ceed-415c-b02e-c61116bbeac9" containerName="alertmanager" containerID="cri-o://24afcb63b47d2fcec3a4a96ec9a29d153f7d7256d01a0fcd9d5e184d34a98a43" gracePeriod=120 Jul 07 17:25:08.489416 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.489302 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4512f419-ceed-415c-b02e-c61116bbeac9" containerName="kube-rbac-proxy-metric" containerID="cri-o://690f7d1bfa2cd6223a719277f263ed8d7c9d1ad04c7da95cf2c975f668704dc3" gracePeriod=120 Jul 07 17:25:08.489416 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.489331 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4512f419-ceed-415c-b02e-c61116bbeac9" containerName="kube-rbac-proxy" containerID="cri-o://459155931f0fd05bf217c5563afd23352bc95194905db506cb92347e29aa7453" gracePeriod=120 Jul 07 17:25:08.489416 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.489349 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4512f419-ceed-415c-b02e-c61116bbeac9" containerName="config-reloader" containerID="cri-o://876ad4d7c3fda9dde0ace870b3ef71b65b90ab0efbd1d24ca068e6f1144afbce" gracePeriod=120 Jul 07 17:25:08.489416 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.489346 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4512f419-ceed-415c-b02e-c61116bbeac9" containerName="prom-label-proxy" containerID="cri-o://ec0cdf04ae0ae5042272c747208ce0d4b227e451ad64e4cedac665a30697262e" gracePeriod=120 Jul 07 17:25:08.489416 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.489304 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4512f419-ceed-415c-b02e-c61116bbeac9" containerName="kube-rbac-proxy-web" containerID="cri-o://a8050489cd27ba10430e4a896c9867355c9ef8462224c4ab36d477c6bb7b496e" gracePeriod=120 Jul 07 17:25:08.913864 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.913829 2549 generic.go:356] "Generic (PLEG): container finished" podID="4512f419-ceed-415c-b02e-c61116bbeac9" containerID="ec0cdf04ae0ae5042272c747208ce0d4b227e451ad64e4cedac665a30697262e" exitCode=0 Jul 07 17:25:08.913864 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.913859 2549 generic.go:356] "Generic (PLEG): container finished" podID="4512f419-ceed-415c-b02e-c61116bbeac9" containerID="459155931f0fd05bf217c5563afd23352bc95194905db506cb92347e29aa7453" exitCode=0 Jul 07 17:25:08.913864 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.913868 2549 generic.go:356] "Generic (PLEG): container finished" podID="4512f419-ceed-415c-b02e-c61116bbeac9" containerID="876ad4d7c3fda9dde0ace870b3ef71b65b90ab0efbd1d24ca068e6f1144afbce" exitCode=0 Jul 07 17:25:08.914132 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.913875 2549 generic.go:356] "Generic (PLEG): container finished" podID="4512f419-ceed-415c-b02e-c61116bbeac9" containerID="24afcb63b47d2fcec3a4a96ec9a29d153f7d7256d01a0fcd9d5e184d34a98a43" exitCode=0 Jul 07 17:25:08.914132 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.913892 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4512f419-ceed-415c-b02e-c61116bbeac9","Type":"ContainerDied","Data":"ec0cdf04ae0ae5042272c747208ce0d4b227e451ad64e4cedac665a30697262e"} Jul 07 17:25:08.914132 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.913970 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4512f419-ceed-415c-b02e-c61116bbeac9","Type":"ContainerDied","Data":"459155931f0fd05bf217c5563afd23352bc95194905db506cb92347e29aa7453"} Jul 07 17:25:08.914132 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.914008 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4512f419-ceed-415c-b02e-c61116bbeac9","Type":"ContainerDied","Data":"876ad4d7c3fda9dde0ace870b3ef71b65b90ab0efbd1d24ca068e6f1144afbce"} Jul 07 17:25:08.914132 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.914035 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4512f419-ceed-415c-b02e-c61116bbeac9","Type":"ContainerDied","Data":"24afcb63b47d2fcec3a4a96ec9a29d153f7d7256d01a0fcd9d5e184d34a98a43"} Jul 07 17:25:08.915454 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.915428 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b778bf9d-zb28c" event={"ID":"f7a044a4-fd75-476f-8958-aa43183aecb7","Type":"ContainerStarted","Data":"3b0454b1917bc9c2808361d7b7810702c40daf7a5334f15a9cbd82da923ae7c0"} Jul 07 17:25:08.915612 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.915474 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b778bf9d-zb28c" event={"ID":"f7a044a4-fd75-476f-8958-aa43183aecb7","Type":"ContainerStarted","Data":"0a9c4b36f78b6e70cde00d9683ddc68cddb981cfdcaf2690ca2feebcf75e099d"} Jul 07 17:25:08.938023 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:08.937974 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8b778bf9d-zb28c" podStartSLOduration=0.937958796 podStartE2EDuration="937.958796ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:25:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:25:08.93703606 +0000 UTC m=+145.223639191" watchObservedRunningTime="2026-07-07 17:25:08.937958796 +0000 UTC m=+145.224561926" Jul 07 17:25:09.735832 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.735811 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:09.793760 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.793697 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-secret-alertmanager-kube-rbac-proxy\") pod \"4512f419-ceed-415c-b02e-c61116bbeac9\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " Jul 07 17:25:09.793760 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.793751 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4512f419-ceed-415c-b02e-c61116bbeac9-metrics-client-ca\") pod \"4512f419-ceed-415c-b02e-c61116bbeac9\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " Jul 07 17:25:09.793936 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.793783 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4512f419-ceed-415c-b02e-c61116bbeac9-alertmanager-trusted-ca-bundle\") pod \"4512f419-ceed-415c-b02e-c61116bbeac9\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " Jul 07 17:25:09.793936 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.793808 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-web-config\") pod \"4512f419-ceed-415c-b02e-c61116bbeac9\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " Jul 07 17:25:09.793936 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.793834 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4512f419-ceed-415c-b02e-c61116bbeac9-alertmanager-main-db\") pod \"4512f419-ceed-415c-b02e-c61116bbeac9\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " Jul 07 17:25:09.793936 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.793875 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-config-volume\") pod \"4512f419-ceed-415c-b02e-c61116bbeac9\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " Jul 07 17:25:09.793936 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.793912 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4512f419-ceed-415c-b02e-c61116bbeac9-config-out\") pod \"4512f419-ceed-415c-b02e-c61116bbeac9\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " Jul 07 17:25:09.794179 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.793940 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4512f419-ceed-415c-b02e-c61116bbeac9-tls-assets\") pod \"4512f419-ceed-415c-b02e-c61116bbeac9\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " Jul 07 17:25:09.794179 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.793985 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spbp7\" (UniqueName: \"kubernetes.io/projected/4512f419-ceed-415c-b02e-c61116bbeac9-kube-api-access-spbp7\") pod \"4512f419-ceed-415c-b02e-c61116bbeac9\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " Jul 07 17:25:09.794179 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.794014 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-secret-alertmanager-kube-rbac-proxy-web\") pod \"4512f419-ceed-415c-b02e-c61116bbeac9\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " Jul 07 17:25:09.794179 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.794068 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-cluster-tls-config\") pod \"4512f419-ceed-415c-b02e-c61116bbeac9\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " Jul 07 17:25:09.794179 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.794100 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-secret-alertmanager-main-tls\") pod \"4512f419-ceed-415c-b02e-c61116bbeac9\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " Jul 07 17:25:09.794179 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.794144 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"4512f419-ceed-415c-b02e-c61116bbeac9\" (UID: \"4512f419-ceed-415c-b02e-c61116bbeac9\") " Jul 07 17:25:09.794462 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.794376 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4512f419-ceed-415c-b02e-c61116bbeac9-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "4512f419-ceed-415c-b02e-c61116bbeac9" (UID: "4512f419-ceed-415c-b02e-c61116bbeac9"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 17:25:09.794462 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.794396 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4512f419-ceed-415c-b02e-c61116bbeac9-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "4512f419-ceed-415c-b02e-c61116bbeac9" (UID: "4512f419-ceed-415c-b02e-c61116bbeac9"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 17:25:09.795468 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.795440 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4512f419-ceed-415c-b02e-c61116bbeac9-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "4512f419-ceed-415c-b02e-c61116bbeac9" (UID: "4512f419-ceed-415c-b02e-c61116bbeac9"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:25:09.798217 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.798185 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4512f419-ceed-415c-b02e-c61116bbeac9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4512f419-ceed-415c-b02e-c61116bbeac9" (UID: "4512f419-ceed-415c-b02e-c61116bbeac9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:25:09.798622 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.798547 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "4512f419-ceed-415c-b02e-c61116bbeac9" (UID: "4512f419-ceed-415c-b02e-c61116bbeac9"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:25:09.798726 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.798661 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "4512f419-ceed-415c-b02e-c61116bbeac9" (UID: "4512f419-ceed-415c-b02e-c61116bbeac9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:25:09.799096 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.799070 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "4512f419-ceed-415c-b02e-c61116bbeac9" (UID: "4512f419-ceed-415c-b02e-c61116bbeac9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:25:09.799231 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.799083 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4512f419-ceed-415c-b02e-c61116bbeac9-kube-api-access-spbp7" (OuterVolumeSpecName: "kube-api-access-spbp7") pod "4512f419-ceed-415c-b02e-c61116bbeac9" (UID: "4512f419-ceed-415c-b02e-c61116bbeac9"). InnerVolumeSpecName "kube-api-access-spbp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:25:09.799345 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.799143 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "4512f419-ceed-415c-b02e-c61116bbeac9" (UID: "4512f419-ceed-415c-b02e-c61116bbeac9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:25:09.799428 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.799370 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4512f419-ceed-415c-b02e-c61116bbeac9-config-out" (OuterVolumeSpecName: "config-out") pod "4512f419-ceed-415c-b02e-c61116bbeac9" (UID: "4512f419-ceed-415c-b02e-c61116bbeac9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:25:09.800128 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.800101 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-config-volume" (OuterVolumeSpecName: "config-volume") pod "4512f419-ceed-415c-b02e-c61116bbeac9" (UID: "4512f419-ceed-415c-b02e-c61116bbeac9"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:25:09.803008 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.802984 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "4512f419-ceed-415c-b02e-c61116bbeac9" (UID: "4512f419-ceed-415c-b02e-c61116bbeac9"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:25:09.809097 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.809078 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-web-config" (OuterVolumeSpecName: "web-config") pod "4512f419-ceed-415c-b02e-c61116bbeac9" (UID: "4512f419-ceed-415c-b02e-c61116bbeac9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:25:09.895552 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.895530 2549 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-secret-alertmanager-main-tls\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:25:09.895552 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.895550 2549 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:25:09.895666 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.895561 2549 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:25:09.895666 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.895570 2549 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4512f419-ceed-415c-b02e-c61116bbeac9-metrics-client-ca\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:25:09.895666 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.895579 2549 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4512f419-ceed-415c-b02e-c61116bbeac9-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:25:09.895666 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.895588 2549 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-web-config\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:25:09.895666 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.895596 2549 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4512f419-ceed-415c-b02e-c61116bbeac9-alertmanager-main-db\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:25:09.895666 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.895604 2549 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-config-volume\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:25:09.895666 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.895611 2549 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4512f419-ceed-415c-b02e-c61116bbeac9-config-out\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:25:09.895666 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.895618 2549 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4512f419-ceed-415c-b02e-c61116bbeac9-tls-assets\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:25:09.895666 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.895625 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spbp7\" (UniqueName: \"kubernetes.io/projected/4512f419-ceed-415c-b02e-c61116bbeac9-kube-api-access-spbp7\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:25:09.895666 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.895634 2549 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:25:09.895666 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.895643 2549 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4512f419-ceed-415c-b02e-c61116bbeac9-cluster-tls-config\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:25:09.926434 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.926404 2549 generic.go:356] "Generic (PLEG): container finished" podID="4512f419-ceed-415c-b02e-c61116bbeac9" containerID="690f7d1bfa2cd6223a719277f263ed8d7c9d1ad04c7da95cf2c975f668704dc3" exitCode=0 Jul 07 17:25:09.926434 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.926433 2549 generic.go:356] "Generic (PLEG): container finished" podID="4512f419-ceed-415c-b02e-c61116bbeac9" containerID="a8050489cd27ba10430e4a896c9867355c9ef8462224c4ab36d477c6bb7b496e" exitCode=0 Jul 07 17:25:09.926580 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.926487 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:09.926580 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.926498 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4512f419-ceed-415c-b02e-c61116bbeac9","Type":"ContainerDied","Data":"690f7d1bfa2cd6223a719277f263ed8d7c9d1ad04c7da95cf2c975f668704dc3"} Jul 07 17:25:09.926646 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.926613 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4512f419-ceed-415c-b02e-c61116bbeac9","Type":"ContainerDied","Data":"a8050489cd27ba10430e4a896c9867355c9ef8462224c4ab36d477c6bb7b496e"} Jul 07 17:25:09.926646 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.926643 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4512f419-ceed-415c-b02e-c61116bbeac9","Type":"ContainerDied","Data":"83f73e0e60d8c9fd6cbff79b04f5ed56539f9ce5b9a37b7713c848cda24de81e"} Jul 07 17:25:09.926722 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.926692 2549 scope.go:117] "RemoveContainer" containerID="ec0cdf04ae0ae5042272c747208ce0d4b227e451ad64e4cedac665a30697262e" Jul 07 17:25:09.935421 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.935402 2549 scope.go:117] "RemoveContainer" containerID="690f7d1bfa2cd6223a719277f263ed8d7c9d1ad04c7da95cf2c975f668704dc3" Jul 07 17:25:09.942065 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.942049 2549 scope.go:117] "RemoveContainer" containerID="459155931f0fd05bf217c5563afd23352bc95194905db506cb92347e29aa7453" Jul 07 17:25:09.950077 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.950060 2549 scope.go:117] "RemoveContainer" containerID="a8050489cd27ba10430e4a896c9867355c9ef8462224c4ab36d477c6bb7b496e" Jul 07 17:25:09.954365 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.954345 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 17:25:09.956818 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.956796 2549 scope.go:117] "RemoveContainer" containerID="876ad4d7c3fda9dde0ace870b3ef71b65b90ab0efbd1d24ca068e6f1144afbce" Jul 07 17:25:09.960330 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.960313 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 17:25:09.963753 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.963736 2549 scope.go:117] "RemoveContainer" containerID="24afcb63b47d2fcec3a4a96ec9a29d153f7d7256d01a0fcd9d5e184d34a98a43" Jul 07 17:25:09.971788 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.971715 2549 scope.go:117] "RemoveContainer" containerID="09569ad9b462f60999c4cf67ea3d57456ffaf48ebb55d2aaae476ee1b4baa017" Jul 07 17:25:09.978424 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.978407 2549 scope.go:117] "RemoveContainer" containerID="ec0cdf04ae0ae5042272c747208ce0d4b227e451ad64e4cedac665a30697262e" Jul 07 17:25:09.978699 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:25:09.978678 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec0cdf04ae0ae5042272c747208ce0d4b227e451ad64e4cedac665a30697262e\": container with ID starting with ec0cdf04ae0ae5042272c747208ce0d4b227e451ad64e4cedac665a30697262e not found: ID does not exist" containerID="ec0cdf04ae0ae5042272c747208ce0d4b227e451ad64e4cedac665a30697262e" Jul 07 17:25:09.978774 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.978705 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec0cdf04ae0ae5042272c747208ce0d4b227e451ad64e4cedac665a30697262e"} err="failed to get container status \"ec0cdf04ae0ae5042272c747208ce0d4b227e451ad64e4cedac665a30697262e\": rpc error: code = NotFound desc = could not find container \"ec0cdf04ae0ae5042272c747208ce0d4b227e451ad64e4cedac665a30697262e\": container with ID starting with ec0cdf04ae0ae5042272c747208ce0d4b227e451ad64e4cedac665a30697262e not found: ID does not exist" Jul 07 17:25:09.978774 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.978733 2549 scope.go:117] "RemoveContainer" containerID="690f7d1bfa2cd6223a719277f263ed8d7c9d1ad04c7da95cf2c975f668704dc3" Jul 07 17:25:09.978958 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:25:09.978943 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"690f7d1bfa2cd6223a719277f263ed8d7c9d1ad04c7da95cf2c975f668704dc3\": container with ID starting with 690f7d1bfa2cd6223a719277f263ed8d7c9d1ad04c7da95cf2c975f668704dc3 not found: ID does not exist" containerID="690f7d1bfa2cd6223a719277f263ed8d7c9d1ad04c7da95cf2c975f668704dc3" Jul 07 17:25:09.978992 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.978962 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"690f7d1bfa2cd6223a719277f263ed8d7c9d1ad04c7da95cf2c975f668704dc3"} err="failed to get container status \"690f7d1bfa2cd6223a719277f263ed8d7c9d1ad04c7da95cf2c975f668704dc3\": rpc error: code = NotFound desc = could not find container \"690f7d1bfa2cd6223a719277f263ed8d7c9d1ad04c7da95cf2c975f668704dc3\": container with ID starting with 690f7d1bfa2cd6223a719277f263ed8d7c9d1ad04c7da95cf2c975f668704dc3 not found: ID does not exist" Jul 07 17:25:09.978992 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.978974 2549 scope.go:117] "RemoveContainer" containerID="459155931f0fd05bf217c5563afd23352bc95194905db506cb92347e29aa7453" Jul 07 17:25:09.979182 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:25:09.979167 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"459155931f0fd05bf217c5563afd23352bc95194905db506cb92347e29aa7453\": container with ID starting with 459155931f0fd05bf217c5563afd23352bc95194905db506cb92347e29aa7453 not found: ID does not exist" containerID="459155931f0fd05bf217c5563afd23352bc95194905db506cb92347e29aa7453" Jul 07 17:25:09.979218 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.979186 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"459155931f0fd05bf217c5563afd23352bc95194905db506cb92347e29aa7453"} err="failed to get container status \"459155931f0fd05bf217c5563afd23352bc95194905db506cb92347e29aa7453\": rpc error: code = NotFound desc = could not find container \"459155931f0fd05bf217c5563afd23352bc95194905db506cb92347e29aa7453\": container with ID starting with 459155931f0fd05bf217c5563afd23352bc95194905db506cb92347e29aa7453 not found: ID does not exist" Jul 07 17:25:09.979218 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.979199 2549 scope.go:117] "RemoveContainer" containerID="a8050489cd27ba10430e4a896c9867355c9ef8462224c4ab36d477c6bb7b496e" Jul 07 17:25:09.979400 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:25:09.979382 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8050489cd27ba10430e4a896c9867355c9ef8462224c4ab36d477c6bb7b496e\": container with ID starting with a8050489cd27ba10430e4a896c9867355c9ef8462224c4ab36d477c6bb7b496e not found: ID does not exist" containerID="a8050489cd27ba10430e4a896c9867355c9ef8462224c4ab36d477c6bb7b496e" Jul 07 17:25:09.979432 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.979404 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8050489cd27ba10430e4a896c9867355c9ef8462224c4ab36d477c6bb7b496e"} err="failed to get container status \"a8050489cd27ba10430e4a896c9867355c9ef8462224c4ab36d477c6bb7b496e\": rpc error: code = NotFound desc = could not find container \"a8050489cd27ba10430e4a896c9867355c9ef8462224c4ab36d477c6bb7b496e\": container with ID starting with a8050489cd27ba10430e4a896c9867355c9ef8462224c4ab36d477c6bb7b496e not found: ID does not exist" Jul 07 17:25:09.979432 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.979415 2549 scope.go:117] "RemoveContainer" containerID="876ad4d7c3fda9dde0ace870b3ef71b65b90ab0efbd1d24ca068e6f1144afbce" Jul 07 17:25:09.979648 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:25:09.979632 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"876ad4d7c3fda9dde0ace870b3ef71b65b90ab0efbd1d24ca068e6f1144afbce\": container with ID starting with 876ad4d7c3fda9dde0ace870b3ef71b65b90ab0efbd1d24ca068e6f1144afbce not found: ID does not exist" containerID="876ad4d7c3fda9dde0ace870b3ef71b65b90ab0efbd1d24ca068e6f1144afbce" Jul 07 17:25:09.979696 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.979653 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"876ad4d7c3fda9dde0ace870b3ef71b65b90ab0efbd1d24ca068e6f1144afbce"} err="failed to get container status \"876ad4d7c3fda9dde0ace870b3ef71b65b90ab0efbd1d24ca068e6f1144afbce\": rpc error: code = NotFound desc = could not find container \"876ad4d7c3fda9dde0ace870b3ef71b65b90ab0efbd1d24ca068e6f1144afbce\": container with ID starting with 876ad4d7c3fda9dde0ace870b3ef71b65b90ab0efbd1d24ca068e6f1144afbce not found: ID does not exist" Jul 07 17:25:09.979696 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.979667 2549 scope.go:117] "RemoveContainer" containerID="24afcb63b47d2fcec3a4a96ec9a29d153f7d7256d01a0fcd9d5e184d34a98a43" Jul 07 17:25:09.979885 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:25:09.979870 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24afcb63b47d2fcec3a4a96ec9a29d153f7d7256d01a0fcd9d5e184d34a98a43\": container with ID starting with 24afcb63b47d2fcec3a4a96ec9a29d153f7d7256d01a0fcd9d5e184d34a98a43 not found: ID does not exist" containerID="24afcb63b47d2fcec3a4a96ec9a29d153f7d7256d01a0fcd9d5e184d34a98a43" Jul 07 17:25:09.979927 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.979888 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24afcb63b47d2fcec3a4a96ec9a29d153f7d7256d01a0fcd9d5e184d34a98a43"} err="failed to get container status \"24afcb63b47d2fcec3a4a96ec9a29d153f7d7256d01a0fcd9d5e184d34a98a43\": rpc error: code = NotFound desc = could not find container \"24afcb63b47d2fcec3a4a96ec9a29d153f7d7256d01a0fcd9d5e184d34a98a43\": container with ID starting with 24afcb63b47d2fcec3a4a96ec9a29d153f7d7256d01a0fcd9d5e184d34a98a43 not found: ID does not exist" Jul 07 17:25:09.979927 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.979900 2549 scope.go:117] "RemoveContainer" containerID="09569ad9b462f60999c4cf67ea3d57456ffaf48ebb55d2aaae476ee1b4baa017" Jul 07 17:25:09.980131 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:25:09.980114 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09569ad9b462f60999c4cf67ea3d57456ffaf48ebb55d2aaae476ee1b4baa017\": container with ID starting with 09569ad9b462f60999c4cf67ea3d57456ffaf48ebb55d2aaae476ee1b4baa017 not found: ID does not exist" containerID="09569ad9b462f60999c4cf67ea3d57456ffaf48ebb55d2aaae476ee1b4baa017" Jul 07 17:25:09.980182 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.980135 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09569ad9b462f60999c4cf67ea3d57456ffaf48ebb55d2aaae476ee1b4baa017"} err="failed to get container status \"09569ad9b462f60999c4cf67ea3d57456ffaf48ebb55d2aaae476ee1b4baa017\": rpc error: code = NotFound desc = could not find container \"09569ad9b462f60999c4cf67ea3d57456ffaf48ebb55d2aaae476ee1b4baa017\": container with ID starting with 09569ad9b462f60999c4cf67ea3d57456ffaf48ebb55d2aaae476ee1b4baa017 not found: ID does not exist" Jul 07 17:25:09.980182 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.980150 2549 scope.go:117] "RemoveContainer" containerID="ec0cdf04ae0ae5042272c747208ce0d4b227e451ad64e4cedac665a30697262e" Jul 07 17:25:09.980337 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.980323 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec0cdf04ae0ae5042272c747208ce0d4b227e451ad64e4cedac665a30697262e"} err="failed to get container status \"ec0cdf04ae0ae5042272c747208ce0d4b227e451ad64e4cedac665a30697262e\": rpc error: code = NotFound desc = could not find container \"ec0cdf04ae0ae5042272c747208ce0d4b227e451ad64e4cedac665a30697262e\": container with ID starting with ec0cdf04ae0ae5042272c747208ce0d4b227e451ad64e4cedac665a30697262e not found: ID does not exist" Jul 07 17:25:09.980382 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.980336 2549 scope.go:117] "RemoveContainer" containerID="690f7d1bfa2cd6223a719277f263ed8d7c9d1ad04c7da95cf2c975f668704dc3" Jul 07 17:25:09.980547 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.980533 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"690f7d1bfa2cd6223a719277f263ed8d7c9d1ad04c7da95cf2c975f668704dc3"} err="failed to get container status \"690f7d1bfa2cd6223a719277f263ed8d7c9d1ad04c7da95cf2c975f668704dc3\": rpc error: code = NotFound desc = could not find container \"690f7d1bfa2cd6223a719277f263ed8d7c9d1ad04c7da95cf2c975f668704dc3\": container with ID starting with 690f7d1bfa2cd6223a719277f263ed8d7c9d1ad04c7da95cf2c975f668704dc3 not found: ID does not exist" Jul 07 17:25:09.980587 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.980547 2549 scope.go:117] "RemoveContainer" containerID="459155931f0fd05bf217c5563afd23352bc95194905db506cb92347e29aa7453" Jul 07 17:25:09.980747 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.980732 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"459155931f0fd05bf217c5563afd23352bc95194905db506cb92347e29aa7453"} err="failed to get container status \"459155931f0fd05bf217c5563afd23352bc95194905db506cb92347e29aa7453\": rpc error: code = NotFound desc = could not find container \"459155931f0fd05bf217c5563afd23352bc95194905db506cb92347e29aa7453\": container with ID starting with 459155931f0fd05bf217c5563afd23352bc95194905db506cb92347e29aa7453 not found: ID does not exist" Jul 07 17:25:09.980791 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.980748 2549 scope.go:117] "RemoveContainer" containerID="a8050489cd27ba10430e4a896c9867355c9ef8462224c4ab36d477c6bb7b496e" Jul 07 17:25:09.980934 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.980918 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8050489cd27ba10430e4a896c9867355c9ef8462224c4ab36d477c6bb7b496e"} err="failed to get container status \"a8050489cd27ba10430e4a896c9867355c9ef8462224c4ab36d477c6bb7b496e\": rpc error: code = NotFound desc = could not find container \"a8050489cd27ba10430e4a896c9867355c9ef8462224c4ab36d477c6bb7b496e\": container with ID starting with a8050489cd27ba10430e4a896c9867355c9ef8462224c4ab36d477c6bb7b496e not found: ID does not exist" Jul 07 17:25:09.980973 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.980933 2549 scope.go:117] "RemoveContainer" containerID="876ad4d7c3fda9dde0ace870b3ef71b65b90ab0efbd1d24ca068e6f1144afbce" Jul 07 17:25:09.981125 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.981112 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"876ad4d7c3fda9dde0ace870b3ef71b65b90ab0efbd1d24ca068e6f1144afbce"} err="failed to get container status \"876ad4d7c3fda9dde0ace870b3ef71b65b90ab0efbd1d24ca068e6f1144afbce\": rpc error: code = NotFound desc = could not find container \"876ad4d7c3fda9dde0ace870b3ef71b65b90ab0efbd1d24ca068e6f1144afbce\": container with ID starting with 876ad4d7c3fda9dde0ace870b3ef71b65b90ab0efbd1d24ca068e6f1144afbce not found: ID does not exist" Jul 07 17:25:09.981125 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.981124 2549 scope.go:117] "RemoveContainer" containerID="24afcb63b47d2fcec3a4a96ec9a29d153f7d7256d01a0fcd9d5e184d34a98a43" Jul 07 17:25:09.981340 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.981320 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24afcb63b47d2fcec3a4a96ec9a29d153f7d7256d01a0fcd9d5e184d34a98a43"} err="failed to get container status \"24afcb63b47d2fcec3a4a96ec9a29d153f7d7256d01a0fcd9d5e184d34a98a43\": rpc error: code = NotFound desc = could not find container \"24afcb63b47d2fcec3a4a96ec9a29d153f7d7256d01a0fcd9d5e184d34a98a43\": container with ID starting with 24afcb63b47d2fcec3a4a96ec9a29d153f7d7256d01a0fcd9d5e184d34a98a43 not found: ID does not exist" Jul 07 17:25:09.981391 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.981340 2549 scope.go:117] "RemoveContainer" containerID="09569ad9b462f60999c4cf67ea3d57456ffaf48ebb55d2aaae476ee1b4baa017" Jul 07 17:25:09.981537 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.981522 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09569ad9b462f60999c4cf67ea3d57456ffaf48ebb55d2aaae476ee1b4baa017"} err="failed to get container status \"09569ad9b462f60999c4cf67ea3d57456ffaf48ebb55d2aaae476ee1b4baa017\": rpc error: code = NotFound desc = could not find container \"09569ad9b462f60999c4cf67ea3d57456ffaf48ebb55d2aaae476ee1b4baa017\": container with ID starting with 09569ad9b462f60999c4cf67ea3d57456ffaf48ebb55d2aaae476ee1b4baa017 not found: ID does not exist" Jul 07 17:25:09.997153 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.997136 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 17:25:09.997360 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.997350 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4512f419-ceed-415c-b02e-c61116bbeac9" containerName="kube-rbac-proxy-web" Jul 07 17:25:09.997394 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.997363 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4512f419-ceed-415c-b02e-c61116bbeac9" containerName="kube-rbac-proxy-web" Jul 07 17:25:09.997394 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.997376 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4512f419-ceed-415c-b02e-c61116bbeac9" containerName="alertmanager" Jul 07 17:25:09.997394 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.997381 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4512f419-ceed-415c-b02e-c61116bbeac9" containerName="alertmanager" Jul 07 17:25:09.997394 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.997389 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4512f419-ceed-415c-b02e-c61116bbeac9" containerName="prom-label-proxy" Jul 07 17:25:09.997394 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.997394 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4512f419-ceed-415c-b02e-c61116bbeac9" containerName="prom-label-proxy" Jul 07 17:25:09.997580 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.997402 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4512f419-ceed-415c-b02e-c61116bbeac9" containerName="config-reloader" Jul 07 17:25:09.997580 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.997407 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4512f419-ceed-415c-b02e-c61116bbeac9" containerName="config-reloader" Jul 07 17:25:09.997580 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.997414 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4512f419-ceed-415c-b02e-c61116bbeac9" containerName="init-config-reloader" Jul 07 17:25:09.997580 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.997418 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4512f419-ceed-415c-b02e-c61116bbeac9" containerName="init-config-reloader" Jul 07 17:25:09.997580 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.997424 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4512f419-ceed-415c-b02e-c61116bbeac9" containerName="kube-rbac-proxy-metric" Jul 07 17:25:09.997580 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.997428 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4512f419-ceed-415c-b02e-c61116bbeac9" containerName="kube-rbac-proxy-metric" Jul 07 17:25:09.997580 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.997437 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4512f419-ceed-415c-b02e-c61116bbeac9" containerName="kube-rbac-proxy" Jul 07 17:25:09.997580 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.997442 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4512f419-ceed-415c-b02e-c61116bbeac9" containerName="kube-rbac-proxy" Jul 07 17:25:09.997580 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.997478 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="4512f419-ceed-415c-b02e-c61116bbeac9" containerName="config-reloader" Jul 07 17:25:09.997580 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.997484 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="4512f419-ceed-415c-b02e-c61116bbeac9" containerName="kube-rbac-proxy" Jul 07 17:25:09.997580 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.997490 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="4512f419-ceed-415c-b02e-c61116bbeac9" containerName="prom-label-proxy" Jul 07 17:25:09.997580 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.997496 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="4512f419-ceed-415c-b02e-c61116bbeac9" containerName="alertmanager" Jul 07 17:25:09.997580 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.997501 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="4512f419-ceed-415c-b02e-c61116bbeac9" containerName="kube-rbac-proxy-web" Jul 07 17:25:09.997580 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:09.997528 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="4512f419-ceed-415c-b02e-c61116bbeac9" containerName="kube-rbac-proxy-metric" Jul 07 17:25:10.000414 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.000398 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.005329 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.005316 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 17:25:10.005421 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.005319 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 17:25:10.006356 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.006338 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 17:25:10.006356 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.006351 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 17:25:10.006495 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.006456 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 17:25:10.006495 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.006464 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 17:25:10.006752 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.006718 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 17:25:10.006899 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.006883 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-l8wv5\"" Jul 07 17:25:10.013128 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.013111 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 17:25:10.013409 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.013395 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 17:25:10.035652 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.035632 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 17:25:10.097642 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.097586 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e34f50a9-99cc-4efb-91fe-cdb63736446e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.097642 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.097615 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e34f50a9-99cc-4efb-91fe-cdb63736446e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.097642 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.097634 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e34f50a9-99cc-4efb-91fe-cdb63736446e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.097795 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.097655 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmfwl\" (UniqueName: \"kubernetes.io/projected/e34f50a9-99cc-4efb-91fe-cdb63736446e-kube-api-access-vmfwl\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.097795 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.097711 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e34f50a9-99cc-4efb-91fe-cdb63736446e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.097795 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.097756 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e34f50a9-99cc-4efb-91fe-cdb63736446e-web-config\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.097795 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.097778 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e34f50a9-99cc-4efb-91fe-cdb63736446e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.097929 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.097799 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e34f50a9-99cc-4efb-91fe-cdb63736446e-config-volume\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.097929 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.097834 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e34f50a9-99cc-4efb-91fe-cdb63736446e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.097929 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.097860 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e34f50a9-99cc-4efb-91fe-cdb63736446e-config-out\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.097929 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.097881 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e34f50a9-99cc-4efb-91fe-cdb63736446e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.097929 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.097902 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e34f50a9-99cc-4efb-91fe-cdb63736446e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.097929 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.097924 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e34f50a9-99cc-4efb-91fe-cdb63736446e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.198800 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.198775 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e34f50a9-99cc-4efb-91fe-cdb63736446e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.198800 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.198802 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e34f50a9-99cc-4efb-91fe-cdb63736446e-config-out\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.198924 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.198824 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e34f50a9-99cc-4efb-91fe-cdb63736446e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.198924 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.198851 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e34f50a9-99cc-4efb-91fe-cdb63736446e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.198924 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.198877 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e34f50a9-99cc-4efb-91fe-cdb63736446e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.199055 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.198923 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e34f50a9-99cc-4efb-91fe-cdb63736446e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.199055 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.198958 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e34f50a9-99cc-4efb-91fe-cdb63736446e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.199134 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.199098 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e34f50a9-99cc-4efb-91fe-cdb63736446e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.199184 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.199146 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmfwl\" (UniqueName: \"kubernetes.io/projected/e34f50a9-99cc-4efb-91fe-cdb63736446e-kube-api-access-vmfwl\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.199238 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.199184 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e34f50a9-99cc-4efb-91fe-cdb63736446e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.199238 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.199223 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e34f50a9-99cc-4efb-91fe-cdb63736446e-web-config\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.199343 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.199244 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e34f50a9-99cc-4efb-91fe-cdb63736446e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.199343 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.199282 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e34f50a9-99cc-4efb-91fe-cdb63736446e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.199343 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.199332 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e34f50a9-99cc-4efb-91fe-cdb63736446e-config-volume\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.200186 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.200158 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e34f50a9-99cc-4efb-91fe-cdb63736446e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.201199 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.201168 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e34f50a9-99cc-4efb-91fe-cdb63736446e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.202046 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.202021 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e34f50a9-99cc-4efb-91fe-cdb63736446e-config-out\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.202138 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.202052 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e34f50a9-99cc-4efb-91fe-cdb63736446e-web-config\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.202196 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.202154 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e34f50a9-99cc-4efb-91fe-cdb63736446e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.202429 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.202408 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e34f50a9-99cc-4efb-91fe-cdb63736446e-config-volume\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.202527 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.202478 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e34f50a9-99cc-4efb-91fe-cdb63736446e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.202640 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.202617 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e34f50a9-99cc-4efb-91fe-cdb63736446e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.203262 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.203243 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e34f50a9-99cc-4efb-91fe-cdb63736446e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.203355 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.203340 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e34f50a9-99cc-4efb-91fe-cdb63736446e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.203835 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.203814 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e34f50a9-99cc-4efb-91fe-cdb63736446e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.209990 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.209971 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmfwl\" (UniqueName: \"kubernetes.io/projected/e34f50a9-99cc-4efb-91fe-cdb63736446e-kube-api-access-vmfwl\") pod \"alertmanager-main-0\" (UID: \"e34f50a9-99cc-4efb-91fe-cdb63736446e\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.219384 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.219365 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4512f419-ceed-415c-b02e-c61116bbeac9" path="/var/lib/kubelet/pods/4512f419-ceed-415c-b02e-c61116bbeac9/volumes" Jul 07 17:25:10.310443 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.310420 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 17:25:10.445645 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.445580 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 17:25:10.447788 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:25:10.447760 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode34f50a9_99cc_4efb_91fe_cdb63736446e.slice/crio-a528581f4377d871fc2fead49560991a0d74f52a5df7a3c6e96d23a4050085cd WatchSource:0}: Error finding container a528581f4377d871fc2fead49560991a0d74f52a5df7a3c6e96d23a4050085cd: Status 404 returned error can't find the container with id a528581f4377d871fc2fead49560991a0d74f52a5df7a3c6e96d23a4050085cd Jul 07 17:25:10.932681 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.932645 2549 generic.go:356] "Generic (PLEG): container finished" podID="e34f50a9-99cc-4efb-91fe-cdb63736446e" containerID="2794c6e340dd4cdc2d3c6f43be4f1784ccb54a8e98383d6d93acc6baaece1c3f" exitCode=0 Jul 07 17:25:10.933025 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.932708 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e34f50a9-99cc-4efb-91fe-cdb63736446e","Type":"ContainerDied","Data":"2794c6e340dd4cdc2d3c6f43be4f1784ccb54a8e98383d6d93acc6baaece1c3f"} Jul 07 17:25:10.933025 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:10.932765 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e34f50a9-99cc-4efb-91fe-cdb63736446e","Type":"ContainerStarted","Data":"a528581f4377d871fc2fead49560991a0d74f52a5df7a3c6e96d23a4050085cd"} Jul 07 17:25:11.940712 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:11.940676 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e34f50a9-99cc-4efb-91fe-cdb63736446e","Type":"ContainerStarted","Data":"4e74b078d28c361c851f8a4d4c126cb6150eb6d4b7c2d360b8d184f5ff0613ee"} Jul 07 17:25:11.941098 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:11.940780 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e34f50a9-99cc-4efb-91fe-cdb63736446e","Type":"ContainerStarted","Data":"6fab58717fdd9483d862c54894f43e75260ccfd9848d2bebcbca7d91ea257aa5"} Jul 07 17:25:11.941098 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:11.940811 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e34f50a9-99cc-4efb-91fe-cdb63736446e","Type":"ContainerStarted","Data":"c13dcfcd36695ca0b4282178992c7e74b689ed5669c8ed653b261e4197c80f40"} Jul 07 17:25:11.941098 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:11.940838 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e34f50a9-99cc-4efb-91fe-cdb63736446e","Type":"ContainerStarted","Data":"aacc2594936e5be8e3024990d08880ad3a2eb7ea5a2f06391f7d6b516b56298e"} Jul 07 17:25:11.941098 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:11.940861 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e34f50a9-99cc-4efb-91fe-cdb63736446e","Type":"ContainerStarted","Data":"ab545d768cb7fffc09228fd01f112ebc1bdef08c0d269353491c2c483905d180"} Jul 07 17:25:11.941098 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:11.940884 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e34f50a9-99cc-4efb-91fe-cdb63736446e","Type":"ContainerStarted","Data":"141fe7c0ea352a9316fe72e63fc3c5189c77e58b623daed979c137ee1f52b096"} Jul 07 17:25:11.977833 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:11.977784 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.963043484 podStartE2EDuration="2.977765817s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.722333ms" isStatefulPod=false podCreationTimestamp="2026-07-07 17:25:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:25:11.975795273 +0000 UTC m=+148.262398404" watchObservedRunningTime="2026-07-07 17:25:11.977765817 +0000 UTC m=+148.264368950" Jul 07 17:25:18.349672 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:18.349627 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:25:18.350166 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:18.349728 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:25:18.354545 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:18.354497 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:25:18.973548 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:18.973492 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:25:19.043908 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:19.043875 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59f774ffff-jx94x"] Jul 07 17:25:44.066125 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:44.066056 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-59f774ffff-jx94x" podUID="f8216170-c3b4-4cc2-98f3-db82011a895c" containerName="console" containerID="cri-o://8aa5fc49361e0df35b6d307406a60772279ec4190141e50102ef3e603cd7c379" gracePeriod=15 Jul 07 17:25:44.303909 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:44.303879 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:25:44.429937 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:44.429910 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8216170-c3b4-4cc2-98f3-db82011a895c-trusted-ca-bundle\") pod \"f8216170-c3b4-4cc2-98f3-db82011a895c\" (UID: \"f8216170-c3b4-4cc2-98f3-db82011a895c\") " Jul 07 17:25:44.430048 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:44.429952 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8216170-c3b4-4cc2-98f3-db82011a895c-service-ca\") pod \"f8216170-c3b4-4cc2-98f3-db82011a895c\" (UID: \"f8216170-c3b4-4cc2-98f3-db82011a895c\") " Jul 07 17:25:44.430048 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:44.429988 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcdz8\" (UniqueName: \"kubernetes.io/projected/f8216170-c3b4-4cc2-98f3-db82011a895c-kube-api-access-lcdz8\") pod \"f8216170-c3b4-4cc2-98f3-db82011a895c\" (UID: \"f8216170-c3b4-4cc2-98f3-db82011a895c\") " Jul 07 17:25:44.430048 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:44.430018 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8216170-c3b4-4cc2-98f3-db82011a895c-console-serving-cert\") pod \"f8216170-c3b4-4cc2-98f3-db82011a895c\" (UID: \"f8216170-c3b4-4cc2-98f3-db82011a895c\") " Jul 07 17:25:44.430048 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:44.430044 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8216170-c3b4-4cc2-98f3-db82011a895c-console-oauth-config\") pod \"f8216170-c3b4-4cc2-98f3-db82011a895c\" (UID: \"f8216170-c3b4-4cc2-98f3-db82011a895c\") " Jul 07 17:25:44.430227 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:44.430068 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8216170-c3b4-4cc2-98f3-db82011a895c-console-config\") pod \"f8216170-c3b4-4cc2-98f3-db82011a895c\" (UID: \"f8216170-c3b4-4cc2-98f3-db82011a895c\") " Jul 07 17:25:44.430227 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:44.430095 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8216170-c3b4-4cc2-98f3-db82011a895c-oauth-serving-cert\") pod \"f8216170-c3b4-4cc2-98f3-db82011a895c\" (UID: \"f8216170-c3b4-4cc2-98f3-db82011a895c\") " Jul 07 17:25:44.430435 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:44.430404 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8216170-c3b4-4cc2-98f3-db82011a895c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f8216170-c3b4-4cc2-98f3-db82011a895c" (UID: "f8216170-c3b4-4cc2-98f3-db82011a895c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 17:25:44.430583 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:44.430552 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8216170-c3b4-4cc2-98f3-db82011a895c-service-ca" (OuterVolumeSpecName: "service-ca") pod "f8216170-c3b4-4cc2-98f3-db82011a895c" (UID: "f8216170-c3b4-4cc2-98f3-db82011a895c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 17:25:44.430702 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:44.430658 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8216170-c3b4-4cc2-98f3-db82011a895c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f8216170-c3b4-4cc2-98f3-db82011a895c" (UID: "f8216170-c3b4-4cc2-98f3-db82011a895c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 17:25:44.430702 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:44.430683 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8216170-c3b4-4cc2-98f3-db82011a895c-console-config" (OuterVolumeSpecName: "console-config") pod "f8216170-c3b4-4cc2-98f3-db82011a895c" (UID: "f8216170-c3b4-4cc2-98f3-db82011a895c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 17:25:44.432347 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:44.432319 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8216170-c3b4-4cc2-98f3-db82011a895c-kube-api-access-lcdz8" (OuterVolumeSpecName: "kube-api-access-lcdz8") pod "f8216170-c3b4-4cc2-98f3-db82011a895c" (UID: "f8216170-c3b4-4cc2-98f3-db82011a895c"). InnerVolumeSpecName "kube-api-access-lcdz8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:25:44.432347 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:44.432322 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8216170-c3b4-4cc2-98f3-db82011a895c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f8216170-c3b4-4cc2-98f3-db82011a895c" (UID: "f8216170-c3b4-4cc2-98f3-db82011a895c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:25:44.432470 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:44.432393 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8216170-c3b4-4cc2-98f3-db82011a895c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f8216170-c3b4-4cc2-98f3-db82011a895c" (UID: "f8216170-c3b4-4cc2-98f3-db82011a895c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:25:44.530820 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:44.530794 2549 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f8216170-c3b4-4cc2-98f3-db82011a895c-console-oauth-config\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:25:44.530820 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:44.530819 2549 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f8216170-c3b4-4cc2-98f3-db82011a895c-console-config\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:25:44.530962 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:44.530833 2549 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f8216170-c3b4-4cc2-98f3-db82011a895c-oauth-serving-cert\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:25:44.530962 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:44.530844 2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8216170-c3b4-4cc2-98f3-db82011a895c-trusted-ca-bundle\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:25:44.530962 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:44.530856 2549 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f8216170-c3b4-4cc2-98f3-db82011a895c-service-ca\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:25:44.530962 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:44.530868 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcdz8\" (UniqueName: \"kubernetes.io/projected/f8216170-c3b4-4cc2-98f3-db82011a895c-kube-api-access-lcdz8\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:25:44.530962 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:44.530879 2549 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8216170-c3b4-4cc2-98f3-db82011a895c-console-serving-cert\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:25:45.070429 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:45.070391 2549 generic.go:356] "Generic (PLEG): container finished" podID="f8216170-c3b4-4cc2-98f3-db82011a895c" containerID="8aa5fc49361e0df35b6d307406a60772279ec4190141e50102ef3e603cd7c379" exitCode=0 Jul 07 17:25:45.070807 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:45.070445 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f774ffff-jx94x" Jul 07 17:25:45.070807 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:45.070482 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f774ffff-jx94x" event={"ID":"f8216170-c3b4-4cc2-98f3-db82011a895c","Type":"ContainerDied","Data":"8aa5fc49361e0df35b6d307406a60772279ec4190141e50102ef3e603cd7c379"} Jul 07 17:25:45.070807 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:45.070556 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f774ffff-jx94x" event={"ID":"f8216170-c3b4-4cc2-98f3-db82011a895c","Type":"ContainerDied","Data":"05de1b953ac789508339fab1467bd06e5c73d274c7a325fdcf57fcaf1e113e9b"} Jul 07 17:25:45.070807 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:45.070578 2549 scope.go:117] "RemoveContainer" containerID="8aa5fc49361e0df35b6d307406a60772279ec4190141e50102ef3e603cd7c379" Jul 07 17:25:45.079495 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:45.079478 2549 scope.go:117] "RemoveContainer" containerID="8aa5fc49361e0df35b6d307406a60772279ec4190141e50102ef3e603cd7c379" Jul 07 17:25:45.079798 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:25:45.079780 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8aa5fc49361e0df35b6d307406a60772279ec4190141e50102ef3e603cd7c379\": container with ID starting with 8aa5fc49361e0df35b6d307406a60772279ec4190141e50102ef3e603cd7c379 not found: ID does not exist" containerID="8aa5fc49361e0df35b6d307406a60772279ec4190141e50102ef3e603cd7c379" Jul 07 17:25:45.079848 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:45.079807 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8aa5fc49361e0df35b6d307406a60772279ec4190141e50102ef3e603cd7c379"} err="failed to get container status \"8aa5fc49361e0df35b6d307406a60772279ec4190141e50102ef3e603cd7c379\": rpc error: code = NotFound desc = could not find container \"8aa5fc49361e0df35b6d307406a60772279ec4190141e50102ef3e603cd7c379\": container with ID starting with 8aa5fc49361e0df35b6d307406a60772279ec4190141e50102ef3e603cd7c379 not found: ID does not exist" Jul 07 17:25:45.097971 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:45.097945 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59f774ffff-jx94x"] Jul 07 17:25:45.100888 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:45.100867 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59f774ffff-jx94x"] Jul 07 17:25:46.219483 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:25:46.219440 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8216170-c3b4-4cc2-98f3-db82011a895c" path="/var/lib/kubelet/pods/f8216170-c3b4-4cc2-98f3-db82011a895c/volumes" Jul 07 17:27:44.103811 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:27:44.103780 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhztd_00383bc5-6090-486b-892b-5be74f96c497/ovn-acl-logging/0.log" Jul 07 17:27:44.105050 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:27:44.105026 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhztd_00383bc5-6090-486b-892b-5be74f96c497/ovn-acl-logging/0.log" Jul 07 17:27:44.111140 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:27:44.111124 2549 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 17:30:24.569968 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:24.569924 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd"] Jul 07 17:30:24.570662 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:24.570309 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8216170-c3b4-4cc2-98f3-db82011a895c" containerName="console" Jul 07 17:30:24.570662 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:24.570328 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8216170-c3b4-4cc2-98f3-db82011a895c" containerName="console" Jul 07 17:30:24.570662 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:24.570397 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8216170-c3b4-4cc2-98f3-db82011a895c" containerName="console" Jul 07 17:30:24.573500 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:24.573473 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd" Jul 07 17:30:24.576887 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:24.576864 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ttxrs\"" Jul 07 17:30:24.577118 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:24.577103 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 17:30:24.578004 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:24.577988 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 17:30:24.596546 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:24.596488 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd"] Jul 07 17:30:24.673491 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:24.673464 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea4f2dc4-ed36-46f7-890e-f2e230546df7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd\" (UID: \"ea4f2dc4-ed36-46f7-890e-f2e230546df7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd" Jul 07 17:30:24.673616 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:24.673530 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t9mf\" (UniqueName: \"kubernetes.io/projected/ea4f2dc4-ed36-46f7-890e-f2e230546df7-kube-api-access-9t9mf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd\" (UID: \"ea4f2dc4-ed36-46f7-890e-f2e230546df7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd" Jul 07 17:30:24.673616 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:24.673580 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea4f2dc4-ed36-46f7-890e-f2e230546df7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd\" (UID: \"ea4f2dc4-ed36-46f7-890e-f2e230546df7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd" Jul 07 17:30:24.774259 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:24.774236 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea4f2dc4-ed36-46f7-890e-f2e230546df7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd\" (UID: \"ea4f2dc4-ed36-46f7-890e-f2e230546df7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd" Jul 07 17:30:24.774357 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:24.774276 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t9mf\" (UniqueName: \"kubernetes.io/projected/ea4f2dc4-ed36-46f7-890e-f2e230546df7-kube-api-access-9t9mf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd\" (UID: \"ea4f2dc4-ed36-46f7-890e-f2e230546df7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd" Jul 07 17:30:24.774357 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:24.774297 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea4f2dc4-ed36-46f7-890e-f2e230546df7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd\" (UID: \"ea4f2dc4-ed36-46f7-890e-f2e230546df7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd" Jul 07 17:30:24.774661 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:24.774609 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea4f2dc4-ed36-46f7-890e-f2e230546df7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd\" (UID: \"ea4f2dc4-ed36-46f7-890e-f2e230546df7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd" Jul 07 17:30:24.774717 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:24.774699 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea4f2dc4-ed36-46f7-890e-f2e230546df7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd\" (UID: \"ea4f2dc4-ed36-46f7-890e-f2e230546df7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd" Jul 07 17:30:24.785544 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:24.785494 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t9mf\" (UniqueName: \"kubernetes.io/projected/ea4f2dc4-ed36-46f7-890e-f2e230546df7-kube-api-access-9t9mf\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd\" (UID: \"ea4f2dc4-ed36-46f7-890e-f2e230546df7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd" Jul 07 17:30:24.883644 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:24.883580 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd" Jul 07 17:30:25.021876 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:25.021850 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd"] Jul 07 17:30:25.025217 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:30:25.025189 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea4f2dc4_ed36_46f7_890e_f2e230546df7.slice/crio-f10f38fc32d1dcc80893da44c1ef836a7d93e6e2273a9d7ced1cd89a47ad8f7a WatchSource:0}: Error finding container f10f38fc32d1dcc80893da44c1ef836a7d93e6e2273a9d7ced1cd89a47ad8f7a: Status 404 returned error can't find the container with id f10f38fc32d1dcc80893da44c1ef836a7d93e6e2273a9d7ced1cd89a47ad8f7a Jul 07 17:30:25.027067 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:25.027049 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 17:30:25.085461 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:25.085436 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd" event={"ID":"ea4f2dc4-ed36-46f7-890e-f2e230546df7","Type":"ContainerStarted","Data":"f10f38fc32d1dcc80893da44c1ef836a7d93e6e2273a9d7ced1cd89a47ad8f7a"} Jul 07 17:30:35.123231 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:35.123200 2549 generic.go:356] "Generic (PLEG): container finished" podID="ea4f2dc4-ed36-46f7-890e-f2e230546df7" containerID="6cad29358106edf6566e8148824a856a4296521b1f1271167cdf91946ade46b0" exitCode=0 Jul 07 17:30:35.123616 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:35.123249 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd" event={"ID":"ea4f2dc4-ed36-46f7-890e-f2e230546df7","Type":"ContainerDied","Data":"6cad29358106edf6566e8148824a856a4296521b1f1271167cdf91946ade46b0"} Jul 07 17:30:40.143074 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:40.143019 2549 generic.go:356] "Generic (PLEG): container finished" podID="ea4f2dc4-ed36-46f7-890e-f2e230546df7" containerID="54b75f01a01877ca5b3740de11930cd234526f3c4b325ea3aa08642999dcc95b" exitCode=0 Jul 07 17:30:40.143397 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:40.143109 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd" event={"ID":"ea4f2dc4-ed36-46f7-890e-f2e230546df7","Type":"ContainerDied","Data":"54b75f01a01877ca5b3740de11930cd234526f3c4b325ea3aa08642999dcc95b"} Jul 07 17:30:50.185863 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:50.185819 2549 generic.go:356] "Generic (PLEG): container finished" podID="ea4f2dc4-ed36-46f7-890e-f2e230546df7" containerID="df6439d339c1c8a4e2887b8d269c9be8c492e58e00d72c930b32b79bd0993005" exitCode=0 Jul 07 17:30:50.186209 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:50.185903 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd" event={"ID":"ea4f2dc4-ed36-46f7-890e-f2e230546df7","Type":"ContainerDied","Data":"df6439d339c1c8a4e2887b8d269c9be8c492e58e00d72c930b32b79bd0993005"} Jul 07 17:30:51.311114 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:51.311093 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd" Jul 07 17:30:51.362349 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:51.362329 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea4f2dc4-ed36-46f7-890e-f2e230546df7-bundle\") pod \"ea4f2dc4-ed36-46f7-890e-f2e230546df7\" (UID: \"ea4f2dc4-ed36-46f7-890e-f2e230546df7\") " Jul 07 17:30:51.362455 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:51.362378 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9t9mf\" (UniqueName: \"kubernetes.io/projected/ea4f2dc4-ed36-46f7-890e-f2e230546df7-kube-api-access-9t9mf\") pod \"ea4f2dc4-ed36-46f7-890e-f2e230546df7\" (UID: \"ea4f2dc4-ed36-46f7-890e-f2e230546df7\") " Jul 07 17:30:51.362455 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:51.362418 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea4f2dc4-ed36-46f7-890e-f2e230546df7-util\") pod \"ea4f2dc4-ed36-46f7-890e-f2e230546df7\" (UID: \"ea4f2dc4-ed36-46f7-890e-f2e230546df7\") " Jul 07 17:30:51.363206 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:51.363151 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea4f2dc4-ed36-46f7-890e-f2e230546df7-bundle" (OuterVolumeSpecName: "bundle") pod "ea4f2dc4-ed36-46f7-890e-f2e230546df7" (UID: "ea4f2dc4-ed36-46f7-890e-f2e230546df7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:30:51.364670 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:51.364637 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea4f2dc4-ed36-46f7-890e-f2e230546df7-kube-api-access-9t9mf" (OuterVolumeSpecName: "kube-api-access-9t9mf") pod "ea4f2dc4-ed36-46f7-890e-f2e230546df7" (UID: "ea4f2dc4-ed36-46f7-890e-f2e230546df7"). InnerVolumeSpecName "kube-api-access-9t9mf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:30:51.367521 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:51.367491 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea4f2dc4-ed36-46f7-890e-f2e230546df7-util" (OuterVolumeSpecName: "util") pod "ea4f2dc4-ed36-46f7-890e-f2e230546df7" (UID: "ea4f2dc4-ed36-46f7-890e-f2e230546df7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:30:51.463814 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:51.463768 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea4f2dc4-ed36-46f7-890e-f2e230546df7-util\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:30:51.463814 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:51.463786 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea4f2dc4-ed36-46f7-890e-f2e230546df7-bundle\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:30:51.463814 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:51.463795 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9t9mf\" (UniqueName: \"kubernetes.io/projected/ea4f2dc4-ed36-46f7-890e-f2e230546df7-kube-api-access-9t9mf\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:30:52.195346 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:52.195317 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd" event={"ID":"ea4f2dc4-ed36-46f7-890e-f2e230546df7","Type":"ContainerDied","Data":"f10f38fc32d1dcc80893da44c1ef836a7d93e6e2273a9d7ced1cd89a47ad8f7a"} Jul 07 17:30:52.195455 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:52.195343 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540twkwd" Jul 07 17:30:52.195455 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:52.195362 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f10f38fc32d1dcc80893da44c1ef836a7d93e6e2273a9d7ced1cd89a47ad8f7a" Jul 07 17:30:58.610873 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:58.610814 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sm4f5"] Jul 07 17:30:58.611440 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:58.611415 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea4f2dc4-ed36-46f7-890e-f2e230546df7" containerName="extract" Jul 07 17:30:58.611440 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:58.611442 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea4f2dc4-ed36-46f7-890e-f2e230546df7" containerName="extract" Jul 07 17:30:58.611589 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:58.611465 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea4f2dc4-ed36-46f7-890e-f2e230546df7" containerName="util" Jul 07 17:30:58.611589 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:58.611475 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea4f2dc4-ed36-46f7-890e-f2e230546df7" containerName="util" Jul 07 17:30:58.611589 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:58.611485 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea4f2dc4-ed36-46f7-890e-f2e230546df7" containerName="pull" Jul 07 17:30:58.611589 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:58.611494 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea4f2dc4-ed36-46f7-890e-f2e230546df7" containerName="pull" Jul 07 17:30:58.611757 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:58.611666 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea4f2dc4-ed36-46f7-890e-f2e230546df7" containerName="extract" Jul 07 17:30:58.614658 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:58.614617 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sm4f5" Jul 07 17:30:58.618926 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:58.618903 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 07 17:30:58.619470 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:58.619453 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 07 17:30:58.619569 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:58.619454 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-bg4jb\"" Jul 07 17:30:58.642441 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:58.642417 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sm4f5"] Jul 07 17:30:58.714330 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:58.714304 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb76l\" (UniqueName: \"kubernetes.io/projected/d47087aa-a24f-4b95-a85d-f1fe846e035e-kube-api-access-mb76l\") pod \"cert-manager-operator-controller-manager-55c444bf86-sm4f5\" (UID: \"d47087aa-a24f-4b95-a85d-f1fe846e035e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sm4f5" Jul 07 17:30:58.714415 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:58.714366 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d47087aa-a24f-4b95-a85d-f1fe846e035e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sm4f5\" (UID: \"d47087aa-a24f-4b95-a85d-f1fe846e035e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sm4f5" Jul 07 17:30:58.815198 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:58.815174 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d47087aa-a24f-4b95-a85d-f1fe846e035e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sm4f5\" (UID: \"d47087aa-a24f-4b95-a85d-f1fe846e035e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sm4f5" Jul 07 17:30:58.815284 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:58.815219 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb76l\" (UniqueName: \"kubernetes.io/projected/d47087aa-a24f-4b95-a85d-f1fe846e035e-kube-api-access-mb76l\") pod \"cert-manager-operator-controller-manager-55c444bf86-sm4f5\" (UID: \"d47087aa-a24f-4b95-a85d-f1fe846e035e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sm4f5" Jul 07 17:30:58.815584 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:58.815564 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d47087aa-a24f-4b95-a85d-f1fe846e035e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sm4f5\" (UID: \"d47087aa-a24f-4b95-a85d-f1fe846e035e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sm4f5" Jul 07 17:30:58.827394 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:58.827369 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb76l\" (UniqueName: \"kubernetes.io/projected/d47087aa-a24f-4b95-a85d-f1fe846e035e-kube-api-access-mb76l\") pod \"cert-manager-operator-controller-manager-55c444bf86-sm4f5\" (UID: \"d47087aa-a24f-4b95-a85d-f1fe846e035e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sm4f5" Jul 07 17:30:58.924395 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:58.924372 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sm4f5" Jul 07 17:30:59.082275 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:59.082252 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sm4f5"] Jul 07 17:30:59.084540 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:30:59.084497 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd47087aa_a24f_4b95_a85d_f1fe846e035e.slice/crio-9ef9b47c4119cb7338e90ff71f981c65a8faa87e8b97da73e72aa19a7ffc66d3 WatchSource:0}: Error finding container 9ef9b47c4119cb7338e90ff71f981c65a8faa87e8b97da73e72aa19a7ffc66d3: Status 404 returned error can't find the container with id 9ef9b47c4119cb7338e90ff71f981c65a8faa87e8b97da73e72aa19a7ffc66d3 Jul 07 17:30:59.223833 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:30:59.223773 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sm4f5" event={"ID":"d47087aa-a24f-4b95-a85d-f1fe846e035e","Type":"ContainerStarted","Data":"9ef9b47c4119cb7338e90ff71f981c65a8faa87e8b97da73e72aa19a7ffc66d3"} Jul 07 17:31:01.232451 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:01.232424 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sm4f5" event={"ID":"d47087aa-a24f-4b95-a85d-f1fe846e035e","Type":"ContainerStarted","Data":"77d4abc86771ce78563bae112793b262bb984a1595aff558d6f07b4549e34495"} Jul 07 17:31:02.213914 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:02.213861 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sm4f5" podStartSLOduration=2.719464727 podStartE2EDuration="4.213845001s" totalImagesPullingTime="1.494380274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:31:01.279891122 +0000 UTC m=+497.566494252" watchObservedRunningTime="2026-07-07 17:31:02.213845001 +0000 UTC m=+498.500448131" Jul 07 17:31:02.214084 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:02.214060 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc"] Jul 07 17:31:02.216733 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:02.216712 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc" Jul 07 17:31:02.220565 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:02.220543 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 17:31:02.221423 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:02.221402 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 17:31:02.225283 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:02.225265 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ttxrs\"" Jul 07 17:31:02.239293 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:02.239272 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4cd659a-cc71-4361-ab7b-42df882651df-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc\" (UID: \"f4cd659a-cc71-4361-ab7b-42df882651df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc" Jul 07 17:31:02.239654 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:02.239321 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsqlh\" (UniqueName: \"kubernetes.io/projected/f4cd659a-cc71-4361-ab7b-42df882651df-kube-api-access-bsqlh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc\" (UID: \"f4cd659a-cc71-4361-ab7b-42df882651df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc" Jul 07 17:31:02.239654 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:02.239383 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4cd659a-cc71-4361-ab7b-42df882651df-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc\" (UID: \"f4cd659a-cc71-4361-ab7b-42df882651df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc" Jul 07 17:31:02.263264 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:02.263240 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc"] Jul 07 17:31:02.340155 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:02.340133 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4cd659a-cc71-4361-ab7b-42df882651df-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc\" (UID: \"f4cd659a-cc71-4361-ab7b-42df882651df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc" Jul 07 17:31:02.340280 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:02.340183 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsqlh\" (UniqueName: \"kubernetes.io/projected/f4cd659a-cc71-4361-ab7b-42df882651df-kube-api-access-bsqlh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc\" (UID: \"f4cd659a-cc71-4361-ab7b-42df882651df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc" Jul 07 17:31:02.340280 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:02.340230 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4cd659a-cc71-4361-ab7b-42df882651df-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc\" (UID: \"f4cd659a-cc71-4361-ab7b-42df882651df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc" Jul 07 17:31:02.340588 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:02.340567 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4cd659a-cc71-4361-ab7b-42df882651df-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc\" (UID: \"f4cd659a-cc71-4361-ab7b-42df882651df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc" Jul 07 17:31:02.340661 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:02.340593 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4cd659a-cc71-4361-ab7b-42df882651df-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc\" (UID: \"f4cd659a-cc71-4361-ab7b-42df882651df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc" Jul 07 17:31:02.387973 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:02.387947 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsqlh\" (UniqueName: \"kubernetes.io/projected/f4cd659a-cc71-4361-ab7b-42df882651df-kube-api-access-bsqlh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc\" (UID: \"f4cd659a-cc71-4361-ab7b-42df882651df\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc" Jul 07 17:31:02.526152 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:02.526102 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc" Jul 07 17:31:02.761703 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:02.761675 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc"] Jul 07 17:31:02.764808 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:31:02.764779 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4cd659a_cc71_4361_ab7b_42df882651df.slice/crio-e15ef6622fd03534afff5163bc9a159570231ab532cfbbbc454606a3ed930e33 WatchSource:0}: Error finding container e15ef6622fd03534afff5163bc9a159570231ab532cfbbbc454606a3ed930e33: Status 404 returned error can't find the container with id e15ef6622fd03534afff5163bc9a159570231ab532cfbbbc454606a3ed930e33 Jul 07 17:31:03.242130 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:03.242093 2549 generic.go:356] "Generic (PLEG): container finished" podID="f4cd659a-cc71-4361-ab7b-42df882651df" containerID="c38fa2a7b7297a0af8e2dcc46111b6dc0c8cdd041c96ecf6eacc48ee5d948c0d" exitCode=0 Jul 07 17:31:03.242540 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:03.242186 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc" event={"ID":"f4cd659a-cc71-4361-ab7b-42df882651df","Type":"ContainerDied","Data":"c38fa2a7b7297a0af8e2dcc46111b6dc0c8cdd041c96ecf6eacc48ee5d948c0d"} Jul 07 17:31:03.242540 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:03.242243 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc" event={"ID":"f4cd659a-cc71-4361-ab7b-42df882651df","Type":"ContainerStarted","Data":"e15ef6622fd03534afff5163bc9a159570231ab532cfbbbc454606a3ed930e33"} Jul 07 17:31:05.622922 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:05.622898 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2cq54"] Jul 07 17:31:05.625035 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:05.625016 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2cq54" Jul 07 17:31:05.628154 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:05.628138 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 07 17:31:05.628219 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:05.628152 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 07 17:31:05.630223 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:05.630209 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-6tm7p\"" Jul 07 17:31:05.651271 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:05.651227 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2cq54"] Jul 07 17:31:05.669297 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:05.669278 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ed6c050c-5180-471e-8c2c-31f31b92e1db-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2cq54\" (UID: \"ed6c050c-5180-471e-8c2c-31f31b92e1db\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2cq54" Jul 07 17:31:05.669381 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:05.669342 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x85lc\" (UniqueName: \"kubernetes.io/projected/ed6c050c-5180-471e-8c2c-31f31b92e1db-kube-api-access-x85lc\") pod \"cert-manager-cainjector-559cdd8c87-2cq54\" (UID: \"ed6c050c-5180-471e-8c2c-31f31b92e1db\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2cq54" Jul 07 17:31:05.770545 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:05.770483 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ed6c050c-5180-471e-8c2c-31f31b92e1db-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2cq54\" (UID: \"ed6c050c-5180-471e-8c2c-31f31b92e1db\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2cq54" Jul 07 17:31:05.770635 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:05.770551 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x85lc\" (UniqueName: \"kubernetes.io/projected/ed6c050c-5180-471e-8c2c-31f31b92e1db-kube-api-access-x85lc\") pod \"cert-manager-cainjector-559cdd8c87-2cq54\" (UID: \"ed6c050c-5180-471e-8c2c-31f31b92e1db\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2cq54" Jul 07 17:31:05.783344 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:05.783325 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ed6c050c-5180-471e-8c2c-31f31b92e1db-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2cq54\" (UID: \"ed6c050c-5180-471e-8c2c-31f31b92e1db\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2cq54" Jul 07 17:31:05.783494 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:05.783478 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x85lc\" (UniqueName: \"kubernetes.io/projected/ed6c050c-5180-471e-8c2c-31f31b92e1db-kube-api-access-x85lc\") pod \"cert-manager-cainjector-559cdd8c87-2cq54\" (UID: \"ed6c050c-5180-471e-8c2c-31f31b92e1db\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2cq54" Jul 07 17:31:06.012873 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:06.012843 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2cq54" Jul 07 17:31:06.158310 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:06.158285 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2cq54"] Jul 07 17:31:06.160899 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:31:06.160873 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded6c050c_5180_471e_8c2c_31f31b92e1db.slice/crio-41ac466af546b2510f0b533a624fc9bdb62e144a0ff64861148c594fbae5abe9 WatchSource:0}: Error finding container 41ac466af546b2510f0b533a624fc9bdb62e144a0ff64861148c594fbae5abe9: Status 404 returned error can't find the container with id 41ac466af546b2510f0b533a624fc9bdb62e144a0ff64861148c594fbae5abe9 Jul 07 17:31:06.256018 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:06.255988 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2cq54" event={"ID":"ed6c050c-5180-471e-8c2c-31f31b92e1db","Type":"ContainerStarted","Data":"41ac466af546b2510f0b533a624fc9bdb62e144a0ff64861148c594fbae5abe9"} Jul 07 17:31:06.257692 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:06.257669 2549 generic.go:356] "Generic (PLEG): container finished" podID="f4cd659a-cc71-4361-ab7b-42df882651df" containerID="a92294eca62179f6fd4ce44a21d3d55fcab654e66e2ef79ffc75d4a3ce512354" exitCode=0 Jul 07 17:31:06.257786 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:06.257700 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc" event={"ID":"f4cd659a-cc71-4361-ab7b-42df882651df","Type":"ContainerDied","Data":"a92294eca62179f6fd4ce44a21d3d55fcab654e66e2ef79ffc75d4a3ce512354"} Jul 07 17:31:07.265797 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:07.265755 2549 generic.go:356] "Generic (PLEG): container finished" podID="f4cd659a-cc71-4361-ab7b-42df882651df" containerID="54dfd825a78e449fb42828624221dfa3b8d8db1b8f98e4429db30779fea2b010" exitCode=0 Jul 07 17:31:07.266231 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:07.265846 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc" event={"ID":"f4cd659a-cc71-4361-ab7b-42df882651df","Type":"ContainerDied","Data":"54dfd825a78e449fb42828624221dfa3b8d8db1b8f98e4429db30779fea2b010"} Jul 07 17:31:08.877904 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:08.877882 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc" Jul 07 17:31:08.996400 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:08.996377 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4cd659a-cc71-4361-ab7b-42df882651df-util\") pod \"f4cd659a-cc71-4361-ab7b-42df882651df\" (UID: \"f4cd659a-cc71-4361-ab7b-42df882651df\") " Jul 07 17:31:08.996521 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:08.996432 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4cd659a-cc71-4361-ab7b-42df882651df-bundle\") pod \"f4cd659a-cc71-4361-ab7b-42df882651df\" (UID: \"f4cd659a-cc71-4361-ab7b-42df882651df\") " Jul 07 17:31:08.996521 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:08.996470 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsqlh\" (UniqueName: \"kubernetes.io/projected/f4cd659a-cc71-4361-ab7b-42df882651df-kube-api-access-bsqlh\") pod \"f4cd659a-cc71-4361-ab7b-42df882651df\" (UID: \"f4cd659a-cc71-4361-ab7b-42df882651df\") " Jul 07 17:31:08.996835 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:08.996809 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4cd659a-cc71-4361-ab7b-42df882651df-bundle" (OuterVolumeSpecName: "bundle") pod "f4cd659a-cc71-4361-ab7b-42df882651df" (UID: "f4cd659a-cc71-4361-ab7b-42df882651df"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:31:08.998469 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:08.998445 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4cd659a-cc71-4361-ab7b-42df882651df-kube-api-access-bsqlh" (OuterVolumeSpecName: "kube-api-access-bsqlh") pod "f4cd659a-cc71-4361-ab7b-42df882651df" (UID: "f4cd659a-cc71-4361-ab7b-42df882651df"). InnerVolumeSpecName "kube-api-access-bsqlh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:31:09.000716 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:09.000695 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4cd659a-cc71-4361-ab7b-42df882651df-util" (OuterVolumeSpecName: "util") pod "f4cd659a-cc71-4361-ab7b-42df882651df" (UID: "f4cd659a-cc71-4361-ab7b-42df882651df"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:31:09.097205 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:09.097182 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsqlh\" (UniqueName: \"kubernetes.io/projected/f4cd659a-cc71-4361-ab7b-42df882651df-kube-api-access-bsqlh\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:31:09.097205 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:09.097202 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f4cd659a-cc71-4361-ab7b-42df882651df-util\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:31:09.097339 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:09.097212 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f4cd659a-cc71-4361-ab7b-42df882651df-bundle\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:31:09.237000 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:09.236969 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-kf2j2"] Jul 07 17:31:09.237274 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:09.237258 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4cd659a-cc71-4361-ab7b-42df882651df" containerName="extract" Jul 07 17:31:09.237349 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:09.237277 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4cd659a-cc71-4361-ab7b-42df882651df" containerName="extract" Jul 07 17:31:09.237349 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:09.237299 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4cd659a-cc71-4361-ab7b-42df882651df" containerName="util" Jul 07 17:31:09.237349 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:09.237308 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4cd659a-cc71-4361-ab7b-42df882651df" containerName="util" Jul 07 17:31:09.237349 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:09.237322 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4cd659a-cc71-4361-ab7b-42df882651df" containerName="pull" Jul 07 17:31:09.237349 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:09.237331 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4cd659a-cc71-4361-ab7b-42df882651df" containerName="pull" Jul 07 17:31:09.237611 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:09.237397 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4cd659a-cc71-4361-ab7b-42df882651df" containerName="extract" Jul 07 17:31:09.239232 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:09.239214 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-kf2j2" Jul 07 17:31:09.243541 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:09.243496 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-kjzgz\"" Jul 07 17:31:09.257523 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:09.255042 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-kf2j2"] Jul 07 17:31:09.275498 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:09.275475 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc" Jul 07 17:31:09.275617 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:09.275494 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f97xvc" event={"ID":"f4cd659a-cc71-4361-ab7b-42df882651df","Type":"ContainerDied","Data":"e15ef6622fd03534afff5163bc9a159570231ab532cfbbbc454606a3ed930e33"} Jul 07 17:31:09.275617 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:09.275581 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e15ef6622fd03534afff5163bc9a159570231ab532cfbbbc454606a3ed930e33" Jul 07 17:31:09.277142 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:09.277120 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2cq54" event={"ID":"ed6c050c-5180-471e-8c2c-31f31b92e1db","Type":"ContainerStarted","Data":"8b069575a6af0e58fc1c5b1ac2b8aa9987a044bd86ab2d3b40d897f03088863f"} Jul 07 17:31:09.298852 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:09.298831 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flgv8\" (UniqueName: \"kubernetes.io/projected/834c8eb6-8a0b-4ad4-a327-353ce1a0670c-kube-api-access-flgv8\") pod \"cert-manager-webhook-6486ffd997-kf2j2\" (UID: \"834c8eb6-8a0b-4ad4-a327-353ce1a0670c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kf2j2" Jul 07 17:31:09.298937 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:09.298893 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/834c8eb6-8a0b-4ad4-a327-353ce1a0670c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-kf2j2\" (UID: \"834c8eb6-8a0b-4ad4-a327-353ce1a0670c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kf2j2" Jul 07 17:31:09.325852 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:09.325814 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2cq54" podStartSLOduration=1.592034204 podStartE2EDuration="4.325800659s" totalImagesPullingTime="2.733766455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:31:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:31:09.323936497 +0000 UTC m=+505.610539628" watchObservedRunningTime="2026-07-07 17:31:09.325800659 +0000 UTC m=+505.612403790" Jul 07 17:31:09.399686 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:09.399653 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/834c8eb6-8a0b-4ad4-a327-353ce1a0670c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-kf2j2\" (UID: \"834c8eb6-8a0b-4ad4-a327-353ce1a0670c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kf2j2" Jul 07 17:31:09.399843 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:09.399736 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flgv8\" (UniqueName: \"kubernetes.io/projected/834c8eb6-8a0b-4ad4-a327-353ce1a0670c-kube-api-access-flgv8\") pod \"cert-manager-webhook-6486ffd997-kf2j2\" (UID: \"834c8eb6-8a0b-4ad4-a327-353ce1a0670c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kf2j2" Jul 07 17:31:09.418549 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:09.418497 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/834c8eb6-8a0b-4ad4-a327-353ce1a0670c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-kf2j2\" (UID: \"834c8eb6-8a0b-4ad4-a327-353ce1a0670c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kf2j2" Jul 07 17:31:09.418658 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:09.418647 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flgv8\" (UniqueName: \"kubernetes.io/projected/834c8eb6-8a0b-4ad4-a327-353ce1a0670c-kube-api-access-flgv8\") pod \"cert-manager-webhook-6486ffd997-kf2j2\" (UID: \"834c8eb6-8a0b-4ad4-a327-353ce1a0670c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-kf2j2" Jul 07 17:31:09.548379 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:09.548324 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-kf2j2" Jul 07 17:31:09.689596 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:09.689573 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-kf2j2"] Jul 07 17:31:09.691834 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:31:09.691811 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod834c8eb6_8a0b_4ad4_a327_353ce1a0670c.slice/crio-934f6f4333becfa9dceb541f3034291fb70c1ccddb6f74779e745bc8eb8d9294 WatchSource:0}: Error finding container 934f6f4333becfa9dceb541f3034291fb70c1ccddb6f74779e745bc8eb8d9294: Status 404 returned error can't find the container with id 934f6f4333becfa9dceb541f3034291fb70c1ccddb6f74779e745bc8eb8d9294 Jul 07 17:31:10.282573 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:10.282540 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-kf2j2" event={"ID":"834c8eb6-8a0b-4ad4-a327-353ce1a0670c","Type":"ContainerStarted","Data":"a37b231dce18b7434fbbc412d41b8aeb1d182e1467ae157a02f08f9f1025d229"} Jul 07 17:31:10.282998 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:10.282581 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-kf2j2" event={"ID":"834c8eb6-8a0b-4ad4-a327-353ce1a0670c","Type":"ContainerStarted","Data":"934f6f4333becfa9dceb541f3034291fb70c1ccddb6f74779e745bc8eb8d9294"} Jul 07 17:31:10.282998 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:10.282776 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-kf2j2" Jul 07 17:31:10.314348 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:10.314292 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-kf2j2" podStartSLOduration=1.314278048 podStartE2EDuration="1.314278048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:31:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:31:10.313775373 +0000 UTC m=+506.600378503" watchObservedRunningTime="2026-07-07 17:31:10.314278048 +0000 UTC m=+506.600881179" Jul 07 17:31:15.503830 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:15.503798 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-r4hxq"] Jul 07 17:31:15.518861 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:15.518842 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-r4hxq" Jul 07 17:31:15.522161 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:15.522133 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-r4hxq"] Jul 07 17:31:15.524234 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:15.524214 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-hmljk\"" Jul 07 17:31:15.649540 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:15.649500 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cc8fb15-b84a-4886-a475-66f496f7341b-bound-sa-token\") pod \"cert-manager-55b4d954d5-r4hxq\" (UID: \"5cc8fb15-b84a-4886-a475-66f496f7341b\") " pod="cert-manager/cert-manager-55b4d954d5-r4hxq" Jul 07 17:31:15.649661 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:15.649550 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzkfw\" (UniqueName: \"kubernetes.io/projected/5cc8fb15-b84a-4886-a475-66f496f7341b-kube-api-access-xzkfw\") pod \"cert-manager-55b4d954d5-r4hxq\" (UID: \"5cc8fb15-b84a-4886-a475-66f496f7341b\") " pod="cert-manager/cert-manager-55b4d954d5-r4hxq" Jul 07 17:31:15.750867 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:15.750846 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cc8fb15-b84a-4886-a475-66f496f7341b-bound-sa-token\") pod \"cert-manager-55b4d954d5-r4hxq\" (UID: \"5cc8fb15-b84a-4886-a475-66f496f7341b\") " pod="cert-manager/cert-manager-55b4d954d5-r4hxq" Jul 07 17:31:15.750954 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:15.750874 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzkfw\" (UniqueName: \"kubernetes.io/projected/5cc8fb15-b84a-4886-a475-66f496f7341b-kube-api-access-xzkfw\") pod \"cert-manager-55b4d954d5-r4hxq\" (UID: \"5cc8fb15-b84a-4886-a475-66f496f7341b\") " pod="cert-manager/cert-manager-55b4d954d5-r4hxq" Jul 07 17:31:15.765039 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:15.764978 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5cc8fb15-b84a-4886-a475-66f496f7341b-bound-sa-token\") pod \"cert-manager-55b4d954d5-r4hxq\" (UID: \"5cc8fb15-b84a-4886-a475-66f496f7341b\") " pod="cert-manager/cert-manager-55b4d954d5-r4hxq" Jul 07 17:31:15.765283 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:15.765261 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzkfw\" (UniqueName: \"kubernetes.io/projected/5cc8fb15-b84a-4886-a475-66f496f7341b-kube-api-access-xzkfw\") pod \"cert-manager-55b4d954d5-r4hxq\" (UID: \"5cc8fb15-b84a-4886-a475-66f496f7341b\") " pod="cert-manager/cert-manager-55b4d954d5-r4hxq" Jul 07 17:31:15.829142 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:15.829120 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-r4hxq" Jul 07 17:31:15.981875 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:15.981844 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-r4hxq"] Jul 07 17:31:15.984784 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:31:15.984760 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5cc8fb15_b84a_4886_a475_66f496f7341b.slice/crio-a4191a974d0f6fb875b74d8651fa0aa9ab96a6ab5bf65a435a91ee6de0168ba1 WatchSource:0}: Error finding container a4191a974d0f6fb875b74d8651fa0aa9ab96a6ab5bf65a435a91ee6de0168ba1: Status 404 returned error can't find the container with id a4191a974d0f6fb875b74d8651fa0aa9ab96a6ab5bf65a435a91ee6de0168ba1 Jul 07 17:31:16.289322 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:16.289260 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-kf2j2" Jul 07 17:31:16.307142 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:16.307112 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-r4hxq" event={"ID":"5cc8fb15-b84a-4886-a475-66f496f7341b","Type":"ContainerStarted","Data":"f6955b07b45a0f420b7bf93baa27c28e4e329056b97984fb181b2f2125b65555"} Jul 07 17:31:16.307260 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:16.307154 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-r4hxq" event={"ID":"5cc8fb15-b84a-4886-a475-66f496f7341b","Type":"ContainerStarted","Data":"a4191a974d0f6fb875b74d8651fa0aa9ab96a6ab5bf65a435a91ee6de0168ba1"} Jul 07 17:31:16.368529 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:16.368457 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-r4hxq" podStartSLOduration=1.368437655 podStartE2EDuration="1.368437655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:31:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:31:16.365340551 +0000 UTC m=+512.651943682" watchObservedRunningTime="2026-07-07 17:31:16.368437655 +0000 UTC m=+512.655040786" Jul 07 17:31:22.186951 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:22.186913 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84"] Jul 07 17:31:22.189975 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:22.189958 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84" Jul 07 17:31:22.192837 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:22.192811 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 17:31:22.192837 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:22.192835 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 17:31:22.194303 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:22.194264 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ttxrs\"" Jul 07 17:31:22.200350 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:22.200330 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84"] Jul 07 17:31:22.294719 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:22.294689 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65f317d2-9d26-4ea5-baf9-80bbe4c1c233-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84\" (UID: \"65f317d2-9d26-4ea5-baf9-80bbe4c1c233\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84" Jul 07 17:31:22.294841 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:22.294727 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c4zc\" (UniqueName: \"kubernetes.io/projected/65f317d2-9d26-4ea5-baf9-80bbe4c1c233-kube-api-access-8c4zc\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84\" (UID: \"65f317d2-9d26-4ea5-baf9-80bbe4c1c233\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84" Jul 07 17:31:22.294841 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:22.294796 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65f317d2-9d26-4ea5-baf9-80bbe4c1c233-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84\" (UID: \"65f317d2-9d26-4ea5-baf9-80bbe4c1c233\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84" Jul 07 17:31:22.395353 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:22.395327 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65f317d2-9d26-4ea5-baf9-80bbe4c1c233-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84\" (UID: \"65f317d2-9d26-4ea5-baf9-80bbe4c1c233\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84" Jul 07 17:31:22.395448 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:22.395368 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65f317d2-9d26-4ea5-baf9-80bbe4c1c233-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84\" (UID: \"65f317d2-9d26-4ea5-baf9-80bbe4c1c233\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84" Jul 07 17:31:22.395448 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:22.395390 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c4zc\" (UniqueName: \"kubernetes.io/projected/65f317d2-9d26-4ea5-baf9-80bbe4c1c233-kube-api-access-8c4zc\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84\" (UID: \"65f317d2-9d26-4ea5-baf9-80bbe4c1c233\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84" Jul 07 17:31:22.395803 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:22.395784 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65f317d2-9d26-4ea5-baf9-80bbe4c1c233-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84\" (UID: \"65f317d2-9d26-4ea5-baf9-80bbe4c1c233\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84" Jul 07 17:31:22.395849 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:22.395828 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65f317d2-9d26-4ea5-baf9-80bbe4c1c233-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84\" (UID: \"65f317d2-9d26-4ea5-baf9-80bbe4c1c233\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84" Jul 07 17:31:22.405735 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:22.405711 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c4zc\" (UniqueName: \"kubernetes.io/projected/65f317d2-9d26-4ea5-baf9-80bbe4c1c233-kube-api-access-8c4zc\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84\" (UID: \"65f317d2-9d26-4ea5-baf9-80bbe4c1c233\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84" Jul 07 17:31:22.499486 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:22.499430 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84" Jul 07 17:31:22.649443 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:22.649421 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84"] Jul 07 17:31:22.651764 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:31:22.651736 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65f317d2_9d26_4ea5_baf9_80bbe4c1c233.slice/crio-4bd0e6ff97c71407e0d6486f62db8732a19cd272e7b0c354085e15b50f306448 WatchSource:0}: Error finding container 4bd0e6ff97c71407e0d6486f62db8732a19cd272e7b0c354085e15b50f306448: Status 404 returned error can't find the container with id 4bd0e6ff97c71407e0d6486f62db8732a19cd272e7b0c354085e15b50f306448 Jul 07 17:31:23.337787 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:23.337757 2549 generic.go:356] "Generic (PLEG): container finished" podID="65f317d2-9d26-4ea5-baf9-80bbe4c1c233" containerID="8ab53d16e0f69609de435ef90812953d4529920900a9d7c00bf294f6002cbc29" exitCode=0 Jul 07 17:31:23.338109 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:23.337796 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84" event={"ID":"65f317d2-9d26-4ea5-baf9-80bbe4c1c233","Type":"ContainerDied","Data":"8ab53d16e0f69609de435ef90812953d4529920900a9d7c00bf294f6002cbc29"} Jul 07 17:31:23.338109 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:23.337833 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84" event={"ID":"65f317d2-9d26-4ea5-baf9-80bbe4c1c233","Type":"ContainerStarted","Data":"4bd0e6ff97c71407e0d6486f62db8732a19cd272e7b0c354085e15b50f306448"} Jul 07 17:31:24.342973 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:24.342898 2549 generic.go:356] "Generic (PLEG): container finished" podID="65f317d2-9d26-4ea5-baf9-80bbe4c1c233" containerID="c65fbcab5f2eb6f7fe230be0c8f43188342d7a43c2bcf866583201ce071d5817" exitCode=0 Jul 07 17:31:24.343326 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:24.342986 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84" event={"ID":"65f317d2-9d26-4ea5-baf9-80bbe4c1c233","Type":"ContainerDied","Data":"c65fbcab5f2eb6f7fe230be0c8f43188342d7a43c2bcf866583201ce071d5817"} Jul 07 17:31:25.349253 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:25.349218 2549 generic.go:356] "Generic (PLEG): container finished" podID="65f317d2-9d26-4ea5-baf9-80bbe4c1c233" containerID="11261aaae4b42665a9d3e31965346d04846da653273a10bf5b257cd1ba74ee38" exitCode=0 Jul 07 17:31:25.349618 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:25.349305 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84" event={"ID":"65f317d2-9d26-4ea5-baf9-80bbe4c1c233","Type":"ContainerDied","Data":"11261aaae4b42665a9d3e31965346d04846da653273a10bf5b257cd1ba74ee38"} Jul 07 17:31:26.472914 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:26.472893 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84" Jul 07 17:31:26.630779 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:26.630712 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65f317d2-9d26-4ea5-baf9-80bbe4c1c233-util\") pod \"65f317d2-9d26-4ea5-baf9-80bbe4c1c233\" (UID: \"65f317d2-9d26-4ea5-baf9-80bbe4c1c233\") " Jul 07 17:31:26.630779 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:26.630757 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65f317d2-9d26-4ea5-baf9-80bbe4c1c233-bundle\") pod \"65f317d2-9d26-4ea5-baf9-80bbe4c1c233\" (UID: \"65f317d2-9d26-4ea5-baf9-80bbe4c1c233\") " Jul 07 17:31:26.630779 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:26.630781 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8c4zc\" (UniqueName: \"kubernetes.io/projected/65f317d2-9d26-4ea5-baf9-80bbe4c1c233-kube-api-access-8c4zc\") pod \"65f317d2-9d26-4ea5-baf9-80bbe4c1c233\" (UID: \"65f317d2-9d26-4ea5-baf9-80bbe4c1c233\") " Jul 07 17:31:26.631469 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:26.631390 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65f317d2-9d26-4ea5-baf9-80bbe4c1c233-bundle" (OuterVolumeSpecName: "bundle") pod "65f317d2-9d26-4ea5-baf9-80bbe4c1c233" (UID: "65f317d2-9d26-4ea5-baf9-80bbe4c1c233"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:31:26.632954 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:26.632927 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65f317d2-9d26-4ea5-baf9-80bbe4c1c233-kube-api-access-8c4zc" (OuterVolumeSpecName: "kube-api-access-8c4zc") pod "65f317d2-9d26-4ea5-baf9-80bbe4c1c233" (UID: "65f317d2-9d26-4ea5-baf9-80bbe4c1c233"). InnerVolumeSpecName "kube-api-access-8c4zc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:31:26.636346 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:26.636328 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65f317d2-9d26-4ea5-baf9-80bbe4c1c233-util" (OuterVolumeSpecName: "util") pod "65f317d2-9d26-4ea5-baf9-80bbe4c1c233" (UID: "65f317d2-9d26-4ea5-baf9-80bbe4c1c233"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:31:26.731823 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:26.731793 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65f317d2-9d26-4ea5-baf9-80bbe4c1c233-util\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:31:26.731823 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:26.731821 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65f317d2-9d26-4ea5-baf9-80bbe4c1c233-bundle\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:31:26.731823 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:26.731830 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8c4zc\" (UniqueName: \"kubernetes.io/projected/65f317d2-9d26-4ea5-baf9-80bbe4c1c233-kube-api-access-8c4zc\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:31:27.359773 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:27.359744 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84" event={"ID":"65f317d2-9d26-4ea5-baf9-80bbe4c1c233","Type":"ContainerDied","Data":"4bd0e6ff97c71407e0d6486f62db8732a19cd272e7b0c354085e15b50f306448"} Jul 07 17:31:27.359919 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:27.359784 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4bd0e6ff97c71407e0d6486f62db8732a19cd272e7b0c354085e15b50f306448" Jul 07 17:31:27.359919 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:27.359795 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2lt84" Jul 07 17:31:38.446071 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.446039 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-684cdbc7fc-d9jtm"] Jul 07 17:31:38.446759 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.446287 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65f317d2-9d26-4ea5-baf9-80bbe4c1c233" containerName="pull" Jul 07 17:31:38.446759 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.446297 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="65f317d2-9d26-4ea5-baf9-80bbe4c1c233" containerName="pull" Jul 07 17:31:38.446759 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.446310 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65f317d2-9d26-4ea5-baf9-80bbe4c1c233" containerName="util" Jul 07 17:31:38.446759 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.446315 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="65f317d2-9d26-4ea5-baf9-80bbe4c1c233" containerName="util" Jul 07 17:31:38.446759 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.446325 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65f317d2-9d26-4ea5-baf9-80bbe4c1c233" containerName="extract" Jul 07 17:31:38.446759 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.446330 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="65f317d2-9d26-4ea5-baf9-80bbe4c1c233" containerName="extract" Jul 07 17:31:38.446759 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.446372 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="65f317d2-9d26-4ea5-baf9-80bbe4c1c233" containerName="extract" Jul 07 17:31:38.448440 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.448419 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-684cdbc7fc-d9jtm" Jul 07 17:31:38.457392 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.457368 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 17:31:38.457483 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.457405 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 17:31:38.457560 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.457535 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 17:31:38.457728 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.457711 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cpf46\"" Jul 07 17:31:38.457805 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.457726 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 17:31:38.519051 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.519027 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-684cdbc7fc-d9jtm"] Jul 07 17:31:38.611119 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.611093 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/df3eaba9-10a0-4478-ade8-eb60b7c495c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-684cdbc7fc-d9jtm\" (UID: \"df3eaba9-10a0-4478-ade8-eb60b7c495c5\") " pod="opendatahub/opendatahub-operator-controller-manager-684cdbc7fc-d9jtm" Jul 07 17:31:38.611207 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.611129 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df3eaba9-10a0-4478-ade8-eb60b7c495c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-684cdbc7fc-d9jtm\" (UID: \"df3eaba9-10a0-4478-ade8-eb60b7c495c5\") " pod="opendatahub/opendatahub-operator-controller-manager-684cdbc7fc-d9jtm" Jul 07 17:31:38.611207 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.611148 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/df3eaba9-10a0-4478-ade8-eb60b7c495c5-manifests\") pod \"opendatahub-operator-controller-manager-684cdbc7fc-d9jtm\" (UID: \"df3eaba9-10a0-4478-ade8-eb60b7c495c5\") " pod="opendatahub/opendatahub-operator-controller-manager-684cdbc7fc-d9jtm" Jul 07 17:31:38.611207 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.611188 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pj4d\" (UniqueName: \"kubernetes.io/projected/df3eaba9-10a0-4478-ade8-eb60b7c495c5-kube-api-access-4pj4d\") pod \"opendatahub-operator-controller-manager-684cdbc7fc-d9jtm\" (UID: \"df3eaba9-10a0-4478-ade8-eb60b7c495c5\") " pod="opendatahub/opendatahub-operator-controller-manager-684cdbc7fc-d9jtm" Jul 07 17:31:38.611317 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.611215 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df3eaba9-10a0-4478-ade8-eb60b7c495c5-tmp\") pod \"opendatahub-operator-controller-manager-684cdbc7fc-d9jtm\" (UID: \"df3eaba9-10a0-4478-ade8-eb60b7c495c5\") " pod="opendatahub/opendatahub-operator-controller-manager-684cdbc7fc-d9jtm" Jul 07 17:31:38.712534 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.712459 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/df3eaba9-10a0-4478-ade8-eb60b7c495c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-684cdbc7fc-d9jtm\" (UID: \"df3eaba9-10a0-4478-ade8-eb60b7c495c5\") " pod="opendatahub/opendatahub-operator-controller-manager-684cdbc7fc-d9jtm" Jul 07 17:31:38.712534 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.712493 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df3eaba9-10a0-4478-ade8-eb60b7c495c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-684cdbc7fc-d9jtm\" (UID: \"df3eaba9-10a0-4478-ade8-eb60b7c495c5\") " pod="opendatahub/opendatahub-operator-controller-manager-684cdbc7fc-d9jtm" Jul 07 17:31:38.712534 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.712524 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/df3eaba9-10a0-4478-ade8-eb60b7c495c5-manifests\") pod \"opendatahub-operator-controller-manager-684cdbc7fc-d9jtm\" (UID: \"df3eaba9-10a0-4478-ade8-eb60b7c495c5\") " pod="opendatahub/opendatahub-operator-controller-manager-684cdbc7fc-d9jtm" Jul 07 17:31:38.712728 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.712540 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pj4d\" (UniqueName: \"kubernetes.io/projected/df3eaba9-10a0-4478-ade8-eb60b7c495c5-kube-api-access-4pj4d\") pod \"opendatahub-operator-controller-manager-684cdbc7fc-d9jtm\" (UID: \"df3eaba9-10a0-4478-ade8-eb60b7c495c5\") " pod="opendatahub/opendatahub-operator-controller-manager-684cdbc7fc-d9jtm" Jul 07 17:31:38.712728 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.712561 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df3eaba9-10a0-4478-ade8-eb60b7c495c5-tmp\") pod \"opendatahub-operator-controller-manager-684cdbc7fc-d9jtm\" (UID: \"df3eaba9-10a0-4478-ade8-eb60b7c495c5\") " pod="opendatahub/opendatahub-operator-controller-manager-684cdbc7fc-d9jtm" Jul 07 17:31:38.712938 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.712905 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/df3eaba9-10a0-4478-ade8-eb60b7c495c5-manifests\") pod \"opendatahub-operator-controller-manager-684cdbc7fc-d9jtm\" (UID: \"df3eaba9-10a0-4478-ade8-eb60b7c495c5\") " pod="opendatahub/opendatahub-operator-controller-manager-684cdbc7fc-d9jtm" Jul 07 17:31:38.714904 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.714885 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df3eaba9-10a0-4478-ade8-eb60b7c495c5-tmp\") pod \"opendatahub-operator-controller-manager-684cdbc7fc-d9jtm\" (UID: \"df3eaba9-10a0-4478-ade8-eb60b7c495c5\") " pod="opendatahub/opendatahub-operator-controller-manager-684cdbc7fc-d9jtm" Jul 07 17:31:38.715021 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.714965 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/df3eaba9-10a0-4478-ade8-eb60b7c495c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-684cdbc7fc-d9jtm\" (UID: \"df3eaba9-10a0-4478-ade8-eb60b7c495c5\") " pod="opendatahub/opendatahub-operator-controller-manager-684cdbc7fc-d9jtm" Jul 07 17:31:38.715021 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.715001 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/df3eaba9-10a0-4478-ade8-eb60b7c495c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-684cdbc7fc-d9jtm\" (UID: \"df3eaba9-10a0-4478-ade8-eb60b7c495c5\") " pod="opendatahub/opendatahub-operator-controller-manager-684cdbc7fc-d9jtm" Jul 07 17:31:38.726605 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.726581 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pj4d\" (UniqueName: \"kubernetes.io/projected/df3eaba9-10a0-4478-ade8-eb60b7c495c5-kube-api-access-4pj4d\") pod \"opendatahub-operator-controller-manager-684cdbc7fc-d9jtm\" (UID: \"df3eaba9-10a0-4478-ade8-eb60b7c495c5\") " pod="opendatahub/opendatahub-operator-controller-manager-684cdbc7fc-d9jtm" Jul 07 17:31:38.758600 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.758580 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-684cdbc7fc-d9jtm" Jul 07 17:31:38.930078 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:38.930050 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-684cdbc7fc-d9jtm"] Jul 07 17:31:38.936651 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:31:38.936631 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf3eaba9_10a0_4478_ade8_eb60b7c495c5.slice/crio-9ccff678028311840f774c8b92eb6be170da81635026814ffbfc8d095b387a7b WatchSource:0}: Error finding container 9ccff678028311840f774c8b92eb6be170da81635026814ffbfc8d095b387a7b: Status 404 returned error can't find the container with id 9ccff678028311840f774c8b92eb6be170da81635026814ffbfc8d095b387a7b Jul 07 17:31:39.411728 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:39.411698 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-684cdbc7fc-d9jtm" event={"ID":"df3eaba9-10a0-4478-ade8-eb60b7c495c5","Type":"ContainerStarted","Data":"9ccff678028311840f774c8b92eb6be170da81635026814ffbfc8d095b387a7b"} Jul 07 17:31:42.426985 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:42.426953 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-684cdbc7fc-d9jtm" event={"ID":"df3eaba9-10a0-4478-ade8-eb60b7c495c5","Type":"ContainerStarted","Data":"38eaf9e59d23efee63ff5dfa3962d72a9b3d02c347a470c47b3400e4bb0fcecf"} Jul 07 17:31:43.432692 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:43.432657 2549 generic.go:356] "Generic (PLEG): container finished" podID="df3eaba9-10a0-4478-ade8-eb60b7c495c5" containerID="38eaf9e59d23efee63ff5dfa3962d72a9b3d02c347a470c47b3400e4bb0fcecf" exitCode=0 Jul 07 17:31:43.433042 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:43.432739 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-684cdbc7fc-d9jtm" event={"ID":"df3eaba9-10a0-4478-ade8-eb60b7c495c5","Type":"ContainerDied","Data":"38eaf9e59d23efee63ff5dfa3962d72a9b3d02c347a470c47b3400e4bb0fcecf"} Jul 07 17:31:44.439644 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:44.439605 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-684cdbc7fc-d9jtm" event={"ID":"df3eaba9-10a0-4478-ade8-eb60b7c495c5","Type":"ContainerStarted","Data":"82c104cdffdd7ae32ce7c6b4c5522c2b952c18c92f11960d3080217cd6102b69"} Jul 07 17:31:44.440115 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:44.439835 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-684cdbc7fc-d9jtm" Jul 07 17:31:44.470390 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:44.470330 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-684cdbc7fc-d9jtm" podStartSLOduration=1.728136522 podStartE2EDuration="6.47031109s" totalImagesPullingTime="3.687263591s" totalInitContainerRuntime="1.054910977s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:31:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:31:44.468802687 +0000 UTC m=+540.755405817" watchObservedRunningTime="2026-07-07 17:31:44.47031109 +0000 UTC m=+540.756914215" Jul 07 17:31:55.447164 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:31:55.447130 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-684cdbc7fc-d9jtm" Jul 07 17:32:00.342919 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:00.342887 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-668c694757-zwt87"] Jul 07 17:32:00.353814 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:00.353794 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-668c694757-zwt87" Jul 07 17:32:00.360575 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:00.360554 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 07 17:32:00.361610 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:00.361589 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 07 17:32:00.361610 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:00.361600 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 17:32:00.361758 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:00.361591 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 17:32:00.403521 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:00.403483 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-668c694757-zwt87"] Jul 07 17:32:00.466891 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:00.466865 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqn5z\" (UniqueName: \"kubernetes.io/projected/10c354b5-8c23-484d-9f14-1906f7b7a1bc-kube-api-access-rqn5z\") pod \"kube-auth-proxy-668c694757-zwt87\" (UID: \"10c354b5-8c23-484d-9f14-1906f7b7a1bc\") " pod="openshift-ingress/kube-auth-proxy-668c694757-zwt87" Jul 07 17:32:00.466995 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:00.466903 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10c354b5-8c23-484d-9f14-1906f7b7a1bc-tls-certs\") pod \"kube-auth-proxy-668c694757-zwt87\" (UID: \"10c354b5-8c23-484d-9f14-1906f7b7a1bc\") " pod="openshift-ingress/kube-auth-proxy-668c694757-zwt87" Jul 07 17:32:00.467051 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:00.467003 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10c354b5-8c23-484d-9f14-1906f7b7a1bc-tmp\") pod \"kube-auth-proxy-668c694757-zwt87\" (UID: \"10c354b5-8c23-484d-9f14-1906f7b7a1bc\") " pod="openshift-ingress/kube-auth-proxy-668c694757-zwt87" Jul 07 17:32:00.567329 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:00.567300 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10c354b5-8c23-484d-9f14-1906f7b7a1bc-tls-certs\") pod \"kube-auth-proxy-668c694757-zwt87\" (UID: \"10c354b5-8c23-484d-9f14-1906f7b7a1bc\") " pod="openshift-ingress/kube-auth-proxy-668c694757-zwt87" Jul 07 17:32:00.567450 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:00.567346 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10c354b5-8c23-484d-9f14-1906f7b7a1bc-tmp\") pod \"kube-auth-proxy-668c694757-zwt87\" (UID: \"10c354b5-8c23-484d-9f14-1906f7b7a1bc\") " pod="openshift-ingress/kube-auth-proxy-668c694757-zwt87" Jul 07 17:32:00.567450 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:00.567389 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqn5z\" (UniqueName: \"kubernetes.io/projected/10c354b5-8c23-484d-9f14-1906f7b7a1bc-kube-api-access-rqn5z\") pod \"kube-auth-proxy-668c694757-zwt87\" (UID: \"10c354b5-8c23-484d-9f14-1906f7b7a1bc\") " pod="openshift-ingress/kube-auth-proxy-668c694757-zwt87" Jul 07 17:32:00.569873 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:00.569852 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10c354b5-8c23-484d-9f14-1906f7b7a1bc-tmp\") pod \"kube-auth-proxy-668c694757-zwt87\" (UID: \"10c354b5-8c23-484d-9f14-1906f7b7a1bc\") " pod="openshift-ingress/kube-auth-proxy-668c694757-zwt87" Jul 07 17:32:00.570098 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:00.570080 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10c354b5-8c23-484d-9f14-1906f7b7a1bc-tls-certs\") pod \"kube-auth-proxy-668c694757-zwt87\" (UID: \"10c354b5-8c23-484d-9f14-1906f7b7a1bc\") " pod="openshift-ingress/kube-auth-proxy-668c694757-zwt87" Jul 07 17:32:00.633290 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:00.633237 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqn5z\" (UniqueName: \"kubernetes.io/projected/10c354b5-8c23-484d-9f14-1906f7b7a1bc-kube-api-access-rqn5z\") pod \"kube-auth-proxy-668c694757-zwt87\" (UID: \"10c354b5-8c23-484d-9f14-1906f7b7a1bc\") " pod="openshift-ingress/kube-auth-proxy-668c694757-zwt87" Jul 07 17:32:00.662663 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:00.662643 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-668c694757-zwt87" Jul 07 17:32:00.848988 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:00.848956 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-668c694757-zwt87"] Jul 07 17:32:00.852485 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:32:00.852449 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10c354b5_8c23_484d_9f14_1906f7b7a1bc.slice/crio-e36f9ec46d02568492633b525e6a59081f80437eb22c7fcbc9064a634ce3c417 WatchSource:0}: Error finding container e36f9ec46d02568492633b525e6a59081f80437eb22c7fcbc9064a634ce3c417: Status 404 returned error can't find the container with id e36f9ec46d02568492633b525e6a59081f80437eb22c7fcbc9064a634ce3c417 Jul 07 17:32:01.478474 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:01.478442 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jvwsc"] Jul 07 17:32:01.481294 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:01.481277 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jvwsc" Jul 07 17:32:01.484107 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:32:01.484081 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"odh-model-controller-dockercfg-2l29s\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-2l29s\"" type="*v1.Secret" Jul 07 17:32:01.484262 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:32:01.484242 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"odh-model-controller-7998c67dc4-jvwsc\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="65df54e8-14da-49bf-a628-f2b33a8efe30" pod="opendatahub/odh-model-controller-7998c67dc4-jvwsc" Jul 07 17:32:01.484361 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:32:01.484340 2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"odh-model-controller-webhook-cert\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" type="*v1.Secret" Jul 07 17:32:01.499270 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:01.499248 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jvwsc"] Jul 07 17:32:01.517969 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:01.517940 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-668c694757-zwt87" event={"ID":"10c354b5-8c23-484d-9f14-1906f7b7a1bc","Type":"ContainerStarted","Data":"e36f9ec46d02568492633b525e6a59081f80437eb22c7fcbc9064a634ce3c417"} Jul 07 17:32:01.676740 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:01.676709 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65df54e8-14da-49bf-a628-f2b33a8efe30-cert\") pod \"odh-model-controller-7998c67dc4-jvwsc\" (UID: \"65df54e8-14da-49bf-a628-f2b33a8efe30\") " pod="opendatahub/odh-model-controller-7998c67dc4-jvwsc" Jul 07 17:32:01.676886 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:01.676758 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt8rb\" (UniqueName: \"kubernetes.io/projected/65df54e8-14da-49bf-a628-f2b33a8efe30-kube-api-access-zt8rb\") pod \"odh-model-controller-7998c67dc4-jvwsc\" (UID: \"65df54e8-14da-49bf-a628-f2b33a8efe30\") " pod="opendatahub/odh-model-controller-7998c67dc4-jvwsc" Jul 07 17:32:01.778308 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:01.778214 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt8rb\" (UniqueName: \"kubernetes.io/projected/65df54e8-14da-49bf-a628-f2b33a8efe30-kube-api-access-zt8rb\") pod \"odh-model-controller-7998c67dc4-jvwsc\" (UID: \"65df54e8-14da-49bf-a628-f2b33a8efe30\") " pod="opendatahub/odh-model-controller-7998c67dc4-jvwsc" Jul 07 17:32:01.778468 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:01.778329 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65df54e8-14da-49bf-a628-f2b33a8efe30-cert\") pod \"odh-model-controller-7998c67dc4-jvwsc\" (UID: \"65df54e8-14da-49bf-a628-f2b33a8efe30\") " pod="opendatahub/odh-model-controller-7998c67dc4-jvwsc" Jul 07 17:32:01.797676 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:01.797647 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt8rb\" (UniqueName: \"kubernetes.io/projected/65df54e8-14da-49bf-a628-f2b33a8efe30-kube-api-access-zt8rb\") pod \"odh-model-controller-7998c67dc4-jvwsc\" (UID: \"65df54e8-14da-49bf-a628-f2b33a8efe30\") " pod="opendatahub/odh-model-controller-7998c67dc4-jvwsc" Jul 07 17:32:02.715778 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:02.715745 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-2l29s\"" Jul 07 17:32:02.779413 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:32:02.779373 2549 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: failed to sync secret cache: timed out waiting for the condition Jul 07 17:32:02.779608 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:32:02.779458 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65df54e8-14da-49bf-a628-f2b33a8efe30-cert podName:65df54e8-14da-49bf-a628-f2b33a8efe30 nodeName:}" failed. No retries permitted until 2026-07-07 17:32:03.279433359 +0000 UTC m=+559.566036475 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/65df54e8-14da-49bf-a628-f2b33a8efe30-cert") pod "odh-model-controller-7998c67dc4-jvwsc" (UID: "65df54e8-14da-49bf-a628-f2b33a8efe30") : failed to sync secret cache: timed out waiting for the condition Jul 07 17:32:03.075635 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:03.075549 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 07 17:32:03.293023 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:03.292984 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65df54e8-14da-49bf-a628-f2b33a8efe30-cert\") pod \"odh-model-controller-7998c67dc4-jvwsc\" (UID: \"65df54e8-14da-49bf-a628-f2b33a8efe30\") " pod="opendatahub/odh-model-controller-7998c67dc4-jvwsc" Jul 07 17:32:03.295552 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:03.295531 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/65df54e8-14da-49bf-a628-f2b33a8efe30-cert\") pod \"odh-model-controller-7998c67dc4-jvwsc\" (UID: \"65df54e8-14da-49bf-a628-f2b33a8efe30\") " pod="opendatahub/odh-model-controller-7998c67dc4-jvwsc" Jul 07 17:32:03.342598 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:03.342528 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-s6vr6"] Jul 07 17:32:03.345561 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:03.345544 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-s6vr6" Jul 07 17:32:03.349233 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:03.349201 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 07 17:32:03.394253 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:03.394232 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-s6vr6"] Jul 07 17:32:03.494815 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:03.494771 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rg7t\" (UniqueName: \"kubernetes.io/projected/e5f58835-77f9-47af-a421-0a0b3f1b07be-kube-api-access-8rg7t\") pod \"model-serving-api-54d89bd5fc-s6vr6\" (UID: \"e5f58835-77f9-47af-a421-0a0b3f1b07be\") " pod="opendatahub/model-serving-api-54d89bd5fc-s6vr6" Jul 07 17:32:03.495064 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:03.494844 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f58835-77f9-47af-a421-0a0b3f1b07be-tls-certs\") pod \"model-serving-api-54d89bd5fc-s6vr6\" (UID: \"e5f58835-77f9-47af-a421-0a0b3f1b07be\") " pod="opendatahub/model-serving-api-54d89bd5fc-s6vr6" Jul 07 17:32:03.591266 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:03.591220 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jvwsc" Jul 07 17:32:03.596086 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:03.596060 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f58835-77f9-47af-a421-0a0b3f1b07be-tls-certs\") pod \"model-serving-api-54d89bd5fc-s6vr6\" (UID: \"e5f58835-77f9-47af-a421-0a0b3f1b07be\") " pod="opendatahub/model-serving-api-54d89bd5fc-s6vr6" Jul 07 17:32:03.596207 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:03.596116 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rg7t\" (UniqueName: \"kubernetes.io/projected/e5f58835-77f9-47af-a421-0a0b3f1b07be-kube-api-access-8rg7t\") pod \"model-serving-api-54d89bd5fc-s6vr6\" (UID: \"e5f58835-77f9-47af-a421-0a0b3f1b07be\") " pod="opendatahub/model-serving-api-54d89bd5fc-s6vr6" Jul 07 17:32:03.598740 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:03.598715 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5f58835-77f9-47af-a421-0a0b3f1b07be-tls-certs\") pod \"model-serving-api-54d89bd5fc-s6vr6\" (UID: \"e5f58835-77f9-47af-a421-0a0b3f1b07be\") " pod="opendatahub/model-serving-api-54d89bd5fc-s6vr6" Jul 07 17:32:03.619071 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:03.619043 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rg7t\" (UniqueName: \"kubernetes.io/projected/e5f58835-77f9-47af-a421-0a0b3f1b07be-kube-api-access-8rg7t\") pod \"model-serving-api-54d89bd5fc-s6vr6\" (UID: \"e5f58835-77f9-47af-a421-0a0b3f1b07be\") " pod="opendatahub/model-serving-api-54d89bd5fc-s6vr6" Jul 07 17:32:03.658764 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:03.658738 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-s6vr6" Jul 07 17:32:04.330845 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.330822 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-s6vr6"] Jul 07 17:32:04.333101 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:32:04.333066 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5f58835_77f9_47af_a421_0a0b3f1b07be.slice/crio-e185546fe34732a48e5064738a8c8fad290e86f2e420818cd098fb765fee44d3 WatchSource:0}: Error finding container e185546fe34732a48e5064738a8c8fad290e86f2e420818cd098fb765fee44d3: Status 404 returned error can't find the container with id e185546fe34732a48e5064738a8c8fad290e86f2e420818cd098fb765fee44d3 Jul 07 17:32:04.379942 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.379920 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jvwsc"] Jul 07 17:32:04.382494 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:32:04.382469 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65df54e8_14da_49bf_a628_f2b33a8efe30.slice/crio-cb04d89d6add4243f0226e227577227ca1babcd8a443b0a57db208422e3accec WatchSource:0}: Error finding container cb04d89d6add4243f0226e227577227ca1babcd8a443b0a57db208422e3accec: Status 404 returned error can't find the container with id cb04d89d6add4243f0226e227577227ca1babcd8a443b0a57db208422e3accec Jul 07 17:32:04.491593 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.491501 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk"] Jul 07 17:32:04.495030 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.495008 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" Jul 07 17:32:04.498664 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.498640 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 17:32:04.498664 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.498641 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 17:32:04.498896 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.498880 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 17:32:04.499138 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.499122 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 17:32:04.499655 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.499638 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-5lghc\"" Jul 07 17:32:04.502564 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.502475 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-7kvwk\" (UID: \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" Jul 07 17:32:04.502564 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.502544 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-local-certs\") pod \"istiod-openshift-gateway-7574459656-7kvwk\" (UID: \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" Jul 07 17:32:04.502770 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.502591 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-istio-token\") pod \"istiod-openshift-gateway-7574459656-7kvwk\" (UID: \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" Jul 07 17:32:04.502770 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.502631 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pqqb\" (UniqueName: \"kubernetes.io/projected/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-kube-api-access-7pqqb\") pod \"istiod-openshift-gateway-7574459656-7kvwk\" (UID: \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" Jul 07 17:32:04.502770 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.502687 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-cacerts\") pod \"istiod-openshift-gateway-7574459656-7kvwk\" (UID: \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" Jul 07 17:32:04.502770 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.502730 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-7kvwk\" (UID: \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" Jul 07 17:32:04.503249 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.502795 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-7kvwk\" (UID: \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" Jul 07 17:32:04.524593 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.524565 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk"] Jul 07 17:32:04.535241 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.535203 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-668c694757-zwt87" event={"ID":"10c354b5-8c23-484d-9f14-1906f7b7a1bc","Type":"ContainerStarted","Data":"73984e6e94451b8bfa803b36785ca510ce798e62536eb92c01798558c6a0b43e"} Jul 07 17:32:04.536551 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.536531 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jvwsc" event={"ID":"65df54e8-14da-49bf-a628-f2b33a8efe30","Type":"ContainerStarted","Data":"cb04d89d6add4243f0226e227577227ca1babcd8a443b0a57db208422e3accec"} Jul 07 17:32:04.537646 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.537625 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-s6vr6" event={"ID":"e5f58835-77f9-47af-a421-0a0b3f1b07be","Type":"ContainerStarted","Data":"e185546fe34732a48e5064738a8c8fad290e86f2e420818cd098fb765fee44d3"} Jul 07 17:32:04.603106 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.603078 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-7kvwk\" (UID: \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" Jul 07 17:32:04.603231 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.603112 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-7kvwk\" (UID: \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" Jul 07 17:32:04.603392 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.603370 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-local-certs\") pod \"istiod-openshift-gateway-7574459656-7kvwk\" (UID: \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" Jul 07 17:32:04.603587 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.603567 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-istio-token\") pod \"istiod-openshift-gateway-7574459656-7kvwk\" (UID: \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" Jul 07 17:32:04.603682 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.603627 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pqqb\" (UniqueName: \"kubernetes.io/projected/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-kube-api-access-7pqqb\") pod \"istiod-openshift-gateway-7574459656-7kvwk\" (UID: \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" Jul 07 17:32:04.603682 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.603661 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-cacerts\") pod \"istiod-openshift-gateway-7574459656-7kvwk\" (UID: \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" Jul 07 17:32:04.603788 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.603712 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-7kvwk\" (UID: \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" Jul 07 17:32:04.603788 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.603759 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-7kvwk\" (UID: \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" Jul 07 17:32:04.605716 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.605692 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-local-certs\") pod \"istiod-openshift-gateway-7574459656-7kvwk\" (UID: \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" Jul 07 17:32:04.605822 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.605778 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-7kvwk\" (UID: \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" Jul 07 17:32:04.605903 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.605886 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-cacerts\") pod \"istiod-openshift-gateway-7574459656-7kvwk\" (UID: \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" Jul 07 17:32:04.605980 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.605964 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-7kvwk\" (UID: \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" Jul 07 17:32:04.627776 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.627717 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-668c694757-zwt87" podStartSLOduration=1.290768749 podStartE2EDuration="4.627697981s" totalImagesPullingTime="3.336929232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:32:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:32:04.626210159 +0000 UTC m=+560.912813314" watchObservedRunningTime="2026-07-07 17:32:04.627697981 +0000 UTC m=+560.914301113" Jul 07 17:32:04.628065 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.628048 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-istio-token\") pod \"istiod-openshift-gateway-7574459656-7kvwk\" (UID: \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" Jul 07 17:32:04.628495 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.628478 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pqqb\" (UniqueName: \"kubernetes.io/projected/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-kube-api-access-7pqqb\") pod \"istiod-openshift-gateway-7574459656-7kvwk\" (UID: \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" Jul 07 17:32:04.805217 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.805145 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" Jul 07 17:32:04.964244 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:04.964087 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk"] Jul 07 17:32:04.967270 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:32:04.967242 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bef3973_ecd4_4d0a_a4d3_c4533cfb4c09.slice/crio-2d58dbae868a545cd68fd37b8bd9ddcb1f32b17d5a0c06d9b3be6a5d6b843ee4 WatchSource:0}: Error finding container 2d58dbae868a545cd68fd37b8bd9ddcb1f32b17d5a0c06d9b3be6a5d6b843ee4: Status 404 returned error can't find the container with id 2d58dbae868a545cd68fd37b8bd9ddcb1f32b17d5a0c06d9b3be6a5d6b843ee4 Jul 07 17:32:05.547919 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:05.547881 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" event={"ID":"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09","Type":"ContainerStarted","Data":"2d58dbae868a545cd68fd37b8bd9ddcb1f32b17d5a0c06d9b3be6a5d6b843ee4"} Jul 07 17:32:09.186923 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:09.186872 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 17:32:09.187284 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:09.186960 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 17:32:09.572698 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:09.572612 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jvwsc" event={"ID":"65df54e8-14da-49bf-a628-f2b33a8efe30","Type":"ContainerStarted","Data":"213804b0df4f63fae56abbb1825ec599363d6868f8d79bf170c4ccc61d9ef214"} Jul 07 17:32:09.572936 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:09.572717 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-jvwsc" Jul 07 17:32:09.574365 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:09.574337 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-s6vr6" event={"ID":"e5f58835-77f9-47af-a421-0a0b3f1b07be","Type":"ContainerStarted","Data":"54f958c226918d2547f6df9a71166237d78283c635c941c4ccf9a68f395e8a48"} Jul 07 17:32:09.574478 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:09.574444 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-s6vr6" Jul 07 17:32:09.575975 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:09.575958 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" event={"ID":"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09","Type":"ContainerStarted","Data":"3d3b4736b91fcb1c52284ffabb3c1903a2de26bacae470bcaf8214934f176600"} Jul 07 17:32:09.576075 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:09.576067 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" Jul 07 17:32:09.598896 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:09.598857 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-jvwsc" podStartSLOduration=3.79358072 podStartE2EDuration="8.598845544s" totalImagesPullingTime="4.805264824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:32:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:32:09.597201492 +0000 UTC m=+565.883804635" watchObservedRunningTime="2026-07-07 17:32:09.598845544 +0000 UTC m=+565.885448716" Jul 07 17:32:09.621347 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:09.621305 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-s6vr6" podStartSLOduration=1.780048316 podStartE2EDuration="6.621291279s" totalImagesPullingTime="4.841242963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:32:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:32:09.619820244 +0000 UTC m=+565.906423375" watchObservedRunningTime="2026-07-07 17:32:09.621291279 +0000 UTC m=+565.907894413" Jul 07 17:32:09.662589 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:09.662548 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" podStartSLOduration=1.445638173 podStartE2EDuration="5.662534198s" totalImagesPullingTime="4.216896025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:32:09.661985658 +0000 UTC m=+565.948588790" watchObservedRunningTime="2026-07-07 17:32:09.662534198 +0000 UTC m=+565.949137329" Jul 07 17:32:10.582929 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:10.582893 2549 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-7kvwk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 17:32:10.583351 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:10.582964 2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" podUID="3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 17:32:13.582536 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:13.582483 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" Jul 07 17:32:14.219735 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:14.219709 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-65ttp"] Jul 07 17:32:14.221874 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:14.221853 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-65ttp" Jul 07 17:32:14.228626 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:14.228604 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 07 17:32:14.228767 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:14.228750 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-l6jpm\"" Jul 07 17:32:14.260135 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:14.260109 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-s9ck9"] Jul 07 17:32:14.262127 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:14.262111 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s9ck9" Jul 07 17:32:14.265637 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:14.265620 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-h6h6b\"" Jul 07 17:32:14.265714 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:14.265622 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 07 17:32:14.272824 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:14.272797 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sggz4\" (UniqueName: \"kubernetes.io/projected/b907a354-14a3-4d57-85fa-489b69bc5b06-kube-api-access-sggz4\") pod \"kserve-controller-manager-d6f4b65b8-65ttp\" (UID: \"b907a354-14a3-4d57-85fa-489b69bc5b06\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-65ttp" Jul 07 17:32:14.272948 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:14.272930 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b907a354-14a3-4d57-85fa-489b69bc5b06-cert\") pod \"kserve-controller-manager-d6f4b65b8-65ttp\" (UID: \"b907a354-14a3-4d57-85fa-489b69bc5b06\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-65ttp" Jul 07 17:32:14.343295 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:14.343269 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-65ttp"] Jul 07 17:32:14.366576 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:14.366556 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-s9ck9"] Jul 07 17:32:14.374099 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:14.374079 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b907a354-14a3-4d57-85fa-489b69bc5b06-cert\") pod \"kserve-controller-manager-d6f4b65b8-65ttp\" (UID: \"b907a354-14a3-4d57-85fa-489b69bc5b06\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-65ttp" Jul 07 17:32:14.374200 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:14.374124 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srr4j\" (UniqueName: \"kubernetes.io/projected/df14c52c-ad9f-413b-9970-d47edada55e3-kube-api-access-srr4j\") pod \"llmisvc-controller-manager-777c6bd7d5-s9ck9\" (UID: \"df14c52c-ad9f-413b-9970-d47edada55e3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s9ck9" Jul 07 17:32:14.374200 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:14.374148 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sggz4\" (UniqueName: \"kubernetes.io/projected/b907a354-14a3-4d57-85fa-489b69bc5b06-kube-api-access-sggz4\") pod \"kserve-controller-manager-d6f4b65b8-65ttp\" (UID: \"b907a354-14a3-4d57-85fa-489b69bc5b06\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-65ttp" Jul 07 17:32:14.374200 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:14.374168 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df14c52c-ad9f-413b-9970-d47edada55e3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s9ck9\" (UID: \"df14c52c-ad9f-413b-9970-d47edada55e3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s9ck9" Jul 07 17:32:14.374333 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:32:14.374236 2549 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 07 17:32:14.374333 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:32:14.374316 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b907a354-14a3-4d57-85fa-489b69bc5b06-cert podName:b907a354-14a3-4d57-85fa-489b69bc5b06 nodeName:}" failed. No retries permitted until 2026-07-07 17:32:14.874294524 +0000 UTC m=+571.160897664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b907a354-14a3-4d57-85fa-489b69bc5b06-cert") pod "kserve-controller-manager-d6f4b65b8-65ttp" (UID: "b907a354-14a3-4d57-85fa-489b69bc5b06") : secret "kserve-webhook-server-cert" not found Jul 07 17:32:14.395049 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:14.395031 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sggz4\" (UniqueName: \"kubernetes.io/projected/b907a354-14a3-4d57-85fa-489b69bc5b06-kube-api-access-sggz4\") pod \"kserve-controller-manager-d6f4b65b8-65ttp\" (UID: \"b907a354-14a3-4d57-85fa-489b69bc5b06\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-65ttp" Jul 07 17:32:14.475280 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:14.475225 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srr4j\" (UniqueName: \"kubernetes.io/projected/df14c52c-ad9f-413b-9970-d47edada55e3-kube-api-access-srr4j\") pod \"llmisvc-controller-manager-777c6bd7d5-s9ck9\" (UID: \"df14c52c-ad9f-413b-9970-d47edada55e3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s9ck9" Jul 07 17:32:14.475280 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:14.475259 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df14c52c-ad9f-413b-9970-d47edada55e3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s9ck9\" (UID: \"df14c52c-ad9f-413b-9970-d47edada55e3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s9ck9" Jul 07 17:32:14.475415 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:32:14.475352 2549 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 07 17:32:14.475415 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:32:14.475398 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df14c52c-ad9f-413b-9970-d47edada55e3-cert podName:df14c52c-ad9f-413b-9970-d47edada55e3 nodeName:}" failed. No retries permitted until 2026-07-07 17:32:14.975383938 +0000 UTC m=+571.261987051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/df14c52c-ad9f-413b-9970-d47edada55e3-cert") pod "llmisvc-controller-manager-777c6bd7d5-s9ck9" (UID: "df14c52c-ad9f-413b-9970-d47edada55e3") : secret "llmisvc-webhook-server-cert" not found Jul 07 17:32:14.495737 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:14.495713 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srr4j\" (UniqueName: \"kubernetes.io/projected/df14c52c-ad9f-413b-9970-d47edada55e3-kube-api-access-srr4j\") pod \"llmisvc-controller-manager-777c6bd7d5-s9ck9\" (UID: \"df14c52c-ad9f-413b-9970-d47edada55e3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s9ck9" Jul 07 17:32:14.877626 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:14.877546 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b907a354-14a3-4d57-85fa-489b69bc5b06-cert\") pod \"kserve-controller-manager-d6f4b65b8-65ttp\" (UID: \"b907a354-14a3-4d57-85fa-489b69bc5b06\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-65ttp" Jul 07 17:32:14.880095 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:14.880069 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b907a354-14a3-4d57-85fa-489b69bc5b06-cert\") pod \"kserve-controller-manager-d6f4b65b8-65ttp\" (UID: \"b907a354-14a3-4d57-85fa-489b69bc5b06\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-65ttp" Jul 07 17:32:14.978430 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:14.978402 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df14c52c-ad9f-413b-9970-d47edada55e3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s9ck9\" (UID: \"df14c52c-ad9f-413b-9970-d47edada55e3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s9ck9" Jul 07 17:32:14.980865 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:14.980847 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df14c52c-ad9f-413b-9970-d47edada55e3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s9ck9\" (UID: \"df14c52c-ad9f-413b-9970-d47edada55e3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s9ck9" Jul 07 17:32:15.132413 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:15.132356 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-65ttp" Jul 07 17:32:15.171539 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:15.171493 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s9ck9" Jul 07 17:32:15.277204 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:15.277173 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-65ttp"] Jul 07 17:32:15.280737 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:32:15.280705 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb907a354_14a3_4d57_85fa_489b69bc5b06.slice/crio-1818120449d9ea313d437f813b808b9c5ee49818cf93f08a552fedc97dd93d1b WatchSource:0}: Error finding container 1818120449d9ea313d437f813b808b9c5ee49818cf93f08a552fedc97dd93d1b: Status 404 returned error can't find the container with id 1818120449d9ea313d437f813b808b9c5ee49818cf93f08a552fedc97dd93d1b Jul 07 17:32:15.319392 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:15.319370 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-s9ck9"] Jul 07 17:32:15.320247 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:32:15.320222 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddf14c52c_ad9f_413b_9970_d47edada55e3.slice/crio-182f4059fd78f7864bb68ccad05c67c15dfac24558d5b2915d35c5d8caf947b6 WatchSource:0}: Error finding container 182f4059fd78f7864bb68ccad05c67c15dfac24558d5b2915d35c5d8caf947b6: Status 404 returned error can't find the container with id 182f4059fd78f7864bb68ccad05c67c15dfac24558d5b2915d35c5d8caf947b6 Jul 07 17:32:15.603867 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:15.603834 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s9ck9" event={"ID":"df14c52c-ad9f-413b-9970-d47edada55e3","Type":"ContainerStarted","Data":"182f4059fd78f7864bb68ccad05c67c15dfac24558d5b2915d35c5d8caf947b6"} Jul 07 17:32:15.604969 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:15.604944 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-65ttp" event={"ID":"b907a354-14a3-4d57-85fa-489b69bc5b06","Type":"ContainerStarted","Data":"1818120449d9ea313d437f813b808b9c5ee49818cf93f08a552fedc97dd93d1b"} Jul 07 17:32:16.175190 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.175153 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk"] Jul 07 17:32:16.175642 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.175391 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" podUID="3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09" containerName="discovery" containerID="cri-o://3d3b4736b91fcb1c52284ffabb3c1903a2de26bacae470bcaf8214934f176600" gracePeriod=30 Jul 07 17:32:16.460133 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.460105 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" Jul 07 17:32:16.490496 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.490472 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-istio-csr-ca-configmap\") pod \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\" (UID: \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\") " Jul 07 17:32:16.490496 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.490519 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-cacerts\") pod \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\" (UID: \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\") " Jul 07 17:32:16.490715 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.490556 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pqqb\" (UniqueName: \"kubernetes.io/projected/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-kube-api-access-7pqqb\") pod \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\" (UID: \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\") " Jul 07 17:32:16.490715 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.490588 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-istio-csr-dns-cert\") pod \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\" (UID: \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\") " Jul 07 17:32:16.490715 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.490623 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-istio-token\") pod \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\" (UID: \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\") " Jul 07 17:32:16.490715 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.490673 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-istio-kubeconfig\") pod \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\" (UID: \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\") " Jul 07 17:32:16.490715 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.490700 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-local-certs\") pod \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\" (UID: \"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09\") " Jul 07 17:32:16.490992 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.490913 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09" (UID: "3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 17:32:16.493126 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.493088 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-cacerts" (OuterVolumeSpecName: "cacerts") pod "3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09" (UID: "3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:32:16.493417 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.493381 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-istio-token" (OuterVolumeSpecName: "istio-token") pod "3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09" (UID: "3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:32:16.493596 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.493575 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-kube-api-access-7pqqb" (OuterVolumeSpecName: "kube-api-access-7pqqb") pod "3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09" (UID: "3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09"). InnerVolumeSpecName "kube-api-access-7pqqb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:32:16.493672 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.493600 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-local-certs" (OuterVolumeSpecName: "local-certs") pod "3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09" (UID: "3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:32:16.493672 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.493614 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09" (UID: "3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:32:16.493821 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.493797 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09" (UID: "3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:32:16.591441 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.591315 2549 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-istio-csr-ca-configmap\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:32:16.591441 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.591350 2549 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-cacerts\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:32:16.591441 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.591364 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pqqb\" (UniqueName: \"kubernetes.io/projected/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-kube-api-access-7pqqb\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:32:16.591441 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.591379 2549 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-istio-csr-dns-cert\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:32:16.591441 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.591392 2549 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-istio-token\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:32:16.591441 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.591404 2549 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-istio-kubeconfig\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:32:16.591441 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.591417 2549 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09-local-certs\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:32:16.619252 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.619219 2549 generic.go:356] "Generic (PLEG): container finished" podID="3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09" containerID="3d3b4736b91fcb1c52284ffabb3c1903a2de26bacae470bcaf8214934f176600" exitCode=0 Jul 07 17:32:16.619395 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.619262 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" event={"ID":"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09","Type":"ContainerDied","Data":"3d3b4736b91fcb1c52284ffabb3c1903a2de26bacae470bcaf8214934f176600"} Jul 07 17:32:16.619395 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.619298 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" event={"ID":"3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09","Type":"ContainerDied","Data":"2d58dbae868a545cd68fd37b8bd9ddcb1f32b17d5a0c06d9b3be6a5d6b843ee4"} Jul 07 17:32:16.619395 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.619316 2549 scope.go:117] "RemoveContainer" containerID="3d3b4736b91fcb1c52284ffabb3c1903a2de26bacae470bcaf8214934f176600" Jul 07 17:32:16.619613 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.619485 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk" Jul 07 17:32:16.655546 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.655518 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk"] Jul 07 17:32:16.664132 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.664104 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-7kvwk"] Jul 07 17:32:16.666720 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.666699 2549 scope.go:117] "RemoveContainer" containerID="3d3b4736b91fcb1c52284ffabb3c1903a2de26bacae470bcaf8214934f176600" Jul 07 17:32:16.667064 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:32:16.667041 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d3b4736b91fcb1c52284ffabb3c1903a2de26bacae470bcaf8214934f176600\": container with ID starting with 3d3b4736b91fcb1c52284ffabb3c1903a2de26bacae470bcaf8214934f176600 not found: ID does not exist" containerID="3d3b4736b91fcb1c52284ffabb3c1903a2de26bacae470bcaf8214934f176600" Jul 07 17:32:16.667150 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:16.667077 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d3b4736b91fcb1c52284ffabb3c1903a2de26bacae470bcaf8214934f176600"} err="failed to get container status \"3d3b4736b91fcb1c52284ffabb3c1903a2de26bacae470bcaf8214934f176600\": rpc error: code = NotFound desc = could not find container \"3d3b4736b91fcb1c52284ffabb3c1903a2de26bacae470bcaf8214934f176600\": container with ID starting with 3d3b4736b91fcb1c52284ffabb3c1903a2de26bacae470bcaf8214934f176600 not found: ID does not exist" Jul 07 17:32:18.221791 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:18.221757 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09" path="/var/lib/kubelet/pods/3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09/volumes" Jul 07 17:32:19.637402 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:19.637366 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s9ck9" event={"ID":"df14c52c-ad9f-413b-9970-d47edada55e3","Type":"ContainerStarted","Data":"cc93b3bc2da18e814f3db1c54f2255235b207c6d7349d8c189a1bcf745c5a0c9"} Jul 07 17:32:19.637848 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:19.637420 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s9ck9" Jul 07 17:32:19.638921 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:19.638894 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-65ttp" event={"ID":"b907a354-14a3-4d57-85fa-489b69bc5b06","Type":"ContainerStarted","Data":"b01b2cbe026580f079a49901611b9ea7d9fe15f95453c0ceb01fca2e4e65e55e"} Jul 07 17:32:19.639016 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:19.638981 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-65ttp" Jul 07 17:32:19.819212 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:19.819154 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-65ttp" podStartSLOduration=2.310086428 podStartE2EDuration="5.81913447s" totalImagesPullingTime="3.509048042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:32:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:32:19.816202338 +0000 UTC m=+576.102805470" watchObservedRunningTime="2026-07-07 17:32:19.81913447 +0000 UTC m=+576.105737602" Jul 07 17:32:19.819468 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:19.819439 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s9ck9" podStartSLOduration=2.3475561799999998 podStartE2EDuration="5.819430364s" totalImagesPullingTime="3.471874184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:32:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:32:19.738026419 +0000 UTC m=+576.024629550" watchObservedRunningTime="2026-07-07 17:32:19.819430364 +0000 UTC m=+576.106033496" Jul 07 17:32:20.583079 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:20.583046 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-jvwsc" Jul 07 17:32:20.587755 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:20.587735 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-s6vr6" Jul 07 17:32:44.141188 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:44.141163 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhztd_00383bc5-6090-486b-892b-5be74f96c497/ovn-acl-logging/0.log" Jul 07 17:32:44.141707 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:44.141200 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhztd_00383bc5-6090-486b-892b-5be74f96c497/ovn-acl-logging/0.log" Jul 07 17:32:50.644756 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:50.644725 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s9ck9" Jul 07 17:32:50.647929 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:32:50.647911 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-65ttp" Jul 07 17:33:01.573448 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:01.573420 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7kpbp"] Jul 07 17:33:01.573831 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:01.573733 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09" containerName="discovery" Jul 07 17:33:01.573831 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:01.573745 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09" containerName="discovery" Jul 07 17:33:01.573831 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:01.573799 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bef3973-ecd4-4d0a-a4d3-c4533cfb4c09" containerName="discovery" Jul 07 17:33:01.582112 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:01.582086 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7kpbp" Jul 07 17:33:01.585573 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:01.585546 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 17:33:01.585970 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:01.585949 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 17:33:01.586963 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:01.586947 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-xqjpg\"" Jul 07 17:33:01.595759 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:01.595736 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7kpbp"] Jul 07 17:33:01.715625 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:01.715596 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgwwz\" (UniqueName: \"kubernetes.io/projected/b22168bd-6e45-495d-a1e4-ccd86dc38dbe-kube-api-access-tgwwz\") pod \"kuadrant-operator-catalog-7kpbp\" (UID: \"b22168bd-6e45-495d-a1e4-ccd86dc38dbe\") " pod="kuadrant-system/kuadrant-operator-catalog-7kpbp" Jul 07 17:33:01.816252 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:01.816230 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgwwz\" (UniqueName: \"kubernetes.io/projected/b22168bd-6e45-495d-a1e4-ccd86dc38dbe-kube-api-access-tgwwz\") pod \"kuadrant-operator-catalog-7kpbp\" (UID: \"b22168bd-6e45-495d-a1e4-ccd86dc38dbe\") " pod="kuadrant-system/kuadrant-operator-catalog-7kpbp" Jul 07 17:33:01.828242 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:01.828160 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgwwz\" (UniqueName: \"kubernetes.io/projected/b22168bd-6e45-495d-a1e4-ccd86dc38dbe-kube-api-access-tgwwz\") pod \"kuadrant-operator-catalog-7kpbp\" (UID: \"b22168bd-6e45-495d-a1e4-ccd86dc38dbe\") " pod="kuadrant-system/kuadrant-operator-catalog-7kpbp" Jul 07 17:33:01.891771 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:01.891745 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7kpbp"] Jul 07 17:33:01.891860 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:01.891830 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7kpbp" Jul 07 17:33:02.030495 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:02.030466 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7kpbp"] Jul 07 17:33:02.033920 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:33:02.033896 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb22168bd_6e45_495d_a1e4_ccd86dc38dbe.slice/crio-6d28a4ffbcca4b001a04f79c178966decf3b0859addd2ba4a333b34a75526db3 WatchSource:0}: Error finding container 6d28a4ffbcca4b001a04f79c178966decf3b0859addd2ba4a333b34a75526db3: Status 404 returned error can't find the container with id 6d28a4ffbcca4b001a04f79c178966decf3b0859addd2ba4a333b34a75526db3 Jul 07 17:33:02.104464 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:02.104411 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9dwqg"] Jul 07 17:33:02.107120 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:02.107107 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9dwqg" Jul 07 17:33:02.121092 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:02.121068 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9dwqg"] Jul 07 17:33:02.219666 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:02.219645 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffq5s\" (UniqueName: \"kubernetes.io/projected/0ea5cd08-e76e-46d0-b501-9d089b9b820d-kube-api-access-ffq5s\") pod \"kuadrant-operator-catalog-9dwqg\" (UID: \"0ea5cd08-e76e-46d0-b501-9d089b9b820d\") " pod="kuadrant-system/kuadrant-operator-catalog-9dwqg" Jul 07 17:33:02.320050 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:02.320023 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffq5s\" (UniqueName: \"kubernetes.io/projected/0ea5cd08-e76e-46d0-b501-9d089b9b820d-kube-api-access-ffq5s\") pod \"kuadrant-operator-catalog-9dwqg\" (UID: \"0ea5cd08-e76e-46d0-b501-9d089b9b820d\") " pod="kuadrant-system/kuadrant-operator-catalog-9dwqg" Jul 07 17:33:02.334703 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:02.334668 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffq5s\" (UniqueName: \"kubernetes.io/projected/0ea5cd08-e76e-46d0-b501-9d089b9b820d-kube-api-access-ffq5s\") pod \"kuadrant-operator-catalog-9dwqg\" (UID: \"0ea5cd08-e76e-46d0-b501-9d089b9b820d\") " pod="kuadrant-system/kuadrant-operator-catalog-9dwqg" Jul 07 17:33:02.415716 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:02.415689 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9dwqg" Jul 07 17:33:02.573233 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:02.573211 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9dwqg"] Jul 07 17:33:02.575081 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:33:02.575046 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ea5cd08_e76e_46d0_b501_9d089b9b820d.slice/crio-e179c9044c46c6332fac88c36c08296221c93622d2e931609d0192c8ece25111 WatchSource:0}: Error finding container e179c9044c46c6332fac88c36c08296221c93622d2e931609d0192c8ece25111: Status 404 returned error can't find the container with id e179c9044c46c6332fac88c36c08296221c93622d2e931609d0192c8ece25111 Jul 07 17:33:02.844605 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:02.844534 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9dwqg" event={"ID":"0ea5cd08-e76e-46d0-b501-9d089b9b820d","Type":"ContainerStarted","Data":"e179c9044c46c6332fac88c36c08296221c93622d2e931609d0192c8ece25111"} Jul 07 17:33:02.845631 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:02.845602 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7kpbp" event={"ID":"b22168bd-6e45-495d-a1e4-ccd86dc38dbe","Type":"ContainerStarted","Data":"6d28a4ffbcca4b001a04f79c178966decf3b0859addd2ba4a333b34a75526db3"} Jul 07 17:33:04.857821 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:04.857734 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9dwqg" event={"ID":"0ea5cd08-e76e-46d0-b501-9d089b9b820d","Type":"ContainerStarted","Data":"ad0e57117223c94e646895527a5058bb77ec439545d6a5d58349a93e8f454f5f"} Jul 07 17:33:04.859488 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:04.859456 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7kpbp" event={"ID":"b22168bd-6e45-495d-a1e4-ccd86dc38dbe","Type":"ContainerStarted","Data":"12230dc3e4e4dbefbd90ed480b8432f26278e7a00e9cc8197c0a7ca8c094138c"} Jul 07 17:33:04.859646 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:04.859528 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-7kpbp" podUID="b22168bd-6e45-495d-a1e4-ccd86dc38dbe" containerName="registry-server" containerID="cri-o://12230dc3e4e4dbefbd90ed480b8432f26278e7a00e9cc8197c0a7ca8c094138c" gracePeriod=2 Jul 07 17:33:04.893325 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:04.893284 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9dwqg" podStartSLOduration=1.262528728 podStartE2EDuration="2.893270115s" totalImagesPullingTime="1.630741387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:33:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:33:04.893198212 +0000 UTC m=+621.179801343" watchObservedRunningTime="2026-07-07 17:33:04.893270115 +0000 UTC m=+621.179873245" Jul 07 17:33:04.929535 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:04.929478 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7kpbp" podStartSLOduration=1.7598201470000001 podStartE2EDuration="3.929465385s" totalImagesPullingTime="2.169645238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:33:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:33:04.928048662 +0000 UTC m=+621.214651792" watchObservedRunningTime="2026-07-07 17:33:04.929465385 +0000 UTC m=+621.216068515" Jul 07 17:33:05.122835 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:05.122812 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7kpbp" Jul 07 17:33:05.248168 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:05.248143 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgwwz\" (UniqueName: \"kubernetes.io/projected/b22168bd-6e45-495d-a1e4-ccd86dc38dbe-kube-api-access-tgwwz\") pod \"b22168bd-6e45-495d-a1e4-ccd86dc38dbe\" (UID: \"b22168bd-6e45-495d-a1e4-ccd86dc38dbe\") " Jul 07 17:33:05.250406 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:05.250378 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b22168bd-6e45-495d-a1e4-ccd86dc38dbe-kube-api-access-tgwwz" (OuterVolumeSpecName: "kube-api-access-tgwwz") pod "b22168bd-6e45-495d-a1e4-ccd86dc38dbe" (UID: "b22168bd-6e45-495d-a1e4-ccd86dc38dbe"). InnerVolumeSpecName "kube-api-access-tgwwz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:33:05.348888 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:05.348864 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgwwz\" (UniqueName: \"kubernetes.io/projected/b22168bd-6e45-495d-a1e4-ccd86dc38dbe-kube-api-access-tgwwz\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:33:05.873206 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:05.873177 2549 generic.go:356] "Generic (PLEG): container finished" podID="b22168bd-6e45-495d-a1e4-ccd86dc38dbe" containerID="12230dc3e4e4dbefbd90ed480b8432f26278e7a00e9cc8197c0a7ca8c094138c" exitCode=0 Jul 07 17:33:05.873705 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:05.873235 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7kpbp" Jul 07 17:33:05.873705 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:05.873263 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7kpbp" event={"ID":"b22168bd-6e45-495d-a1e4-ccd86dc38dbe","Type":"ContainerDied","Data":"12230dc3e4e4dbefbd90ed480b8432f26278e7a00e9cc8197c0a7ca8c094138c"} Jul 07 17:33:05.873705 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:05.873340 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7kpbp" event={"ID":"b22168bd-6e45-495d-a1e4-ccd86dc38dbe","Type":"ContainerDied","Data":"6d28a4ffbcca4b001a04f79c178966decf3b0859addd2ba4a333b34a75526db3"} Jul 07 17:33:05.873705 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:05.873362 2549 scope.go:117] "RemoveContainer" containerID="12230dc3e4e4dbefbd90ed480b8432f26278e7a00e9cc8197c0a7ca8c094138c" Jul 07 17:33:05.883348 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:05.883330 2549 scope.go:117] "RemoveContainer" containerID="12230dc3e4e4dbefbd90ed480b8432f26278e7a00e9cc8197c0a7ca8c094138c" Jul 07 17:33:05.883650 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:33:05.883630 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12230dc3e4e4dbefbd90ed480b8432f26278e7a00e9cc8197c0a7ca8c094138c\": container with ID starting with 12230dc3e4e4dbefbd90ed480b8432f26278e7a00e9cc8197c0a7ca8c094138c not found: ID does not exist" containerID="12230dc3e4e4dbefbd90ed480b8432f26278e7a00e9cc8197c0a7ca8c094138c" Jul 07 17:33:05.883722 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:05.883662 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12230dc3e4e4dbefbd90ed480b8432f26278e7a00e9cc8197c0a7ca8c094138c"} err="failed to get container status \"12230dc3e4e4dbefbd90ed480b8432f26278e7a00e9cc8197c0a7ca8c094138c\": rpc error: code = NotFound desc = could not find container \"12230dc3e4e4dbefbd90ed480b8432f26278e7a00e9cc8197c0a7ca8c094138c\": container with ID starting with 12230dc3e4e4dbefbd90ed480b8432f26278e7a00e9cc8197c0a7ca8c094138c not found: ID does not exist" Jul 07 17:33:05.907384 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:05.907360 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7kpbp"] Jul 07 17:33:05.913705 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:05.913686 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7kpbp"] Jul 07 17:33:06.221213 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:06.221185 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b22168bd-6e45-495d-a1e4-ccd86dc38dbe" path="/var/lib/kubelet/pods/b22168bd-6e45-495d-a1e4-ccd86dc38dbe/volumes" Jul 07 17:33:12.416526 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:12.416477 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-9dwqg" Jul 07 17:33:12.416935 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:12.416579 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-9dwqg" Jul 07 17:33:12.439004 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:12.438981 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-9dwqg" Jul 07 17:33:12.934117 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:12.934088 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-9dwqg" Jul 07 17:33:17.194648 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:17.194613 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp"] Jul 07 17:33:17.195095 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:17.194934 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b22168bd-6e45-495d-a1e4-ccd86dc38dbe" containerName="registry-server" Jul 07 17:33:17.195095 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:17.194946 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="b22168bd-6e45-495d-a1e4-ccd86dc38dbe" containerName="registry-server" Jul 07 17:33:17.195095 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:17.195011 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="b22168bd-6e45-495d-a1e4-ccd86dc38dbe" containerName="registry-server" Jul 07 17:33:17.198147 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:17.198127 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp" Jul 07 17:33:17.201627 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:17.201606 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-d7tsf\"" Jul 07 17:33:17.216803 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:17.216778 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp"] Jul 07 17:33:17.334092 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:17.334067 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp\" (UID: \"f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp" Jul 07 17:33:17.334187 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:17.334108 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bdp7\" (UniqueName: \"kubernetes.io/projected/f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560-kube-api-access-7bdp7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp\" (UID: \"f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp" Jul 07 17:33:17.334187 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:17.334143 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp\" (UID: \"f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp" Jul 07 17:33:17.435374 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:17.435352 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bdp7\" (UniqueName: \"kubernetes.io/projected/f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560-kube-api-access-7bdp7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp\" (UID: \"f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp" Jul 07 17:33:17.435475 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:17.435393 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp\" (UID: \"f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp" Jul 07 17:33:17.435475 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:17.435429 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp\" (UID: \"f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp" Jul 07 17:33:17.435739 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:17.435724 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp\" (UID: \"f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp" Jul 07 17:33:17.435810 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:17.435791 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp\" (UID: \"f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp" Jul 07 17:33:17.446826 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:17.446769 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bdp7\" (UniqueName: \"kubernetes.io/projected/f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560-kube-api-access-7bdp7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp\" (UID: \"f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp" Jul 07 17:33:17.507424 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:17.507404 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp" Jul 07 17:33:17.645434 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:17.645412 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp"] Jul 07 17:33:17.647127 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:33:17.647102 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9d47ebe_7f9d_40d5_bf31_aa50ff2e4560.slice/crio-fedc8f4d1bfb998772ac19a2cf16e496206e079d6054fea5a608999df0f48d82 WatchSource:0}: Error finding container fedc8f4d1bfb998772ac19a2cf16e496206e079d6054fea5a608999df0f48d82: Status 404 returned error can't find the container with id fedc8f4d1bfb998772ac19a2cf16e496206e079d6054fea5a608999df0f48d82 Jul 07 17:33:17.823651 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:17.823624 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2"] Jul 07 17:33:17.826858 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:17.826843 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2" Jul 07 17:33:17.860422 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:17.858300 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2"] Jul 07 17:33:17.935060 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:17.935029 2549 generic.go:356] "Generic (PLEG): container finished" podID="f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560" containerID="5d8fa181748fa05602bd6b0c54fedf24686ad31e91fd93c800b32363236043d6" exitCode=0 Jul 07 17:33:17.935182 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:17.935063 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp" event={"ID":"f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560","Type":"ContainerDied","Data":"5d8fa181748fa05602bd6b0c54fedf24686ad31e91fd93c800b32363236043d6"} Jul 07 17:33:17.935182 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:17.935113 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp" event={"ID":"f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560","Type":"ContainerStarted","Data":"fedc8f4d1bfb998772ac19a2cf16e496206e079d6054fea5a608999df0f48d82"} Jul 07 17:33:17.939216 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:17.939194 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2\" (UID: \"fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2" Jul 07 17:33:17.939355 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:17.939225 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2\" (UID: \"fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2" Jul 07 17:33:17.939355 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:17.939245 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzmp9\" (UniqueName: \"kubernetes.io/projected/fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8-kube-api-access-gzmp9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2\" (UID: \"fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2" Jul 07 17:33:18.039743 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.039695 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2\" (UID: \"fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2" Jul 07 17:33:18.039743 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.039724 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2\" (UID: \"fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2" Jul 07 17:33:18.039947 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.039925 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzmp9\" (UniqueName: \"kubernetes.io/projected/fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8-kube-api-access-gzmp9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2\" (UID: \"fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2" Jul 07 17:33:18.040089 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.040070 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2\" (UID: \"fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2" Jul 07 17:33:18.040089 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.040082 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2\" (UID: \"fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2" Jul 07 17:33:18.057592 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.057568 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzmp9\" (UniqueName: \"kubernetes.io/projected/fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8-kube-api-access-gzmp9\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2\" (UID: \"fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2" Jul 07 17:33:18.135590 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.135572 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2" Jul 07 17:33:18.278144 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.278118 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2"] Jul 07 17:33:18.279886 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:33:18.279836 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe3c0c0e_a98f_460b_b240_c19b1a1bb2a8.slice/crio-95f8a20812275e6ad035a5f0c17836aceac8544c91d600a36f91c2790079bb9b WatchSource:0}: Error finding container 95f8a20812275e6ad035a5f0c17836aceac8544c91d600a36f91c2790079bb9b: Status 404 returned error can't find the container with id 95f8a20812275e6ad035a5f0c17836aceac8544c91d600a36f91c2790079bb9b Jul 07 17:33:18.400731 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.400704 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq"] Jul 07 17:33:18.404156 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.404137 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq" Jul 07 17:33:18.423228 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.423205 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq"] Jul 07 17:33:18.543944 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.543920 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1bd1408-750c-4e73-b5d3-c134dbf0e201-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq\" (UID: \"f1bd1408-750c-4e73-b5d3-c134dbf0e201\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq" Jul 07 17:33:18.544056 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.543948 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1bd1408-750c-4e73-b5d3-c134dbf0e201-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq\" (UID: \"f1bd1408-750c-4e73-b5d3-c134dbf0e201\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq" Jul 07 17:33:18.544124 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.544054 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4w9s\" (UniqueName: \"kubernetes.io/projected/f1bd1408-750c-4e73-b5d3-c134dbf0e201-kube-api-access-b4w9s\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq\" (UID: \"f1bd1408-750c-4e73-b5d3-c134dbf0e201\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq" Jul 07 17:33:18.644643 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.644621 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4w9s\" (UniqueName: \"kubernetes.io/projected/f1bd1408-750c-4e73-b5d3-c134dbf0e201-kube-api-access-b4w9s\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq\" (UID: \"f1bd1408-750c-4e73-b5d3-c134dbf0e201\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq" Jul 07 17:33:18.644744 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.644675 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1bd1408-750c-4e73-b5d3-c134dbf0e201-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq\" (UID: \"f1bd1408-750c-4e73-b5d3-c134dbf0e201\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq" Jul 07 17:33:18.644744 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.644697 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1bd1408-750c-4e73-b5d3-c134dbf0e201-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq\" (UID: \"f1bd1408-750c-4e73-b5d3-c134dbf0e201\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq" Jul 07 17:33:18.644992 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.644934 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1bd1408-750c-4e73-b5d3-c134dbf0e201-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq\" (UID: \"f1bd1408-750c-4e73-b5d3-c134dbf0e201\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq" Jul 07 17:33:18.645055 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.645023 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1bd1408-750c-4e73-b5d3-c134dbf0e201-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq\" (UID: \"f1bd1408-750c-4e73-b5d3-c134dbf0e201\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq" Jul 07 17:33:18.654913 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.654893 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4w9s\" (UniqueName: \"kubernetes.io/projected/f1bd1408-750c-4e73-b5d3-c134dbf0e201-kube-api-access-b4w9s\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq\" (UID: \"f1bd1408-750c-4e73-b5d3-c134dbf0e201\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq" Jul 07 17:33:18.759033 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.759010 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq" Jul 07 17:33:18.784612 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.784590 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt"] Jul 07 17:33:18.789035 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.789013 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt" Jul 07 17:33:18.805149 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.805128 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt"] Jul 07 17:33:18.905862 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.905838 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq"] Jul 07 17:33:18.907769 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:33:18.907745 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1bd1408_750c_4e73_b5d3_c134dbf0e201.slice/crio-557b11bc5045ddbda953efb04c0c5ff67db62be3d1e52e8d969f5dff342a071d WatchSource:0}: Error finding container 557b11bc5045ddbda953efb04c0c5ff67db62be3d1e52e8d969f5dff342a071d: Status 404 returned error can't find the container with id 557b11bc5045ddbda953efb04c0c5ff67db62be3d1e52e8d969f5dff342a071d Jul 07 17:33:18.942419 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.942390 2549 generic.go:356] "Generic (PLEG): container finished" podID="f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560" containerID="0b3c0187dd6a9aa3eb45f112e55e15c3c7ad00b969eb5ee1f082c1f5b87d4b93" exitCode=0 Jul 07 17:33:18.942543 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.942497 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp" event={"ID":"f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560","Type":"ContainerDied","Data":"0b3c0187dd6a9aa3eb45f112e55e15c3c7ad00b969eb5ee1f082c1f5b87d4b93"} Jul 07 17:33:18.944158 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.944138 2549 generic.go:356] "Generic (PLEG): container finished" podID="fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8" containerID="754cd4db1c27b3d48493b9368704997e67bdd126bbe97a7f97dcf3f139177f37" exitCode=0 Jul 07 17:33:18.944252 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.944171 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2" event={"ID":"fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8","Type":"ContainerDied","Data":"754cd4db1c27b3d48493b9368704997e67bdd126bbe97a7f97dcf3f139177f37"} Jul 07 17:33:18.944252 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.944212 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2" event={"ID":"fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8","Type":"ContainerStarted","Data":"95f8a20812275e6ad035a5f0c17836aceac8544c91d600a36f91c2790079bb9b"} Jul 07 17:33:18.945712 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.945691 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq" event={"ID":"f1bd1408-750c-4e73-b5d3-c134dbf0e201","Type":"ContainerStarted","Data":"557b11bc5045ddbda953efb04c0c5ff67db62be3d1e52e8d969f5dff342a071d"} Jul 07 17:33:18.945992 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.945968 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64f624f2-d13b-4ec5-b710-9d951564b2f9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt\" (UID: \"64f624f2-d13b-4ec5-b710-9d951564b2f9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt" Jul 07 17:33:18.946047 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.946034 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64f624f2-d13b-4ec5-b710-9d951564b2f9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt\" (UID: \"64f624f2-d13b-4ec5-b710-9d951564b2f9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt" Jul 07 17:33:18.946093 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:18.946077 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtksh\" (UniqueName: \"kubernetes.io/projected/64f624f2-d13b-4ec5-b710-9d951564b2f9-kube-api-access-mtksh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt\" (UID: \"64f624f2-d13b-4ec5-b710-9d951564b2f9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt" Jul 07 17:33:19.047329 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:19.047276 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtksh\" (UniqueName: \"kubernetes.io/projected/64f624f2-d13b-4ec5-b710-9d951564b2f9-kube-api-access-mtksh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt\" (UID: \"64f624f2-d13b-4ec5-b710-9d951564b2f9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt" Jul 07 17:33:19.047442 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:19.047389 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64f624f2-d13b-4ec5-b710-9d951564b2f9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt\" (UID: \"64f624f2-d13b-4ec5-b710-9d951564b2f9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt" Jul 07 17:33:19.047538 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:19.047498 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64f624f2-d13b-4ec5-b710-9d951564b2f9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt\" (UID: \"64f624f2-d13b-4ec5-b710-9d951564b2f9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt" Jul 07 17:33:19.047855 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:19.047832 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64f624f2-d13b-4ec5-b710-9d951564b2f9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt\" (UID: \"64f624f2-d13b-4ec5-b710-9d951564b2f9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt" Jul 07 17:33:19.047935 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:19.047868 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64f624f2-d13b-4ec5-b710-9d951564b2f9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt\" (UID: \"64f624f2-d13b-4ec5-b710-9d951564b2f9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt" Jul 07 17:33:19.061045 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:19.061022 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtksh\" (UniqueName: \"kubernetes.io/projected/64f624f2-d13b-4ec5-b710-9d951564b2f9-kube-api-access-mtksh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt\" (UID: \"64f624f2-d13b-4ec5-b710-9d951564b2f9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt" Jul 07 17:33:19.100056 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:19.100035 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt" Jul 07 17:33:19.243403 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:19.243377 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt"] Jul 07 17:33:19.245001 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:33:19.244976 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64f624f2_d13b_4ec5_b710_9d951564b2f9.slice/crio-fb3d18defac1221a7a929518426791e5b5e91c9376da9b56538aa87e313e1a62 WatchSource:0}: Error finding container fb3d18defac1221a7a929518426791e5b5e91c9376da9b56538aa87e313e1a62: Status 404 returned error can't find the container with id fb3d18defac1221a7a929518426791e5b5e91c9376da9b56538aa87e313e1a62 Jul 07 17:33:19.952113 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:19.952081 2549 generic.go:356] "Generic (PLEG): container finished" podID="f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560" containerID="242534db273fd9395dcd472eb5346894dcd8358a105f7dc0a5a8df33b4d6caf7" exitCode=0 Jul 07 17:33:19.952463 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:19.952163 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp" event={"ID":"f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560","Type":"ContainerDied","Data":"242534db273fd9395dcd472eb5346894dcd8358a105f7dc0a5a8df33b4d6caf7"} Jul 07 17:33:19.954047 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:19.954025 2549 generic.go:356] "Generic (PLEG): container finished" podID="fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8" containerID="e15915a5501806adb244dd813eaf6ac3fee3e04cb26b66db6ffd8e7cb32c3065" exitCode=0 Jul 07 17:33:19.954141 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:19.954107 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2" event={"ID":"fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8","Type":"ContainerDied","Data":"e15915a5501806adb244dd813eaf6ac3fee3e04cb26b66db6ffd8e7cb32c3065"} Jul 07 17:33:19.955773 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:19.955754 2549 generic.go:356] "Generic (PLEG): container finished" podID="64f624f2-d13b-4ec5-b710-9d951564b2f9" containerID="7a17dc8ea4700990c58531fe265e7f48885063604f7b52f8f8b8752956d743e3" exitCode=0 Jul 07 17:33:19.955863 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:19.955847 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt" event={"ID":"64f624f2-d13b-4ec5-b710-9d951564b2f9","Type":"ContainerDied","Data":"7a17dc8ea4700990c58531fe265e7f48885063604f7b52f8f8b8752956d743e3"} Jul 07 17:33:19.955923 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:19.955872 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt" event={"ID":"64f624f2-d13b-4ec5-b710-9d951564b2f9","Type":"ContainerStarted","Data":"fb3d18defac1221a7a929518426791e5b5e91c9376da9b56538aa87e313e1a62"} Jul 07 17:33:19.957375 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:19.957352 2549 generic.go:356] "Generic (PLEG): container finished" podID="f1bd1408-750c-4e73-b5d3-c134dbf0e201" containerID="215499d9758ffdafb515f168dc34f25397e9adab89261af4a694210d359e5ffb" exitCode=0 Jul 07 17:33:19.957455 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:19.957408 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq" event={"ID":"f1bd1408-750c-4e73-b5d3-c134dbf0e201","Type":"ContainerDied","Data":"215499d9758ffdafb515f168dc34f25397e9adab89261af4a694210d359e5ffb"} Jul 07 17:33:20.965113 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:20.965081 2549 generic.go:356] "Generic (PLEG): container finished" podID="f1bd1408-750c-4e73-b5d3-c134dbf0e201" containerID="55f14c9930e881393d8ea2f01b1ce1da98f3df0aeea6b280b9835183de8b2f3a" exitCode=0 Jul 07 17:33:20.965534 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:20.965153 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq" event={"ID":"f1bd1408-750c-4e73-b5d3-c134dbf0e201","Type":"ContainerDied","Data":"55f14c9930e881393d8ea2f01b1ce1da98f3df0aeea6b280b9835183de8b2f3a"} Jul 07 17:33:20.967883 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:20.967860 2549 generic.go:356] "Generic (PLEG): container finished" podID="fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8" containerID="ceaea877c4c7f50da2f7c8b1653afe7f291ea9decc8c2fcef114dc7a4092112a" exitCode=0 Jul 07 17:33:20.967979 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:20.967944 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2" event={"ID":"fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8","Type":"ContainerDied","Data":"ceaea877c4c7f50da2f7c8b1653afe7f291ea9decc8c2fcef114dc7a4092112a"} Jul 07 17:33:21.105554 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:21.105484 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp" Jul 07 17:33:21.265024 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:21.264996 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560-bundle\") pod \"f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560\" (UID: \"f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560\") " Jul 07 17:33:21.265179 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:21.265031 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bdp7\" (UniqueName: \"kubernetes.io/projected/f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560-kube-api-access-7bdp7\") pod \"f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560\" (UID: \"f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560\") " Jul 07 17:33:21.265179 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:21.265052 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560-util\") pod \"f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560\" (UID: \"f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560\") " Jul 07 17:33:21.265461 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:21.265433 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560-bundle" (OuterVolumeSpecName: "bundle") pod "f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560" (UID: "f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:33:21.266961 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:21.266940 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560-kube-api-access-7bdp7" (OuterVolumeSpecName: "kube-api-access-7bdp7") pod "f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560" (UID: "f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560"). InnerVolumeSpecName "kube-api-access-7bdp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:33:21.270912 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:21.270889 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560-util" (OuterVolumeSpecName: "util") pod "f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560" (UID: "f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:33:21.366072 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:21.366047 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560-bundle\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:33:21.366072 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:21.366072 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bdp7\" (UniqueName: \"kubernetes.io/projected/f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560-kube-api-access-7bdp7\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:33:21.366229 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:21.366080 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560-util\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:33:21.976030 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:21.975988 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp" Jul 07 17:33:21.976429 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:21.975989 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp" event={"ID":"f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560","Type":"ContainerDied","Data":"fedc8f4d1bfb998772ac19a2cf16e496206e079d6054fea5a608999df0f48d82"} Jul 07 17:33:21.976429 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:21.976133 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fedc8f4d1bfb998772ac19a2cf16e496206e079d6054fea5a608999df0f48d82" Jul 07 17:33:21.978331 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:21.978308 2549 generic.go:356] "Generic (PLEG): container finished" podID="64f624f2-d13b-4ec5-b710-9d951564b2f9" containerID="7df7a15160c0f9f9cb5c9567889b2f2bb5aee42083326e78c61cd90259c8cb45" exitCode=0 Jul 07 17:33:21.978451 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:21.978352 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt" event={"ID":"64f624f2-d13b-4ec5-b710-9d951564b2f9","Type":"ContainerDied","Data":"7df7a15160c0f9f9cb5c9567889b2f2bb5aee42083326e78c61cd90259c8cb45"} Jul 07 17:33:21.981696 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:21.981670 2549 generic.go:356] "Generic (PLEG): container finished" podID="f1bd1408-750c-4e73-b5d3-c134dbf0e201" containerID="95d329a6b13a224a70db84420f167b732a8a4c3088e709deac0aed8693a7268e" exitCode=0 Jul 07 17:33:21.981805 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:21.981749 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq" event={"ID":"f1bd1408-750c-4e73-b5d3-c134dbf0e201","Type":"ContainerDied","Data":"95d329a6b13a224a70db84420f167b732a8a4c3088e709deac0aed8693a7268e"} Jul 07 17:33:22.123455 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:22.123391 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2" Jul 07 17:33:22.273808 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:22.273769 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8-util\") pod \"fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8\" (UID: \"fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8\") " Jul 07 17:33:22.273808 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:22.273811 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8-bundle\") pod \"fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8\" (UID: \"fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8\") " Jul 07 17:33:22.273968 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:22.273860 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzmp9\" (UniqueName: \"kubernetes.io/projected/fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8-kube-api-access-gzmp9\") pod \"fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8\" (UID: \"fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8\") " Jul 07 17:33:22.274403 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:22.274370 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8-bundle" (OuterVolumeSpecName: "bundle") pod "fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8" (UID: "fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:33:22.276007 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:22.275978 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8-kube-api-access-gzmp9" (OuterVolumeSpecName: "kube-api-access-gzmp9") pod "fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8" (UID: "fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8"). InnerVolumeSpecName "kube-api-access-gzmp9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:33:22.279286 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:22.279250 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8-util" (OuterVolumeSpecName: "util") pod "fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8" (UID: "fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:33:22.374991 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:22.374926 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8-util\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:33:22.374991 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:22.374949 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8-bundle\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:33:22.374991 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:22.374962 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzmp9\" (UniqueName: \"kubernetes.io/projected/fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8-kube-api-access-gzmp9\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:33:22.988750 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:22.988710 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2" event={"ID":"fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8","Type":"ContainerDied","Data":"95f8a20812275e6ad035a5f0c17836aceac8544c91d600a36f91c2790079bb9b"} Jul 07 17:33:22.989129 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:22.988765 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95f8a20812275e6ad035a5f0c17836aceac8544c91d600a36f91c2790079bb9b" Jul 07 17:33:22.989129 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:22.988723 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2" Jul 07 17:33:22.990828 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:22.990802 2549 generic.go:356] "Generic (PLEG): container finished" podID="64f624f2-d13b-4ec5-b710-9d951564b2f9" containerID="429f37954e8d8bc43fee99c4dcf1bf9378a962e700e3f26ce458c48dbd099686" exitCode=0 Jul 07 17:33:22.990950 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:22.990874 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt" event={"ID":"64f624f2-d13b-4ec5-b710-9d951564b2f9","Type":"ContainerDied","Data":"429f37954e8d8bc43fee99c4dcf1bf9378a962e700e3f26ce458c48dbd099686"} Jul 07 17:33:23.118791 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:23.118765 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq" Jul 07 17:33:23.280973 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:23.280948 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4w9s\" (UniqueName: \"kubernetes.io/projected/f1bd1408-750c-4e73-b5d3-c134dbf0e201-kube-api-access-b4w9s\") pod \"f1bd1408-750c-4e73-b5d3-c134dbf0e201\" (UID: \"f1bd1408-750c-4e73-b5d3-c134dbf0e201\") " Jul 07 17:33:23.281083 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:23.280980 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1bd1408-750c-4e73-b5d3-c134dbf0e201-bundle\") pod \"f1bd1408-750c-4e73-b5d3-c134dbf0e201\" (UID: \"f1bd1408-750c-4e73-b5d3-c134dbf0e201\") " Jul 07 17:33:23.281083 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:23.281005 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1bd1408-750c-4e73-b5d3-c134dbf0e201-util\") pod \"f1bd1408-750c-4e73-b5d3-c134dbf0e201\" (UID: \"f1bd1408-750c-4e73-b5d3-c134dbf0e201\") " Jul 07 17:33:23.281606 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:23.281580 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1bd1408-750c-4e73-b5d3-c134dbf0e201-bundle" (OuterVolumeSpecName: "bundle") pod "f1bd1408-750c-4e73-b5d3-c134dbf0e201" (UID: "f1bd1408-750c-4e73-b5d3-c134dbf0e201"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:33:23.283113 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:23.283091 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1bd1408-750c-4e73-b5d3-c134dbf0e201-kube-api-access-b4w9s" (OuterVolumeSpecName: "kube-api-access-b4w9s") pod "f1bd1408-750c-4e73-b5d3-c134dbf0e201" (UID: "f1bd1408-750c-4e73-b5d3-c134dbf0e201"). InnerVolumeSpecName "kube-api-access-b4w9s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:33:23.288519 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:23.288484 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1bd1408-750c-4e73-b5d3-c134dbf0e201-util" (OuterVolumeSpecName: "util") pod "f1bd1408-750c-4e73-b5d3-c134dbf0e201" (UID: "f1bd1408-750c-4e73-b5d3-c134dbf0e201"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:33:23.382059 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:23.382030 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4w9s\" (UniqueName: \"kubernetes.io/projected/f1bd1408-750c-4e73-b5d3-c134dbf0e201-kube-api-access-b4w9s\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:33:23.382059 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:23.382056 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1bd1408-750c-4e73-b5d3-c134dbf0e201-bundle\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:33:23.382212 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:23.382070 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1bd1408-750c-4e73-b5d3-c134dbf0e201-util\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:33:23.998382 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:23.998352 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq" Jul 07 17:33:23.998793 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:23.998382 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq" event={"ID":"f1bd1408-750c-4e73-b5d3-c134dbf0e201","Type":"ContainerDied","Data":"557b11bc5045ddbda953efb04c0c5ff67db62be3d1e52e8d969f5dff342a071d"} Jul 07 17:33:23.998793 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:23.998437 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="557b11bc5045ddbda953efb04c0c5ff67db62be3d1e52e8d969f5dff342a071d" Jul 07 17:33:24.131440 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:24.131417 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt" Jul 07 17:33:24.288977 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:24.288915 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtksh\" (UniqueName: \"kubernetes.io/projected/64f624f2-d13b-4ec5-b710-9d951564b2f9-kube-api-access-mtksh\") pod \"64f624f2-d13b-4ec5-b710-9d951564b2f9\" (UID: \"64f624f2-d13b-4ec5-b710-9d951564b2f9\") " Jul 07 17:33:24.288977 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:24.288973 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64f624f2-d13b-4ec5-b710-9d951564b2f9-bundle\") pod \"64f624f2-d13b-4ec5-b710-9d951564b2f9\" (UID: \"64f624f2-d13b-4ec5-b710-9d951564b2f9\") " Jul 07 17:33:24.289136 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:24.289003 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64f624f2-d13b-4ec5-b710-9d951564b2f9-util\") pod \"64f624f2-d13b-4ec5-b710-9d951564b2f9\" (UID: \"64f624f2-d13b-4ec5-b710-9d951564b2f9\") " Jul 07 17:33:24.289413 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:24.289380 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64f624f2-d13b-4ec5-b710-9d951564b2f9-bundle" (OuterVolumeSpecName: "bundle") pod "64f624f2-d13b-4ec5-b710-9d951564b2f9" (UID: "64f624f2-d13b-4ec5-b710-9d951564b2f9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:33:24.291190 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:24.291162 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64f624f2-d13b-4ec5-b710-9d951564b2f9-kube-api-access-mtksh" (OuterVolumeSpecName: "kube-api-access-mtksh") pod "64f624f2-d13b-4ec5-b710-9d951564b2f9" (UID: "64f624f2-d13b-4ec5-b710-9d951564b2f9"). InnerVolumeSpecName "kube-api-access-mtksh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:33:24.295676 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:24.295649 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64f624f2-d13b-4ec5-b710-9d951564b2f9-util" (OuterVolumeSpecName: "util") pod "64f624f2-d13b-4ec5-b710-9d951564b2f9" (UID: "64f624f2-d13b-4ec5-b710-9d951564b2f9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:33:24.390315 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:24.390289 2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/64f624f2-d13b-4ec5-b710-9d951564b2f9-bundle\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:33:24.390315 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:24.390310 2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/64f624f2-d13b-4ec5-b710-9d951564b2f9-util\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:33:24.390489 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:24.390322 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtksh\" (UniqueName: \"kubernetes.io/projected/64f624f2-d13b-4ec5-b710-9d951564b2f9-kube-api-access-mtksh\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:33:25.006564 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:25.006528 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt" event={"ID":"64f624f2-d13b-4ec5-b710-9d951564b2f9","Type":"ContainerDied","Data":"fb3d18defac1221a7a929518426791e5b5e91c9376da9b56538aa87e313e1a62"} Jul 07 17:33:25.007017 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:25.006588 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb3d18defac1221a7a929518426791e5b5e91c9376da9b56538aa87e313e1a62" Jul 07 17:33:25.007017 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:25.006542 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt" Jul 07 17:33:36.708587 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.708547 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clkpr"] Jul 07 17:33:36.709000 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.708877 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8" containerName="extract" Jul 07 17:33:36.709000 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.708889 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8" containerName="extract" Jul 07 17:33:36.709000 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.708903 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560" containerName="util" Jul 07 17:33:36.709000 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.708909 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560" containerName="util" Jul 07 17:33:36.709000 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.708916 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1bd1408-750c-4e73-b5d3-c134dbf0e201" containerName="pull" Jul 07 17:33:36.709000 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.708923 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1bd1408-750c-4e73-b5d3-c134dbf0e201" containerName="pull" Jul 07 17:33:36.709000 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.708934 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560" containerName="extract" Jul 07 17:33:36.709000 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.708939 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560" containerName="extract" Jul 07 17:33:36.709000 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.708945 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64f624f2-d13b-4ec5-b710-9d951564b2f9" containerName="pull" Jul 07 17:33:36.709000 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.708950 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="64f624f2-d13b-4ec5-b710-9d951564b2f9" containerName="pull" Jul 07 17:33:36.709000 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.708957 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560" containerName="pull" Jul 07 17:33:36.709000 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.708962 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560" containerName="pull" Jul 07 17:33:36.709000 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.708968 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64f624f2-d13b-4ec5-b710-9d951564b2f9" containerName="util" Jul 07 17:33:36.709000 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.708973 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="64f624f2-d13b-4ec5-b710-9d951564b2f9" containerName="util" Jul 07 17:33:36.709000 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.708981 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1bd1408-750c-4e73-b5d3-c134dbf0e201" containerName="util" Jul 07 17:33:36.709000 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.708986 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1bd1408-750c-4e73-b5d3-c134dbf0e201" containerName="util" Jul 07 17:33:36.709000 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.708991 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1bd1408-750c-4e73-b5d3-c134dbf0e201" containerName="extract" Jul 07 17:33:36.709000 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.708996 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1bd1408-750c-4e73-b5d3-c134dbf0e201" containerName="extract" Jul 07 17:33:36.709000 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.709006 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8" containerName="pull" Jul 07 17:33:36.709000 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.709011 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8" containerName="pull" Jul 07 17:33:36.709564 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.709020 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64f624f2-d13b-4ec5-b710-9d951564b2f9" containerName="extract" Jul 07 17:33:36.709564 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.709025 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="64f624f2-d13b-4ec5-b710-9d951564b2f9" containerName="extract" Jul 07 17:33:36.709564 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.709032 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8" containerName="util" Jul 07 17:33:36.709564 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.709038 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8" containerName="util" Jul 07 17:33:36.709564 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.709089 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8" containerName="extract" Jul 07 17:33:36.709564 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.709097 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560" containerName="extract" Jul 07 17:33:36.709564 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.709102 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="64f624f2-d13b-4ec5-b710-9d951564b2f9" containerName="extract" Jul 07 17:33:36.709564 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.709107 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1bd1408-750c-4e73-b5d3-c134dbf0e201" containerName="extract" Jul 07 17:33:36.713463 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.713444 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clkpr" Jul 07 17:33:36.716588 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.716560 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-bmq8l\"" Jul 07 17:33:36.733229 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.733202 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clkpr"] Jul 07 17:33:36.878500 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.878476 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hff8\" (UniqueName: \"kubernetes.io/projected/e281982e-9b9a-4e91-b016-2dd2db84a2d0-kube-api-access-8hff8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-clkpr\" (UID: \"e281982e-9b9a-4e91-b016-2dd2db84a2d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clkpr" Jul 07 17:33:36.878621 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.878537 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e281982e-9b9a-4e91-b016-2dd2db84a2d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-clkpr\" (UID: \"e281982e-9b9a-4e91-b016-2dd2db84a2d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clkpr" Jul 07 17:33:36.979819 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.979769 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e281982e-9b9a-4e91-b016-2dd2db84a2d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-clkpr\" (UID: \"e281982e-9b9a-4e91-b016-2dd2db84a2d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clkpr" Jul 07 17:33:36.979965 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.979847 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hff8\" (UniqueName: \"kubernetes.io/projected/e281982e-9b9a-4e91-b016-2dd2db84a2d0-kube-api-access-8hff8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-clkpr\" (UID: \"e281982e-9b9a-4e91-b016-2dd2db84a2d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clkpr" Jul 07 17:33:36.980185 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.980170 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e281982e-9b9a-4e91-b016-2dd2db84a2d0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-clkpr\" (UID: \"e281982e-9b9a-4e91-b016-2dd2db84a2d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clkpr" Jul 07 17:33:36.996678 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:36.996651 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hff8\" (UniqueName: \"kubernetes.io/projected/e281982e-9b9a-4e91-b016-2dd2db84a2d0-kube-api-access-8hff8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-clkpr\" (UID: \"e281982e-9b9a-4e91-b016-2dd2db84a2d0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clkpr" Jul 07 17:33:37.024069 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:37.024044 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clkpr" Jul 07 17:33:37.171261 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:37.171234 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clkpr"] Jul 07 17:33:37.173046 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:33:37.173019 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode281982e_9b9a_4e91_b016_2dd2db84a2d0.slice/crio-66affddc2effad17acaae1c90ea728f104b6a427f65cca46f7b94dee9d1b47c3 WatchSource:0}: Error finding container 66affddc2effad17acaae1c90ea728f104b6a427f65cca46f7b94dee9d1b47c3: Status 404 returned error can't find the container with id 66affddc2effad17acaae1c90ea728f104b6a427f65cca46f7b94dee9d1b47c3 Jul 07 17:33:38.076969 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:38.076938 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clkpr" event={"ID":"e281982e-9b9a-4e91-b016-2dd2db84a2d0","Type":"ContainerStarted","Data":"66affddc2effad17acaae1c90ea728f104b6a427f65cca46f7b94dee9d1b47c3"} Jul 07 17:33:38.570426 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:38.570391 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slxdr"] Jul 07 17:33:38.578669 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:38.578648 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slxdr" Jul 07 17:33:38.581628 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:38.581610 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-fpnd2\"" Jul 07 17:33:38.592066 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:38.592047 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slxdr"] Jul 07 17:33:38.694229 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:38.694202 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfqzp\" (UniqueName: \"kubernetes.io/projected/5f01d5f3-fd3f-4665-a0ad-7861bc363dcf-kube-api-access-rfqzp\") pod \"limitador-operator-controller-manager-859d7b78bd-slxdr\" (UID: \"5f01d5f3-fd3f-4665-a0ad-7861bc363dcf\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slxdr" Jul 07 17:33:38.795332 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:38.795303 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfqzp\" (UniqueName: \"kubernetes.io/projected/5f01d5f3-fd3f-4665-a0ad-7861bc363dcf-kube-api-access-rfqzp\") pod \"limitador-operator-controller-manager-859d7b78bd-slxdr\" (UID: \"5f01d5f3-fd3f-4665-a0ad-7861bc363dcf\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slxdr" Jul 07 17:33:38.817346 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:38.817321 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfqzp\" (UniqueName: \"kubernetes.io/projected/5f01d5f3-fd3f-4665-a0ad-7861bc363dcf-kube-api-access-rfqzp\") pod \"limitador-operator-controller-manager-859d7b78bd-slxdr\" (UID: \"5f01d5f3-fd3f-4665-a0ad-7861bc363dcf\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slxdr" Jul 07 17:33:38.888879 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:38.888812 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slxdr" Jul 07 17:33:39.041005 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:39.040982 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slxdr"] Jul 07 17:33:39.042334 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:33:39.042308 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f01d5f3_fd3f_4665_a0ad_7861bc363dcf.slice/crio-1f6cc24a4efa3b884902729611322b38ec3ac8209255ee03aa95f1b3137c59e7 WatchSource:0}: Error finding container 1f6cc24a4efa3b884902729611322b38ec3ac8209255ee03aa95f1b3137c59e7: Status 404 returned error can't find the container with id 1f6cc24a4efa3b884902729611322b38ec3ac8209255ee03aa95f1b3137c59e7 Jul 07 17:33:39.082648 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:39.082609 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slxdr" event={"ID":"5f01d5f3-fd3f-4665-a0ad-7861bc363dcf","Type":"ContainerStarted","Data":"1f6cc24a4efa3b884902729611322b38ec3ac8209255ee03aa95f1b3137c59e7"} Jul 07 17:33:41.741960 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:41.741933 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8zzz8"] Jul 07 17:33:41.745830 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:41.745810 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8zzz8" Jul 07 17:33:41.748860 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:41.748837 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-7tdd5\"" Jul 07 17:33:41.756980 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:41.756959 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8zzz8"] Jul 07 17:33:41.923654 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:41.923624 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc9b7\" (UniqueName: \"kubernetes.io/projected/b99cbd4d-9b65-43b8-bb4c-8cac82038c97-kube-api-access-xc9b7\") pod \"authorino-operator-75cc8d5cb7-8zzz8\" (UID: \"b99cbd4d-9b65-43b8-bb4c-8cac82038c97\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8zzz8" Jul 07 17:33:42.024232 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:42.024164 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc9b7\" (UniqueName: \"kubernetes.io/projected/b99cbd4d-9b65-43b8-bb4c-8cac82038c97-kube-api-access-xc9b7\") pod \"authorino-operator-75cc8d5cb7-8zzz8\" (UID: \"b99cbd4d-9b65-43b8-bb4c-8cac82038c97\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8zzz8" Jul 07 17:33:42.049098 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:42.049074 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc9b7\" (UniqueName: \"kubernetes.io/projected/b99cbd4d-9b65-43b8-bb4c-8cac82038c97-kube-api-access-xc9b7\") pod \"authorino-operator-75cc8d5cb7-8zzz8\" (UID: \"b99cbd4d-9b65-43b8-bb4c-8cac82038c97\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-8zzz8" Jul 07 17:33:42.055868 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:42.055660 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8zzz8" Jul 07 17:33:42.100582 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:42.100548 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slxdr" event={"ID":"5f01d5f3-fd3f-4665-a0ad-7861bc363dcf","Type":"ContainerStarted","Data":"46219ab4487b18cc3756208dc7b1fa9956a8668310ad8f62a396a6c7299c96cd"} Jul 07 17:33:42.100712 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:42.100664 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slxdr" Jul 07 17:33:42.124815 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:42.124763 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slxdr" podStartSLOduration=1.981915726 podStartE2EDuration="4.124742039s" totalImagesPullingTime="2.142826313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:33:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:33:42.124550452 +0000 UTC m=+658.411153582" watchObservedRunningTime="2026-07-07 17:33:42.124742039 +0000 UTC m=+658.411345168" Jul 07 17:33:42.201051 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:42.201023 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-8zzz8"] Jul 07 17:33:42.202219 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:33:42.202191 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb99cbd4d_9b65_43b8_bb4c_8cac82038c97.slice/crio-becb2c03be6193993ac357b45d745f0e43db863c762802d95d1dcc960ce88c45 WatchSource:0}: Error finding container becb2c03be6193993ac357b45d745f0e43db863c762802d95d1dcc960ce88c45: Status 404 returned error can't find the container with id becb2c03be6193993ac357b45d745f0e43db863c762802d95d1dcc960ce88c45 Jul 07 17:33:43.109528 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:43.109410 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8zzz8" event={"ID":"b99cbd4d-9b65-43b8-bb4c-8cac82038c97","Type":"ContainerStarted","Data":"becb2c03be6193993ac357b45d745f0e43db863c762802d95d1dcc960ce88c45"} Jul 07 17:33:46.129299 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:46.129190 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8zzz8" event={"ID":"b99cbd4d-9b65-43b8-bb4c-8cac82038c97","Type":"ContainerStarted","Data":"8f259213c0d1a51947ad5ac9fd5f2503da9fed1daf1d2deff8ca33674a720d29"} Jul 07 17:33:46.129299 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:46.129288 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8zzz8" Jul 07 17:33:46.131065 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:46.131041 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clkpr" event={"ID":"e281982e-9b9a-4e91-b016-2dd2db84a2d0","Type":"ContainerStarted","Data":"84d89aaf411412fa7753e2a559d16ff2b1a5f7f16564dfd7deb23c6ab6f5e1b3"} Jul 07 17:33:46.131186 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:46.131097 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clkpr" Jul 07 17:33:46.186323 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:46.186270 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8zzz8" podStartSLOduration=1.603087036 podStartE2EDuration="5.186256989s" totalImagesPullingTime="3.583169953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:33:46.183052713 +0000 UTC m=+662.469655844" watchObservedRunningTime="2026-07-07 17:33:46.186256989 +0000 UTC m=+662.472860122" Jul 07 17:33:46.211210 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:46.211168 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clkpr" podStartSLOduration=1.5869884029999999 podStartE2EDuration="10.21115207s" totalImagesPullingTime="8.624163667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:33:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:33:46.20923421 +0000 UTC m=+662.495837341" watchObservedRunningTime="2026-07-07 17:33:46.21115207 +0000 UTC m=+662.497755202" Jul 07 17:33:48.654289 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:48.654255 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6sl99"] Jul 07 17:33:48.658635 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:48.658615 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sl99" Jul 07 17:33:48.661247 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:48.661227 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 07 17:33:48.661359 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:48.661286 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 07 17:33:48.661430 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:48.661399 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-d7tsf\"" Jul 07 17:33:48.672556 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:48.672536 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6sl99"] Jul 07 17:33:48.672652 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:48.672565 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea5873a9-3372-4e9b-9805-950e338de308-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6sl99\" (UID: \"ea5873a9-3372-4e9b-9805-950e338de308\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sl99" Jul 07 17:33:48.672652 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:48.672587 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqvg6\" (UniqueName: \"kubernetes.io/projected/ea5873a9-3372-4e9b-9805-950e338de308-kube-api-access-nqvg6\") pod \"kuadrant-console-plugin-66b5774985-6sl99\" (UID: \"ea5873a9-3372-4e9b-9805-950e338de308\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sl99" Jul 07 17:33:48.672652 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:48.672621 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ea5873a9-3372-4e9b-9805-950e338de308-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6sl99\" (UID: \"ea5873a9-3372-4e9b-9805-950e338de308\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sl99" Jul 07 17:33:48.773439 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:48.773411 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea5873a9-3372-4e9b-9805-950e338de308-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6sl99\" (UID: \"ea5873a9-3372-4e9b-9805-950e338de308\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sl99" Jul 07 17:33:48.773562 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:48.773441 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqvg6\" (UniqueName: \"kubernetes.io/projected/ea5873a9-3372-4e9b-9805-950e338de308-kube-api-access-nqvg6\") pod \"kuadrant-console-plugin-66b5774985-6sl99\" (UID: \"ea5873a9-3372-4e9b-9805-950e338de308\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sl99" Jul 07 17:33:48.773562 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:48.773469 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ea5873a9-3372-4e9b-9805-950e338de308-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6sl99\" (UID: \"ea5873a9-3372-4e9b-9805-950e338de308\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sl99" Jul 07 17:33:48.773653 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:33:48.773587 2549 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 07 17:33:48.773653 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:33:48.773652 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea5873a9-3372-4e9b-9805-950e338de308-plugin-serving-cert podName:ea5873a9-3372-4e9b-9805-950e338de308 nodeName:}" failed. No retries permitted until 2026-07-07 17:33:49.273634537 +0000 UTC m=+665.560237647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/ea5873a9-3372-4e9b-9805-950e338de308-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-6sl99" (UID: "ea5873a9-3372-4e9b-9805-950e338de308") : secret "plugin-serving-cert" not found Jul 07 17:33:48.774042 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:48.774025 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ea5873a9-3372-4e9b-9805-950e338de308-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6sl99\" (UID: \"ea5873a9-3372-4e9b-9805-950e338de308\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sl99" Jul 07 17:33:48.783815 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:48.783789 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqvg6\" (UniqueName: \"kubernetes.io/projected/ea5873a9-3372-4e9b-9805-950e338de308-kube-api-access-nqvg6\") pod \"kuadrant-console-plugin-66b5774985-6sl99\" (UID: \"ea5873a9-3372-4e9b-9805-950e338de308\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sl99" Jul 07 17:33:49.277854 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:49.277830 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea5873a9-3372-4e9b-9805-950e338de308-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6sl99\" (UID: \"ea5873a9-3372-4e9b-9805-950e338de308\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sl99" Jul 07 17:33:49.280383 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:49.280361 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea5873a9-3372-4e9b-9805-950e338de308-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6sl99\" (UID: \"ea5873a9-3372-4e9b-9805-950e338de308\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sl99" Jul 07 17:33:49.567608 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:49.567538 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sl99" Jul 07 17:33:49.707914 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:49.707889 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6sl99"] Jul 07 17:33:49.711493 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:33:49.711464 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea5873a9_3372_4e9b_9805_950e338de308.slice/crio-c65aea47d57de26bf3863d85d264f0b0f6d58f8cdd518ebc7d7d48f3d9695f86 WatchSource:0}: Error finding container c65aea47d57de26bf3863d85d264f0b0f6d58f8cdd518ebc7d7d48f3d9695f86: Status 404 returned error can't find the container with id c65aea47d57de26bf3863d85d264f0b0f6d58f8cdd518ebc7d7d48f3d9695f86 Jul 07 17:33:50.154275 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:50.154247 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sl99" event={"ID":"ea5873a9-3372-4e9b-9805-950e338de308","Type":"ContainerStarted","Data":"c65aea47d57de26bf3863d85d264f0b0f6d58f8cdd518ebc7d7d48f3d9695f86"} Jul 07 17:33:53.111929 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:53.111896 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slxdr" Jul 07 17:33:57.138500 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:57.138450 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-8zzz8" Jul 07 17:33:57.138920 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:57.138574 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clkpr" Jul 07 17:33:59.049439 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.049400 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clkpr"] Jul 07 17:33:59.049925 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.049674 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clkpr" podUID="e281982e-9b9a-4e91-b016-2dd2db84a2d0" containerName="manager" containerID="cri-o://84d89aaf411412fa7753e2a559d16ff2b1a5f7f16564dfd7deb23c6ab6f5e1b3" gracePeriod=2 Jul 07 17:33:59.052152 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.052124 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clkpr"] Jul 07 17:33:59.052715 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:33:59.052680 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-clkpr\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="e281982e-9b9a-4e91-b016-2dd2db84a2d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clkpr" Jul 07 17:33:59.073869 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.073846 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slxdr"] Jul 07 17:33:59.074059 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.074038 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slxdr" podUID="5f01d5f3-fd3f-4665-a0ad-7861bc363dcf" containerName="manager" containerID="cri-o://46219ab4487b18cc3756208dc7b1fa9956a8668310ad8f62a396a6c7299c96cd" gracePeriod=2 Jul 07 17:33:59.081446 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:33:59.081410 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-clkpr\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="e281982e-9b9a-4e91-b016-2dd2db84a2d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clkpr" Jul 07 17:33:59.081770 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.081750 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slxdr"] Jul 07 17:33:59.085982 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:33:59.085960 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-slxdr\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="5f01d5f3-fd3f-4665-a0ad-7861bc363dcf" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slxdr" Jul 07 17:33:59.101733 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.101712 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tjd8m"] Jul 07 17:33:59.102209 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.102191 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f01d5f3-fd3f-4665-a0ad-7861bc363dcf" containerName="manager" Jul 07 17:33:59.102266 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.102215 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f01d5f3-fd3f-4665-a0ad-7861bc363dcf" containerName="manager" Jul 07 17:33:59.102266 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.102244 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e281982e-9b9a-4e91-b016-2dd2db84a2d0" containerName="manager" Jul 07 17:33:59.102266 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.102252 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="e281982e-9b9a-4e91-b016-2dd2db84a2d0" containerName="manager" Jul 07 17:33:59.102356 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.102339 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f01d5f3-fd3f-4665-a0ad-7861bc363dcf" containerName="manager" Jul 07 17:33:59.102356 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.102352 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="e281982e-9b9a-4e91-b016-2dd2db84a2d0" containerName="manager" Jul 07 17:33:59.105574 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.105552 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tjd8m" Jul 07 17:33:59.108780 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:33:59.108746 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-clkpr\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="e281982e-9b9a-4e91-b016-2dd2db84a2d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clkpr" Jul 07 17:33:59.116390 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:33:59.116355 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-slxdr\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="5f01d5f3-fd3f-4665-a0ad-7861bc363dcf" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slxdr" Jul 07 17:33:59.120370 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.120348 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5pct"] Jul 07 17:33:59.123836 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.123801 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5pct" Jul 07 17:33:59.127704 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.127680 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tjd8m"] Jul 07 17:33:59.140113 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.140091 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5pct"] Jul 07 17:33:59.164266 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.164243 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h4c2\" (UniqueName: \"kubernetes.io/projected/c13322db-0cde-4183-b4bb-2c7843d7d0ad-kube-api-access-6h4c2\") pod \"limitador-operator-controller-manager-859d7b78bd-s5pct\" (UID: \"c13322db-0cde-4183-b4bb-2c7843d7d0ad\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5pct" Jul 07 17:33:59.164367 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.164291 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb20be38-156f-462d-b5ff-57073d156d97-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tjd8m\" (UID: \"cb20be38-156f-462d-b5ff-57073d156d97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tjd8m" Jul 07 17:33:59.164367 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.164353 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n685c\" (UniqueName: \"kubernetes.io/projected/cb20be38-156f-462d-b5ff-57073d156d97-kube-api-access-n685c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tjd8m\" (UID: \"cb20be38-156f-462d-b5ff-57073d156d97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tjd8m" Jul 07 17:33:59.173412 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:33:59.173382 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-clkpr\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="e281982e-9b9a-4e91-b016-2dd2db84a2d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clkpr" Jul 07 17:33:59.179679 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:33:59.179648 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-slxdr\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="5f01d5f3-fd3f-4665-a0ad-7861bc363dcf" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slxdr" Jul 07 17:33:59.211553 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.211490 2549 generic.go:356] "Generic (PLEG): container finished" podID="5f01d5f3-fd3f-4665-a0ad-7861bc363dcf" containerID="46219ab4487b18cc3756208dc7b1fa9956a8668310ad8f62a396a6c7299c96cd" exitCode=0 Jul 07 17:33:59.212966 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.212944 2549 generic.go:356] "Generic (PLEG): container finished" podID="e281982e-9b9a-4e91-b016-2dd2db84a2d0" containerID="84d89aaf411412fa7753e2a559d16ff2b1a5f7f16564dfd7deb23c6ab6f5e1b3" exitCode=0 Jul 07 17:33:59.265107 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.264914 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h4c2\" (UniqueName: \"kubernetes.io/projected/c13322db-0cde-4183-b4bb-2c7843d7d0ad-kube-api-access-6h4c2\") pod \"limitador-operator-controller-manager-859d7b78bd-s5pct\" (UID: \"c13322db-0cde-4183-b4bb-2c7843d7d0ad\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5pct" Jul 07 17:33:59.265107 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.264987 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb20be38-156f-462d-b5ff-57073d156d97-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tjd8m\" (UID: \"cb20be38-156f-462d-b5ff-57073d156d97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tjd8m" Jul 07 17:33:59.265107 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.265053 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n685c\" (UniqueName: \"kubernetes.io/projected/cb20be38-156f-462d-b5ff-57073d156d97-kube-api-access-n685c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tjd8m\" (UID: \"cb20be38-156f-462d-b5ff-57073d156d97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tjd8m" Jul 07 17:33:59.265859 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.265810 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb20be38-156f-462d-b5ff-57073d156d97-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tjd8m\" (UID: \"cb20be38-156f-462d-b5ff-57073d156d97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tjd8m" Jul 07 17:33:59.282186 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.282162 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h4c2\" (UniqueName: \"kubernetes.io/projected/c13322db-0cde-4183-b4bb-2c7843d7d0ad-kube-api-access-6h4c2\") pod \"limitador-operator-controller-manager-859d7b78bd-s5pct\" (UID: \"c13322db-0cde-4183-b4bb-2c7843d7d0ad\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5pct" Jul 07 17:33:59.282538 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.282494 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n685c\" (UniqueName: \"kubernetes.io/projected/cb20be38-156f-462d-b5ff-57073d156d97-kube-api-access-n685c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tjd8m\" (UID: \"cb20be38-156f-462d-b5ff-57073d156d97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tjd8m" Jul 07 17:33:59.310236 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.310205 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clkpr" Jul 07 17:33:59.312928 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:33:59.312903 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-clkpr\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="e281982e-9b9a-4e91-b016-2dd2db84a2d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clkpr" Jul 07 17:33:59.315242 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:33:59.315219 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-slxdr\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="5f01d5f3-fd3f-4665-a0ad-7861bc363dcf" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slxdr" Jul 07 17:33:59.317731 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.317714 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slxdr" Jul 07 17:33:59.320163 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:33:59.320129 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-clkpr\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="e281982e-9b9a-4e91-b016-2dd2db84a2d0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clkpr" Jul 07 17:33:59.324944 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:33:59.324921 2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-slxdr\" is forbidden: User \"system:node:ip-10-0-136-69.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-69.ec2.internal' and this object" podUID="5f01d5f3-fd3f-4665-a0ad-7861bc363dcf" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slxdr" Jul 07 17:33:59.366395 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.366366 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hff8\" (UniqueName: \"kubernetes.io/projected/e281982e-9b9a-4e91-b016-2dd2db84a2d0-kube-api-access-8hff8\") pod \"e281982e-9b9a-4e91-b016-2dd2db84a2d0\" (UID: \"e281982e-9b9a-4e91-b016-2dd2db84a2d0\") " Jul 07 17:33:59.366525 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.366428 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e281982e-9b9a-4e91-b016-2dd2db84a2d0-extensions-socket-volume\") pod \"e281982e-9b9a-4e91-b016-2dd2db84a2d0\" (UID: \"e281982e-9b9a-4e91-b016-2dd2db84a2d0\") " Jul 07 17:33:59.366525 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.366484 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfqzp\" (UniqueName: \"kubernetes.io/projected/5f01d5f3-fd3f-4665-a0ad-7861bc363dcf-kube-api-access-rfqzp\") pod \"5f01d5f3-fd3f-4665-a0ad-7861bc363dcf\" (UID: \"5f01d5f3-fd3f-4665-a0ad-7861bc363dcf\") " Jul 07 17:33:59.366875 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.366848 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e281982e-9b9a-4e91-b016-2dd2db84a2d0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e281982e-9b9a-4e91-b016-2dd2db84a2d0" (UID: "e281982e-9b9a-4e91-b016-2dd2db84a2d0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:33:59.368435 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.368415 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e281982e-9b9a-4e91-b016-2dd2db84a2d0-kube-api-access-8hff8" (OuterVolumeSpecName: "kube-api-access-8hff8") pod "e281982e-9b9a-4e91-b016-2dd2db84a2d0" (UID: "e281982e-9b9a-4e91-b016-2dd2db84a2d0"). InnerVolumeSpecName "kube-api-access-8hff8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:33:59.368497 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.368460 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f01d5f3-fd3f-4665-a0ad-7861bc363dcf-kube-api-access-rfqzp" (OuterVolumeSpecName: "kube-api-access-rfqzp") pod "5f01d5f3-fd3f-4665-a0ad-7861bc363dcf" (UID: "5f01d5f3-fd3f-4665-a0ad-7861bc363dcf"). InnerVolumeSpecName "kube-api-access-rfqzp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:33:59.467117 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.467083 2549 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e281982e-9b9a-4e91-b016-2dd2db84a2d0-extensions-socket-volume\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:33:59.467117 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.467108 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfqzp\" (UniqueName: \"kubernetes.io/projected/5f01d5f3-fd3f-4665-a0ad-7861bc363dcf-kube-api-access-rfqzp\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:33:59.467117 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.467118 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hff8\" (UniqueName: \"kubernetes.io/projected/e281982e-9b9a-4e91-b016-2dd2db84a2d0-kube-api-access-8hff8\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:33:59.479405 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.479368 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tjd8m" Jul 07 17:33:59.486529 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.486481 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5pct" Jul 07 17:33:59.639002 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.638980 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tjd8m"] Jul 07 17:33:59.639665 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:33:59.639639 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb20be38_156f_462d_b5ff_57073d156d97.slice/crio-f3daf7c9f49932c4759088966b08ab712b16178bc32b18f829d8df4a7c477c4c WatchSource:0}: Error finding container f3daf7c9f49932c4759088966b08ab712b16178bc32b18f829d8df4a7c477c4c: Status 404 returned error can't find the container with id f3daf7c9f49932c4759088966b08ab712b16178bc32b18f829d8df4a7c477c4c Jul 07 17:33:59.652759 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:33:59.652734 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5pct"] Jul 07 17:33:59.654371 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:33:59.654347 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc13322db_0cde_4183_b4bb_2c7843d7d0ad.slice/crio-87f8dac0d29ea4965760f46db2dcd3ca55f811c78a0e24f106cbb2818e0e66e2 WatchSource:0}: Error finding container 87f8dac0d29ea4965760f46db2dcd3ca55f811c78a0e24f106cbb2818e0e66e2: Status 404 returned error can't find the container with id 87f8dac0d29ea4965760f46db2dcd3ca55f811c78a0e24f106cbb2818e0e66e2 Jul 07 17:34:00.222025 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:00.221984 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f01d5f3-fd3f-4665-a0ad-7861bc363dcf" path="/var/lib/kubelet/pods/5f01d5f3-fd3f-4665-a0ad-7861bc363dcf/volumes" Jul 07 17:34:00.222577 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:00.222558 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e281982e-9b9a-4e91-b016-2dd2db84a2d0" path="/var/lib/kubelet/pods/e281982e-9b9a-4e91-b016-2dd2db84a2d0/volumes" Jul 07 17:34:00.223460 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:00.223431 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tjd8m" event={"ID":"cb20be38-156f-462d-b5ff-57073d156d97","Type":"ContainerStarted","Data":"4c0f43be721a6961be6821f294e923c1299a76699d9c582b1bba1ce0e740ac7e"} Jul 07 17:34:00.223603 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:00.223486 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tjd8m" event={"ID":"cb20be38-156f-462d-b5ff-57073d156d97","Type":"ContainerStarted","Data":"f3daf7c9f49932c4759088966b08ab712b16178bc32b18f829d8df4a7c477c4c"} Jul 07 17:34:00.224162 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:00.224108 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tjd8m" Jul 07 17:34:00.225891 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:00.225871 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-slxdr" Jul 07 17:34:00.226003 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:00.225873 2549 scope.go:117] "RemoveContainer" containerID="46219ab4487b18cc3756208dc7b1fa9956a8668310ad8f62a396a6c7299c96cd" Jul 07 17:34:00.228155 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:00.228130 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5pct" event={"ID":"c13322db-0cde-4183-b4bb-2c7843d7d0ad","Type":"ContainerStarted","Data":"13dd11c1b8aa8b5ca9cbd9b61d8c5413d68e7f1cf854a963deea1b208c975f14"} Jul 07 17:34:00.228332 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:00.228177 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5pct" event={"ID":"c13322db-0cde-4183-b4bb-2c7843d7d0ad","Type":"ContainerStarted","Data":"87f8dac0d29ea4965760f46db2dcd3ca55f811c78a0e24f106cbb2818e0e66e2"} Jul 07 17:34:00.228332 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:00.228221 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5pct" Jul 07 17:34:00.230616 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:00.230595 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-clkpr" Jul 07 17:34:00.237243 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:00.237224 2549 scope.go:117] "RemoveContainer" containerID="84d89aaf411412fa7753e2a559d16ff2b1a5f7f16564dfd7deb23c6ab6f5e1b3" Jul 07 17:34:00.304287 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:00.304237 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tjd8m" podStartSLOduration=1.304217326 podStartE2EDuration="1.304217326s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:33:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:34:00.26707002 +0000 UTC m=+676.553673164" watchObservedRunningTime="2026-07-07 17:34:00.304217326 +0000 UTC m=+676.590820459" Jul 07 17:34:00.305611 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:00.305423 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5pct" podStartSLOduration=1.30540934 podStartE2EDuration="1.30540934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:33:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:34:00.302900362 +0000 UTC m=+676.589503495" watchObservedRunningTime="2026-07-07 17:34:00.30540934 +0000 UTC m=+676.592012473" Jul 07 17:34:11.242474 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:11.242444 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-s5pct" Jul 07 17:34:12.250011 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:12.249976 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tjd8m" Jul 07 17:34:18.343166 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:18.343093 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sl99" event={"ID":"ea5873a9-3372-4e9b-9805-950e338de308","Type":"ContainerStarted","Data":"989adbc2b47c1bd53d7fbdb4543b65499ed9f52e6197054d1b2feb3baa91eded"} Jul 07 17:34:18.376420 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:18.376372 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6sl99" podStartSLOduration=2.062332255 podStartE2EDuration="30.376358199s" totalImagesPullingTime="28.314025944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:33:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:34:18.375354168 +0000 UTC m=+694.661957322" watchObservedRunningTime="2026-07-07 17:34:18.376358199 +0000 UTC m=+694.662961329" Jul 07 17:34:18.636746 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:18.636678 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tjd8m"] Jul 07 17:34:18.636891 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:18.636847 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tjd8m" podUID="cb20be38-156f-462d-b5ff-57073d156d97" containerName="manager" containerID="cri-o://4c0f43be721a6961be6821f294e923c1299a76699d9c582b1bba1ce0e740ac7e" gracePeriod=10 Jul 07 17:34:18.927104 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:18.927076 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tjd8m" Jul 07 17:34:19.042075 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:19.042046 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n685c\" (UniqueName: \"kubernetes.io/projected/cb20be38-156f-462d-b5ff-57073d156d97-kube-api-access-n685c\") pod \"cb20be38-156f-462d-b5ff-57073d156d97\" (UID: \"cb20be38-156f-462d-b5ff-57073d156d97\") " Jul 07 17:34:19.042219 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:19.042125 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb20be38-156f-462d-b5ff-57073d156d97-extensions-socket-volume\") pod \"cb20be38-156f-462d-b5ff-57073d156d97\" (UID: \"cb20be38-156f-462d-b5ff-57073d156d97\") " Jul 07 17:34:19.042527 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:19.042481 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb20be38-156f-462d-b5ff-57073d156d97-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cb20be38-156f-462d-b5ff-57073d156d97" (UID: "cb20be38-156f-462d-b5ff-57073d156d97"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 17:34:19.044218 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:19.044197 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb20be38-156f-462d-b5ff-57073d156d97-kube-api-access-n685c" (OuterVolumeSpecName: "kube-api-access-n685c") pod "cb20be38-156f-462d-b5ff-57073d156d97" (UID: "cb20be38-156f-462d-b5ff-57073d156d97"). InnerVolumeSpecName "kube-api-access-n685c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:34:19.143126 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:19.143067 2549 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb20be38-156f-462d-b5ff-57073d156d97-extensions-socket-volume\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:34:19.143126 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:19.143092 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n685c\" (UniqueName: \"kubernetes.io/projected/cb20be38-156f-462d-b5ff-57073d156d97-kube-api-access-n685c\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:34:19.349363 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:19.349320 2549 generic.go:356] "Generic (PLEG): container finished" podID="cb20be38-156f-462d-b5ff-57073d156d97" containerID="4c0f43be721a6961be6821f294e923c1299a76699d9c582b1bba1ce0e740ac7e" exitCode=0 Jul 07 17:34:19.349753 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:19.349384 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tjd8m" Jul 07 17:34:19.349753 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:19.349413 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tjd8m" event={"ID":"cb20be38-156f-462d-b5ff-57073d156d97","Type":"ContainerDied","Data":"4c0f43be721a6961be6821f294e923c1299a76699d9c582b1bba1ce0e740ac7e"} Jul 07 17:34:19.349753 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:19.349476 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tjd8m" event={"ID":"cb20be38-156f-462d-b5ff-57073d156d97","Type":"ContainerDied","Data":"f3daf7c9f49932c4759088966b08ab712b16178bc32b18f829d8df4a7c477c4c"} Jul 07 17:34:19.349753 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:19.349533 2549 scope.go:117] "RemoveContainer" containerID="4c0f43be721a6961be6821f294e923c1299a76699d9c582b1bba1ce0e740ac7e" Jul 07 17:34:19.359046 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:19.359028 2549 scope.go:117] "RemoveContainer" containerID="4c0f43be721a6961be6821f294e923c1299a76699d9c582b1bba1ce0e740ac7e" Jul 07 17:34:19.359301 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:34:19.359285 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c0f43be721a6961be6821f294e923c1299a76699d9c582b1bba1ce0e740ac7e\": container with ID starting with 4c0f43be721a6961be6821f294e923c1299a76699d9c582b1bba1ce0e740ac7e not found: ID does not exist" containerID="4c0f43be721a6961be6821f294e923c1299a76699d9c582b1bba1ce0e740ac7e" Jul 07 17:34:19.359338 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:19.359310 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c0f43be721a6961be6821f294e923c1299a76699d9c582b1bba1ce0e740ac7e"} err="failed to get container status \"4c0f43be721a6961be6821f294e923c1299a76699d9c582b1bba1ce0e740ac7e\": rpc error: code = NotFound desc = could not find container \"4c0f43be721a6961be6821f294e923c1299a76699d9c582b1bba1ce0e740ac7e\": container with ID starting with 4c0f43be721a6961be6821f294e923c1299a76699d9c582b1bba1ce0e740ac7e not found: ID does not exist" Jul 07 17:34:19.377880 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:19.377852 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tjd8m"] Jul 07 17:34:19.381681 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:19.381660 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tjd8m"] Jul 07 17:34:20.226061 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:20.226019 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb20be38-156f-462d-b5ff-57073d156d97" path="/var/lib/kubelet/pods/cb20be38-156f-462d-b5ff-57073d156d97/volumes" Jul 07 17:34:35.039533 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.039478 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh"] Jul 07 17:34:35.039890 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.039826 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb20be38-156f-462d-b5ff-57073d156d97" containerName="manager" Jul 07 17:34:35.039890 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.039838 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb20be38-156f-462d-b5ff-57073d156d97" containerName="manager" Jul 07 17:34:35.039961 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.039909 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb20be38-156f-462d-b5ff-57073d156d97" containerName="manager" Jul 07 17:34:35.059341 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.059314 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh"] Jul 07 17:34:35.059472 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.059411 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.062768 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.062739 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 17:34:35.062904 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.062855 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-bxxvn\"" Jul 07 17:34:35.166634 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.166605 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0409efe-d7ef-4440-8b75-866e3f13d3b3-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-r8jvh\" (UID: \"e0409efe-d7ef-4440-8b75-866e3f13d3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.166813 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.166655 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0409efe-d7ef-4440-8b75-866e3f13d3b3-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-r8jvh\" (UID: \"e0409efe-d7ef-4440-8b75-866e3f13d3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.166813 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.166698 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0409efe-d7ef-4440-8b75-866e3f13d3b3-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r8jvh\" (UID: \"e0409efe-d7ef-4440-8b75-866e3f13d3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.166813 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.166725 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0409efe-d7ef-4440-8b75-866e3f13d3b3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-r8jvh\" (UID: \"e0409efe-d7ef-4440-8b75-866e3f13d3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.166967 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.166826 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0409efe-d7ef-4440-8b75-866e3f13d3b3-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-r8jvh\" (UID: \"e0409efe-d7ef-4440-8b75-866e3f13d3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.166967 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.166872 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0409efe-d7ef-4440-8b75-866e3f13d3b3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-r8jvh\" (UID: \"e0409efe-d7ef-4440-8b75-866e3f13d3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.166967 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.166936 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0409efe-d7ef-4440-8b75-866e3f13d3b3-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r8jvh\" (UID: \"e0409efe-d7ef-4440-8b75-866e3f13d3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.167111 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.166981 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0409efe-d7ef-4440-8b75-866e3f13d3b3-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-r8jvh\" (UID: \"e0409efe-d7ef-4440-8b75-866e3f13d3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.167111 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.167003 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgw4p\" (UniqueName: \"kubernetes.io/projected/e0409efe-d7ef-4440-8b75-866e3f13d3b3-kube-api-access-lgw4p\") pod \"maas-default-gateway-openshift-default-56654dcf7-r8jvh\" (UID: \"e0409efe-d7ef-4440-8b75-866e3f13d3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.268312 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.268283 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0409efe-d7ef-4440-8b75-866e3f13d3b3-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r8jvh\" (UID: \"e0409efe-d7ef-4440-8b75-866e3f13d3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.268312 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.268315 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0409efe-d7ef-4440-8b75-866e3f13d3b3-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-r8jvh\" (UID: \"e0409efe-d7ef-4440-8b75-866e3f13d3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.268474 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.268332 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgw4p\" (UniqueName: \"kubernetes.io/projected/e0409efe-d7ef-4440-8b75-866e3f13d3b3-kube-api-access-lgw4p\") pod \"maas-default-gateway-openshift-default-56654dcf7-r8jvh\" (UID: \"e0409efe-d7ef-4440-8b75-866e3f13d3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.268474 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.268391 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0409efe-d7ef-4440-8b75-866e3f13d3b3-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-r8jvh\" (UID: \"e0409efe-d7ef-4440-8b75-866e3f13d3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.268474 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.268423 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0409efe-d7ef-4440-8b75-866e3f13d3b3-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-r8jvh\" (UID: \"e0409efe-d7ef-4440-8b75-866e3f13d3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.268474 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.268454 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0409efe-d7ef-4440-8b75-866e3f13d3b3-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r8jvh\" (UID: \"e0409efe-d7ef-4440-8b75-866e3f13d3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.268718 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.268479 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0409efe-d7ef-4440-8b75-866e3f13d3b3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-r8jvh\" (UID: \"e0409efe-d7ef-4440-8b75-866e3f13d3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.268718 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.268542 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0409efe-d7ef-4440-8b75-866e3f13d3b3-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-r8jvh\" (UID: \"e0409efe-d7ef-4440-8b75-866e3f13d3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.268718 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.268569 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0409efe-d7ef-4440-8b75-866e3f13d3b3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-r8jvh\" (UID: \"e0409efe-d7ef-4440-8b75-866e3f13d3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.268718 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.268686 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0409efe-d7ef-4440-8b75-866e3f13d3b3-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r8jvh\" (UID: \"e0409efe-d7ef-4440-8b75-866e3f13d3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.268894 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.268748 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e0409efe-d7ef-4440-8b75-866e3f13d3b3-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-r8jvh\" (UID: \"e0409efe-d7ef-4440-8b75-866e3f13d3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.268894 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.268799 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e0409efe-d7ef-4440-8b75-866e3f13d3b3-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-r8jvh\" (UID: \"e0409efe-d7ef-4440-8b75-866e3f13d3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.268894 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.268870 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e0409efe-d7ef-4440-8b75-866e3f13d3b3-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r8jvh\" (UID: \"e0409efe-d7ef-4440-8b75-866e3f13d3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.269154 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.269133 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e0409efe-d7ef-4440-8b75-866e3f13d3b3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-r8jvh\" (UID: \"e0409efe-d7ef-4440-8b75-866e3f13d3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.270936 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.270919 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e0409efe-d7ef-4440-8b75-866e3f13d3b3-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-r8jvh\" (UID: \"e0409efe-d7ef-4440-8b75-866e3f13d3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.271150 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.271134 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e0409efe-d7ef-4440-8b75-866e3f13d3b3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-r8jvh\" (UID: \"e0409efe-d7ef-4440-8b75-866e3f13d3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.280860 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.280834 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e0409efe-d7ef-4440-8b75-866e3f13d3b3-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-r8jvh\" (UID: \"e0409efe-d7ef-4440-8b75-866e3f13d3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.281073 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.281052 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgw4p\" (UniqueName: \"kubernetes.io/projected/e0409efe-d7ef-4440-8b75-866e3f13d3b3-kube-api-access-lgw4p\") pod \"maas-default-gateway-openshift-default-56654dcf7-r8jvh\" (UID: \"e0409efe-d7ef-4440-8b75-866e3f13d3b3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.369632 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.369583 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:35.506126 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:35.506098 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh"] Jul 07 17:34:35.507692 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:34:35.507668 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0409efe_d7ef_4440_8b75_866e3f13d3b3.slice/crio-171168dee8a7b91dbd82e719199e1224c6594679246a75343e49d3d102611876 WatchSource:0}: Error finding container 171168dee8a7b91dbd82e719199e1224c6594679246a75343e49d3d102611876: Status 404 returned error can't find the container with id 171168dee8a7b91dbd82e719199e1224c6594679246a75343e49d3d102611876 Jul 07 17:34:36.438121 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:36.438088 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" event={"ID":"e0409efe-d7ef-4440-8b75-866e3f13d3b3","Type":"ContainerStarted","Data":"171168dee8a7b91dbd82e719199e1224c6594679246a75343e49d3d102611876"} Jul 07 17:34:38.150801 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:38.148968 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 17:34:38.150801 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:38.149124 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 17:34:38.150801 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:38.149205 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 17:34:38.450430 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:38.450352 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" event={"ID":"e0409efe-d7ef-4440-8b75-866e3f13d3b3","Type":"ContainerStarted","Data":"0e0c29d8e4f6f64f327ac57bf7754396d49ae61508a19e2ebbc4316d8c49b350"} Jul 07 17:34:38.484957 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:38.484911 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" podStartSLOduration=0.846312458 podStartE2EDuration="3.484894334s" totalImagesPullingTime="2.638581876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:34:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:34:38.481855882 +0000 UTC m=+714.768459012" watchObservedRunningTime="2026-07-07 17:34:38.484894334 +0000 UTC m=+714.771497466" Jul 07 17:34:39.369881 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:39.369845 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:39.375232 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:39.375199 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:39.455529 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:39.455487 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:39.456374 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:39.456356 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:34:39.674127 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:39.674097 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jqx7f"] Jul 07 17:34:39.676730 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:39.676714 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jqx7f" Jul 07 17:34:39.680687 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:39.680663 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 07 17:34:39.688894 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:39.688873 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jqx7f"] Jul 07 17:34:39.772147 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:39.772120 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jqx7f"] Jul 07 17:34:39.804091 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:39.804067 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qmqk\" (UniqueName: \"kubernetes.io/projected/0f24d7a8-a362-4c1c-b89f-8bd93285fc2e-kube-api-access-5qmqk\") pod \"limitador-limitador-64c94fd64f-jqx7f\" (UID: \"0f24d7a8-a362-4c1c-b89f-8bd93285fc2e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jqx7f" Jul 07 17:34:39.804233 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:39.804131 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f24d7a8-a362-4c1c-b89f-8bd93285fc2e-config-file\") pod \"limitador-limitador-64c94fd64f-jqx7f\" (UID: \"0f24d7a8-a362-4c1c-b89f-8bd93285fc2e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jqx7f" Jul 07 17:34:39.905400 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:39.905367 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f24d7a8-a362-4c1c-b89f-8bd93285fc2e-config-file\") pod \"limitador-limitador-64c94fd64f-jqx7f\" (UID: \"0f24d7a8-a362-4c1c-b89f-8bd93285fc2e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jqx7f" Jul 07 17:34:39.905573 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:39.905444 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qmqk\" (UniqueName: \"kubernetes.io/projected/0f24d7a8-a362-4c1c-b89f-8bd93285fc2e-kube-api-access-5qmqk\") pod \"limitador-limitador-64c94fd64f-jqx7f\" (UID: \"0f24d7a8-a362-4c1c-b89f-8bd93285fc2e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jqx7f" Jul 07 17:34:39.906016 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:39.905996 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f24d7a8-a362-4c1c-b89f-8bd93285fc2e-config-file\") pod \"limitador-limitador-64c94fd64f-jqx7f\" (UID: \"0f24d7a8-a362-4c1c-b89f-8bd93285fc2e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jqx7f" Jul 07 17:34:39.921854 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:39.921834 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qmqk\" (UniqueName: \"kubernetes.io/projected/0f24d7a8-a362-4c1c-b89f-8bd93285fc2e-kube-api-access-5qmqk\") pod \"limitador-limitador-64c94fd64f-jqx7f\" (UID: \"0f24d7a8-a362-4c1c-b89f-8bd93285fc2e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jqx7f" Jul 07 17:34:39.986754 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:39.986691 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jqx7f" Jul 07 17:34:40.126881 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:40.126850 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jqx7f"] Jul 07 17:34:40.128930 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:34:40.128904 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f24d7a8_a362_4c1c_b89f_8bd93285fc2e.slice/crio-084d45ceed36dfe4f14314bfb129f51838d2d27f06c3f75bb723001089dca7d7 WatchSource:0}: Error finding container 084d45ceed36dfe4f14314bfb129f51838d2d27f06c3f75bb723001089dca7d7: Status 404 returned error can't find the container with id 084d45ceed36dfe4f14314bfb129f51838d2d27f06c3f75bb723001089dca7d7 Jul 07 17:34:40.462256 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:40.462221 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jqx7f" event={"ID":"0f24d7a8-a362-4c1c-b89f-8bd93285fc2e","Type":"ContainerStarted","Data":"084d45ceed36dfe4f14314bfb129f51838d2d27f06c3f75bb723001089dca7d7"} Jul 07 17:34:40.630953 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:40.630927 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-bfzgf"] Jul 07 17:34:40.633881 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:40.633863 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bfzgf" Jul 07 17:34:40.638008 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:40.637990 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-64bl4\"" Jul 07 17:34:40.665360 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:40.665338 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-bfzgf"] Jul 07 17:34:40.814332 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:40.814272 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vnlb\" (UniqueName: \"kubernetes.io/projected/346a2cb2-2cf9-470e-8292-8855cb355869-kube-api-access-2vnlb\") pod \"authorino-58cd955675-bfzgf\" (UID: \"346a2cb2-2cf9-470e-8292-8855cb355869\") " pod="kuadrant-system/authorino-58cd955675-bfzgf" Jul 07 17:34:40.862843 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:40.862814 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-d7cgz"] Jul 07 17:34:40.865709 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:40.865687 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-d7cgz" Jul 07 17:34:40.876587 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:40.876532 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d7cgz"] Jul 07 17:34:40.915568 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:40.915489 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vnlb\" (UniqueName: \"kubernetes.io/projected/346a2cb2-2cf9-470e-8292-8855cb355869-kube-api-access-2vnlb\") pod \"authorino-58cd955675-bfzgf\" (UID: \"346a2cb2-2cf9-470e-8292-8855cb355869\") " pod="kuadrant-system/authorino-58cd955675-bfzgf" Jul 07 17:34:40.926676 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:40.926558 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vnlb\" (UniqueName: \"kubernetes.io/projected/346a2cb2-2cf9-470e-8292-8855cb355869-kube-api-access-2vnlb\") pod \"authorino-58cd955675-bfzgf\" (UID: \"346a2cb2-2cf9-470e-8292-8855cb355869\") " pod="kuadrant-system/authorino-58cd955675-bfzgf" Jul 07 17:34:40.944295 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:40.944120 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bfzgf" Jul 07 17:34:41.016560 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:41.016498 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l22l2\" (UniqueName: \"kubernetes.io/projected/e053e248-81c4-4ce5-b905-6ae5c10cffdf-kube-api-access-l22l2\") pod \"authorino-75d556bd77-d7cgz\" (UID: \"e053e248-81c4-4ce5-b905-6ae5c10cffdf\") " pod="kuadrant-system/authorino-75d556bd77-d7cgz" Jul 07 17:34:41.117361 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:41.117256 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l22l2\" (UniqueName: \"kubernetes.io/projected/e053e248-81c4-4ce5-b905-6ae5c10cffdf-kube-api-access-l22l2\") pod \"authorino-75d556bd77-d7cgz\" (UID: \"e053e248-81c4-4ce5-b905-6ae5c10cffdf\") " pod="kuadrant-system/authorino-75d556bd77-d7cgz" Jul 07 17:34:41.129684 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:41.129653 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-bfzgf"] Jul 07 17:34:41.130012 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:41.129987 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l22l2\" (UniqueName: \"kubernetes.io/projected/e053e248-81c4-4ce5-b905-6ae5c10cffdf-kube-api-access-l22l2\") pod \"authorino-75d556bd77-d7cgz\" (UID: \"e053e248-81c4-4ce5-b905-6ae5c10cffdf\") " pod="kuadrant-system/authorino-75d556bd77-d7cgz" Jul 07 17:34:41.176865 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:41.176845 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-d7cgz" Jul 07 17:34:41.328654 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:41.328620 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d7cgz"] Jul 07 17:34:41.330154 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:34:41.330104 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode053e248_81c4_4ce5_b905_6ae5c10cffdf.slice/crio-d1f5a9d574c16dbda887971b3345b8de96bd6ea60e67187639bf6eb1ca8eca10 WatchSource:0}: Error finding container d1f5a9d574c16dbda887971b3345b8de96bd6ea60e67187639bf6eb1ca8eca10: Status 404 returned error can't find the container with id d1f5a9d574c16dbda887971b3345b8de96bd6ea60e67187639bf6eb1ca8eca10 Jul 07 17:34:41.474203 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:41.471377 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bfzgf" event={"ID":"346a2cb2-2cf9-470e-8292-8855cb355869","Type":"ContainerStarted","Data":"49dbc844234e95a857529e6eaacd84eb7f410f79de19566da4c23db2ac7b4252"} Jul 07 17:34:41.474203 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:41.474183 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-d7cgz" event={"ID":"e053e248-81c4-4ce5-b905-6ae5c10cffdf","Type":"ContainerStarted","Data":"d1f5a9d574c16dbda887971b3345b8de96bd6ea60e67187639bf6eb1ca8eca10"} Jul 07 17:34:46.508859 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:46.508820 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jqx7f" event={"ID":"0f24d7a8-a362-4c1c-b89f-8bd93285fc2e","Type":"ContainerStarted","Data":"4155d8e38d8a0d72bda22cd1dfe85ba25feff5f99a10f796be4564f550bd06d4"} Jul 07 17:34:46.509316 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:46.508948 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jqx7f" Jul 07 17:34:46.510485 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:46.510463 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bfzgf" event={"ID":"346a2cb2-2cf9-470e-8292-8855cb355869","Type":"ContainerStarted","Data":"a36abb63ab278607fcdcde18861b0516c0ce43d9865505542d4aaf9752abe941"} Jul 07 17:34:46.511900 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:46.511878 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-d7cgz" event={"ID":"e053e248-81c4-4ce5-b905-6ae5c10cffdf","Type":"ContainerStarted","Data":"b28e107a8569050d857688c4d8ee9d20b3df690e44050b36dcfdd395d6ef460b"} Jul 07 17:34:46.529280 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:46.529236 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-jqx7f" podStartSLOduration=1.9916690849999998 podStartE2EDuration="7.52922324s" totalImagesPullingTime="5.537554155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:34:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:34:46.527548542 +0000 UTC m=+722.814151676" watchObservedRunningTime="2026-07-07 17:34:46.52922324 +0000 UTC m=+722.815826420" Jul 07 17:34:46.545207 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:46.545168 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-bfzgf" podStartSLOduration=1.934005644 podStartE2EDuration="6.545155605s" totalImagesPullingTime="4.611149961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:34:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:34:46.543747996 +0000 UTC m=+722.830351142" watchObservedRunningTime="2026-07-07 17:34:46.545155605 +0000 UTC m=+722.831758759" Jul 07 17:34:46.561287 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:46.561248 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-d7cgz" podStartSLOduration=2.158901165 podStartE2EDuration="6.56123633s" totalImagesPullingTime="4.402335165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:34:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:34:46.560432471 +0000 UTC m=+722.847035601" watchObservedRunningTime="2026-07-07 17:34:46.56123633 +0000 UTC m=+722.847839521" Jul 07 17:34:46.592120 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:46.592089 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-bfzgf"] Jul 07 17:34:48.522322 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:48.522282 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-bfzgf" podUID="346a2cb2-2cf9-470e-8292-8855cb355869" containerName="authorino" containerID="cri-o://a36abb63ab278607fcdcde18861b0516c0ce43d9865505542d4aaf9752abe941" gracePeriod=30 Jul 07 17:34:48.779834 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:48.779779 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bfzgf" Jul 07 17:34:48.886495 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:48.886464 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vnlb\" (UniqueName: \"kubernetes.io/projected/346a2cb2-2cf9-470e-8292-8855cb355869-kube-api-access-2vnlb\") pod \"346a2cb2-2cf9-470e-8292-8855cb355869\" (UID: \"346a2cb2-2cf9-470e-8292-8855cb355869\") " Jul 07 17:34:48.888610 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:48.888581 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/346a2cb2-2cf9-470e-8292-8855cb355869-kube-api-access-2vnlb" (OuterVolumeSpecName: "kube-api-access-2vnlb") pod "346a2cb2-2cf9-470e-8292-8855cb355869" (UID: "346a2cb2-2cf9-470e-8292-8855cb355869"). InnerVolumeSpecName "kube-api-access-2vnlb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:34:48.988097 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:48.988070 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vnlb\" (UniqueName: \"kubernetes.io/projected/346a2cb2-2cf9-470e-8292-8855cb355869-kube-api-access-2vnlb\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:34:49.528777 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:49.528745 2549 generic.go:356] "Generic (PLEG): container finished" podID="346a2cb2-2cf9-470e-8292-8855cb355869" containerID="a36abb63ab278607fcdcde18861b0516c0ce43d9865505542d4aaf9752abe941" exitCode=0 Jul 07 17:34:49.529224 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:49.528788 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bfzgf" Jul 07 17:34:49.529224 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:49.528805 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bfzgf" event={"ID":"346a2cb2-2cf9-470e-8292-8855cb355869","Type":"ContainerDied","Data":"a36abb63ab278607fcdcde18861b0516c0ce43d9865505542d4aaf9752abe941"} Jul 07 17:34:49.529224 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:49.528847 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bfzgf" event={"ID":"346a2cb2-2cf9-470e-8292-8855cb355869","Type":"ContainerDied","Data":"49dbc844234e95a857529e6eaacd84eb7f410f79de19566da4c23db2ac7b4252"} Jul 07 17:34:49.529224 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:49.528868 2549 scope.go:117] "RemoveContainer" containerID="a36abb63ab278607fcdcde18861b0516c0ce43d9865505542d4aaf9752abe941" Jul 07 17:34:49.539593 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:49.539468 2549 scope.go:117] "RemoveContainer" containerID="a36abb63ab278607fcdcde18861b0516c0ce43d9865505542d4aaf9752abe941" Jul 07 17:34:49.539810 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:34:49.539787 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a36abb63ab278607fcdcde18861b0516c0ce43d9865505542d4aaf9752abe941\": container with ID starting with a36abb63ab278607fcdcde18861b0516c0ce43d9865505542d4aaf9752abe941 not found: ID does not exist" containerID="a36abb63ab278607fcdcde18861b0516c0ce43d9865505542d4aaf9752abe941" Jul 07 17:34:49.539869 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:49.539824 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a36abb63ab278607fcdcde18861b0516c0ce43d9865505542d4aaf9752abe941"} err="failed to get container status \"a36abb63ab278607fcdcde18861b0516c0ce43d9865505542d4aaf9752abe941\": rpc error: code = NotFound desc = could not find container \"a36abb63ab278607fcdcde18861b0516c0ce43d9865505542d4aaf9752abe941\": container with ID starting with a36abb63ab278607fcdcde18861b0516c0ce43d9865505542d4aaf9752abe941 not found: ID does not exist" Jul 07 17:34:49.553668 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:49.553649 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-bfzgf"] Jul 07 17:34:49.560502 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:49.560482 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-bfzgf"] Jul 07 17:34:50.221335 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:50.221296 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="346a2cb2-2cf9-470e-8292-8855cb355869" path="/var/lib/kubelet/pods/346a2cb2-2cf9-470e-8292-8855cb355869/volumes" Jul 07 17:34:54.782326 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:54.782287 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jqx7f"] Jul 07 17:34:54.782846 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:54.782538 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-jqx7f" podUID="0f24d7a8-a362-4c1c-b89f-8bd93285fc2e" containerName="limitador" containerID="cri-o://4155d8e38d8a0d72bda22cd1dfe85ba25feff5f99a10f796be4564f550bd06d4" gracePeriod=30 Jul 07 17:34:54.784864 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:54.784840 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jqx7f" Jul 07 17:34:55.337707 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:55.337680 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jqx7f" Jul 07 17:34:55.434240 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:55.434216 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qmqk\" (UniqueName: \"kubernetes.io/projected/0f24d7a8-a362-4c1c-b89f-8bd93285fc2e-kube-api-access-5qmqk\") pod \"0f24d7a8-a362-4c1c-b89f-8bd93285fc2e\" (UID: \"0f24d7a8-a362-4c1c-b89f-8bd93285fc2e\") " Jul 07 17:34:55.434362 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:55.434250 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f24d7a8-a362-4c1c-b89f-8bd93285fc2e-config-file\") pod \"0f24d7a8-a362-4c1c-b89f-8bd93285fc2e\" (UID: \"0f24d7a8-a362-4c1c-b89f-8bd93285fc2e\") " Jul 07 17:34:55.434679 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:55.434653 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f24d7a8-a362-4c1c-b89f-8bd93285fc2e-config-file" (OuterVolumeSpecName: "config-file") pod "0f24d7a8-a362-4c1c-b89f-8bd93285fc2e" (UID: "0f24d7a8-a362-4c1c-b89f-8bd93285fc2e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 17:34:55.436326 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:55.436300 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f24d7a8-a362-4c1c-b89f-8bd93285fc2e-kube-api-access-5qmqk" (OuterVolumeSpecName: "kube-api-access-5qmqk") pod "0f24d7a8-a362-4c1c-b89f-8bd93285fc2e" (UID: "0f24d7a8-a362-4c1c-b89f-8bd93285fc2e"). InnerVolumeSpecName "kube-api-access-5qmqk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:34:55.535143 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:55.535111 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qmqk\" (UniqueName: \"kubernetes.io/projected/0f24d7a8-a362-4c1c-b89f-8bd93285fc2e-kube-api-access-5qmqk\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:34:55.535143 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:55.535142 2549 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0f24d7a8-a362-4c1c-b89f-8bd93285fc2e-config-file\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:34:55.570293 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:55.570263 2549 generic.go:356] "Generic (PLEG): container finished" podID="0f24d7a8-a362-4c1c-b89f-8bd93285fc2e" containerID="4155d8e38d8a0d72bda22cd1dfe85ba25feff5f99a10f796be4564f550bd06d4" exitCode=0 Jul 07 17:34:55.570382 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:55.570311 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jqx7f" Jul 07 17:34:55.570382 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:55.570353 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jqx7f" event={"ID":"0f24d7a8-a362-4c1c-b89f-8bd93285fc2e","Type":"ContainerDied","Data":"4155d8e38d8a0d72bda22cd1dfe85ba25feff5f99a10f796be4564f550bd06d4"} Jul 07 17:34:55.570458 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:55.570412 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jqx7f" event={"ID":"0f24d7a8-a362-4c1c-b89f-8bd93285fc2e","Type":"ContainerDied","Data":"084d45ceed36dfe4f14314bfb129f51838d2d27f06c3f75bb723001089dca7d7"} Jul 07 17:34:55.570458 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:55.570441 2549 scope.go:117] "RemoveContainer" containerID="4155d8e38d8a0d72bda22cd1dfe85ba25feff5f99a10f796be4564f550bd06d4" Jul 07 17:34:55.580223 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:55.580204 2549 scope.go:117] "RemoveContainer" containerID="4155d8e38d8a0d72bda22cd1dfe85ba25feff5f99a10f796be4564f550bd06d4" Jul 07 17:34:55.580488 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:34:55.580470 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4155d8e38d8a0d72bda22cd1dfe85ba25feff5f99a10f796be4564f550bd06d4\": container with ID starting with 4155d8e38d8a0d72bda22cd1dfe85ba25feff5f99a10f796be4564f550bd06d4 not found: ID does not exist" containerID="4155d8e38d8a0d72bda22cd1dfe85ba25feff5f99a10f796be4564f550bd06d4" Jul 07 17:34:55.580571 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:55.580520 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4155d8e38d8a0d72bda22cd1dfe85ba25feff5f99a10f796be4564f550bd06d4"} err="failed to get container status \"4155d8e38d8a0d72bda22cd1dfe85ba25feff5f99a10f796be4564f550bd06d4\": rpc error: code = NotFound desc = could not find container \"4155d8e38d8a0d72bda22cd1dfe85ba25feff5f99a10f796be4564f550bd06d4\": container with ID starting with 4155d8e38d8a0d72bda22cd1dfe85ba25feff5f99a10f796be4564f550bd06d4 not found: ID does not exist" Jul 07 17:34:55.601417 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:55.599739 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jqx7f"] Jul 07 17:34:55.606809 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:55.606788 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jqx7f"] Jul 07 17:34:56.220895 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:34:56.220848 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f24d7a8-a362-4c1c-b89f-8bd93285fc2e" path="/var/lib/kubelet/pods/0f24d7a8-a362-4c1c-b89f-8bd93285fc2e/volumes" Jul 07 17:35:01.219196 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:01.219150 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-bkpl5"] Jul 07 17:35:01.219616 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:01.219550 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f24d7a8-a362-4c1c-b89f-8bd93285fc2e" containerName="limitador" Jul 07 17:35:01.219616 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:01.219563 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f24d7a8-a362-4c1c-b89f-8bd93285fc2e" containerName="limitador" Jul 07 17:35:01.219616 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:01.219583 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="346a2cb2-2cf9-470e-8292-8855cb355869" containerName="authorino" Jul 07 17:35:01.219616 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:01.219588 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="346a2cb2-2cf9-470e-8292-8855cb355869" containerName="authorino" Jul 07 17:35:01.219774 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:01.219657 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f24d7a8-a362-4c1c-b89f-8bd93285fc2e" containerName="limitador" Jul 07 17:35:01.219774 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:01.219665 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="346a2cb2-2cf9-470e-8292-8855cb355869" containerName="authorino" Jul 07 17:35:01.223930 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:01.223911 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-bkpl5" Jul 07 17:35:01.227112 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:01.227087 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 07 17:35:01.227301 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:01.227287 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-dwvmx\"" Jul 07 17:35:01.236708 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:01.236683 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-bkpl5"] Jul 07 17:35:01.276250 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:01.276229 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9f296389-8454-4522-bb0a-5b7fee0b6557-data\") pod \"postgres-69fb4594cf-bkpl5\" (UID: \"9f296389-8454-4522-bb0a-5b7fee0b6557\") " pod="opendatahub/postgres-69fb4594cf-bkpl5" Jul 07 17:35:01.276371 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:01.276297 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2swp\" (UniqueName: \"kubernetes.io/projected/9f296389-8454-4522-bb0a-5b7fee0b6557-kube-api-access-p2swp\") pod \"postgres-69fb4594cf-bkpl5\" (UID: \"9f296389-8454-4522-bb0a-5b7fee0b6557\") " pod="opendatahub/postgres-69fb4594cf-bkpl5" Jul 07 17:35:01.377377 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:01.377348 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9f296389-8454-4522-bb0a-5b7fee0b6557-data\") pod \"postgres-69fb4594cf-bkpl5\" (UID: \"9f296389-8454-4522-bb0a-5b7fee0b6557\") " pod="opendatahub/postgres-69fb4594cf-bkpl5" Jul 07 17:35:01.377495 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:01.377397 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2swp\" (UniqueName: \"kubernetes.io/projected/9f296389-8454-4522-bb0a-5b7fee0b6557-kube-api-access-p2swp\") pod \"postgres-69fb4594cf-bkpl5\" (UID: \"9f296389-8454-4522-bb0a-5b7fee0b6557\") " pod="opendatahub/postgres-69fb4594cf-bkpl5" Jul 07 17:35:01.377709 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:01.377690 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9f296389-8454-4522-bb0a-5b7fee0b6557-data\") pod \"postgres-69fb4594cf-bkpl5\" (UID: \"9f296389-8454-4522-bb0a-5b7fee0b6557\") " pod="opendatahub/postgres-69fb4594cf-bkpl5" Jul 07 17:35:01.389032 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:01.389001 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2swp\" (UniqueName: \"kubernetes.io/projected/9f296389-8454-4522-bb0a-5b7fee0b6557-kube-api-access-p2swp\") pod \"postgres-69fb4594cf-bkpl5\" (UID: \"9f296389-8454-4522-bb0a-5b7fee0b6557\") " pod="opendatahub/postgres-69fb4594cf-bkpl5" Jul 07 17:35:01.534302 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:01.534232 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-bkpl5" Jul 07 17:35:01.668869 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:01.668840 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-bkpl5"] Jul 07 17:35:01.670670 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:35:01.670646 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f296389_8454_4522_bb0a_5b7fee0b6557.slice/crio-c0258fa0c351ffb43f32404c646ee72fe0731f39dbfc70c97763fb8bf0b2e883 WatchSource:0}: Error finding container c0258fa0c351ffb43f32404c646ee72fe0731f39dbfc70c97763fb8bf0b2e883: Status 404 returned error can't find the container with id c0258fa0c351ffb43f32404c646ee72fe0731f39dbfc70c97763fb8bf0b2e883 Jul 07 17:35:02.611798 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:02.611754 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-bkpl5" event={"ID":"9f296389-8454-4522-bb0a-5b7fee0b6557","Type":"ContainerStarted","Data":"c0258fa0c351ffb43f32404c646ee72fe0731f39dbfc70c97763fb8bf0b2e883"} Jul 07 17:35:07.643652 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:07.643620 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-bkpl5" event={"ID":"9f296389-8454-4522-bb0a-5b7fee0b6557","Type":"ContainerStarted","Data":"64fe7c321973304b3e4f5bd23dd376ba02136fd10ec7673e0bd8ba9e2803a900"} Jul 07 17:35:07.644036 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:07.643721 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-bkpl5" Jul 07 17:35:07.669108 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:07.669059 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-bkpl5" podStartSLOduration=1.708478561 podStartE2EDuration="6.669045857s" totalImagesPullingTime="4.960567296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:35:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:35:07.667084258 +0000 UTC m=+743.953687388" watchObservedRunningTime="2026-07-07 17:35:07.669045857 +0000 UTC m=+743.955649025" Jul 07 17:35:13.680433 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:13.680400 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-bkpl5" Jul 07 17:35:14.271887 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:14.271858 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kvtrx"] Jul 07 17:35:14.278600 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:14.278586 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kvtrx" Jul 07 17:35:14.284397 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:14.284369 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kvtrx"] Jul 07 17:35:14.393465 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:14.393434 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqsm8\" (UniqueName: \"kubernetes.io/projected/23d37e92-098b-456b-af50-962def9edea1-kube-api-access-pqsm8\") pod \"authorino-5d4b67c446-kvtrx\" (UID: \"23d37e92-098b-456b-af50-962def9edea1\") " pod="kuadrant-system/authorino-5d4b67c446-kvtrx" Jul 07 17:35:14.494060 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:14.494035 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqsm8\" (UniqueName: \"kubernetes.io/projected/23d37e92-098b-456b-af50-962def9edea1-kube-api-access-pqsm8\") pod \"authorino-5d4b67c446-kvtrx\" (UID: \"23d37e92-098b-456b-af50-962def9edea1\") " pod="kuadrant-system/authorino-5d4b67c446-kvtrx" Jul 07 17:35:14.496776 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:14.496755 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kvtrx"] Jul 07 17:35:14.496968 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:35:14.496951 2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-pqsm8], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-kvtrx" podUID="23d37e92-098b-456b-af50-962def9edea1" Jul 07 17:35:14.505305 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:14.505284 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqsm8\" (UniqueName: \"kubernetes.io/projected/23d37e92-098b-456b-af50-962def9edea1-kube-api-access-pqsm8\") pod \"authorino-5d4b67c446-kvtrx\" (UID: \"23d37e92-098b-456b-af50-962def9edea1\") " pod="kuadrant-system/authorino-5d4b67c446-kvtrx" Jul 07 17:35:14.529982 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:14.529934 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c4c98f4-5h58j"] Jul 07 17:35:14.533344 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:14.533329 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c4c98f4-5h58j" Jul 07 17:35:14.539226 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:14.539199 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c4c98f4-5h58j"] Jul 07 17:35:14.595180 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:14.595153 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zqq9\" (UniqueName: \"kubernetes.io/projected/037fcc3c-c871-4ce1-95f5-57040c68afa8-kube-api-access-6zqq9\") pod \"authorino-5c4c98f4-5h58j\" (UID: \"037fcc3c-c871-4ce1-95f5-57040c68afa8\") " pod="kuadrant-system/authorino-5c4c98f4-5h58j" Jul 07 17:35:14.685345 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:14.685321 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kvtrx" Jul 07 17:35:14.691801 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:14.691782 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kvtrx" Jul 07 17:35:14.696090 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:14.696072 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zqq9\" (UniqueName: \"kubernetes.io/projected/037fcc3c-c871-4ce1-95f5-57040c68afa8-kube-api-access-6zqq9\") pod \"authorino-5c4c98f4-5h58j\" (UID: \"037fcc3c-c871-4ce1-95f5-57040c68afa8\") " pod="kuadrant-system/authorino-5c4c98f4-5h58j" Jul 07 17:35:14.707944 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:14.707913 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zqq9\" (UniqueName: \"kubernetes.io/projected/037fcc3c-c871-4ce1-95f5-57040c68afa8-kube-api-access-6zqq9\") pod \"authorino-5c4c98f4-5h58j\" (UID: \"037fcc3c-c871-4ce1-95f5-57040c68afa8\") " pod="kuadrant-system/authorino-5c4c98f4-5h58j" Jul 07 17:35:14.739492 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:14.739469 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c4c98f4-5h58j"] Jul 07 17:35:14.739694 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:14.739679 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c4c98f4-5h58j" Jul 07 17:35:14.769051 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:14.769017 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7dcfb9fdf8-j6crv"] Jul 07 17:35:14.772715 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:14.772696 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7dcfb9fdf8-j6crv" Jul 07 17:35:14.775363 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:14.775330 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 07 17:35:14.783115 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:14.783063 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7dcfb9fdf8-j6crv"] Jul 07 17:35:14.797304 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:14.797277 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqsm8\" (UniqueName: \"kubernetes.io/projected/23d37e92-098b-456b-af50-962def9edea1-kube-api-access-pqsm8\") pod \"23d37e92-098b-456b-af50-962def9edea1\" (UID: \"23d37e92-098b-456b-af50-962def9edea1\") " Jul 07 17:35:14.810953 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:14.810786 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23d37e92-098b-456b-af50-962def9edea1-kube-api-access-pqsm8" (OuterVolumeSpecName: "kube-api-access-pqsm8") pod "23d37e92-098b-456b-af50-962def9edea1" (UID: "23d37e92-098b-456b-af50-962def9edea1"). InnerVolumeSpecName "kube-api-access-pqsm8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:35:14.879114 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:14.879090 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c4c98f4-5h58j"] Jul 07 17:35:14.880322 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:35:14.880298 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod037fcc3c_c871_4ce1_95f5_57040c68afa8.slice/crio-a123f7f09c441498ccb2847db01428de10a9aaa1657962f0e3c511321b270381 WatchSource:0}: Error finding container a123f7f09c441498ccb2847db01428de10a9aaa1657962f0e3c511321b270381: Status 404 returned error can't find the container with id a123f7f09c441498ccb2847db01428de10a9aaa1657962f0e3c511321b270381 Jul 07 17:35:14.898737 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:14.898718 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn85s\" (UniqueName: \"kubernetes.io/projected/573b8e46-97ee-4268-ac06-d04135b61761-kube-api-access-mn85s\") pod \"authorino-7dcfb9fdf8-j6crv\" (UID: \"573b8e46-97ee-4268-ac06-d04135b61761\") " pod="kuadrant-system/authorino-7dcfb9fdf8-j6crv" Jul 07 17:35:14.898835 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:14.898758 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/573b8e46-97ee-4268-ac06-d04135b61761-tls-cert\") pod \"authorino-7dcfb9fdf8-j6crv\" (UID: \"573b8e46-97ee-4268-ac06-d04135b61761\") " pod="kuadrant-system/authorino-7dcfb9fdf8-j6crv" Jul 07 17:35:14.898882 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:14.898853 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqsm8\" (UniqueName: \"kubernetes.io/projected/23d37e92-098b-456b-af50-962def9edea1-kube-api-access-pqsm8\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:35:15.000022 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:14.999994 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/573b8e46-97ee-4268-ac06-d04135b61761-tls-cert\") pod \"authorino-7dcfb9fdf8-j6crv\" (UID: \"573b8e46-97ee-4268-ac06-d04135b61761\") " pod="kuadrant-system/authorino-7dcfb9fdf8-j6crv" Jul 07 17:35:15.000110 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:15.000067 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn85s\" (UniqueName: \"kubernetes.io/projected/573b8e46-97ee-4268-ac06-d04135b61761-kube-api-access-mn85s\") pod \"authorino-7dcfb9fdf8-j6crv\" (UID: \"573b8e46-97ee-4268-ac06-d04135b61761\") " pod="kuadrant-system/authorino-7dcfb9fdf8-j6crv" Jul 07 17:35:15.002337 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:15.002316 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/573b8e46-97ee-4268-ac06-d04135b61761-tls-cert\") pod \"authorino-7dcfb9fdf8-j6crv\" (UID: \"573b8e46-97ee-4268-ac06-d04135b61761\") " pod="kuadrant-system/authorino-7dcfb9fdf8-j6crv" Jul 07 17:35:15.009580 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:15.009558 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn85s\" (UniqueName: \"kubernetes.io/projected/573b8e46-97ee-4268-ac06-d04135b61761-kube-api-access-mn85s\") pod \"authorino-7dcfb9fdf8-j6crv\" (UID: \"573b8e46-97ee-4268-ac06-d04135b61761\") " pod="kuadrant-system/authorino-7dcfb9fdf8-j6crv" Jul 07 17:35:15.083477 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:15.083423 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7dcfb9fdf8-j6crv" Jul 07 17:35:15.217620 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:15.217591 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7dcfb9fdf8-j6crv"] Jul 07 17:35:15.219033 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:35:15.219005 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod573b8e46_97ee_4268_ac06_d04135b61761.slice/crio-bdedd41f6163a82402a16677bc6ea5cd983a8ad7bd689263daedb317aa7ab15e WatchSource:0}: Error finding container bdedd41f6163a82402a16677bc6ea5cd983a8ad7bd689263daedb317aa7ab15e: Status 404 returned error can't find the container with id bdedd41f6163a82402a16677bc6ea5cd983a8ad7bd689263daedb317aa7ab15e Jul 07 17:35:15.692408 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:15.692379 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7dcfb9fdf8-j6crv" event={"ID":"573b8e46-97ee-4268-ac06-d04135b61761","Type":"ContainerStarted","Data":"6dcef5f3f4e5e1d32e4331baaac3ea4e571c11a78627d6a8ddff1676ac96761e"} Jul 07 17:35:15.692794 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:15.692421 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7dcfb9fdf8-j6crv" event={"ID":"573b8e46-97ee-4268-ac06-d04135b61761","Type":"ContainerStarted","Data":"bdedd41f6163a82402a16677bc6ea5cd983a8ad7bd689263daedb317aa7ab15e"} Jul 07 17:35:15.694095 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:15.694059 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kvtrx" Jul 07 17:35:15.694228 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:15.694097 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5c4c98f4-5h58j" podUID="037fcc3c-c871-4ce1-95f5-57040c68afa8" containerName="authorino" containerID="cri-o://b21bb4843c85a509d8cf9e0bfc641eee690cbad6c673187a99942db9bc9fed67" gracePeriod=30 Jul 07 17:35:15.694320 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:15.694062 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c4c98f4-5h58j" event={"ID":"037fcc3c-c871-4ce1-95f5-57040c68afa8","Type":"ContainerStarted","Data":"b21bb4843c85a509d8cf9e0bfc641eee690cbad6c673187a99942db9bc9fed67"} Jul 07 17:35:15.694432 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:15.694390 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c4c98f4-5h58j" event={"ID":"037fcc3c-c871-4ce1-95f5-57040c68afa8","Type":"ContainerStarted","Data":"a123f7f09c441498ccb2847db01428de10a9aaa1657962f0e3c511321b270381"} Jul 07 17:35:15.710732 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:15.710085 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7dcfb9fdf8-j6crv" podStartSLOduration=1.319311975 podStartE2EDuration="1.710066624s" totalImagesPullingTime="390.754649ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:35:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:35:15.709400876 +0000 UTC m=+751.996004009" watchObservedRunningTime="2026-07-07 17:35:15.710066624 +0000 UTC m=+751.996669756" Jul 07 17:35:15.726211 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:15.726170 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5c4c98f4-5h58j" podStartSLOduration=1.388894277 podStartE2EDuration="1.726155576s" totalImagesPullingTime="337.261299ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:35:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:35:15.724368717 +0000 UTC m=+752.010971847" watchObservedRunningTime="2026-07-07 17:35:15.726155576 +0000 UTC m=+752.012758707" Jul 07 17:35:15.743376 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:15.743347 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d7cgz"] Jul 07 17:35:15.743591 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:15.743565 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-d7cgz" podUID="e053e248-81c4-4ce5-b905-6ae5c10cffdf" containerName="authorino" containerID="cri-o://b28e107a8569050d857688c4d8ee9d20b3df690e44050b36dcfdd395d6ef460b" gracePeriod=30 Jul 07 17:35:15.795591 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:15.795564 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kvtrx"] Jul 07 17:35:15.801336 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:15.801307 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kvtrx"] Jul 07 17:35:15.984328 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:15.984309 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c4c98f4-5h58j" Jul 07 17:35:16.006869 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:16.006848 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-d7cgz" Jul 07 17:35:16.109378 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:16.109351 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zqq9\" (UniqueName: \"kubernetes.io/projected/037fcc3c-c871-4ce1-95f5-57040c68afa8-kube-api-access-6zqq9\") pod \"037fcc3c-c871-4ce1-95f5-57040c68afa8\" (UID: \"037fcc3c-c871-4ce1-95f5-57040c68afa8\") " Jul 07 17:35:16.109550 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:16.109397 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l22l2\" (UniqueName: \"kubernetes.io/projected/e053e248-81c4-4ce5-b905-6ae5c10cffdf-kube-api-access-l22l2\") pod \"e053e248-81c4-4ce5-b905-6ae5c10cffdf\" (UID: \"e053e248-81c4-4ce5-b905-6ae5c10cffdf\") " Jul 07 17:35:16.111474 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:16.111447 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e053e248-81c4-4ce5-b905-6ae5c10cffdf-kube-api-access-l22l2" (OuterVolumeSpecName: "kube-api-access-l22l2") pod "e053e248-81c4-4ce5-b905-6ae5c10cffdf" (UID: "e053e248-81c4-4ce5-b905-6ae5c10cffdf"). InnerVolumeSpecName "kube-api-access-l22l2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:35:16.111582 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:16.111532 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/037fcc3c-c871-4ce1-95f5-57040c68afa8-kube-api-access-6zqq9" (OuterVolumeSpecName: "kube-api-access-6zqq9") pod "037fcc3c-c871-4ce1-95f5-57040c68afa8" (UID: "037fcc3c-c871-4ce1-95f5-57040c68afa8"). InnerVolumeSpecName "kube-api-access-6zqq9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:35:16.210852 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:16.210828 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zqq9\" (UniqueName: \"kubernetes.io/projected/037fcc3c-c871-4ce1-95f5-57040c68afa8-kube-api-access-6zqq9\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:35:16.210852 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:16.210850 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l22l2\" (UniqueName: \"kubernetes.io/projected/e053e248-81c4-4ce5-b905-6ae5c10cffdf-kube-api-access-l22l2\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:35:16.220954 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:16.220926 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23d37e92-098b-456b-af50-962def9edea1" path="/var/lib/kubelet/pods/23d37e92-098b-456b-af50-962def9edea1/volumes" Jul 07 17:35:16.701276 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:16.701242 2549 generic.go:356] "Generic (PLEG): container finished" podID="037fcc3c-c871-4ce1-95f5-57040c68afa8" containerID="b21bb4843c85a509d8cf9e0bfc641eee690cbad6c673187a99942db9bc9fed67" exitCode=0 Jul 07 17:35:16.701665 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:16.701284 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c4c98f4-5h58j" Jul 07 17:35:16.701665 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:16.701335 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c4c98f4-5h58j" event={"ID":"037fcc3c-c871-4ce1-95f5-57040c68afa8","Type":"ContainerDied","Data":"b21bb4843c85a509d8cf9e0bfc641eee690cbad6c673187a99942db9bc9fed67"} Jul 07 17:35:16.701665 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:16.701386 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c4c98f4-5h58j" event={"ID":"037fcc3c-c871-4ce1-95f5-57040c68afa8","Type":"ContainerDied","Data":"a123f7f09c441498ccb2847db01428de10a9aaa1657962f0e3c511321b270381"} Jul 07 17:35:16.701665 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:16.701411 2549 scope.go:117] "RemoveContainer" containerID="b21bb4843c85a509d8cf9e0bfc641eee690cbad6c673187a99942db9bc9fed67" Jul 07 17:35:16.702895 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:16.702863 2549 generic.go:356] "Generic (PLEG): container finished" podID="e053e248-81c4-4ce5-b905-6ae5c10cffdf" containerID="b28e107a8569050d857688c4d8ee9d20b3df690e44050b36dcfdd395d6ef460b" exitCode=0 Jul 07 17:35:16.703003 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:16.702903 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-d7cgz" event={"ID":"e053e248-81c4-4ce5-b905-6ae5c10cffdf","Type":"ContainerDied","Data":"b28e107a8569050d857688c4d8ee9d20b3df690e44050b36dcfdd395d6ef460b"} Jul 07 17:35:16.703003 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:16.702936 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-d7cgz" event={"ID":"e053e248-81c4-4ce5-b905-6ae5c10cffdf","Type":"ContainerDied","Data":"d1f5a9d574c16dbda887971b3345b8de96bd6ea60e67187639bf6eb1ca8eca10"} Jul 07 17:35:16.703003 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:16.702980 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-d7cgz" Jul 07 17:35:16.711011 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:16.710991 2549 scope.go:117] "RemoveContainer" containerID="b21bb4843c85a509d8cf9e0bfc641eee690cbad6c673187a99942db9bc9fed67" Jul 07 17:35:16.711304 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:35:16.711285 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b21bb4843c85a509d8cf9e0bfc641eee690cbad6c673187a99942db9bc9fed67\": container with ID starting with b21bb4843c85a509d8cf9e0bfc641eee690cbad6c673187a99942db9bc9fed67 not found: ID does not exist" containerID="b21bb4843c85a509d8cf9e0bfc641eee690cbad6c673187a99942db9bc9fed67" Jul 07 17:35:16.711365 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:16.711312 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b21bb4843c85a509d8cf9e0bfc641eee690cbad6c673187a99942db9bc9fed67"} err="failed to get container status \"b21bb4843c85a509d8cf9e0bfc641eee690cbad6c673187a99942db9bc9fed67\": rpc error: code = NotFound desc = could not find container \"b21bb4843c85a509d8cf9e0bfc641eee690cbad6c673187a99942db9bc9fed67\": container with ID starting with b21bb4843c85a509d8cf9e0bfc641eee690cbad6c673187a99942db9bc9fed67 not found: ID does not exist" Jul 07 17:35:16.711365 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:16.711332 2549 scope.go:117] "RemoveContainer" containerID="b28e107a8569050d857688c4d8ee9d20b3df690e44050b36dcfdd395d6ef460b" Jul 07 17:35:16.719694 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:16.719583 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d7cgz"] Jul 07 17:35:16.719758 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:16.719721 2549 scope.go:117] "RemoveContainer" containerID="b28e107a8569050d857688c4d8ee9d20b3df690e44050b36dcfdd395d6ef460b" Jul 07 17:35:16.719985 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:35:16.719967 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b28e107a8569050d857688c4d8ee9d20b3df690e44050b36dcfdd395d6ef460b\": container with ID starting with b28e107a8569050d857688c4d8ee9d20b3df690e44050b36dcfdd395d6ef460b not found: ID does not exist" containerID="b28e107a8569050d857688c4d8ee9d20b3df690e44050b36dcfdd395d6ef460b" Jul 07 17:35:16.720051 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:16.720003 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b28e107a8569050d857688c4d8ee9d20b3df690e44050b36dcfdd395d6ef460b"} err="failed to get container status \"b28e107a8569050d857688c4d8ee9d20b3df690e44050b36dcfdd395d6ef460b\": rpc error: code = NotFound desc = could not find container \"b28e107a8569050d857688c4d8ee9d20b3df690e44050b36dcfdd395d6ef460b\": container with ID starting with b28e107a8569050d857688c4d8ee9d20b3df690e44050b36dcfdd395d6ef460b not found: ID does not exist" Jul 07 17:35:16.722987 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:16.722968 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d7cgz"] Jul 07 17:35:16.733957 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:16.733918 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c4c98f4-5h58j"] Jul 07 17:35:16.735905 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:16.735887 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5c4c98f4-5h58j"] Jul 07 17:35:18.220486 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:18.220454 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="037fcc3c-c871-4ce1-95f5-57040c68afa8" path="/var/lib/kubelet/pods/037fcc3c-c871-4ce1-95f5-57040c68afa8/volumes" Jul 07 17:35:18.220876 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:18.220782 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e053e248-81c4-4ce5-b905-6ae5c10cffdf" path="/var/lib/kubelet/pods/e053e248-81c4-4ce5-b905-6ae5c10cffdf/volumes" Jul 07 17:35:20.801978 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:20.801950 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5bb869f588-phr6j"] Jul 07 17:35:20.802441 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:20.802278 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="037fcc3c-c871-4ce1-95f5-57040c68afa8" containerName="authorino" Jul 07 17:35:20.802441 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:20.802288 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="037fcc3c-c871-4ce1-95f5-57040c68afa8" containerName="authorino" Jul 07 17:35:20.802441 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:20.802309 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e053e248-81c4-4ce5-b905-6ae5c10cffdf" containerName="authorino" Jul 07 17:35:20.802441 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:20.802314 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="e053e248-81c4-4ce5-b905-6ae5c10cffdf" containerName="authorino" Jul 07 17:35:20.802441 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:20.802370 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="e053e248-81c4-4ce5-b905-6ae5c10cffdf" containerName="authorino" Jul 07 17:35:20.802441 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:20.802380 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="037fcc3c-c871-4ce1-95f5-57040c68afa8" containerName="authorino" Jul 07 17:35:20.809240 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:20.809222 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bb869f588-phr6j" Jul 07 17:35:20.812485 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:20.812464 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 07 17:35:20.812607 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:20.812556 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 07 17:35:20.812607 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:20.812580 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-x8wh8\"" Jul 07 17:35:20.817484 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:20.817462 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5bb869f588-phr6j"] Jul 07 17:35:20.946009 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:20.945980 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec810e2a-b5c8-44ad-be5b-193c4554dc05-webhook-cert\") pod \"maas-controller-5bb869f588-phr6j\" (UID: \"ec810e2a-b5c8-44ad-be5b-193c4554dc05\") " pod="opendatahub/maas-controller-5bb869f588-phr6j" Jul 07 17:35:20.946166 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:20.946017 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xvpv\" (UniqueName: \"kubernetes.io/projected/ec810e2a-b5c8-44ad-be5b-193c4554dc05-kube-api-access-2xvpv\") pod \"maas-controller-5bb869f588-phr6j\" (UID: \"ec810e2a-b5c8-44ad-be5b-193c4554dc05\") " pod="opendatahub/maas-controller-5bb869f588-phr6j" Jul 07 17:35:20.997085 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:20.997058 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8f58f69f-68r84"] Jul 07 17:35:20.999725 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:20.999708 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f58f69f-68r84" Jul 07 17:35:21.010442 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:21.010423 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8f58f69f-68r84"] Jul 07 17:35:21.046882 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:21.046863 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec810e2a-b5c8-44ad-be5b-193c4554dc05-webhook-cert\") pod \"maas-controller-5bb869f588-phr6j\" (UID: \"ec810e2a-b5c8-44ad-be5b-193c4554dc05\") " pod="opendatahub/maas-controller-5bb869f588-phr6j" Jul 07 17:35:21.047001 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:21.046910 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xvpv\" (UniqueName: \"kubernetes.io/projected/ec810e2a-b5c8-44ad-be5b-193c4554dc05-kube-api-access-2xvpv\") pod \"maas-controller-5bb869f588-phr6j\" (UID: \"ec810e2a-b5c8-44ad-be5b-193c4554dc05\") " pod="opendatahub/maas-controller-5bb869f588-phr6j" Jul 07 17:35:21.049274 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:21.049250 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec810e2a-b5c8-44ad-be5b-193c4554dc05-webhook-cert\") pod \"maas-controller-5bb869f588-phr6j\" (UID: \"ec810e2a-b5c8-44ad-be5b-193c4554dc05\") " pod="opendatahub/maas-controller-5bb869f588-phr6j" Jul 07 17:35:21.055822 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:21.055765 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xvpv\" (UniqueName: \"kubernetes.io/projected/ec810e2a-b5c8-44ad-be5b-193c4554dc05-kube-api-access-2xvpv\") pod \"maas-controller-5bb869f588-phr6j\" (UID: \"ec810e2a-b5c8-44ad-be5b-193c4554dc05\") " pod="opendatahub/maas-controller-5bb869f588-phr6j" Jul 07 17:35:21.121871 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:21.121842 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bb869f588-phr6j" Jul 07 17:35:21.147604 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:21.147583 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c45a15b3-7fe2-44d6-92cb-7f635b70f779-webhook-cert\") pod \"maas-controller-8f58f69f-68r84\" (UID: \"c45a15b3-7fe2-44d6-92cb-7f635b70f779\") " pod="opendatahub/maas-controller-8f58f69f-68r84" Jul 07 17:35:21.147702 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:21.147686 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbkw7\" (UniqueName: \"kubernetes.io/projected/c45a15b3-7fe2-44d6-92cb-7f635b70f779-kube-api-access-lbkw7\") pod \"maas-controller-8f58f69f-68r84\" (UID: \"c45a15b3-7fe2-44d6-92cb-7f635b70f779\") " pod="opendatahub/maas-controller-8f58f69f-68r84" Jul 07 17:35:21.248351 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:21.248320 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbkw7\" (UniqueName: \"kubernetes.io/projected/c45a15b3-7fe2-44d6-92cb-7f635b70f779-kube-api-access-lbkw7\") pod \"maas-controller-8f58f69f-68r84\" (UID: \"c45a15b3-7fe2-44d6-92cb-7f635b70f779\") " pod="opendatahub/maas-controller-8f58f69f-68r84" Jul 07 17:35:21.248474 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:21.248412 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c45a15b3-7fe2-44d6-92cb-7f635b70f779-webhook-cert\") pod \"maas-controller-8f58f69f-68r84\" (UID: \"c45a15b3-7fe2-44d6-92cb-7f635b70f779\") " pod="opendatahub/maas-controller-8f58f69f-68r84" Jul 07 17:35:21.251066 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:21.251034 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c45a15b3-7fe2-44d6-92cb-7f635b70f779-webhook-cert\") pod \"maas-controller-8f58f69f-68r84\" (UID: \"c45a15b3-7fe2-44d6-92cb-7f635b70f779\") " pod="opendatahub/maas-controller-8f58f69f-68r84" Jul 07 17:35:21.253298 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:21.253279 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5bb869f588-phr6j"] Jul 07 17:35:21.254573 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:35:21.254546 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec810e2a_b5c8_44ad_be5b_193c4554dc05.slice/crio-79d860c4d9c453df21a0333e1dc8f947f5df12070c0bdb474ad5de708eb99642 WatchSource:0}: Error finding container 79d860c4d9c453df21a0333e1dc8f947f5df12070c0bdb474ad5de708eb99642: Status 404 returned error can't find the container with id 79d860c4d9c453df21a0333e1dc8f947f5df12070c0bdb474ad5de708eb99642 Jul 07 17:35:21.257567 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:21.257547 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbkw7\" (UniqueName: \"kubernetes.io/projected/c45a15b3-7fe2-44d6-92cb-7f635b70f779-kube-api-access-lbkw7\") pod \"maas-controller-8f58f69f-68r84\" (UID: \"c45a15b3-7fe2-44d6-92cb-7f635b70f779\") " pod="opendatahub/maas-controller-8f58f69f-68r84" Jul 07 17:35:21.309851 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:21.309799 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f58f69f-68r84" Jul 07 17:35:21.442293 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:21.442271 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8f58f69f-68r84"] Jul 07 17:35:21.443476 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:35:21.443445 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc45a15b3_7fe2_44d6_92cb_7f635b70f779.slice/crio-3b33092e0d2707715e60f3bf9d6a4caf0a8aa5aac5b98faa528e8e53944e60e7 WatchSource:0}: Error finding container 3b33092e0d2707715e60f3bf9d6a4caf0a8aa5aac5b98faa528e8e53944e60e7: Status 404 returned error can't find the container with id 3b33092e0d2707715e60f3bf9d6a4caf0a8aa5aac5b98faa528e8e53944e60e7 Jul 07 17:35:21.733822 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:21.733761 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f58f69f-68r84" event={"ID":"c45a15b3-7fe2-44d6-92cb-7f635b70f779","Type":"ContainerStarted","Data":"3b33092e0d2707715e60f3bf9d6a4caf0a8aa5aac5b98faa528e8e53944e60e7"} Jul 07 17:35:21.734984 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:21.734964 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bb869f588-phr6j" event={"ID":"ec810e2a-b5c8-44ad-be5b-193c4554dc05","Type":"ContainerStarted","Data":"79d860c4d9c453df21a0333e1dc8f947f5df12070c0bdb474ad5de708eb99642"} Jul 07 17:35:23.749134 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:23.749083 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f58f69f-68r84" event={"ID":"c45a15b3-7fe2-44d6-92cb-7f635b70f779","Type":"ContainerStarted","Data":"2b2268ee4e9d2bac622f1d1a97dc8fffea6eec6e03a8b800ca5e811971e9f291"} Jul 07 17:35:23.749579 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:23.749212 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8f58f69f-68r84" Jul 07 17:35:23.750663 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:23.750638 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bb869f588-phr6j" event={"ID":"ec810e2a-b5c8-44ad-be5b-193c4554dc05","Type":"ContainerStarted","Data":"86282abc2a7d27bb36b1bf634bc846948e92d1fc28daacad9df6975da6cd73a6"} Jul 07 17:35:23.750794 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:23.750776 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5bb869f588-phr6j" Jul 07 17:35:23.772894 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:23.772853 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8f58f69f-68r84" podStartSLOduration=1.938660448 podStartE2EDuration="3.772841318s" totalImagesPullingTime="1.83418087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:35:23.771026845 +0000 UTC m=+760.057629976" watchObservedRunningTime="2026-07-07 17:35:23.772841318 +0000 UTC m=+760.059444449" Jul 07 17:35:23.795355 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:23.795321 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5bb869f588-phr6j" podStartSLOduration=1.783128061 podStartE2EDuration="3.795311539s" totalImagesPullingTime="2.012183478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:35:23.793828722 +0000 UTC m=+760.080431854" watchObservedRunningTime="2026-07-07 17:35:23.795311539 +0000 UTC m=+760.081914694" Jul 07 17:35:34.762807 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:34.762773 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5bb869f588-phr6j" Jul 07 17:35:34.763135 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:34.762862 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8f58f69f-68r84" Jul 07 17:35:34.839569 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:34.839538 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5bb869f588-phr6j"] Jul 07 17:35:34.839798 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:34.839778 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5bb869f588-phr6j" podUID="ec810e2a-b5c8-44ad-be5b-193c4554dc05" containerName="manager" containerID="cri-o://86282abc2a7d27bb36b1bf634bc846948e92d1fc28daacad9df6975da6cd73a6" gracePeriod=30 Jul 07 17:35:35.096610 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:35.096587 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bb869f588-phr6j" Jul 07 17:35:35.261355 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:35.261322 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec810e2a-b5c8-44ad-be5b-193c4554dc05-webhook-cert\") pod \"ec810e2a-b5c8-44ad-be5b-193c4554dc05\" (UID: \"ec810e2a-b5c8-44ad-be5b-193c4554dc05\") " Jul 07 17:35:35.261528 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:35.261414 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xvpv\" (UniqueName: \"kubernetes.io/projected/ec810e2a-b5c8-44ad-be5b-193c4554dc05-kube-api-access-2xvpv\") pod \"ec810e2a-b5c8-44ad-be5b-193c4554dc05\" (UID: \"ec810e2a-b5c8-44ad-be5b-193c4554dc05\") " Jul 07 17:35:35.263718 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:35.263687 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec810e2a-b5c8-44ad-be5b-193c4554dc05-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ec810e2a-b5c8-44ad-be5b-193c4554dc05" (UID: "ec810e2a-b5c8-44ad-be5b-193c4554dc05"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:35:35.263829 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:35.263725 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec810e2a-b5c8-44ad-be5b-193c4554dc05-kube-api-access-2xvpv" (OuterVolumeSpecName: "kube-api-access-2xvpv") pod "ec810e2a-b5c8-44ad-be5b-193c4554dc05" (UID: "ec810e2a-b5c8-44ad-be5b-193c4554dc05"). InnerVolumeSpecName "kube-api-access-2xvpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:35:35.362392 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:35.362371 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xvpv\" (UniqueName: \"kubernetes.io/projected/ec810e2a-b5c8-44ad-be5b-193c4554dc05-kube-api-access-2xvpv\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:35:35.362392 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:35.362392 2549 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ec810e2a-b5c8-44ad-be5b-193c4554dc05-webhook-cert\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:35:35.818521 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:35.818468 2549 generic.go:356] "Generic (PLEG): container finished" podID="ec810e2a-b5c8-44ad-be5b-193c4554dc05" containerID="86282abc2a7d27bb36b1bf634bc846948e92d1fc28daacad9df6975da6cd73a6" exitCode=0 Jul 07 17:35:35.818987 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:35.818544 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bb869f588-phr6j" Jul 07 17:35:35.818987 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:35.818541 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bb869f588-phr6j" event={"ID":"ec810e2a-b5c8-44ad-be5b-193c4554dc05","Type":"ContainerDied","Data":"86282abc2a7d27bb36b1bf634bc846948e92d1fc28daacad9df6975da6cd73a6"} Jul 07 17:35:35.818987 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:35.818604 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bb869f588-phr6j" event={"ID":"ec810e2a-b5c8-44ad-be5b-193c4554dc05","Type":"ContainerDied","Data":"79d860c4d9c453df21a0333e1dc8f947f5df12070c0bdb474ad5de708eb99642"} Jul 07 17:35:35.818987 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:35.818621 2549 scope.go:117] "RemoveContainer" containerID="86282abc2a7d27bb36b1bf634bc846948e92d1fc28daacad9df6975da6cd73a6" Jul 07 17:35:35.832017 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:35.831999 2549 scope.go:117] "RemoveContainer" containerID="86282abc2a7d27bb36b1bf634bc846948e92d1fc28daacad9df6975da6cd73a6" Jul 07 17:35:35.832315 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:35:35.832294 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86282abc2a7d27bb36b1bf634bc846948e92d1fc28daacad9df6975da6cd73a6\": container with ID starting with 86282abc2a7d27bb36b1bf634bc846948e92d1fc28daacad9df6975da6cd73a6 not found: ID does not exist" containerID="86282abc2a7d27bb36b1bf634bc846948e92d1fc28daacad9df6975da6cd73a6" Jul 07 17:35:35.832362 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:35.832323 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86282abc2a7d27bb36b1bf634bc846948e92d1fc28daacad9df6975da6cd73a6"} err="failed to get container status \"86282abc2a7d27bb36b1bf634bc846948e92d1fc28daacad9df6975da6cd73a6\": rpc error: code = NotFound desc = could not find container \"86282abc2a7d27bb36b1bf634bc846948e92d1fc28daacad9df6975da6cd73a6\": container with ID starting with 86282abc2a7d27bb36b1bf634bc846948e92d1fc28daacad9df6975da6cd73a6 not found: ID does not exist" Jul 07 17:35:35.846153 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:35.846129 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5bb869f588-phr6j"] Jul 07 17:35:35.850800 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:35.850777 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5bb869f588-phr6j"] Jul 07 17:35:35.860495 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:35:35.860475 2549 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec810e2a_b5c8_44ad_be5b_193c4554dc05.slice\": RecentStats: unable to find data in memory cache]" Jul 07 17:35:36.220670 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:36.220641 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec810e2a-b5c8-44ad-be5b-193c4554dc05" path="/var/lib/kubelet/pods/ec810e2a-b5c8-44ad-be5b-193c4554dc05/volumes" Jul 07 17:35:56.649408 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:56.649373 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-cc758d988-s9zv4"] Jul 07 17:35:56.649834 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:56.649748 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec810e2a-b5c8-44ad-be5b-193c4554dc05" containerName="manager" Jul 07 17:35:56.649834 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:56.649760 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec810e2a-b5c8-44ad-be5b-193c4554dc05" containerName="manager" Jul 07 17:35:56.649834 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:56.649821 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec810e2a-b5c8-44ad-be5b-193c4554dc05" containerName="manager" Jul 07 17:35:56.665048 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:56.665027 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-cc758d988-s9zv4" Jul 07 17:35:56.668233 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:56.668204 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-rv6qc\"" Jul 07 17:35:56.669456 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:56.669442 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 07 17:35:56.676447 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:56.676423 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-cc758d988-s9zv4"] Jul 07 17:35:56.729667 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:56.729640 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl8gh\" (UniqueName: \"kubernetes.io/projected/e44e9944-fbdd-4321-8249-00add35f0ef9-kube-api-access-pl8gh\") pod \"maas-api-cc758d988-s9zv4\" (UID: \"e44e9944-fbdd-4321-8249-00add35f0ef9\") " pod="opendatahub/maas-api-cc758d988-s9zv4" Jul 07 17:35:56.729783 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:56.729704 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e44e9944-fbdd-4321-8249-00add35f0ef9-openshift-service-ca\") pod \"maas-api-cc758d988-s9zv4\" (UID: \"e44e9944-fbdd-4321-8249-00add35f0ef9\") " pod="opendatahub/maas-api-cc758d988-s9zv4" Jul 07 17:35:56.729783 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:56.729748 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e44e9944-fbdd-4321-8249-00add35f0ef9-maas-api-tls\") pod \"maas-api-cc758d988-s9zv4\" (UID: \"e44e9944-fbdd-4321-8249-00add35f0ef9\") " pod="opendatahub/maas-api-cc758d988-s9zv4" Jul 07 17:35:56.830330 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:56.830298 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e44e9944-fbdd-4321-8249-00add35f0ef9-maas-api-tls\") pod \"maas-api-cc758d988-s9zv4\" (UID: \"e44e9944-fbdd-4321-8249-00add35f0ef9\") " pod="opendatahub/maas-api-cc758d988-s9zv4" Jul 07 17:35:56.830468 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:56.830348 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl8gh\" (UniqueName: \"kubernetes.io/projected/e44e9944-fbdd-4321-8249-00add35f0ef9-kube-api-access-pl8gh\") pod \"maas-api-cc758d988-s9zv4\" (UID: \"e44e9944-fbdd-4321-8249-00add35f0ef9\") " pod="opendatahub/maas-api-cc758d988-s9zv4" Jul 07 17:35:56.830468 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:56.830412 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e44e9944-fbdd-4321-8249-00add35f0ef9-openshift-service-ca\") pod \"maas-api-cc758d988-s9zv4\" (UID: \"e44e9944-fbdd-4321-8249-00add35f0ef9\") " pod="opendatahub/maas-api-cc758d988-s9zv4" Jul 07 17:35:56.831062 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:56.831040 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e44e9944-fbdd-4321-8249-00add35f0ef9-openshift-service-ca\") pod \"maas-api-cc758d988-s9zv4\" (UID: \"e44e9944-fbdd-4321-8249-00add35f0ef9\") " pod="opendatahub/maas-api-cc758d988-s9zv4" Jul 07 17:35:56.832983 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:56.832959 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e44e9944-fbdd-4321-8249-00add35f0ef9-maas-api-tls\") pod \"maas-api-cc758d988-s9zv4\" (UID: \"e44e9944-fbdd-4321-8249-00add35f0ef9\") " pod="opendatahub/maas-api-cc758d988-s9zv4" Jul 07 17:35:56.841877 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:56.841854 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl8gh\" (UniqueName: \"kubernetes.io/projected/e44e9944-fbdd-4321-8249-00add35f0ef9-kube-api-access-pl8gh\") pod \"maas-api-cc758d988-s9zv4\" (UID: \"e44e9944-fbdd-4321-8249-00add35f0ef9\") " pod="opendatahub/maas-api-cc758d988-s9zv4" Jul 07 17:35:56.975858 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:56.975792 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-cc758d988-s9zv4" Jul 07 17:35:57.122848 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.122809 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-cc758d988-s9zv4"] Jul 07 17:35:57.125237 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:35:57.125211 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode44e9944_fbdd_4321_8249_00add35f0ef9.slice/crio-8615a4b7789f246e2ff9c47f037cc07cdef5e07877bb0ecfb50b2329a0912f5a WatchSource:0}: Error finding container 8615a4b7789f246e2ff9c47f037cc07cdef5e07877bb0ecfb50b2329a0912f5a: Status 404 returned error can't find the container with id 8615a4b7789f246e2ff9c47f037cc07cdef5e07877bb0ecfb50b2329a0912f5a Jul 07 17:35:57.126599 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.126584 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 17:35:57.207086 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.207063 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-dqsh4"] Jul 07 17:35:57.212800 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.212782 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-dqsh4" Jul 07 17:35:57.215543 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.215478 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 07 17:35:57.225255 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.225201 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-dqsh4"] Jul 07 17:35:57.234399 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.234347 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a690f0f0-9fa0-458e-aa8b-05fc7f1113f9-plugins-config-volume\") pod \"payload-processing-58f86c7798-dqsh4\" (UID: \"a690f0f0-9fa0-458e-aa8b-05fc7f1113f9\") " pod="openshift-ingress/payload-processing-58f86c7798-dqsh4" Jul 07 17:35:57.234399 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.234386 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj7ng\" (UniqueName: \"kubernetes.io/projected/a690f0f0-9fa0-458e-aa8b-05fc7f1113f9-kube-api-access-xj7ng\") pod \"payload-processing-58f86c7798-dqsh4\" (UID: \"a690f0f0-9fa0-458e-aa8b-05fc7f1113f9\") " pod="openshift-ingress/payload-processing-58f86c7798-dqsh4" Jul 07 17:35:57.241192 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.241171 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-2s9fh"] Jul 07 17:35:57.245144 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.245122 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-2s9fh" Jul 07 17:35:57.248843 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.248826 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-8j7hc\"" Jul 07 17:35:57.258804 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.258783 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-2s9fh"] Jul 07 17:35:57.334818 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.334789 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c42tt\" (UniqueName: \"kubernetes.io/projected/66d26bd6-4fdb-424f-8bf1-ede2b36296a6-kube-api-access-c42tt\") pod \"payload-pre-processing-7964457696-2s9fh\" (UID: \"66d26bd6-4fdb-424f-8bf1-ede2b36296a6\") " pod="openshift-ingress/payload-pre-processing-7964457696-2s9fh" Jul 07 17:35:57.334967 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.334856 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66d26bd6-4fdb-424f-8bf1-ede2b36296a6-plugins-config-volume\") pod \"payload-pre-processing-7964457696-2s9fh\" (UID: \"66d26bd6-4fdb-424f-8bf1-ede2b36296a6\") " pod="openshift-ingress/payload-pre-processing-7964457696-2s9fh" Jul 07 17:35:57.334967 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.334920 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a690f0f0-9fa0-458e-aa8b-05fc7f1113f9-plugins-config-volume\") pod \"payload-processing-58f86c7798-dqsh4\" (UID: \"a690f0f0-9fa0-458e-aa8b-05fc7f1113f9\") " pod="openshift-ingress/payload-processing-58f86c7798-dqsh4" Jul 07 17:35:57.335065 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.334968 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj7ng\" (UniqueName: \"kubernetes.io/projected/a690f0f0-9fa0-458e-aa8b-05fc7f1113f9-kube-api-access-xj7ng\") pod \"payload-processing-58f86c7798-dqsh4\" (UID: \"a690f0f0-9fa0-458e-aa8b-05fc7f1113f9\") " pod="openshift-ingress/payload-processing-58f86c7798-dqsh4" Jul 07 17:35:57.335771 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.335745 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a690f0f0-9fa0-458e-aa8b-05fc7f1113f9-plugins-config-volume\") pod \"payload-processing-58f86c7798-dqsh4\" (UID: \"a690f0f0-9fa0-458e-aa8b-05fc7f1113f9\") " pod="openshift-ingress/payload-processing-58f86c7798-dqsh4" Jul 07 17:35:57.349075 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.349044 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj7ng\" (UniqueName: \"kubernetes.io/projected/a690f0f0-9fa0-458e-aa8b-05fc7f1113f9-kube-api-access-xj7ng\") pod \"payload-processing-58f86c7798-dqsh4\" (UID: \"a690f0f0-9fa0-458e-aa8b-05fc7f1113f9\") " pod="openshift-ingress/payload-processing-58f86c7798-dqsh4" Jul 07 17:35:57.435998 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.435959 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c42tt\" (UniqueName: \"kubernetes.io/projected/66d26bd6-4fdb-424f-8bf1-ede2b36296a6-kube-api-access-c42tt\") pod \"payload-pre-processing-7964457696-2s9fh\" (UID: \"66d26bd6-4fdb-424f-8bf1-ede2b36296a6\") " pod="openshift-ingress/payload-pre-processing-7964457696-2s9fh" Jul 07 17:35:57.436132 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.436018 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66d26bd6-4fdb-424f-8bf1-ede2b36296a6-plugins-config-volume\") pod \"payload-pre-processing-7964457696-2s9fh\" (UID: \"66d26bd6-4fdb-424f-8bf1-ede2b36296a6\") " pod="openshift-ingress/payload-pre-processing-7964457696-2s9fh" Jul 07 17:35:57.436793 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.436767 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/66d26bd6-4fdb-424f-8bf1-ede2b36296a6-plugins-config-volume\") pod \"payload-pre-processing-7964457696-2s9fh\" (UID: \"66d26bd6-4fdb-424f-8bf1-ede2b36296a6\") " pod="openshift-ingress/payload-pre-processing-7964457696-2s9fh" Jul 07 17:35:57.445361 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.445342 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c42tt\" (UniqueName: \"kubernetes.io/projected/66d26bd6-4fdb-424f-8bf1-ede2b36296a6-kube-api-access-c42tt\") pod \"payload-pre-processing-7964457696-2s9fh\" (UID: \"66d26bd6-4fdb-424f-8bf1-ede2b36296a6\") " pod="openshift-ingress/payload-pre-processing-7964457696-2s9fh" Jul 07 17:35:57.524633 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.524559 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-dqsh4" Jul 07 17:35:57.555204 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.555178 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-2s9fh" Jul 07 17:35:57.681636 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.681613 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-dqsh4"] Jul 07 17:35:57.683457 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:35:57.683419 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda690f0f0_9fa0_458e_aa8b_05fc7f1113f9.slice/crio-940fb7539649bbfc4a709b8e642d9c3468e118d81db306017015b5d5db5d5620 WatchSource:0}: Error finding container 940fb7539649bbfc4a709b8e642d9c3468e118d81db306017015b5d5db5d5620: Status 404 returned error can't find the container with id 940fb7539649bbfc4a709b8e642d9c3468e118d81db306017015b5d5db5d5620 Jul 07 17:35:57.708486 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.708444 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-2s9fh"] Jul 07 17:35:57.710487 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:35:57.710462 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66d26bd6_4fdb_424f_8bf1_ede2b36296a6.slice/crio-87ed98c60987b43004bb1f7f5077eb4a5b0b7b584265fba9f2311afdcddacc29 WatchSource:0}: Error finding container 87ed98c60987b43004bb1f7f5077eb4a5b0b7b584265fba9f2311afdcddacc29: Status 404 returned error can't find the container with id 87ed98c60987b43004bb1f7f5077eb4a5b0b7b584265fba9f2311afdcddacc29 Jul 07 17:35:57.953241 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.953199 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-cc758d988-s9zv4" event={"ID":"e44e9944-fbdd-4321-8249-00add35f0ef9","Type":"ContainerStarted","Data":"8615a4b7789f246e2ff9c47f037cc07cdef5e07877bb0ecfb50b2329a0912f5a"} Jul 07 17:35:57.954825 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.954796 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-2s9fh" event={"ID":"66d26bd6-4fdb-424f-8bf1-ede2b36296a6","Type":"ContainerStarted","Data":"87ed98c60987b43004bb1f7f5077eb4a5b0b7b584265fba9f2311afdcddacc29"} Jul 07 17:35:57.956199 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:57.956113 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-dqsh4" event={"ID":"a690f0f0-9fa0-458e-aa8b-05fc7f1113f9","Type":"ContainerStarted","Data":"940fb7539649bbfc4a709b8e642d9c3468e118d81db306017015b5d5db5d5620"} Jul 07 17:35:59.970321 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:59.970286 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-cc758d988-s9zv4" event={"ID":"e44e9944-fbdd-4321-8249-00add35f0ef9","Type":"ContainerStarted","Data":"83f8782fb5046c56c436af83a51c50b151c2456db768242bae87e301e69547c5"} Jul 07 17:35:59.970718 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:59.970692 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-cc758d988-s9zv4" Jul 07 17:35:59.972384 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:59.972352 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-2s9fh" event={"ID":"66d26bd6-4fdb-424f-8bf1-ede2b36296a6","Type":"ContainerStarted","Data":"823b20b52e9f59b60c7f3e4008601e8c0cbe45821f7de8b2d9bf7176ac991b0d"} Jul 07 17:35:59.972480 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:59.972441 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-2s9fh" Jul 07 17:35:59.973594 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:59.973571 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-dqsh4" event={"ID":"a690f0f0-9fa0-458e-aa8b-05fc7f1113f9","Type":"ContainerStarted","Data":"6ec354b1aa4f35cd6de948c068348f90f73b2af8f8c8301fdfbd0929790e86f6"} Jul 07 17:35:59.973929 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:59.973912 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-dqsh4" Jul 07 17:35:59.994002 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:35:59.993959 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-cc758d988-s9zv4" podStartSLOduration=1.35046511 podStartE2EDuration="3.993943279s" totalImagesPullingTime="2.643478169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:35:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:35:59.992013751 +0000 UTC m=+796.278616881" watchObservedRunningTime="2026-07-07 17:35:59.993943279 +0000 UTC m=+796.280546409" Jul 07 17:36:00.009723 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:00.009658 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-2s9fh" podStartSLOduration=0.949352764 podStartE2EDuration="3.009646553s" totalImagesPullingTime="2.060293789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:35:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:36:00.009160372 +0000 UTC m=+796.295763503" watchObservedRunningTime="2026-07-07 17:36:00.009646553 +0000 UTC m=+796.296249685" Jul 07 17:36:00.029581 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:00.029492 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-dqsh4" podStartSLOduration=0.944630831 podStartE2EDuration="3.029474416s" totalImagesPullingTime="2.084843585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:35:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:36:00.02632954 +0000 UTC m=+796.312932681" watchObservedRunningTime="2026-07-07 17:36:00.029474416 +0000 UTC m=+796.316077552" Jul 07 17:36:05.002025 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:05.001969 2549 generic.go:356] "Generic (PLEG): container finished" podID="e0409efe-d7ef-4440-8b75-866e3f13d3b3" containerID="0e0c29d8e4f6f64f327ac57bf7754396d49ae61508a19e2ebbc4316d8c49b350" exitCode=0 Jul 07 17:36:05.002527 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:05.002041 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" event={"ID":"e0409efe-d7ef-4440-8b75-866e3f13d3b3","Type":"ContainerDied","Data":"0e0c29d8e4f6f64f327ac57bf7754396d49ae61508a19e2ebbc4316d8c49b350"} Jul 07 17:36:05.002527 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:05.002427 2549 scope.go:117] "RemoveContainer" containerID="0e0c29d8e4f6f64f327ac57bf7754396d49ae61508a19e2ebbc4316d8c49b350" Jul 07 17:36:05.003410 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:05.003385 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 17:36:05.003476 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:05.003450 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 17:36:05.003528 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:05.003482 2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 07 17:36:05.984122 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:05.984092 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-cc758d988-s9zv4" Jul 07 17:36:06.009939 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:06.009912 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" event={"ID":"e0409efe-d7ef-4440-8b75-866e3f13d3b3","Type":"ContainerStarted","Data":"2dc184873f3b4b7f911b7b6956c00a7636aef91e7d9bbbf73c6ab593952c77fe"} Jul 07 17:36:06.370265 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:06.370170 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:36:06.371522 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:06.371483 2549 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-r8jvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 07 17:36:06.371644 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:06.371555 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" podUID="e0409efe-d7ef-4440-8b75-866e3f13d3b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 07 17:36:07.370079 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:07.370044 2549 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-r8jvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 07 17:36:07.370450 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:07.370109 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" podUID="e0409efe-d7ef-4440-8b75-866e3f13d3b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 07 17:36:08.370652 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:08.370610 2549 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-r8jvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 07 17:36:08.371181 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:08.370687 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" podUID="e0409efe-d7ef-4440-8b75-866e3f13d3b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 07 17:36:09.370739 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:09.370704 2549 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-r8jvh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 07 17:36:09.371114 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:09.370758 2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" podUID="e0409efe-d7ef-4440-8b75-866e3f13d3b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 07 17:36:09.456036 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:09.456005 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:36:10.373458 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:10.373429 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:36:10.374548 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:10.374523 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r8jvh" Jul 07 17:36:10.980615 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:10.980586 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-2s9fh" Jul 07 17:36:11.986194 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:11.986165 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-dqsh4" Jul 07 17:36:19.296834 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:19.296802 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d"] Jul 07 17:36:19.299480 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:19.299459 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d" Jul 07 17:36:19.302159 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:19.302142 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 07 17:36:19.303322 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:19.303303 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bl7jx\"" Jul 07 17:36:19.303427 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:19.303366 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 07 17:36:19.303427 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:19.303371 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 07 17:36:19.309335 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:19.309310 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d"] Jul 07 17:36:19.442025 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:19.441988 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c837f92-58fb-43eb-9a08-63de8aae2028-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d\" (UID: \"2c837f92-58fb-43eb-9a08-63de8aae2028\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d" Jul 07 17:36:19.442169 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:19.442142 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c837f92-58fb-43eb-9a08-63de8aae2028-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d\" (UID: \"2c837f92-58fb-43eb-9a08-63de8aae2028\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d" Jul 07 17:36:19.442211 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:19.442171 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c837f92-58fb-43eb-9a08-63de8aae2028-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d\" (UID: \"2c837f92-58fb-43eb-9a08-63de8aae2028\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d" Jul 07 17:36:19.442211 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:19.442198 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c837f92-58fb-43eb-9a08-63de8aae2028-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d\" (UID: \"2c837f92-58fb-43eb-9a08-63de8aae2028\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d" Jul 07 17:36:19.442319 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:19.442245 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfbcc\" (UniqueName: \"kubernetes.io/projected/2c837f92-58fb-43eb-9a08-63de8aae2028-kube-api-access-lfbcc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d\" (UID: \"2c837f92-58fb-43eb-9a08-63de8aae2028\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d" Jul 07 17:36:19.442319 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:19.442274 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c837f92-58fb-43eb-9a08-63de8aae2028-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d\" (UID: \"2c837f92-58fb-43eb-9a08-63de8aae2028\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d" Jul 07 17:36:19.543446 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:19.543415 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c837f92-58fb-43eb-9a08-63de8aae2028-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d\" (UID: \"2c837f92-58fb-43eb-9a08-63de8aae2028\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d" Jul 07 17:36:19.543446 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:19.543448 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c837f92-58fb-43eb-9a08-63de8aae2028-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d\" (UID: \"2c837f92-58fb-43eb-9a08-63de8aae2028\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d" Jul 07 17:36:19.543705 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:19.543579 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c837f92-58fb-43eb-9a08-63de8aae2028-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d\" (UID: \"2c837f92-58fb-43eb-9a08-63de8aae2028\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d" Jul 07 17:36:19.543705 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:19.543627 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfbcc\" (UniqueName: \"kubernetes.io/projected/2c837f92-58fb-43eb-9a08-63de8aae2028-kube-api-access-lfbcc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d\" (UID: \"2c837f92-58fb-43eb-9a08-63de8aae2028\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d" Jul 07 17:36:19.543705 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:19.543651 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c837f92-58fb-43eb-9a08-63de8aae2028-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d\" (UID: \"2c837f92-58fb-43eb-9a08-63de8aae2028\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d" Jul 07 17:36:19.543861 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:19.543732 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c837f92-58fb-43eb-9a08-63de8aae2028-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d\" (UID: \"2c837f92-58fb-43eb-9a08-63de8aae2028\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d" Jul 07 17:36:19.543972 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:19.543901 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2c837f92-58fb-43eb-9a08-63de8aae2028-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d\" (UID: \"2c837f92-58fb-43eb-9a08-63de8aae2028\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d" Jul 07 17:36:19.544102 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:19.544083 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2c837f92-58fb-43eb-9a08-63de8aae2028-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d\" (UID: \"2c837f92-58fb-43eb-9a08-63de8aae2028\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d" Jul 07 17:36:19.544185 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:19.544134 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2c837f92-58fb-43eb-9a08-63de8aae2028-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d\" (UID: \"2c837f92-58fb-43eb-9a08-63de8aae2028\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d" Jul 07 17:36:19.546308 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:19.546289 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2c837f92-58fb-43eb-9a08-63de8aae2028-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d\" (UID: \"2c837f92-58fb-43eb-9a08-63de8aae2028\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d" Jul 07 17:36:19.546584 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:19.546566 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2c837f92-58fb-43eb-9a08-63de8aae2028-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d\" (UID: \"2c837f92-58fb-43eb-9a08-63de8aae2028\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d" Jul 07 17:36:19.553453 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:19.553397 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfbcc\" (UniqueName: \"kubernetes.io/projected/2c837f92-58fb-43eb-9a08-63de8aae2028-kube-api-access-lfbcc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d\" (UID: \"2c837f92-58fb-43eb-9a08-63de8aae2028\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d" Jul 07 17:36:19.611751 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:19.611728 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d" Jul 07 17:36:19.745636 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:19.745609 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d"] Jul 07 17:36:19.746562 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:36:19.746529 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c837f92_58fb_43eb_9a08_63de8aae2028.slice/crio-977dd986b297aca7925f68bae39896df7917a15ed3a8f26431bc4489590116d2 WatchSource:0}: Error finding container 977dd986b297aca7925f68bae39896df7917a15ed3a8f26431bc4489590116d2: Status 404 returned error can't find the container with id 977dd986b297aca7925f68bae39896df7917a15ed3a8f26431bc4489590116d2 Jul 07 17:36:20.093590 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:20.093453 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d" event={"ID":"2c837f92-58fb-43eb-9a08-63de8aae2028","Type":"ContainerStarted","Data":"977dd986b297aca7925f68bae39896df7917a15ed3a8f26431bc4489590116d2"} Jul 07 17:36:21.100463 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:21.100379 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d" event={"ID":"2c837f92-58fb-43eb-9a08-63de8aae2028","Type":"ContainerStarted","Data":"f709629963c7859640623e3ebcc1a07f6ba558189d269490e5936198bc2bcba8"} Jul 07 17:36:21.122394 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:21.122343 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d" podStartSLOduration=1.035401984 podStartE2EDuration="2.122324997s" totalImagesPullingTime="1.086923013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:36:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:36:21.120329913 +0000 UTC m=+817.406933044" watchObservedRunningTime="2026-07-07 17:36:21.122324997 +0000 UTC m=+817.408928131" Jul 07 17:36:29.612788 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:29.612754 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d" Jul 07 17:36:29.613305 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:29.612817 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d" Jul 07 17:36:29.629178 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:29.629155 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d" Jul 07 17:36:30.162437 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:30.162408 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d" Jul 07 17:36:34.381484 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:34.381449 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w"] Jul 07 17:36:34.385316 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:34.385295 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w" Jul 07 17:36:34.388220 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:34.388199 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 07 17:36:34.395054 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:34.395030 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w"] Jul 07 17:36:34.563059 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:34.563023 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcwnx\" (UniqueName: \"kubernetes.io/projected/61e5bb64-65d8-4a2a-ad0e-ea9d79033977-kube-api-access-bcwnx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tcp5w\" (UID: \"61e5bb64-65d8-4a2a-ad0e-ea9d79033977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w" Jul 07 17:36:34.563219 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:34.563072 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61e5bb64-65d8-4a2a-ad0e-ea9d79033977-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tcp5w\" (UID: \"61e5bb64-65d8-4a2a-ad0e-ea9d79033977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w" Jul 07 17:36:34.563219 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:34.563113 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61e5bb64-65d8-4a2a-ad0e-ea9d79033977-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tcp5w\" (UID: \"61e5bb64-65d8-4a2a-ad0e-ea9d79033977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w" Jul 07 17:36:34.563219 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:34.563136 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61e5bb64-65d8-4a2a-ad0e-ea9d79033977-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tcp5w\" (UID: \"61e5bb64-65d8-4a2a-ad0e-ea9d79033977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w" Jul 07 17:36:34.563219 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:34.563208 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61e5bb64-65d8-4a2a-ad0e-ea9d79033977-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tcp5w\" (UID: \"61e5bb64-65d8-4a2a-ad0e-ea9d79033977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w" Jul 07 17:36:34.563362 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:34.563239 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61e5bb64-65d8-4a2a-ad0e-ea9d79033977-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tcp5w\" (UID: \"61e5bb64-65d8-4a2a-ad0e-ea9d79033977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w" Jul 07 17:36:34.663729 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:34.663702 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61e5bb64-65d8-4a2a-ad0e-ea9d79033977-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tcp5w\" (UID: \"61e5bb64-65d8-4a2a-ad0e-ea9d79033977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w" Jul 07 17:36:34.663847 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:34.663745 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61e5bb64-65d8-4a2a-ad0e-ea9d79033977-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tcp5w\" (UID: \"61e5bb64-65d8-4a2a-ad0e-ea9d79033977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w" Jul 07 17:36:34.663847 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:34.663764 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcwnx\" (UniqueName: \"kubernetes.io/projected/61e5bb64-65d8-4a2a-ad0e-ea9d79033977-kube-api-access-bcwnx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tcp5w\" (UID: \"61e5bb64-65d8-4a2a-ad0e-ea9d79033977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w" Jul 07 17:36:34.663847 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:34.663809 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61e5bb64-65d8-4a2a-ad0e-ea9d79033977-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tcp5w\" (UID: \"61e5bb64-65d8-4a2a-ad0e-ea9d79033977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w" Jul 07 17:36:34.663847 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:34.663831 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61e5bb64-65d8-4a2a-ad0e-ea9d79033977-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tcp5w\" (UID: \"61e5bb64-65d8-4a2a-ad0e-ea9d79033977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w" Jul 07 17:36:34.664015 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:34.663977 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61e5bb64-65d8-4a2a-ad0e-ea9d79033977-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tcp5w\" (UID: \"61e5bb64-65d8-4a2a-ad0e-ea9d79033977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w" Jul 07 17:36:34.664211 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:34.664183 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61e5bb64-65d8-4a2a-ad0e-ea9d79033977-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tcp5w\" (UID: \"61e5bb64-65d8-4a2a-ad0e-ea9d79033977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w" Jul 07 17:36:34.664348 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:34.664238 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61e5bb64-65d8-4a2a-ad0e-ea9d79033977-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tcp5w\" (UID: \"61e5bb64-65d8-4a2a-ad0e-ea9d79033977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w" Jul 07 17:36:34.664348 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:34.664298 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61e5bb64-65d8-4a2a-ad0e-ea9d79033977-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tcp5w\" (UID: \"61e5bb64-65d8-4a2a-ad0e-ea9d79033977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w" Jul 07 17:36:34.666343 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:34.666324 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61e5bb64-65d8-4a2a-ad0e-ea9d79033977-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tcp5w\" (UID: \"61e5bb64-65d8-4a2a-ad0e-ea9d79033977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w" Jul 07 17:36:34.666592 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:34.666571 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61e5bb64-65d8-4a2a-ad0e-ea9d79033977-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tcp5w\" (UID: \"61e5bb64-65d8-4a2a-ad0e-ea9d79033977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w" Jul 07 17:36:34.674942 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:34.674924 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcwnx\" (UniqueName: \"kubernetes.io/projected/61e5bb64-65d8-4a2a-ad0e-ea9d79033977-kube-api-access-bcwnx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tcp5w\" (UID: \"61e5bb64-65d8-4a2a-ad0e-ea9d79033977\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w" Jul 07 17:36:34.696855 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:34.696838 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w" Jul 07 17:36:34.838856 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:34.838822 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w"] Jul 07 17:36:34.839228 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:36:34.839200 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61e5bb64_65d8_4a2a_ad0e_ea9d79033977.slice/crio-259efa62dff01a391962b4691596b26399c61e316313f3d119860ee01d976ef5 WatchSource:0}: Error finding container 259efa62dff01a391962b4691596b26399c61e316313f3d119860ee01d976ef5: Status 404 returned error can't find the container with id 259efa62dff01a391962b4691596b26399c61e316313f3d119860ee01d976ef5 Jul 07 17:36:35.180625 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:35.180589 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w" event={"ID":"61e5bb64-65d8-4a2a-ad0e-ea9d79033977","Type":"ContainerStarted","Data":"a138388fefaa3b8a20e7bd4878e95868d0c9cd2fb0b1a1aed94181c53d4f6323"} Jul 07 17:36:35.180820 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:35.180650 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w" event={"ID":"61e5bb64-65d8-4a2a-ad0e-ea9d79033977","Type":"ContainerStarted","Data":"259efa62dff01a391962b4691596b26399c61e316313f3d119860ee01d976ef5"} Jul 07 17:36:35.206716 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:35.206663 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w" podStartSLOduration=1.022878209 podStartE2EDuration="1.206646684s" totalImagesPullingTime="183.768475ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:36:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:36:35.204818763 +0000 UTC m=+831.491421896" watchObservedRunningTime="2026-07-07 17:36:35.206646684 +0000 UTC m=+831.493249866" Jul 07 17:36:44.697585 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:44.697555 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w" Jul 07 17:36:44.697992 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:44.697609 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w" Jul 07 17:36:44.710353 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:44.710333 2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w" Jul 07 17:36:45.245844 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:36:45.245817 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tcp5w" Jul 07 17:37:44.176988 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:37:44.176961 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhztd_00383bc5-6090-486b-892b-5be74f96c497/ovn-acl-logging/0.log" Jul 07 17:37:44.178416 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:37:44.178398 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhztd_00383bc5-6090-486b-892b-5be74f96c497/ovn-acl-logging/0.log" Jul 07 17:39:03.680350 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:03.680314 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5f6c869587-nb2jf"] Jul 07 17:39:03.683032 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:03.683009 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f6c869587-nb2jf" Jul 07 17:39:03.695395 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:03.695372 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f6c869587-nb2jf"] Jul 07 17:39:03.806991 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:03.806963 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh4c6\" (UniqueName: \"kubernetes.io/projected/cf7ce3fd-3bdd-420b-be12-7038e461139e-kube-api-access-dh4c6\") pod \"authorino-5f6c869587-nb2jf\" (UID: \"cf7ce3fd-3bdd-420b-be12-7038e461139e\") " pod="kuadrant-system/authorino-5f6c869587-nb2jf" Jul 07 17:39:03.807103 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:03.807044 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cf7ce3fd-3bdd-420b-be12-7038e461139e-tls-cert\") pod \"authorino-5f6c869587-nb2jf\" (UID: \"cf7ce3fd-3bdd-420b-be12-7038e461139e\") " pod="kuadrant-system/authorino-5f6c869587-nb2jf" Jul 07 17:39:03.908361 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:03.908332 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cf7ce3fd-3bdd-420b-be12-7038e461139e-tls-cert\") pod \"authorino-5f6c869587-nb2jf\" (UID: \"cf7ce3fd-3bdd-420b-be12-7038e461139e\") " pod="kuadrant-system/authorino-5f6c869587-nb2jf" Jul 07 17:39:03.908456 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:03.908376 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh4c6\" (UniqueName: \"kubernetes.io/projected/cf7ce3fd-3bdd-420b-be12-7038e461139e-kube-api-access-dh4c6\") pod \"authorino-5f6c869587-nb2jf\" (UID: \"cf7ce3fd-3bdd-420b-be12-7038e461139e\") " pod="kuadrant-system/authorino-5f6c869587-nb2jf" Jul 07 17:39:03.910803 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:03.910782 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cf7ce3fd-3bdd-420b-be12-7038e461139e-tls-cert\") pod \"authorino-5f6c869587-nb2jf\" (UID: \"cf7ce3fd-3bdd-420b-be12-7038e461139e\") " pod="kuadrant-system/authorino-5f6c869587-nb2jf" Jul 07 17:39:03.917365 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:03.917341 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh4c6\" (UniqueName: \"kubernetes.io/projected/cf7ce3fd-3bdd-420b-be12-7038e461139e-kube-api-access-dh4c6\") pod \"authorino-5f6c869587-nb2jf\" (UID: \"cf7ce3fd-3bdd-420b-be12-7038e461139e\") " pod="kuadrant-system/authorino-5f6c869587-nb2jf" Jul 07 17:39:03.992202 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:03.992154 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f6c869587-nb2jf" Jul 07 17:39:04.136570 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:04.136546 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f6c869587-nb2jf"] Jul 07 17:39:04.138059 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:39:04.138033 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf7ce3fd_3bdd_420b_be12_7038e461139e.slice/crio-dda56de1511fa2c5ddb623e532052a5d5138df32bbff1ee9c7a1af87cd754912 WatchSource:0}: Error finding container dda56de1511fa2c5ddb623e532052a5d5138df32bbff1ee9c7a1af87cd754912: Status 404 returned error can't find the container with id dda56de1511fa2c5ddb623e532052a5d5138df32bbff1ee9c7a1af87cd754912 Jul 07 17:39:04.987720 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:04.987681 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f6c869587-nb2jf" event={"ID":"cf7ce3fd-3bdd-420b-be12-7038e461139e","Type":"ContainerStarted","Data":"95145e995ddc3ec9d6e04b912d2977b851207767952aedadf489cd8235af8cf6"} Jul 07 17:39:04.987720 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:04.987733 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f6c869587-nb2jf" event={"ID":"cf7ce3fd-3bdd-420b-be12-7038e461139e","Type":"ContainerStarted","Data":"dda56de1511fa2c5ddb623e532052a5d5138df32bbff1ee9c7a1af87cd754912"} Jul 07 17:39:05.010222 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:05.010164 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5f6c869587-nb2jf" podStartSLOduration=1.5768881430000001 podStartE2EDuration="2.010141816s" totalImagesPullingTime="433.253673ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:39:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:39:05.007789363 +0000 UTC m=+981.294392495" watchObservedRunningTime="2026-07-07 17:39:05.010141816 +0000 UTC m=+981.296744949" Jul 07 17:39:05.051470 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:05.051436 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7dcfb9fdf8-j6crv"] Jul 07 17:39:05.051704 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:05.051675 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7dcfb9fdf8-j6crv" podUID="573b8e46-97ee-4268-ac06-d04135b61761" containerName="authorino" containerID="cri-o://6dcef5f3f4e5e1d32e4331baaac3ea4e571c11a78627d6a8ddff1676ac96761e" gracePeriod=30 Jul 07 17:39:05.314256 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:05.314222 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7dcfb9fdf8-j6crv" Jul 07 17:39:05.424022 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:05.423985 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/573b8e46-97ee-4268-ac06-d04135b61761-tls-cert\") pod \"573b8e46-97ee-4268-ac06-d04135b61761\" (UID: \"573b8e46-97ee-4268-ac06-d04135b61761\") " Jul 07 17:39:05.424210 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:05.424098 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mn85s\" (UniqueName: \"kubernetes.io/projected/573b8e46-97ee-4268-ac06-d04135b61761-kube-api-access-mn85s\") pod \"573b8e46-97ee-4268-ac06-d04135b61761\" (UID: \"573b8e46-97ee-4268-ac06-d04135b61761\") " Jul 07 17:39:05.426220 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:05.426185 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/573b8e46-97ee-4268-ac06-d04135b61761-kube-api-access-mn85s" (OuterVolumeSpecName: "kube-api-access-mn85s") pod "573b8e46-97ee-4268-ac06-d04135b61761" (UID: "573b8e46-97ee-4268-ac06-d04135b61761"). InnerVolumeSpecName "kube-api-access-mn85s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:39:05.437003 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:05.436978 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/573b8e46-97ee-4268-ac06-d04135b61761-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "573b8e46-97ee-4268-ac06-d04135b61761" (UID: "573b8e46-97ee-4268-ac06-d04135b61761"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:39:05.525763 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:05.525723 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mn85s\" (UniqueName: \"kubernetes.io/projected/573b8e46-97ee-4268-ac06-d04135b61761-kube-api-access-mn85s\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:39:05.525763 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:05.525764 2549 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/573b8e46-97ee-4268-ac06-d04135b61761-tls-cert\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:39:05.995043 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:05.995005 2549 generic.go:356] "Generic (PLEG): container finished" podID="573b8e46-97ee-4268-ac06-d04135b61761" containerID="6dcef5f3f4e5e1d32e4331baaac3ea4e571c11a78627d6a8ddff1676ac96761e" exitCode=0 Jul 07 17:39:05.995598 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:05.995066 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7dcfb9fdf8-j6crv" Jul 07 17:39:05.995598 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:05.995106 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7dcfb9fdf8-j6crv" event={"ID":"573b8e46-97ee-4268-ac06-d04135b61761","Type":"ContainerDied","Data":"6dcef5f3f4e5e1d32e4331baaac3ea4e571c11a78627d6a8ddff1676ac96761e"} Jul 07 17:39:05.995598 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:05.995159 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7dcfb9fdf8-j6crv" event={"ID":"573b8e46-97ee-4268-ac06-d04135b61761","Type":"ContainerDied","Data":"bdedd41f6163a82402a16677bc6ea5cd983a8ad7bd689263daedb317aa7ab15e"} Jul 07 17:39:05.995598 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:05.995178 2549 scope.go:117] "RemoveContainer" containerID="6dcef5f3f4e5e1d32e4331baaac3ea4e571c11a78627d6a8ddff1676ac96761e" Jul 07 17:39:06.005616 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:06.005596 2549 scope.go:117] "RemoveContainer" containerID="6dcef5f3f4e5e1d32e4331baaac3ea4e571c11a78627d6a8ddff1676ac96761e" Jul 07 17:39:06.005890 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:39:06.005869 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dcef5f3f4e5e1d32e4331baaac3ea4e571c11a78627d6a8ddff1676ac96761e\": container with ID starting with 6dcef5f3f4e5e1d32e4331baaac3ea4e571c11a78627d6a8ddff1676ac96761e not found: ID does not exist" containerID="6dcef5f3f4e5e1d32e4331baaac3ea4e571c11a78627d6a8ddff1676ac96761e" Jul 07 17:39:06.005957 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:06.005899 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dcef5f3f4e5e1d32e4331baaac3ea4e571c11a78627d6a8ddff1676ac96761e"} err="failed to get container status \"6dcef5f3f4e5e1d32e4331baaac3ea4e571c11a78627d6a8ddff1676ac96761e\": rpc error: code = NotFound desc = could not find container \"6dcef5f3f4e5e1d32e4331baaac3ea4e571c11a78627d6a8ddff1676ac96761e\": container with ID starting with 6dcef5f3f4e5e1d32e4331baaac3ea4e571c11a78627d6a8ddff1676ac96761e not found: ID does not exist" Jul 07 17:39:06.020870 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:06.020845 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7dcfb9fdf8-j6crv"] Jul 07 17:39:06.028603 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:06.028582 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7dcfb9fdf8-j6crv"] Jul 07 17:39:06.221548 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:39:06.221458 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="573b8e46-97ee-4268-ac06-d04135b61761" path="/var/lib/kubelet/pods/573b8e46-97ee-4268-ac06-d04135b61761/volumes" Jul 07 17:40:16.932045 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:16.931982 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8f58f69f-68r84"] Jul 07 17:40:16.932728 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:16.932383 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-8f58f69f-68r84" podUID="c45a15b3-7fe2-44d6-92cb-7f635b70f779" containerName="manager" containerID="cri-o://2b2268ee4e9d2bac622f1d1a97dc8fffea6eec6e03a8b800ca5e811971e9f291" gracePeriod=30 Jul 07 17:40:17.186713 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:17.186662 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f58f69f-68r84" Jul 07 17:40:17.323925 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:17.323897 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c45a15b3-7fe2-44d6-92cb-7f635b70f779-webhook-cert\") pod \"c45a15b3-7fe2-44d6-92cb-7f635b70f779\" (UID: \"c45a15b3-7fe2-44d6-92cb-7f635b70f779\") " Jul 07 17:40:17.324058 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:17.323998 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbkw7\" (UniqueName: \"kubernetes.io/projected/c45a15b3-7fe2-44d6-92cb-7f635b70f779-kube-api-access-lbkw7\") pod \"c45a15b3-7fe2-44d6-92cb-7f635b70f779\" (UID: \"c45a15b3-7fe2-44d6-92cb-7f635b70f779\") " Jul 07 17:40:17.325993 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:17.325964 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c45a15b3-7fe2-44d6-92cb-7f635b70f779-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "c45a15b3-7fe2-44d6-92cb-7f635b70f779" (UID: "c45a15b3-7fe2-44d6-92cb-7f635b70f779"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:40:17.326119 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:17.326097 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c45a15b3-7fe2-44d6-92cb-7f635b70f779-kube-api-access-lbkw7" (OuterVolumeSpecName: "kube-api-access-lbkw7") pod "c45a15b3-7fe2-44d6-92cb-7f635b70f779" (UID: "c45a15b3-7fe2-44d6-92cb-7f635b70f779"). InnerVolumeSpecName "kube-api-access-lbkw7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:40:17.410648 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:17.410621 2549 generic.go:356] "Generic (PLEG): container finished" podID="c45a15b3-7fe2-44d6-92cb-7f635b70f779" containerID="2b2268ee4e9d2bac622f1d1a97dc8fffea6eec6e03a8b800ca5e811971e9f291" exitCode=0 Jul 07 17:40:17.410743 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:17.410670 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f58f69f-68r84" Jul 07 17:40:17.410743 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:17.410704 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f58f69f-68r84" event={"ID":"c45a15b3-7fe2-44d6-92cb-7f635b70f779","Type":"ContainerDied","Data":"2b2268ee4e9d2bac622f1d1a97dc8fffea6eec6e03a8b800ca5e811971e9f291"} Jul 07 17:40:17.410818 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:17.410764 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f58f69f-68r84" event={"ID":"c45a15b3-7fe2-44d6-92cb-7f635b70f779","Type":"ContainerDied","Data":"3b33092e0d2707715e60f3bf9d6a4caf0a8aa5aac5b98faa528e8e53944e60e7"} Jul 07 17:40:17.410818 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:17.410786 2549 scope.go:117] "RemoveContainer" containerID="2b2268ee4e9d2bac622f1d1a97dc8fffea6eec6e03a8b800ca5e811971e9f291" Jul 07 17:40:17.419851 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:17.419833 2549 scope.go:117] "RemoveContainer" containerID="2b2268ee4e9d2bac622f1d1a97dc8fffea6eec6e03a8b800ca5e811971e9f291" Jul 07 17:40:17.420105 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:40:17.420086 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b2268ee4e9d2bac622f1d1a97dc8fffea6eec6e03a8b800ca5e811971e9f291\": container with ID starting with 2b2268ee4e9d2bac622f1d1a97dc8fffea6eec6e03a8b800ca5e811971e9f291 not found: ID does not exist" containerID="2b2268ee4e9d2bac622f1d1a97dc8fffea6eec6e03a8b800ca5e811971e9f291" Jul 07 17:40:17.420169 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:17.420116 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b2268ee4e9d2bac622f1d1a97dc8fffea6eec6e03a8b800ca5e811971e9f291"} err="failed to get container status \"2b2268ee4e9d2bac622f1d1a97dc8fffea6eec6e03a8b800ca5e811971e9f291\": rpc error: code = NotFound desc = could not find container \"2b2268ee4e9d2bac622f1d1a97dc8fffea6eec6e03a8b800ca5e811971e9f291\": container with ID starting with 2b2268ee4e9d2bac622f1d1a97dc8fffea6eec6e03a8b800ca5e811971e9f291 not found: ID does not exist" Jul 07 17:40:17.424813 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:17.424796 2549 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c45a15b3-7fe2-44d6-92cb-7f635b70f779-webhook-cert\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:40:17.424900 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:17.424815 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbkw7\" (UniqueName: \"kubernetes.io/projected/c45a15b3-7fe2-44d6-92cb-7f635b70f779-kube-api-access-lbkw7\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:40:17.433371 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:17.433344 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8f58f69f-68r84"] Jul 07 17:40:17.437356 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:17.437308 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8f58f69f-68r84"] Jul 07 17:40:18.222121 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:18.222022 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c45a15b3-7fe2-44d6-92cb-7f635b70f779" path="/var/lib/kubelet/pods/c45a15b3-7fe2-44d6-92cb-7f635b70f779/volumes" Jul 07 17:40:18.247542 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:18.247496 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8f58f69f-sf2nj"] Jul 07 17:40:18.248160 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:18.248133 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c45a15b3-7fe2-44d6-92cb-7f635b70f779" containerName="manager" Jul 07 17:40:18.248160 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:18.248156 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="c45a15b3-7fe2-44d6-92cb-7f635b70f779" containerName="manager" Jul 07 17:40:18.248362 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:18.248185 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="573b8e46-97ee-4268-ac06-d04135b61761" containerName="authorino" Jul 07 17:40:18.248362 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:18.248194 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="573b8e46-97ee-4268-ac06-d04135b61761" containerName="authorino" Jul 07 17:40:18.248362 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:18.248299 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="573b8e46-97ee-4268-ac06-d04135b61761" containerName="authorino" Jul 07 17:40:18.248362 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:18.248315 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="c45a15b3-7fe2-44d6-92cb-7f635b70f779" containerName="manager" Jul 07 17:40:18.253122 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:18.253100 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f58f69f-sf2nj" Jul 07 17:40:18.257207 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:18.257185 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 07 17:40:18.257341 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:18.257188 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 07 17:40:18.257341 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:18.257245 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-x8wh8\"" Jul 07 17:40:18.261000 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:18.260960 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8f58f69f-sf2nj"] Jul 07 17:40:18.433410 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:18.433383 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvfbd\" (UniqueName: \"kubernetes.io/projected/ae0e6515-3dff-4386-8d44-b51cead2f273-kube-api-access-xvfbd\") pod \"maas-controller-8f58f69f-sf2nj\" (UID: \"ae0e6515-3dff-4386-8d44-b51cead2f273\") " pod="opendatahub/maas-controller-8f58f69f-sf2nj" Jul 07 17:40:18.433579 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:18.433431 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae0e6515-3dff-4386-8d44-b51cead2f273-webhook-cert\") pod \"maas-controller-8f58f69f-sf2nj\" (UID: \"ae0e6515-3dff-4386-8d44-b51cead2f273\") " pod="opendatahub/maas-controller-8f58f69f-sf2nj" Jul 07 17:40:18.534313 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:18.534241 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvfbd\" (UniqueName: \"kubernetes.io/projected/ae0e6515-3dff-4386-8d44-b51cead2f273-kube-api-access-xvfbd\") pod \"maas-controller-8f58f69f-sf2nj\" (UID: \"ae0e6515-3dff-4386-8d44-b51cead2f273\") " pod="opendatahub/maas-controller-8f58f69f-sf2nj" Jul 07 17:40:18.534418 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:18.534358 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae0e6515-3dff-4386-8d44-b51cead2f273-webhook-cert\") pod \"maas-controller-8f58f69f-sf2nj\" (UID: \"ae0e6515-3dff-4386-8d44-b51cead2f273\") " pod="opendatahub/maas-controller-8f58f69f-sf2nj" Jul 07 17:40:18.537024 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:18.537002 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae0e6515-3dff-4386-8d44-b51cead2f273-webhook-cert\") pod \"maas-controller-8f58f69f-sf2nj\" (UID: \"ae0e6515-3dff-4386-8d44-b51cead2f273\") " pod="opendatahub/maas-controller-8f58f69f-sf2nj" Jul 07 17:40:18.544061 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:18.544037 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvfbd\" (UniqueName: \"kubernetes.io/projected/ae0e6515-3dff-4386-8d44-b51cead2f273-kube-api-access-xvfbd\") pod \"maas-controller-8f58f69f-sf2nj\" (UID: \"ae0e6515-3dff-4386-8d44-b51cead2f273\") " pod="opendatahub/maas-controller-8f58f69f-sf2nj" Jul 07 17:40:18.564774 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:18.564753 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8f58f69f-sf2nj" Jul 07 17:40:18.911660 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:18.911633 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8f58f69f-sf2nj"] Jul 07 17:40:18.912267 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:40:18.912240 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae0e6515_3dff_4386_8d44_b51cead2f273.slice/crio-471f0c98c7924a05715ba66072f080a7db881c22ebf266f4e2a3d7692afa0a09 WatchSource:0}: Error finding container 471f0c98c7924a05715ba66072f080a7db881c22ebf266f4e2a3d7692afa0a09: Status 404 returned error can't find the container with id 471f0c98c7924a05715ba66072f080a7db881c22ebf266f4e2a3d7692afa0a09 Jul 07 17:40:19.424999 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:19.424970 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f58f69f-sf2nj" event={"ID":"ae0e6515-3dff-4386-8d44-b51cead2f273","Type":"ContainerStarted","Data":"471f0c98c7924a05715ba66072f080a7db881c22ebf266f4e2a3d7692afa0a09"} Jul 07 17:40:20.431264 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:20.431228 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8f58f69f-sf2nj" event={"ID":"ae0e6515-3dff-4386-8d44-b51cead2f273","Type":"ContainerStarted","Data":"fadd1831755b47b19743f183b28a77f0044f701f730c8a9e58616ff46425b2ff"} Jul 07 17:40:20.431639 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:20.431359 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8f58f69f-sf2nj" Jul 07 17:40:20.450582 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:20.450531 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8f58f69f-sf2nj" podStartSLOduration=1.836789923 podStartE2EDuration="2.450496073s" totalImagesPullingTime="613.70615ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:40:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:40:20.449386708 +0000 UTC m=+1056.735989861" watchObservedRunningTime="2026-07-07 17:40:20.450496073 +0000 UTC m=+1056.737099203" Jul 07 17:40:31.444765 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:40:31.444733 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8f58f69f-sf2nj" Jul 07 17:42:44.213030 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:42:44.213002 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhztd_00383bc5-6090-486b-892b-5be74f96c497/ovn-acl-logging/0.log" Jul 07 17:42:44.218635 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:42:44.218614 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhztd_00383bc5-6090-486b-892b-5be74f96c497/ovn-acl-logging/0.log" Jul 07 17:45:00.184218 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:45:00.184180 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29724105-wlzr4"] Jul 07 17:45:00.187945 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:45:00.187923 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724105-wlzr4" Jul 07 17:45:00.206139 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:45:00.206113 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724105-wlzr4"] Jul 07 17:45:00.304203 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:45:00.304168 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ztxw\" (UniqueName: \"kubernetes.io/projected/1c697725-322c-4265-8c18-4ea2926beb92-kube-api-access-5ztxw\") pod \"maas-api-key-cleanup-29724105-wlzr4\" (UID: \"1c697725-322c-4265-8c18-4ea2926beb92\") " pod="opendatahub/maas-api-key-cleanup-29724105-wlzr4" Jul 07 17:45:00.405373 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:45:00.405336 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ztxw\" (UniqueName: \"kubernetes.io/projected/1c697725-322c-4265-8c18-4ea2926beb92-kube-api-access-5ztxw\") pod \"maas-api-key-cleanup-29724105-wlzr4\" (UID: \"1c697725-322c-4265-8c18-4ea2926beb92\") " pod="opendatahub/maas-api-key-cleanup-29724105-wlzr4" Jul 07 17:45:00.423441 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:45:00.423410 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ztxw\" (UniqueName: \"kubernetes.io/projected/1c697725-322c-4265-8c18-4ea2926beb92-kube-api-access-5ztxw\") pod \"maas-api-key-cleanup-29724105-wlzr4\" (UID: \"1c697725-322c-4265-8c18-4ea2926beb92\") " pod="opendatahub/maas-api-key-cleanup-29724105-wlzr4" Jul 07 17:45:00.498595 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:45:00.498526 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724105-wlzr4" Jul 07 17:45:00.634810 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:45:00.634786 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724105-wlzr4"] Jul 07 17:45:00.636932 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:45:00.636907 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c697725_322c_4265_8c18_4ea2926beb92.slice/crio-4e97e06fd2c5ce6c0744d9103485e8cb8092cea4766c57294d5e3fe4bbc923f1 WatchSource:0}: Error finding container 4e97e06fd2c5ce6c0744d9103485e8cb8092cea4766c57294d5e3fe4bbc923f1: Status 404 returned error can't find the container with id 4e97e06fd2c5ce6c0744d9103485e8cb8092cea4766c57294d5e3fe4bbc923f1 Jul 07 17:45:00.639362 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:45:00.639344 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 17:45:01.038813 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:45:01.038781 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724105-wlzr4" event={"ID":"1c697725-322c-4265-8c18-4ea2926beb92","Type":"ContainerStarted","Data":"4e97e06fd2c5ce6c0744d9103485e8cb8092cea4766c57294d5e3fe4bbc923f1"} Jul 07 17:45:03.052339 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:45:03.052300 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724105-wlzr4" event={"ID":"1c697725-322c-4265-8c18-4ea2926beb92","Type":"ContainerStarted","Data":"7d3bd1b6af1184cc3559433238fdea741c4569ae0d2ed835767fa0b2a5efad48"} Jul 07 17:45:03.073299 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:45:03.073261 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29724105-wlzr4" podStartSLOduration=0.96628396 podStartE2EDuration="3.073247406s" totalImagesPullingTime="2.106963446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:45:03.071423981 +0000 UTC m=+1339.358027113" watchObservedRunningTime="2026-07-07 17:45:03.073247406 +0000 UTC m=+1339.359850538" Jul 07 17:45:04.060448 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:45:04.060414 2549 generic.go:356] "Generic (PLEG): container finished" podID="1c697725-322c-4265-8c18-4ea2926beb92" containerID="7d3bd1b6af1184cc3559433238fdea741c4569ae0d2ed835767fa0b2a5efad48" exitCode=0 Jul 07 17:45:04.060871 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:45:04.060525 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724105-wlzr4" event={"ID":"1c697725-322c-4265-8c18-4ea2926beb92","Type":"ContainerDied","Data":"7d3bd1b6af1184cc3559433238fdea741c4569ae0d2ed835767fa0b2a5efad48"} Jul 07 17:45:05.213218 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:45:05.213195 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724105-wlzr4" Jul 07 17:45:05.353607 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:45:05.353545 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ztxw\" (UniqueName: \"kubernetes.io/projected/1c697725-322c-4265-8c18-4ea2926beb92-kube-api-access-5ztxw\") pod \"1c697725-322c-4265-8c18-4ea2926beb92\" (UID: \"1c697725-322c-4265-8c18-4ea2926beb92\") " Jul 07 17:45:05.355635 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:45:05.355610 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c697725-322c-4265-8c18-4ea2926beb92-kube-api-access-5ztxw" (OuterVolumeSpecName: "kube-api-access-5ztxw") pod "1c697725-322c-4265-8c18-4ea2926beb92" (UID: "1c697725-322c-4265-8c18-4ea2926beb92"). InnerVolumeSpecName "kube-api-access-5ztxw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:45:05.454677 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:45:05.454652 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ztxw\" (UniqueName: \"kubernetes.io/projected/1c697725-322c-4265-8c18-4ea2926beb92-kube-api-access-5ztxw\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:45:06.075821 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:45:06.075785 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724105-wlzr4" event={"ID":"1c697725-322c-4265-8c18-4ea2926beb92","Type":"ContainerDied","Data":"4e97e06fd2c5ce6c0744d9103485e8cb8092cea4766c57294d5e3fe4bbc923f1"} Jul 07 17:45:06.076085 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:45:06.075837 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724105-wlzr4" Jul 07 17:45:06.076085 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:45:06.075841 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e97e06fd2c5ce6c0744d9103485e8cb8092cea4766c57294d5e3fe4bbc923f1" Jul 07 17:46:09.321087 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:46:09.321052 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hxbm"] Jul 07 17:46:09.321596 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:46:09.321449 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c697725-322c-4265-8c18-4ea2926beb92" containerName="cleanup" Jul 07 17:46:09.321596 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:46:09.321460 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c697725-322c-4265-8c18-4ea2926beb92" containerName="cleanup" Jul 07 17:46:09.321596 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:46:09.321565 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c697725-322c-4265-8c18-4ea2926beb92" containerName="cleanup" Jul 07 17:46:09.324651 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:46:09.324633 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hxbm" Jul 07 17:46:09.360088 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:46:09.360062 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-bmq8l\"" Jul 07 17:46:09.435229 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:46:09.435207 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hxbm"] Jul 07 17:46:09.467812 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:46:09.467767 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4lr2\" (UniqueName: \"kubernetes.io/projected/158356ae-a7c1-4a9f-b528-3bff9530cca7-kube-api-access-p4lr2\") pod \"kuadrant-operator-controller-manager-86878c769f-8hxbm\" (UID: \"158356ae-a7c1-4a9f-b528-3bff9530cca7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hxbm" Jul 07 17:46:09.467971 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:46:09.467904 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/158356ae-a7c1-4a9f-b528-3bff9530cca7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8hxbm\" (UID: \"158356ae-a7c1-4a9f-b528-3bff9530cca7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hxbm" Jul 07 17:46:09.568887 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:46:09.568855 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/158356ae-a7c1-4a9f-b528-3bff9530cca7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8hxbm\" (UID: \"158356ae-a7c1-4a9f-b528-3bff9530cca7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hxbm" Jul 07 17:46:09.569051 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:46:09.568893 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4lr2\" (UniqueName: \"kubernetes.io/projected/158356ae-a7c1-4a9f-b528-3bff9530cca7-kube-api-access-p4lr2\") pod \"kuadrant-operator-controller-manager-86878c769f-8hxbm\" (UID: \"158356ae-a7c1-4a9f-b528-3bff9530cca7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hxbm" Jul 07 17:46:09.569267 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:46:09.569246 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/158356ae-a7c1-4a9f-b528-3bff9530cca7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8hxbm\" (UID: \"158356ae-a7c1-4a9f-b528-3bff9530cca7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hxbm" Jul 07 17:46:09.582681 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:46:09.582617 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4lr2\" (UniqueName: \"kubernetes.io/projected/158356ae-a7c1-4a9f-b528-3bff9530cca7-kube-api-access-p4lr2\") pod \"kuadrant-operator-controller-manager-86878c769f-8hxbm\" (UID: \"158356ae-a7c1-4a9f-b528-3bff9530cca7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hxbm" Jul 07 17:46:09.634590 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:46:09.634562 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hxbm" Jul 07 17:46:09.776330 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:46:09.776309 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hxbm"] Jul 07 17:46:09.778692 ip-10-0-136-69 kubenswrapper[2549]: W0707 17:46:09.778662 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod158356ae_a7c1_4a9f_b528_3bff9530cca7.slice/crio-ad5aaba59bdad6c34089a920684ac58b5b08a58904d6eb9ec4014f69d345791e WatchSource:0}: Error finding container ad5aaba59bdad6c34089a920684ac58b5b08a58904d6eb9ec4014f69d345791e: Status 404 returned error can't find the container with id ad5aaba59bdad6c34089a920684ac58b5b08a58904d6eb9ec4014f69d345791e Jul 07 17:46:10.452053 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:46:10.452016 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hxbm" event={"ID":"158356ae-a7c1-4a9f-b528-3bff9530cca7","Type":"ContainerStarted","Data":"d669b1e03c69c0c518395d303fee0b4c28caca57e599e2370965c767144b4666"} Jul 07 17:46:10.452397 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:46:10.452079 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hxbm" Jul 07 17:46:10.452397 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:46:10.452101 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hxbm" event={"ID":"158356ae-a7c1-4a9f-b528-3bff9530cca7","Type":"ContainerStarted","Data":"ad5aaba59bdad6c34089a920684ac58b5b08a58904d6eb9ec4014f69d345791e"} Jul 07 17:46:10.477477 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:46:10.477385 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hxbm" podStartSLOduration=1.477372775 podStartE2EDuration="1.477372775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:46:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:46:10.476239616 +0000 UTC m=+1406.762842746" watchObservedRunningTime="2026-07-07 17:46:10.477372775 +0000 UTC m=+1406.763975905" Jul 07 17:46:21.461867 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:46:21.461832 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8hxbm" Jul 07 17:47:44.256789 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:47:44.256673 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhztd_00383bc5-6090-486b-892b-5be74f96c497/ovn-acl-logging/0.log" Jul 07 17:47:44.261894 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:47:44.261869 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhztd_00383bc5-6090-486b-892b-5be74f96c497/ovn-acl-logging/0.log" Jul 07 17:49:27.941163 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:27.941120 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8b778bf9d-zb28c"] Jul 07 17:49:52.963222 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:52.963171 2549 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8b778bf9d-zb28c" podUID="f7a044a4-fd75-476f-8958-aa43183aecb7" containerName="console" containerID="cri-o://3b0454b1917bc9c2808361d7b7810702c40daf7a5334f15a9cbd82da923ae7c0" gracePeriod=15 Jul 07 17:49:53.237321 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.237281 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:49:53.296456 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.296409 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f7a044a4-fd75-476f-8958-aa43183aecb7-oauth-serving-cert\") pod \"f7a044a4-fd75-476f-8958-aa43183aecb7\" (UID: \"f7a044a4-fd75-476f-8958-aa43183aecb7\") " Jul 07 17:49:53.296456 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.296462 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f7a044a4-fd75-476f-8958-aa43183aecb7-console-config\") pod \"f7a044a4-fd75-476f-8958-aa43183aecb7\" (UID: \"f7a044a4-fd75-476f-8958-aa43183aecb7\") " Jul 07 17:49:53.296714 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.296649 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f7a044a4-fd75-476f-8958-aa43183aecb7-service-ca\") pod \"f7a044a4-fd75-476f-8958-aa43183aecb7\" (UID: \"f7a044a4-fd75-476f-8958-aa43183aecb7\") " Jul 07 17:49:53.296774 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.296711 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7a044a4-fd75-476f-8958-aa43183aecb7-trusted-ca-bundle\") pod \"f7a044a4-fd75-476f-8958-aa43183aecb7\" (UID: \"f7a044a4-fd75-476f-8958-aa43183aecb7\") " Jul 07 17:49:53.296774 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.296756 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f7a044a4-fd75-476f-8958-aa43183aecb7-console-oauth-config\") pod \"f7a044a4-fd75-476f-8958-aa43183aecb7\" (UID: \"f7a044a4-fd75-476f-8958-aa43183aecb7\") " Jul 07 17:49:53.296878 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.296787 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffbt4\" (UniqueName: \"kubernetes.io/projected/f7a044a4-fd75-476f-8958-aa43183aecb7-kube-api-access-ffbt4\") pod \"f7a044a4-fd75-476f-8958-aa43183aecb7\" (UID: \"f7a044a4-fd75-476f-8958-aa43183aecb7\") " Jul 07 17:49:53.296878 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.296832 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f7a044a4-fd75-476f-8958-aa43183aecb7-console-serving-cert\") pod \"f7a044a4-fd75-476f-8958-aa43183aecb7\" (UID: \"f7a044a4-fd75-476f-8958-aa43183aecb7\") " Jul 07 17:49:53.296965 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.296917 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7a044a4-fd75-476f-8958-aa43183aecb7-console-config" (OuterVolumeSpecName: "console-config") pod "f7a044a4-fd75-476f-8958-aa43183aecb7" (UID: "f7a044a4-fd75-476f-8958-aa43183aecb7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 17:49:53.296965 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.296926 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7a044a4-fd75-476f-8958-aa43183aecb7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f7a044a4-fd75-476f-8958-aa43183aecb7" (UID: "f7a044a4-fd75-476f-8958-aa43183aecb7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 17:49:53.297079 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.296994 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7a044a4-fd75-476f-8958-aa43183aecb7-service-ca" (OuterVolumeSpecName: "service-ca") pod "f7a044a4-fd75-476f-8958-aa43183aecb7" (UID: "f7a044a4-fd75-476f-8958-aa43183aecb7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 17:49:53.297251 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.297225 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7a044a4-fd75-476f-8958-aa43183aecb7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f7a044a4-fd75-476f-8958-aa43183aecb7" (UID: "f7a044a4-fd75-476f-8958-aa43183aecb7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 17:49:53.297334 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.297316 2549 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f7a044a4-fd75-476f-8958-aa43183aecb7-oauth-serving-cert\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:49:53.297378 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.297341 2549 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f7a044a4-fd75-476f-8958-aa43183aecb7-console-config\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:49:53.297378 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.297356 2549 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f7a044a4-fd75-476f-8958-aa43183aecb7-service-ca\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:49:53.299286 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.299253 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7a044a4-fd75-476f-8958-aa43183aecb7-kube-api-access-ffbt4" (OuterVolumeSpecName: "kube-api-access-ffbt4") pod "f7a044a4-fd75-476f-8958-aa43183aecb7" (UID: "f7a044a4-fd75-476f-8958-aa43183aecb7"). InnerVolumeSpecName "kube-api-access-ffbt4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 17:49:53.299286 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.299256 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7a044a4-fd75-476f-8958-aa43183aecb7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f7a044a4-fd75-476f-8958-aa43183aecb7" (UID: "f7a044a4-fd75-476f-8958-aa43183aecb7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:49:53.299440 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.299292 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7a044a4-fd75-476f-8958-aa43183aecb7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f7a044a4-fd75-476f-8958-aa43183aecb7" (UID: "f7a044a4-fd75-476f-8958-aa43183aecb7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 17:49:53.398098 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.398060 2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7a044a4-fd75-476f-8958-aa43183aecb7-trusted-ca-bundle\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:49:53.398098 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.398092 2549 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f7a044a4-fd75-476f-8958-aa43183aecb7-console-oauth-config\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:49:53.398098 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.398102 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffbt4\" (UniqueName: \"kubernetes.io/projected/f7a044a4-fd75-476f-8958-aa43183aecb7-kube-api-access-ffbt4\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:49:53.398411 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.398114 2549 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f7a044a4-fd75-476f-8958-aa43183aecb7-console-serving-cert\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 17:49:53.799719 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.799684 2549 generic.go:356] "Generic (PLEG): container finished" podID="f7a044a4-fd75-476f-8958-aa43183aecb7" containerID="3b0454b1917bc9c2808361d7b7810702c40daf7a5334f15a9cbd82da923ae7c0" exitCode=0 Jul 07 17:49:53.799948 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.799734 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b778bf9d-zb28c" Jul 07 17:49:53.799948 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.799782 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b778bf9d-zb28c" event={"ID":"f7a044a4-fd75-476f-8958-aa43183aecb7","Type":"ContainerDied","Data":"3b0454b1917bc9c2808361d7b7810702c40daf7a5334f15a9cbd82da923ae7c0"} Jul 07 17:49:53.799948 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.799843 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b778bf9d-zb28c" event={"ID":"f7a044a4-fd75-476f-8958-aa43183aecb7","Type":"ContainerDied","Data":"0a9c4b36f78b6e70cde00d9683ddc68cddb981cfdcaf2690ca2feebcf75e099d"} Jul 07 17:49:53.799948 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.799873 2549 scope.go:117] "RemoveContainer" containerID="3b0454b1917bc9c2808361d7b7810702c40daf7a5334f15a9cbd82da923ae7c0" Jul 07 17:49:53.810912 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.810890 2549 scope.go:117] "RemoveContainer" containerID="3b0454b1917bc9c2808361d7b7810702c40daf7a5334f15a9cbd82da923ae7c0" Jul 07 17:49:53.811237 ip-10-0-136-69 kubenswrapper[2549]: E0707 17:49:53.811214 2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b0454b1917bc9c2808361d7b7810702c40daf7a5334f15a9cbd82da923ae7c0\": container with ID starting with 3b0454b1917bc9c2808361d7b7810702c40daf7a5334f15a9cbd82da923ae7c0 not found: ID does not exist" containerID="3b0454b1917bc9c2808361d7b7810702c40daf7a5334f15a9cbd82da923ae7c0" Jul 07 17:49:53.811315 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.811244 2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b0454b1917bc9c2808361d7b7810702c40daf7a5334f15a9cbd82da923ae7c0"} err="failed to get container status \"3b0454b1917bc9c2808361d7b7810702c40daf7a5334f15a9cbd82da923ae7c0\": rpc error: code = NotFound desc = could not find container \"3b0454b1917bc9c2808361d7b7810702c40daf7a5334f15a9cbd82da923ae7c0\": container with ID starting with 3b0454b1917bc9c2808361d7b7810702c40daf7a5334f15a9cbd82da923ae7c0 not found: ID does not exist" Jul 07 17:49:53.824604 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.824572 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8b778bf9d-zb28c"] Jul 07 17:49:53.828778 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:53.828748 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8b778bf9d-zb28c"] Jul 07 17:49:54.222468 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:49:54.222428 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7a044a4-fd75-476f-8958-aa43183aecb7" path="/var/lib/kubelet/pods/f7a044a4-fd75-476f-8958-aa43183aecb7/volumes" Jul 07 17:52:44.294709 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:52:44.294595 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhztd_00383bc5-6090-486b-892b-5be74f96c497/ovn-acl-logging/0.log" Jul 07 17:52:44.301865 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:52:44.301687 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhztd_00383bc5-6090-486b-892b-5be74f96c497/ovn-acl-logging/0.log" Jul 07 17:57:44.334498 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:57:44.334378 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhztd_00383bc5-6090-486b-892b-5be74f96c497/ovn-acl-logging/0.log" Jul 07 17:57:44.343192 ip-10-0-136-69 kubenswrapper[2549]: I0707 17:57:44.343167 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhztd_00383bc5-6090-486b-892b-5be74f96c497/ovn-acl-logging/0.log" Jul 07 18:00:00.152146 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:00.152107 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-f629b8-29724120-ss846"] Jul 07 18:00:00.153392 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:00.153359 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7a044a4-fd75-476f-8958-aa43183aecb7" containerName="console" Jul 07 18:00:00.153392 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:00.153392 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7a044a4-fd75-476f-8958-aa43183aecb7" containerName="console" Jul 07 18:00:00.153663 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:00.153479 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7a044a4-fd75-476f-8958-aa43183aecb7" containerName="console" Jul 07 18:00:00.157039 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:00.157014 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-f629b8-29724120-ss846" Jul 07 18:00:00.159923 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:00.159893 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29724120-kgpqm"] Jul 07 18:00:00.163641 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:00.163617 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724120-kgpqm" Jul 07 18:00:00.169254 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:00.169221 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-f629b8-29724120-ss846"] Jul 07 18:00:00.188161 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:00.188110 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724120-kgpqm"] Jul 07 18:00:00.198314 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:00.198281 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx5zb\" (UniqueName: \"kubernetes.io/projected/19b02943-da55-4c0a-bdbf-64faf3c36c60-kube-api-access-rx5zb\") pod \"maas-api-key-cleanup-29724120-kgpqm\" (UID: \"19b02943-da55-4c0a-bdbf-64faf3c36c60\") " pod="opendatahub/maas-api-key-cleanup-29724120-kgpqm" Jul 07 18:00:00.198547 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:00.198331 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr6dh\" (UniqueName: \"kubernetes.io/projected/69f2ec56-1f89-465b-b663-7c327bf76352-kube-api-access-vr6dh\") pod \"maas-api-key-cleanup-e2e-inf-a-f629b8-29724120-ss846\" (UID: \"69f2ec56-1f89-465b-b663-7c327bf76352\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-f629b8-29724120-ss846" Jul 07 18:00:00.299399 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:00.299353 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx5zb\" (UniqueName: \"kubernetes.io/projected/19b02943-da55-4c0a-bdbf-64faf3c36c60-kube-api-access-rx5zb\") pod \"maas-api-key-cleanup-29724120-kgpqm\" (UID: \"19b02943-da55-4c0a-bdbf-64faf3c36c60\") " pod="opendatahub/maas-api-key-cleanup-29724120-kgpqm" Jul 07 18:00:00.299673 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:00.299431 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr6dh\" (UniqueName: \"kubernetes.io/projected/69f2ec56-1f89-465b-b663-7c327bf76352-kube-api-access-vr6dh\") pod \"maas-api-key-cleanup-e2e-inf-a-f629b8-29724120-ss846\" (UID: \"69f2ec56-1f89-465b-b663-7c327bf76352\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-f629b8-29724120-ss846" Jul 07 18:00:00.311021 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:00.310993 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr6dh\" (UniqueName: \"kubernetes.io/projected/69f2ec56-1f89-465b-b663-7c327bf76352-kube-api-access-vr6dh\") pod \"maas-api-key-cleanup-e2e-inf-a-f629b8-29724120-ss846\" (UID: \"69f2ec56-1f89-465b-b663-7c327bf76352\") " pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-f629b8-29724120-ss846" Jul 07 18:00:00.311198 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:00.310993 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx5zb\" (UniqueName: \"kubernetes.io/projected/19b02943-da55-4c0a-bdbf-64faf3c36c60-kube-api-access-rx5zb\") pod \"maas-api-key-cleanup-29724120-kgpqm\" (UID: \"19b02943-da55-4c0a-bdbf-64faf3c36c60\") " pod="opendatahub/maas-api-key-cleanup-29724120-kgpqm" Jul 07 18:00:00.472646 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:00.472552 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-f629b8-29724120-ss846" Jul 07 18:00:00.479796 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:00.479769 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724120-kgpqm" Jul 07 18:00:00.643596 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:00.643485 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-f629b8-29724120-ss846"] Jul 07 18:00:00.645585 ip-10-0-136-69 kubenswrapper[2549]: W0707 18:00:00.645546 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69f2ec56_1f89_465b_b663_7c327bf76352.slice/crio-b8f08a0df79583ff919967cfcbaa9c3406f35926ff966ae9c4b2f7b6e047369d WatchSource:0}: Error finding container b8f08a0df79583ff919967cfcbaa9c3406f35926ff966ae9c4b2f7b6e047369d: Status 404 returned error can't find the container with id b8f08a0df79583ff919967cfcbaa9c3406f35926ff966ae9c4b2f7b6e047369d Jul 07 18:00:00.674036 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:00.674009 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724120-kgpqm"] Jul 07 18:00:00.687881 ip-10-0-136-69 kubenswrapper[2549]: W0707 18:00:00.687847 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19b02943_da55_4c0a_bdbf_64faf3c36c60.slice/crio-61601de584078671ad2ad6a62f08d9a50abf35f88c07f10a98b53cdbc7597560 WatchSource:0}: Error finding container 61601de584078671ad2ad6a62f08d9a50abf35f88c07f10a98b53cdbc7597560: Status 404 returned error can't find the container with id 61601de584078671ad2ad6a62f08d9a50abf35f88c07f10a98b53cdbc7597560 Jul 07 18:00:01.469596 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:01.469553 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724120-kgpqm" event={"ID":"19b02943-da55-4c0a-bdbf-64faf3c36c60","Type":"ContainerStarted","Data":"598eabb2e3f0611afdd7d4b6edd0df133e91b5924f5e6f0fe24ba463a8c43bb8"} Jul 07 18:00:01.470085 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:01.469627 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724120-kgpqm" event={"ID":"19b02943-da55-4c0a-bdbf-64faf3c36c60","Type":"ContainerStarted","Data":"61601de584078671ad2ad6a62f08d9a50abf35f88c07f10a98b53cdbc7597560"} Jul 07 18:00:01.471148 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:01.471122 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-f629b8-29724120-ss846" event={"ID":"69f2ec56-1f89-465b-b663-7c327bf76352","Type":"ContainerStarted","Data":"37336ca2c1b643a982a1c507426143767245cd98ffcd04a3b2c04a110653d137"} Jul 07 18:00:01.471268 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:01.471170 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-f629b8-29724120-ss846" event={"ID":"69f2ec56-1f89-465b-b663-7c327bf76352","Type":"ContainerStarted","Data":"b8f08a0df79583ff919967cfcbaa9c3406f35926ff966ae9c4b2f7b6e047369d"} Jul 07 18:00:01.495858 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:01.495795 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29724120-kgpqm" podStartSLOduration=1.495775211 podStartE2EDuration="1.495775211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:00:01.494705135 +0000 UTC m=+2237.781308265" watchObservedRunningTime="2026-07-07 18:00:01.495775211 +0000 UTC m=+2237.782378341" Jul 07 18:00:01.516430 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:01.516373 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-f629b8-29724120-ss846" podStartSLOduration=1.516357673 podStartE2EDuration="1.516357673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:00:01.514015219 +0000 UTC m=+2237.800618350" watchObservedRunningTime="2026-07-07 18:00:01.516357673 +0000 UTC m=+2237.802960804" Jul 07 18:00:02.479255 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:02.479222 2549 generic.go:356] "Generic (PLEG): container finished" podID="19b02943-da55-4c0a-bdbf-64faf3c36c60" containerID="598eabb2e3f0611afdd7d4b6edd0df133e91b5924f5e6f0fe24ba463a8c43bb8" exitCode=0 Jul 07 18:00:02.479776 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:02.479312 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724120-kgpqm" event={"ID":"19b02943-da55-4c0a-bdbf-64faf3c36c60","Type":"ContainerDied","Data":"598eabb2e3f0611afdd7d4b6edd0df133e91b5924f5e6f0fe24ba463a8c43bb8"} Jul 07 18:00:02.481287 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:02.481255 2549 generic.go:356] "Generic (PLEG): container finished" podID="69f2ec56-1f89-465b-b663-7c327bf76352" containerID="37336ca2c1b643a982a1c507426143767245cd98ffcd04a3b2c04a110653d137" exitCode=0 Jul 07 18:00:02.481416 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:02.481299 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-f629b8-29724120-ss846" event={"ID":"69f2ec56-1f89-465b-b663-7c327bf76352","Type":"ContainerDied","Data":"37336ca2c1b643a982a1c507426143767245cd98ffcd04a3b2c04a110653d137"} Jul 07 18:00:03.195171 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:03.195129 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-f629b8-29724120-ss846"] Jul 07 18:00:03.650478 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:03.650438 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724120-kgpqm" Jul 07 18:00:03.653749 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:03.653723 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-f629b8-29724120-ss846" Jul 07 18:00:03.738198 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:03.738158 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rx5zb\" (UniqueName: \"kubernetes.io/projected/19b02943-da55-4c0a-bdbf-64faf3c36c60-kube-api-access-rx5zb\") pod \"19b02943-da55-4c0a-bdbf-64faf3c36c60\" (UID: \"19b02943-da55-4c0a-bdbf-64faf3c36c60\") " Jul 07 18:00:03.738384 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:03.738304 2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vr6dh\" (UniqueName: \"kubernetes.io/projected/69f2ec56-1f89-465b-b663-7c327bf76352-kube-api-access-vr6dh\") pod \"69f2ec56-1f89-465b-b663-7c327bf76352\" (UID: \"69f2ec56-1f89-465b-b663-7c327bf76352\") " Jul 07 18:00:03.740755 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:03.740671 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19b02943-da55-4c0a-bdbf-64faf3c36c60-kube-api-access-rx5zb" (OuterVolumeSpecName: "kube-api-access-rx5zb") pod "19b02943-da55-4c0a-bdbf-64faf3c36c60" (UID: "19b02943-da55-4c0a-bdbf-64faf3c36c60"). InnerVolumeSpecName "kube-api-access-rx5zb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:00:03.740755 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:03.740721 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69f2ec56-1f89-465b-b663-7c327bf76352-kube-api-access-vr6dh" (OuterVolumeSpecName: "kube-api-access-vr6dh") pod "69f2ec56-1f89-465b-b663-7c327bf76352" (UID: "69f2ec56-1f89-465b-b663-7c327bf76352"). InnerVolumeSpecName "kube-api-access-vr6dh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 18:00:03.839367 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:03.839323 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rx5zb\" (UniqueName: \"kubernetes.io/projected/19b02943-da55-4c0a-bdbf-64faf3c36c60-kube-api-access-rx5zb\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 18:00:03.839367 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:03.839362 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vr6dh\" (UniqueName: \"kubernetes.io/projected/69f2ec56-1f89-465b-b663-7c327bf76352-kube-api-access-vr6dh\") on node \"ip-10-0-136-69.ec2.internal\" DevicePath \"\"" Jul 07 18:00:04.495154 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:04.495064 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724120-kgpqm" Jul 07 18:00:04.495154 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:04.495089 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724120-kgpqm" event={"ID":"19b02943-da55-4c0a-bdbf-64faf3c36c60","Type":"ContainerDied","Data":"61601de584078671ad2ad6a62f08d9a50abf35f88c07f10a98b53cdbc7597560"} Jul 07 18:00:04.495154 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:04.495144 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="61601de584078671ad2ad6a62f08d9a50abf35f88c07f10a98b53cdbc7597560" Jul 07 18:00:04.496644 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:04.496623 2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-f629b8-29724120-ss846" Jul 07 18:00:04.496775 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:04.496668 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-inf-a-f629b8-29724120-ss846" event={"ID":"69f2ec56-1f89-465b-b663-7c327bf76352","Type":"ContainerDied","Data":"b8f08a0df79583ff919967cfcbaa9c3406f35926ff966ae9c4b2f7b6e047369d"} Jul 07 18:00:04.496775 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:04.496716 2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b8f08a0df79583ff919967cfcbaa9c3406f35926ff966ae9c4b2f7b6e047369d" Jul 07 18:00:04.560362 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:04.560315 2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-f629b8-29724120-ss846"] Jul 07 18:00:04.566643 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:04.566610 2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-inf-a-f629b8-29724120-ss846"] Jul 07 18:00:06.221231 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:00:06.221195 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69f2ec56-1f89-465b-b663-7c327bf76352" path="/var/lib/kubelet/pods/69f2ec56-1f89-465b-b663-7c327bf76352/volumes" Jul 07 18:02:44.375332 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:02:44.375216 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhztd_00383bc5-6090-486b-892b-5be74f96c497/ovn-acl-logging/0.log" Jul 07 18:02:44.387051 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:02:44.387024 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhztd_00383bc5-6090-486b-892b-5be74f96c497/ovn-acl-logging/0.log" Jul 07 18:06:46.117554 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:06:46.117493 2549 scope.go:117] "RemoveContainer" containerID="37336ca2c1b643a982a1c507426143767245cd98ffcd04a3b2c04a110653d137" Jul 07 18:07:44.413709 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:07:44.413686 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhztd_00383bc5-6090-486b-892b-5be74f96c497/ovn-acl-logging/0.log" Jul 07 18:07:44.426796 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:07:44.426777 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mhztd_00383bc5-6090-486b-892b-5be74f96c497/ovn-acl-logging/0.log" Jul 07 18:08:41.326609 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:41.326574 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f6c869587-nb2jf_cf7ce3fd-3bdd-420b-be12-7038e461139e/authorino/0.log" Jul 07 18:08:46.148845 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:46.148812 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-65ttp_b907a354-14a3-4d57-85fa-489b69bc5b06/manager/0.log" Jul 07 18:08:46.283490 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:46.283465 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-s9ck9_df14c52c-ad9f-413b-9970-d47edada55e3/manager/0.log" Jul 07 18:08:46.417992 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:46.417922 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-cc758d988-s9zv4_e44e9944-fbdd-4321-8249-00add35f0ef9/maas-api/0.log" Jul 07 18:08:46.550081 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:46.550054 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724105-wlzr4_1c697725-322c-4265-8c18-4ea2926beb92/cleanup/0.log" Jul 07 18:08:46.666751 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:46.666725 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724120-kgpqm_19b02943-da55-4c0a-bdbf-64faf3c36c60/cleanup/0.log" Jul 07 18:08:46.802393 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:46.802332 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8f58f69f-sf2nj_ae0e6515-3dff-4386-8d44-b51cead2f273/manager/0.log" Jul 07 18:08:46.933695 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:46.933668 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-s6vr6_e5f58835-77f9-47af-a421-0a0b3f1b07be/server/0.log" Jul 07 18:08:47.062758 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:47.062684 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jvwsc_65df54e8-14da-49bf-a628-f2b33a8efe30/manager/0.log" Jul 07 18:08:47.350531 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:47.350435 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-684cdbc7fc-d9jtm_df3eaba9-10a0-4478-ade8-eb60b7c495c5/copy-manifests/0.log" Jul 07 18:08:47.364015 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:47.363993 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-684cdbc7fc-d9jtm_df3eaba9-10a0-4478-ade8-eb60b7c495c5/manager/0.log" Jul 07 18:08:47.635283 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:47.635195 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-bkpl5_9f296389-8454-4522-bb0a-5b7fee0b6557/postgres/0.log" Jul 07 18:08:48.464988 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:48.464963 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt_64f624f2-d13b-4ec5-b710-9d951564b2f9/util/0.log" Jul 07 18:08:48.474345 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:48.474320 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt_64f624f2-d13b-4ec5-b710-9d951564b2f9/pull/0.log" Jul 07 18:08:48.481561 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:48.481536 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt_64f624f2-d13b-4ec5-b710-9d951564b2f9/extract/0.log" Jul 07 18:08:48.604969 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:48.604947 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp_f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560/pull/0.log" Jul 07 18:08:48.612286 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:48.612267 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp_f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560/extract/0.log" Jul 07 18:08:48.622601 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:48.622581 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp_f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560/util/0.log" Jul 07 18:08:48.743726 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:48.743657 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2_fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8/extract/0.log" Jul 07 18:08:48.751453 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:48.751433 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2_fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8/util/0.log" Jul 07 18:08:48.761548 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:48.761530 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2_fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8/pull/0.log" Jul 07 18:08:48.892287 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:48.892261 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq_f1bd1408-750c-4e73-b5d3-c134dbf0e201/util/0.log" Jul 07 18:08:48.903641 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:48.903622 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq_f1bd1408-750c-4e73-b5d3-c134dbf0e201/pull/0.log" Jul 07 18:08:48.923059 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:48.923044 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq_f1bd1408-750c-4e73-b5d3-c134dbf0e201/extract/0.log" Jul 07 18:08:49.054151 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:49.054085 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f6c869587-nb2jf_cf7ce3fd-3bdd-420b-be12-7038e461139e/authorino/0.log" Jul 07 18:08:49.183733 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:49.183710 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-8zzz8_b99cbd4d-9b65-43b8-bb4c-8cac82038c97/manager/0.log" Jul 07 18:08:49.425644 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:49.425621 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6sl99_ea5873a9-3372-4e9b-9805-950e338de308/kuadrant-console-plugin/0.log" Jul 07 18:08:49.547787 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:49.547759 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9dwqg_0ea5cd08-e76e-46d0-b501-9d089b9b820d/registry-server/0.log" Jul 07 18:08:49.696956 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:49.696883 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-8hxbm_158356ae-a7c1-4a9f-b528-3bff9530cca7/manager/0.log" Jul 07 18:08:49.962336 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:49.962265 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-s5pct_c13322db-0cde-4183-b4bb-2c7843d7d0ad/manager/0.log" Jul 07 18:08:50.753225 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:50.753191 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-668c694757-zwt87_10c354b5-8c23-484d-9f14-1906f7b7a1bc/kube-auth-proxy/0.log" Jul 07 18:08:50.882988 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:50.882955 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r8jvh_e0409efe-d7ef-4440-8b75-866e3f13d3b3/istio-proxy/1.log" Jul 07 18:08:51.013992 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:51.013925 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-2s9fh_66d26bd6-4fdb-424f-8bf1-ede2b36296a6/payload-pre-processing/0.log" Jul 07 18:08:51.170038 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:51.170013 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-dqsh4_a690f0f0-9fa0-458e-aa8b-05fc7f1113f9/payload-processing/0.log" Jul 07 18:08:51.662248 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:51.662210 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-msv6d_2c837f92-58fb-43eb-9a08-63de8aae2028/main/0.log" Jul 07 18:08:51.776051 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:51.776014 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-tcp5w_61e5bb64-65d8-4a2a-ad0e-ea9d79033977/main/0.log" Jul 07 18:08:59.802591 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:59.802560 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-45k9q_77800761-9499-4c79-b3b7-f9f39131c8f9/global-pull-secret-syncer/0.log" Jul 07 18:08:59.978693 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:08:59.978665 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rs7tq_4b116fae-395d-4aac-ad81-c14945b2a706/konnectivity-agent/0.log" Jul 07 18:09:00.084154 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:00.084084 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-69.ec2.internal_151e2e5ee0d5207030555e86076a8303/haproxy/0.log" Jul 07 18:09:04.730347 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:04.730267 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt_64f624f2-d13b-4ec5-b710-9d951564b2f9/extract/0.log" Jul 07 18:09:04.778575 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:04.778552 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt_64f624f2-d13b-4ec5-b710-9d951564b2f9/util/0.log" Jul 07 18:09:04.843721 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:04.843694 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7595qfnt_64f624f2-d13b-4ec5-b710-9d951564b2f9/pull/0.log" Jul 07 18:09:04.892702 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:04.892681 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp_f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560/extract/0.log" Jul 07 18:09:04.925616 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:04.925594 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp_f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560/util/0.log" Jul 07 18:09:04.969634 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:04.969614 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04wcgp_f9d47ebe-7f9d-40d5-bf31-aa50ff2e4560/pull/0.log" Jul 07 18:09:05.012458 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:05.012398 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2_fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8/extract/0.log" Jul 07 18:09:05.043782 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:05.043763 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2_fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8/util/0.log" Jul 07 18:09:05.071220 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:05.071202 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ftps2_fe3c0c0e-a98f-460b-b240-c19b1a1bb2a8/pull/0.log" Jul 07 18:09:05.112227 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:05.112206 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq_f1bd1408-750c-4e73-b5d3-c134dbf0e201/extract/0.log" Jul 07 18:09:05.144940 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:05.144920 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq_f1bd1408-750c-4e73-b5d3-c134dbf0e201/util/0.log" Jul 07 18:09:05.173017 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:05.173001 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r49kq_f1bd1408-750c-4e73-b5d3-c134dbf0e201/pull/0.log" Jul 07 18:09:05.446882 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:05.446852 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f6c869587-nb2jf_cf7ce3fd-3bdd-420b-be12-7038e461139e/authorino/0.log" Jul 07 18:09:05.504353 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:05.504327 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-8zzz8_b99cbd4d-9b65-43b8-bb4c-8cac82038c97/manager/0.log" Jul 07 18:09:05.605865 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:05.605844 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6sl99_ea5873a9-3372-4e9b-9805-950e338de308/kuadrant-console-plugin/0.log" Jul 07 18:09:05.654044 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:05.654025 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9dwqg_0ea5cd08-e76e-46d0-b501-9d089b9b820d/registry-server/0.log" Jul 07 18:09:05.749530 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:05.749438 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-8hxbm_158356ae-a7c1-4a9f-b528-3bff9530cca7/manager/0.log" Jul 07 18:09:05.887659 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:05.887634 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-s5pct_c13322db-0cde-4183-b4bb-2c7843d7d0ad/manager/0.log" Jul 07 18:09:07.458578 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:07.458553 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e34f50a9-99cc-4efb-91fe-cdb63736446e/alertmanager/0.log" Jul 07 18:09:07.556747 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:07.556724 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e34f50a9-99cc-4efb-91fe-cdb63736446e/config-reloader/0.log" Jul 07 18:09:07.654349 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:07.654323 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e34f50a9-99cc-4efb-91fe-cdb63736446e/kube-rbac-proxy-web/0.log" Jul 07 18:09:07.751138 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:07.751068 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e34f50a9-99cc-4efb-91fe-cdb63736446e/kube-rbac-proxy/0.log" Jul 07 18:09:07.790757 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:07.790729 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e34f50a9-99cc-4efb-91fe-cdb63736446e/kube-rbac-proxy-metric/0.log" Jul 07 18:09:07.834468 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:07.834444 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e34f50a9-99cc-4efb-91fe-cdb63736446e/prom-label-proxy/0.log" Jul 07 18:09:07.875138 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:07.875114 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e34f50a9-99cc-4efb-91fe-cdb63736446e/init-config-reloader/0.log" Jul 07 18:09:08.098887 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:08.098820 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-b7568f448-hblx2_64b9916c-a200-4090-8c47-9171b42c6bd9/metrics-server/0.log" Jul 07 18:09:08.321832 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:08.321802 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hwdfn_fc268fef-45f8-4525-b0c5-6c68da072c13/node-exporter/0.log" Jul 07 18:09:08.371294 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:08.371228 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hwdfn_fc268fef-45f8-4525-b0c5-6c68da072c13/kube-rbac-proxy/0.log" Jul 07 18:09:08.401063 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:08.401040 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hwdfn_fc268fef-45f8-4525-b0c5-6c68da072c13/init-textfile/0.log" Jul 07 18:09:09.050130 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:09.050100 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-92gws_4ed05cf1-7704-4308-a8db-08cb0b9d6ec4/prometheus-operator/0.log" Jul 07 18:09:09.108905 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:09.108884 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-92gws_4ed05cf1-7704-4308-a8db-08cb0b9d6ec4/kube-rbac-proxy/0.log" Jul 07 18:09:09.801379 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:09.801346 2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qlcl8/perf-node-gather-daemonset-z4q7b"] Jul 07 18:09:09.801924 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:09.801901 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19b02943-da55-4c0a-bdbf-64faf3c36c60" containerName="cleanup" Jul 07 18:09:09.801924 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:09.801926 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="19b02943-da55-4c0a-bdbf-64faf3c36c60" containerName="cleanup" Jul 07 18:09:09.802148 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:09.801947 2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69f2ec56-1f89-465b-b663-7c327bf76352" containerName="cleanup" Jul 07 18:09:09.802148 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:09.801957 2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="69f2ec56-1f89-465b-b663-7c327bf76352" containerName="cleanup" Jul 07 18:09:09.802148 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:09.802087 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="19b02943-da55-4c0a-bdbf-64faf3c36c60" containerName="cleanup" Jul 07 18:09:09.802148 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:09.802103 2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="69f2ec56-1f89-465b-b663-7c327bf76352" containerName="cleanup" Jul 07 18:09:09.805487 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:09.805468 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qlcl8/perf-node-gather-daemonset-z4q7b" Jul 07 18:09:09.808768 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:09.808749 2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qlcl8\"/\"default-dockercfg-xx92f\"" Jul 07 18:09:09.808858 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:09.808787 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qlcl8\"/\"openshift-service-ca.crt\"" Jul 07 18:09:09.809667 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:09.809647 2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qlcl8\"/\"kube-root-ca.crt\"" Jul 07 18:09:09.815137 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:09.815116 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qlcl8/perf-node-gather-daemonset-z4q7b"] Jul 07 18:09:09.941132 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:09.941104 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/149fbe8b-3732-44ab-a6e7-c30e3e1ca649-proc\") pod \"perf-node-gather-daemonset-z4q7b\" (UID: \"149fbe8b-3732-44ab-a6e7-c30e3e1ca649\") " pod="openshift-must-gather-qlcl8/perf-node-gather-daemonset-z4q7b" Jul 07 18:09:09.941254 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:09.941135 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvl45\" (UniqueName: \"kubernetes.io/projected/149fbe8b-3732-44ab-a6e7-c30e3e1ca649-kube-api-access-jvl45\") pod \"perf-node-gather-daemonset-z4q7b\" (UID: \"149fbe8b-3732-44ab-a6e7-c30e3e1ca649\") " pod="openshift-must-gather-qlcl8/perf-node-gather-daemonset-z4q7b" Jul 07 18:09:09.941254 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:09.941164 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/149fbe8b-3732-44ab-a6e7-c30e3e1ca649-podres\") pod \"perf-node-gather-daemonset-z4q7b\" (UID: \"149fbe8b-3732-44ab-a6e7-c30e3e1ca649\") " pod="openshift-must-gather-qlcl8/perf-node-gather-daemonset-z4q7b" Jul 07 18:09:09.941254 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:09.941239 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/149fbe8b-3732-44ab-a6e7-c30e3e1ca649-lib-modules\") pod \"perf-node-gather-daemonset-z4q7b\" (UID: \"149fbe8b-3732-44ab-a6e7-c30e3e1ca649\") " pod="openshift-must-gather-qlcl8/perf-node-gather-daemonset-z4q7b" Jul 07 18:09:09.941424 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:09.941319 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/149fbe8b-3732-44ab-a6e7-c30e3e1ca649-sys\") pod \"perf-node-gather-daemonset-z4q7b\" (UID: \"149fbe8b-3732-44ab-a6e7-c30e3e1ca649\") " pod="openshift-must-gather-qlcl8/perf-node-gather-daemonset-z4q7b" Jul 07 18:09:10.042438 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:10.042419 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/149fbe8b-3732-44ab-a6e7-c30e3e1ca649-podres\") pod \"perf-node-gather-daemonset-z4q7b\" (UID: \"149fbe8b-3732-44ab-a6e7-c30e3e1ca649\") " pod="openshift-must-gather-qlcl8/perf-node-gather-daemonset-z4q7b" Jul 07 18:09:10.042571 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:10.042460 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/149fbe8b-3732-44ab-a6e7-c30e3e1ca649-lib-modules\") pod \"perf-node-gather-daemonset-z4q7b\" (UID: \"149fbe8b-3732-44ab-a6e7-c30e3e1ca649\") " pod="openshift-must-gather-qlcl8/perf-node-gather-daemonset-z4q7b" Jul 07 18:09:10.042571 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:10.042496 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/149fbe8b-3732-44ab-a6e7-c30e3e1ca649-sys\") pod \"perf-node-gather-daemonset-z4q7b\" (UID: \"149fbe8b-3732-44ab-a6e7-c30e3e1ca649\") " pod="openshift-must-gather-qlcl8/perf-node-gather-daemonset-z4q7b" Jul 07 18:09:10.042571 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:10.042555 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/149fbe8b-3732-44ab-a6e7-c30e3e1ca649-proc\") pod \"perf-node-gather-daemonset-z4q7b\" (UID: \"149fbe8b-3732-44ab-a6e7-c30e3e1ca649\") " pod="openshift-must-gather-qlcl8/perf-node-gather-daemonset-z4q7b" Jul 07 18:09:10.042700 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:10.042577 2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvl45\" (UniqueName: \"kubernetes.io/projected/149fbe8b-3732-44ab-a6e7-c30e3e1ca649-kube-api-access-jvl45\") pod \"perf-node-gather-daemonset-z4q7b\" (UID: \"149fbe8b-3732-44ab-a6e7-c30e3e1ca649\") " pod="openshift-must-gather-qlcl8/perf-node-gather-daemonset-z4q7b" Jul 07 18:09:10.042700 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:10.042621 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/149fbe8b-3732-44ab-a6e7-c30e3e1ca649-lib-modules\") pod \"perf-node-gather-daemonset-z4q7b\" (UID: \"149fbe8b-3732-44ab-a6e7-c30e3e1ca649\") " pod="openshift-must-gather-qlcl8/perf-node-gather-daemonset-z4q7b" Jul 07 18:09:10.042700 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:10.042639 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/149fbe8b-3732-44ab-a6e7-c30e3e1ca649-sys\") pod \"perf-node-gather-daemonset-z4q7b\" (UID: \"149fbe8b-3732-44ab-a6e7-c30e3e1ca649\") " pod="openshift-must-gather-qlcl8/perf-node-gather-daemonset-z4q7b" Jul 07 18:09:10.042700 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:10.042621 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/149fbe8b-3732-44ab-a6e7-c30e3e1ca649-podres\") pod \"perf-node-gather-daemonset-z4q7b\" (UID: \"149fbe8b-3732-44ab-a6e7-c30e3e1ca649\") " pod="openshift-must-gather-qlcl8/perf-node-gather-daemonset-z4q7b" Jul 07 18:09:10.042700 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:10.042663 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/149fbe8b-3732-44ab-a6e7-c30e3e1ca649-proc\") pod \"perf-node-gather-daemonset-z4q7b\" (UID: \"149fbe8b-3732-44ab-a6e7-c30e3e1ca649\") " pod="openshift-must-gather-qlcl8/perf-node-gather-daemonset-z4q7b" Jul 07 18:09:10.053312 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:10.053258 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvl45\" (UniqueName: \"kubernetes.io/projected/149fbe8b-3732-44ab-a6e7-c30e3e1ca649-kube-api-access-jvl45\") pod \"perf-node-gather-daemonset-z4q7b\" (UID: \"149fbe8b-3732-44ab-a6e7-c30e3e1ca649\") " pod="openshift-must-gather-qlcl8/perf-node-gather-daemonset-z4q7b" Jul 07 18:09:10.117487 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:10.117465 2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qlcl8/perf-node-gather-daemonset-z4q7b" Jul 07 18:09:10.261872 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:10.261846 2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qlcl8/perf-node-gather-daemonset-z4q7b"] Jul 07 18:09:10.263632 ip-10-0-136-69 kubenswrapper[2549]: W0707 18:09:10.263602 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod149fbe8b_3732_44ab_a6e7_c30e3e1ca649.slice/crio-2a5c96101661f5f3693ac1ad04a4fba23ca988e1adbd80646174a8cbf68e1747 WatchSource:0}: Error finding container 2a5c96101661f5f3693ac1ad04a4fba23ca988e1adbd80646174a8cbf68e1747: Status 404 returned error can't find the container with id 2a5c96101661f5f3693ac1ad04a4fba23ca988e1adbd80646174a8cbf68e1747 Jul 07 18:09:10.715223 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:10.715183 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qlcl8/perf-node-gather-daemonset-z4q7b" event={"ID":"149fbe8b-3732-44ab-a6e7-c30e3e1ca649","Type":"ContainerStarted","Data":"eb154b201dfe571a4c6327ab5bd8cbb89fa1af35f23fcd41b82a06d9752d5b3a"} Jul 07 18:09:10.715399 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:10.715238 2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qlcl8/perf-node-gather-daemonset-z4q7b" event={"ID":"149fbe8b-3732-44ab-a6e7-c30e3e1ca649","Type":"ContainerStarted","Data":"2a5c96101661f5f3693ac1ad04a4fba23ca988e1adbd80646174a8cbf68e1747"} Jul 07 18:09:10.715399 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:10.715279 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qlcl8/perf-node-gather-daemonset-z4q7b" Jul 07 18:09:10.740789 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:10.740735 2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qlcl8/perf-node-gather-daemonset-z4q7b" podStartSLOduration=1.740720707 podStartE2EDuration="1.740720707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:09:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:09:10.740268024 +0000 UTC m=+2787.026871155" watchObservedRunningTime="2026-07-07 18:09:10.740720707 +0000 UTC m=+2787.027323838" Jul 07 18:09:14.159449 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:14.159406 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t88qh_af4ab4e6-36fa-4d42-877d-e0d9a0262cbe/dns/0.log" Jul 07 18:09:14.192455 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:14.192420 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t88qh_af4ab4e6-36fa-4d42-877d-e0d9a0262cbe/kube-rbac-proxy/0.log" Jul 07 18:09:14.292999 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:14.292977 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jk577_85e73679-afa9-417c-a7d5-8d8e795965b1/dns-node-resolver/0.log" Jul 07 18:09:14.988211 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:14.988183 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-64b6745578-krn5m_6a66202a-7bf0-4977-87cd-6c477367e249/registry/0.log" Jul 07 18:09:15.015072 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:15.015039 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6qsgn_dc3322ee-9711-4997-b100-02824e125414/node-ca/0.log" Jul 07 18:09:16.442757 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:16.442705 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-668c694757-zwt87_10c354b5-8c23-484d-9f14-1906f7b7a1bc/kube-auth-proxy/0.log" Jul 07 18:09:16.487785 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:16.487758 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r8jvh_e0409efe-d7ef-4440-8b75-866e3f13d3b3/istio-proxy/0.log" Jul 07 18:09:16.514719 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:16.514694 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r8jvh_e0409efe-d7ef-4440-8b75-866e3f13d3b3/istio-proxy/1.log" Jul 07 18:09:16.550828 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:16.550788 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-2s9fh_66d26bd6-4fdb-424f-8bf1-ede2b36296a6/payload-pre-processing/0.log" Jul 07 18:09:16.599803 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:16.599782 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-dqsh4_a690f0f0-9fa0-458e-aa8b-05fc7f1113f9/payload-processing/0.log" Jul 07 18:09:16.730975 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:16.730911 2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qlcl8/perf-node-gather-daemonset-z4q7b" Jul 07 18:09:17.538484 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:17.538454 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fbql5_f35b592d-681c-46b0-985a-07ffe8ad432b/serve-healthcheck-canary/0.log" Jul 07 18:09:18.418832 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:18.418804 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-csgq8_347b071e-f42e-4c03-8320-65185889aa7a/kube-rbac-proxy/0.log" Jul 07 18:09:18.449516 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:18.449490 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-csgq8_347b071e-f42e-4c03-8320-65185889aa7a/exporter/0.log" Jul 07 18:09:18.480921 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:18.480896 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-csgq8_347b071e-f42e-4c03-8320-65185889aa7a/extractor/0.log" Jul 07 18:09:21.006736 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:21.006710 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-668c694757-zwt87_10c354b5-8c23-484d-9f14-1906f7b7a1bc/kube-auth-proxy/0.log" Jul 07 18:09:21.027745 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:21.027720 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r8jvh_e0409efe-d7ef-4440-8b75-866e3f13d3b3/istio-proxy/0.log" Jul 07 18:09:21.054372 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:21.054348 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r8jvh_e0409efe-d7ef-4440-8b75-866e3f13d3b3/istio-proxy/1.log" Jul 07 18:09:21.075388 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:21.075366 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-2s9fh_66d26bd6-4fdb-424f-8bf1-ede2b36296a6/payload-pre-processing/0.log" Jul 07 18:09:21.115499 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:21.115480 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-dqsh4_a690f0f0-9fa0-458e-aa8b-05fc7f1113f9/payload-processing/0.log" Jul 07 18:09:21.248020 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:21.248002 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-65ttp_b907a354-14a3-4d57-85fa-489b69bc5b06/manager/0.log" Jul 07 18:09:21.401053 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:21.401023 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-s9ck9_df14c52c-ad9f-413b-9970-d47edada55e3/manager/0.log" Jul 07 18:09:21.444555 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:21.444532 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-cc758d988-s9zv4_e44e9944-fbdd-4321-8249-00add35f0ef9/maas-api/0.log" Jul 07 18:09:21.468517 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:21.468480 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724105-wlzr4_1c697725-322c-4265-8c18-4ea2926beb92/cleanup/0.log" Jul 07 18:09:21.499214 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:21.499160 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724120-kgpqm_19b02943-da55-4c0a-bdbf-64faf3c36c60/cleanup/0.log" Jul 07 18:09:21.600762 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:21.600737 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8f58f69f-sf2nj_ae0e6515-3dff-4386-8d44-b51cead2f273/manager/0.log" Jul 07 18:09:21.638625 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:21.638602 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-s6vr6_e5f58835-77f9-47af-a421-0a0b3f1b07be/server/0.log" Jul 07 18:09:21.712371 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:21.712350 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jvwsc_65df54e8-14da-49bf-a628-f2b33a8efe30/manager/0.log" Jul 07 18:09:21.901417 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:21.901387 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-684cdbc7fc-d9jtm_df3eaba9-10a0-4478-ade8-eb60b7c495c5/manager/0.log" Jul 07 18:09:21.922004 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:21.921981 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-684cdbc7fc-d9jtm_df3eaba9-10a0-4478-ade8-eb60b7c495c5/copy-manifests/0.log" Jul 07 18:09:22.078762 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:22.078689 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-bkpl5_9f296389-8454-4522-bb0a-5b7fee0b6557/postgres/0.log" Jul 07 18:09:22.629827 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:22.629806 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-668c694757-zwt87_10c354b5-8c23-484d-9f14-1906f7b7a1bc/kube-auth-proxy/0.log" Jul 07 18:09:22.651221 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:22.651199 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r8jvh_e0409efe-d7ef-4440-8b75-866e3f13d3b3/istio-proxy/0.log" Jul 07 18:09:22.677177 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:22.677153 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r8jvh_e0409efe-d7ef-4440-8b75-866e3f13d3b3/istio-proxy/1.log" Jul 07 18:09:22.700308 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:22.700274 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-2s9fh_66d26bd6-4fdb-424f-8bf1-ede2b36296a6/payload-pre-processing/0.log" Jul 07 18:09:22.745804 ip-10-0-136-69 kubenswrapper[2549]: I0707 18:09:22.745776 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-dqsh4_a690f0f0-9fa0-458e-aa8b-05fc7f1113f9/payload-processing/0.log"